Commit graph

7 commits

Author SHA1 Message Date
oobabooga
df90d03e0b Replace --mul_mat_q with --no_mul_mat_q 2023-10-22 12:23:03 -07:00
oobabooga
63688004dc Add default cmd flags to colab 2023-10-22 09:56:43 -07:00
oobabooga
613feca23b Make colab functional for llama.cpp
- Download only Q4_K_M for GGUF repositories by default
- Use maximum n-gpu-layers by default
2023-10-22 09:08:25 -07:00
oobabooga
994502d41b Colab fixes 2023-10-22 08:57:16 -07:00
oobabooga
05741821a5 Minor colab changes 2023-10-22 08:44:35 -07:00
mongolu
c18504f369
USE_CUDA118 from ENV remains null one_click.py + cuda-toolkit (#4352) 2023-10-22 12:37:24 -03:00
oobabooga
619093483e Add Colab notebook 2023-10-21 20:27:52 -07:00