A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Updated 2024-05-19 19:57:42 +02:00
Updated 2023-03-29 10:30:44 +02:00