A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Find a file
2022-12-21 01:17:38 -03:00
LICENSE Initial commit 2022-12-21 01:17:38 -03:00
README.md Initial commit 2022-12-21 01:17:38 -03:00

text-generation-webui

A gradio webui for running large language models locally. Supports gpt-j-6B, gpt-neox-20b, opt, galactica, and many others.