Commit graph

1590 commits

Author SHA1 Message Date
oobabooga
8b482b4127
Merge #1073 from sgsdxzy/triton
* Multi-GPU support for triton
* Better quantized model filename detection
2023-04-13 11:31:21 -03:00
oobabooga
fde6d06167 Prioritize names with the groupsize in them 2023-04-13 11:27:03 -03:00
oobabooga
f2bf1a2c9e Add some comments, remove obsolete code 2023-04-13 11:17:32 -03:00
oobabooga
5744b31593 Reorganize some buttons 2023-04-13 11:05:47 -03:00
Light
da74cd7c44 Generalized weight search path. 2023-04-13 21:43:32 +08:00
oobabooga
7a0ef1c941 Reorganize whisper extension 2023-04-13 10:40:27 -03:00
oobabooga
02cf8f5898 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-04-13 10:35:43 -03:00
oobabooga
04866dc4fc Add a warning for when no model is loaded 2023-04-13 10:35:08 -03:00
Xan
6e19ae4b2f
Fix gpt-j model type in UI (#1129) 2023-04-13 10:17:20 -03:00
Light
97e67d136b Update README.md 2023-04-13 21:00:58 +08:00
Light
cf58058c33 Change warmup_autotune to a negative switch. 2023-04-13 20:59:49 +08:00
Light
15d5a043f2 Merge remote-tracking branch 'origin/main' into triton 2023-04-13 19:38:51 +08:00
oobabooga
ddbd237ec9 Better way to sort the models/loras 2023-04-12 22:56:32 -03:00
oobabooga
7dfbe54f42 Add --model-menu option 2023-04-12 21:24:26 -03:00
oobabooga
86c10c6f0c Add some labels 2023-04-12 18:39:21 -03:00
oobabooga
388038fb8e Update settings-template.json 2023-04-12 18:30:43 -03:00
oobabooga
0baa50bcc4 Update a comment 2023-04-12 18:26:15 -03:00
oobabooga
5d1d0bd11f Add the GPU index to the label 2023-04-12 18:24:19 -03:00
oobabooga
13789fd200 Handle the no-GPU / multi-GPU cases 2023-04-12 18:21:14 -03:00
oobabooga
10e939c9b4 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-04-12 17:21:59 -03:00
oobabooga
1566d8e344 Add model settings to the Models tab 2023-04-12 17:20:18 -03:00
MarlinMr
47daf891fe
Link to developer.nvidia.com (#1104) 2023-04-12 15:56:42 -03:00
Light
a405064ceb Better dispatch. 2023-04-13 01:48:17 +08:00
Light
f3591ccfa1 Keep minimal change. 2023-04-12 23:26:06 +08:00
Φφ
1d8526849b
SD_api_pictures: Fix for metadata (#1082) 2023-04-12 11:42:30 -03:00
Lukas
5ad92c940e
lora training fixes: (#970)
Fix wrong input format being picked
Fix crash when an entry in the dataset has an attribute of value None
2023-04-12 11:38:01 -03:00
oobabooga
4f7e88c043 Simplify send_pictures 2023-04-12 10:30:12 -03:00
oobabooga
80f4eabb2a Fix send_pictures extension 2023-04-12 10:27:06 -03:00
oobabooga
49ce866c99 Fix silero_tts 2023-04-12 00:58:11 -03:00
oobabooga
ff610b47d2 Make api-example-stream.py functional again 2023-04-12 00:25:30 -03:00
Andy Salerno
3850f13624
Change fn_index in api_example_stream (#904) 2023-04-12 00:15:12 -03:00
oobabooga
461ca7faf5
Mention that pull request reviews are welcome 2023-04-11 23:12:48 -03:00
Tymec
832ee4323d
API: add endpoint for counting tokens (#1051) 2023-04-11 23:08:42 -03:00
oobabooga
1405cd8af2 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-04-11 22:44:05 -03:00
oobabooga
2289d3686f Update API example 2023-04-11 22:43:43 -03:00
Alexander01998
61641a4551
Add missing new parameters to API extension 2023-04-11 22:41:13 -03:00
oobabooga
f2be87235d Comment lines that were causing undefined behavior 2023-04-11 22:40:04 -03:00
oobabooga
8265d45db8 Add send dummy message/reply buttons
Useful for starting a new reply.
2023-04-11 22:21:41 -03:00
oobabooga
37d52c96bc Fix Continue in chat mode 2023-04-11 21:46:17 -03:00
oobabooga
f2ec880e81 Auto-scroll to the bottom when streaming is over in notebook/default modes 2023-04-11 20:58:10 -03:00
oobabooga
f34f2daa3d More reasonable default preset 2023-04-11 18:57:46 -03:00
oobabooga
cacbcda208
Two new options: truncation length and ban eos token 2023-04-11 18:46:06 -03:00
oobabooga
749c08a4ff
Update README.md 2023-04-11 14:42:10 -03:00
DavG25
e9e93189ff
Fix text overflow in chat and instruct mode (#1044) 2023-04-11 14:41:29 -03:00
oobabooga
dc3c9d00a0 Update the API extension 2023-04-11 13:07:45 -03:00
oobabooga
457d3c58eb Update the API example 2023-04-11 12:57:36 -03:00
catalpaaa
78bbc66fc4
allow custom stopping strings in all modes (#903) 2023-04-11 12:30:06 -03:00
oobabooga
0f212093a3
Refactor the UI
A single dictionary called 'interface_state' is now passed as input to all functions. The values are updated only when necessary.

The goal is to make it easier to add new elements to the UI.
2023-04-11 11:46:30 -03:00
oobabooga
64f5c90ee7 Fix the API extension 2023-04-10 20:14:38 -03:00
oobabooga
58b34c0841 Fix chat_prompt_size 2023-04-10 20:06:42 -03:00