Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-09-20 18:45:09 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
2400 commits 7 branches 50 tags 63 MiB
Commit graph

283 commits

Author SHA1 Message Date
GuizzyQC
d7a7f7896b
Add SD checkpoint selection in sd_api_pictures (#2872) 2023-06-27 17:29:27 -03:00
oobabooga
c52290de50
ExLlama with long context (#2875) 2023-06-25 22:49:26 -03:00
matatonic
b45baeea41
extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements (#2849) 2023-06-24 22:50:04 -03:00
rizerphe
77baf43f6d
Add CORS support to the API (#2718) 2023-06-24 10:16:06 -03:00
matatonic
1e97aaac95
extensions/openai: docs update, model loader, minor fixes (#2557) 2023-06-17 19:15:24 -03:00
oobabooga
7ef6a50e84
Reorganize model loading UI completely (#2720) 2023-06-16 19:00:37 -03:00
oobabooga
134430bbe2 Minor change 2023-06-14 11:34:42 -03:00
oobabooga
474dc7355a Allow API requests to use parameter presets 2023-06-14 11:32:20 -03:00
oobabooga
c6552785af Minor cleanup 2023-06-09 00:30:22 -03:00
matatonic
7be6fe126b
extensions/api: models api for blocking_api (updated) (#2539) 2023-06-08 11:34:36 -03:00
bobzilla
643c44e975
Add ngrok shared URL ingress support (#1944) 2023-06-06 07:34:20 -03:00
matatonic
4a17a5db67
[extensions/openai] various fixes (#2533) 2023-06-06 01:43:04 -03:00
oobabooga
d183c7d29e Fix streaming japanese/chinese characters 
Credits to matasonic for the idea
 2023-06-02 02:09:52 -03:00
matatonic
a6d3f010a5
extensions/openai: include all available models in Model.list (#2368) 
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
 2023-05-30 22:13:37 -03:00
matatonic
e5b756ecfe
Fixes #2331, IndexError: string index out of range (#2383) 2023-05-30 22:07:40 -03:00
Yiximail
4715123f55
Add a /api/v1/stop-stream API that allows the user to interrupt the generation (#2392) 2023-05-30 22:03:40 -03:00
matatonic
ebcadc0042
extensions/openai: cross_origin + chunked_response (updated fix) (#2423) 2023-05-30 21:54:24 -03:00
matatonic
df50f077db
fixup missing tfs top_a params, defaults reorg (#2443) 2023-05-30 21:52:33 -03:00
oobabooga
8e0a997c60
Add new parameters to API extension 2023-05-29 22:03:08 -03:00
matatonic
2b7ba9586f
Fixes #2326, KeyError: 'assistant' (#2382) 2023-05-29 14:19:57 -03:00
Elias Vincent Simon
2cf711f35e
update SpeechRecognition dependency (#2345) 2023-05-26 00:34:57 -03:00
Luis Lopez
0dbc3d9b2c
Fix get_documents_ids_distances return error when n_results = 0 (#2347) 2023-05-25 23:25:36 -03:00
Luis Lopez
ee674afa50
Add superbooga time weighted history retrieval (#2080) 2023-05-25 10:22:45 -03:00
Gabriel Terrien
e50ade438a
FIX silero_tts/elevenlabs_tts activation/deactivation (#2313) 2023-05-24 10:06:38 -03:00
Anthony K
7dc87984a2
Fix spelling mistake in new name var of chat api (#2309) 2023-05-23 23:03:03 -03:00
matatonic
9714072692
[extensions/openai] use instruction templates with chat_completions (#2291) 2023-05-23 19:58:41 -03:00
oobabooga
74aae34beb Allow passing your name to the chat API 2023-05-23 19:39:18 -03:00
oobabooga
4d94a111d4 memoize load_character to speed up the chat API 2023-05-23 00:50:58 -03:00
oobabooga
c0fd7f3257
Add mirostat parameters for llama.cpp (#2287) 2023-05-22 19:37:24 -03:00
oobabooga
e116d31180 Prevent unwanted log messages from modules 2023-05-21 22:42:34 -03:00
oobabooga
8ac3636966
Add epsilon_cutoff/eta_cutoff parameters (#2258) 2023-05-21 15:11:57 -03:00
oobabooga
767a767989 Fix elevenlabs_tts too 2023-05-21 14:11:46 -03:00
oobabooga
1e5821bd9e Fix silero tts autoplay (attempt #2) 2023-05-21 13:25:11 -03:00
oobabooga
a5d5bb9390 Fix silero tts autoplay 2023-05-21 12:11:59 -03:00
matatonic
78b2478d9c
assistant: space fix, system: prompt fix (#2219) 2023-05-20 23:32:34 -03:00
Luis Lopez
9c53517d2c
Fix superbooga error when querying empty DB (Issue #2160) (#2212) 2023-05-20 22:27:22 -03:00
oobabooga
c5af549d4b
Add chat API (#2233) 2023-05-20 18:42:17 -03:00
oobabooga
ad0b71af11 Add missing file 2023-05-17 00:37:34 -03:00
oobabooga
a84f499718 Allow extensions to define custom CSS and JS 2023-05-17 00:30:54 -03:00
pixel
458a627ab9
fix: elevenlabs cloned voices do not show up in webui after entering API key (#2107) 2023-05-16 20:21:36 -03:00
Orbitoid
428261eede
fix: elevenlabs removed the need for the api key for refreshing voices (#2097) 2023-05-16 13:34:49 -03:00
atriantafy
26cf8c2545
add api port options (#1990) 2023-05-15 20:44:16 -03:00
oobabooga
897fa60069 Sort selected superbooga chunks by insertion order 
For better coherence
 2023-05-14 22:19:29 -03:00
Luis Lopez
b07f849e41
Add superbooga chunk separator option (#2051) 2023-05-14 21:44:52 -03:00
matatonic
ab08cf6465
[extensions/openai] clip extra leading space (#2042) 2023-05-14 12:57:52 -03:00
oobabooga
5f6cf39f36 Change the injection context string 2023-05-13 14:23:02 -03:00
oobabooga
7cc17e3f1f Refactor superbooga 2023-05-13 14:15:40 -03:00
oobabooga
826c74c201 Expand superbooga to instruct mode and change the chat implementation 2023-05-13 12:50:19 -03:00
oobabooga
c746a5bd00 Add .rstrip(' ') to openai api 2023-05-12 14:40:48 -03:00
Damian Stewart
3f1bfba718
Clarify how to start server.py with multimodal API support (#2025) 2023-05-12 14:37:49 -03:00
oobabooga
146a9cb393 Allow superbooga to download URLs in parallel 2023-05-12 14:19:55 -03:00
matatonic
f98fd01dcd
is_chat=False for /edits (#2011) 2023-05-11 19:15:11 -03:00
oobabooga
0d36c18f5d Always return only the new tokens in generation functions 2023-05-11 17:07:20 -03:00
matatonic
c4f0e6d740
is_chat changes fix for openai extension (#2008) 2023-05-11 16:32:25 -03:00
oobabooga
638c6a65a2
Refactor chat functions (#2003) 2023-05-11 15:37:04 -03:00
matatonic
309b72e549
[extension/openai] add edits & image endpoints & fix prompt return in non --chat modes (#1935) 2023-05-11 11:06:39 -03:00
oobabooga
943b5e5f80 Minor bug fix 2023-05-10 23:54:25 -03:00
oobabooga
9695bfe117 Add an option for cleaning up html in superbooga 2023-05-10 23:51:52 -03:00
oobabooga
f1d10edcb7
Update README.md 2023-05-10 12:13:14 -03:00
oobabooga
c35860ff2f Add a link to silero samples 2023-05-10 01:39:35 -03:00
oobabooga
3913155c1f
Style improvements (#1957) 2023-05-09 22:49:39 -03:00
missionfloyd
fe4dfc647d
SileroTTS preview (#1934) 2023-05-09 20:28:59 -03:00
oobabooga
8fa5f651d6 Style changes 2023-05-09 20:20:35 -03:00
Wojtab
e9e75a9ec7
Generalize multimodality (llava/minigpt4 7b and 13b now supported) (#1741) 2023-05-09 20:18:02 -03:00
Jeffrey Lin
791a38bad1
[extensions/openai] Support undocumented base64 'encoding_format' param for compatibility with official OpenAI client (#1876) 2023-05-08 22:31:34 -03:00
kaiokendev
0e27b660e8
Fix issue where n_results/k > index size (#1929) 2023-05-08 21:16:00 -03:00
oobabooga
b5260b24f1
Add support for custom chat styles (#1917) 2023-05-08 12:35:03 -03:00
oobabooga
82eb284a3f Fix a bug in silero tts 2023-05-07 23:59:43 -03:00
oobabooga
b3bbda22d1 Exception handling 2023-05-07 16:50:45 -03:00
oobabooga
8515f19078 Fix typing error 2023-05-07 16:25:39 -03:00
oobabooga
6b67cb6611 Generalize superbooga to chat mode 2023-05-07 15:05:26 -03:00
oobabooga
ec1cda0e1f Rename superbig to superbooga 2023-05-07 13:29:49 -03:00
oobabooga
8216c8f732 Handle multiline inputs 2023-05-07 11:54:26 -03:00
oobabooga
a35a2fab02 Reorganize superbig ui 2023-05-07 11:30:16 -03:00
oobabooga
befa307c42 Add support for loading multiple URLs into superbig 2023-05-07 11:08:02 -03:00
oobabooga
04eca9b65b Make chunk length/count customizable 2023-05-07 05:02:04 -03:00
oobabooga
8c06eeaf84 Add requirement 2023-05-07 04:50:12 -03:00
oobabooga
58f9a30be1 Add support for input file/url in superbig 2023-05-07 04:49:02 -03:00
oobabooga
6afba065a1 Only update the chroma database when necessary 2023-05-07 04:03:17 -03:00
kaiokendev
5a4bd3918c
Add SuperBIG extension (alpha) (#1548) 
---------

Co-authored-by: kaiokendev <>
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-05-07 03:50:12 -03:00
oobabooga
85238de421 Remove unused variable 2023-05-06 11:03:12 -03:00
oobabooga
de9c4e260e
Minor fixes to elevenlabs_tts 2023-05-06 10:57:34 -03:00
Steve Randall
b03a2ac512
Elevenlabs Extension Improvement and migration to official API (#1830) 2023-05-06 10:56:31 -03:00
oobabooga
8aafb1f796
Refactor text_generation.py, add support for custom generation functions (#1817) 2023-05-05 18:53:03 -03:00
oobabooga
4bf7253ec5 Fix typing bug in api 2023-05-03 19:27:20 -03:00
Thireus ☠
4883e20fa7
Fix openai extension script.py - TypeError: '_Environ' object is not callable (#1753) 2023-05-03 09:51:49 -03:00
Wojtab
80c2f25131
LLaVA: small fixes (#1664) 
* change multimodal projector to the correct one

* remove reference to custom stopping strings from readme

* fix stopping strings if tokenizer extension adds/removes tokens

* add API example

* LLaVA 7B just dropped, add to readme that there is no support for it currently
 2023-05-02 23:12:22 -03:00
oobabooga
c31b0f15a7 Remove some spaces 2023-05-02 23:07:07 -03:00
oobabooga
320fcfde4e Style/pep8 improvements 2023-05-02 23:05:38 -03:00
matatonic
7ac41b87df
add openai compatible api (#1475) 2023-05-02 22:49:53 -03:00
oobabooga
88cdf6ed3d Prevent websocket from disconnecting 2023-05-02 19:03:19 -03:00
oobabooga
d87ca8f2af LLaVA fixes 2023-04-26 03:47:34 -03:00
oobabooga
68ed73dd89 Make API extension print its exceptions 2023-04-25 23:23:47 -03:00
Wojtab
65beb51b0b
fix returned dtypes for LLaVA (#1547) 2023-04-25 21:25:34 -03:00
MajdajkD
c86e9a3372
fix websocket batching (#1511) 2023-04-24 03:51:32 -03:00
Wojtab
04b98a8485
Fix Continue for LLaVA (#1507) 2023-04-23 22:58:15 -03:00
Wojtab
12212cf6be
LLaVA support (#1487) 2023-04-23 20:32:22 -03:00
Andy Salerno
654933c634
New universal API with streaming/blocking endpoints (#990) 
Previous title: Add api_streaming extension and update api-example-stream to use it

* Merge with latest main

* Add parameter capturing encoder_repetition_penalty

* Change some defaults, minor fixes

* Add --api, --public-api flags

* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.

* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'

* Update the API examples

* Change a comment

* Update README

* Remove the gradio API

* Remove unused import

* Minor change

* Remove unused import

---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-04-23 15:52:43 -03:00
oobabooga
7ff645899e Fix bug in api extension 2023-04-22 17:33:36 -03:00
AICatgirls
b992c9236a
Prevent API extension responses from getting cut off with --chat enabled (#1467) 2023-04-22 16:06:43 -03:00