Commit graph

2616 commits

Author SHA1 Message Date
oobabooga
b3cba0b330 Bug 2023-01-18 21:54:44 -03:00
oobabooga
df2e910421 Stop generating in chat mode when \nYou: is generated 2023-01-18 21:51:18 -03:00
oobabooga
022960a087 This is the correct way of sampling 1 token at a time 2023-01-18 21:37:21 -03:00
oobabooga
0f01a3b1fa Implement text streaming (#10)
Still experimental. There might be bugs.
2023-01-18 19:06:50 -03:00
oobabooga
ca13acdfa0 Ensure that the chat prompt will always contain < 2048 tokens
This way, we can keep the context string at the top of the prompt
even if you keep talking to the bot for hours.

Before this commit, the prompt would be simply truncated and the
context string would eventually be lost.
2023-01-17 20:16:23 -03:00
oobabooga
6456777b09 Clean things up 2023-01-16 16:35:45 -03:00
oobabooga
3a99b2b030 Change a truncation parameter 2023-01-16 13:53:30 -03:00
oobabooga
54bf55372b Truncate prompts to 2048 characters 2023-01-16 13:43:23 -03:00
oobabooga
99d24bdbfe
Update README.md 2023-01-16 11:23:45 -03:00
oobabooga
ed1d2c0d38
Update README.md 2023-01-16 11:19:23 -03:00
oobabooga
82c50a09b2
Update README.md 2023-01-16 10:31:13 -03:00
oobabooga
c7a2818665
Grammar 2023-01-16 10:10:09 -03:00
oobabooga
3a28865eb2
Update README.md 2023-01-16 10:07:00 -03:00
oobabooga
d973897021
Typo 2023-01-16 01:52:28 -03:00
oobabooga
18626c4788
Update README.md 2023-01-16 01:51:59 -03:00
oobabooga
47a20638de Don't need this 2023-01-15 23:15:30 -03:00
oobabooga
b55486fa00 Reorganize things 2023-01-15 23:01:51 -03:00
oobabooga
a3bb18002a Update README 2023-01-15 22:34:56 -03:00
oobabooga
ebf4d5f506 Add --max-gpu-memory parameter for #7 2023-01-15 22:33:35 -03:00
oobabooga
bb1a172da0 Fix a bug in cai mode chat 2023-01-15 19:41:25 -03:00
oobabooga
e6691bd920 Make chat mode more like cai 2023-01-15 18:16:46 -03:00
oobabooga
9f1b6e0398 Update README 2023-01-15 16:50:58 -03:00
oobabooga
e04ecd4bce Minor improvements 2023-01-15 16:43:31 -03:00
oobabooga
c6083f3dca Fix the template 2023-01-15 15:57:00 -03:00
oobabooga
99b35dd48d Update README 2023-01-15 15:46:09 -03:00
oobabooga
027c3dd27d Allow jpg profile images 2023-01-15 15:45:25 -03:00
oobabooga
ada2e556d0 Update README 2023-01-15 15:41:36 -03:00
oobabooga
26d8ec3188 Update README 2023-01-15 15:40:03 -03:00
oobabooga
afe9f77f96 Reorder parameters 2023-01-15 15:30:39 -03:00
oobabooga
88d67427e1 Implement default settings customization using a json file 2023-01-15 15:23:41 -03:00
oobabooga
cf0cdae9c6 Add italics to *actions* 2023-01-15 13:32:24 -03:00
oobabooga
56be7149aa Update README 2023-01-15 12:39:31 -03:00
oobabooga
6136da419c Add --cai-chat option that mimics Character.AI's interface 2023-01-15 12:20:04 -03:00
oobabooga
d0af274185 Update README 2023-01-15 04:29:19 -03:00
oobabooga
5bbba25528 Move screenshots somewhere else 2023-01-15 04:27:22 -03:00
oobabooga
0aefcded63 Update README 2023-01-15 04:12:04 -03:00
oobabooga
a027cf22fc Add back the torch dumps folder 2023-01-15 03:54:54 -03:00
oobabooga
9a261d82e9 Update README 2023-01-15 03:35:57 -03:00
oobabooga
b73decda6f Update README 2023-01-15 03:34:34 -03:00
oobabooga
525834ea34 Update README 2023-01-15 03:33:32 -03:00
oobabooga
5b6760dfa3 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-01-15 03:19:43 -03:00
oobabooga
13b04c1b94 Add "remove last message" button to chat 2023-01-15 03:19:09 -03:00
oobabooga
34021131ff
Credit the presets 2023-01-15 03:00:59 -03:00
oobabooga
fa29cd8698
Update README.md 2023-01-15 02:51:52 -03:00
oobabooga
194e2f8439
Update README.md 2023-01-15 02:50:10 -03:00
oobabooga
fd220f827f Remove annoying warnings 2023-01-15 00:39:51 -03:00
oobabooga
d962e69496 Improve chat preprocessing 2023-01-14 23:50:34 -03:00
oobabooga
9a7f187b5a Improve pygmalion line breaks 2023-01-14 23:26:14 -03:00
oobabooga
830ec7123a Add more screenshots 2023-01-14 23:25:05 -03:00
oobabooga
ecb2cc2194 Pygmalion: add checkbox for choosing whether to stop at newline or not 2023-01-13 15:02:17 -03:00