Commit graph

3 commits

Author SHA1 Message Date
oobabooga
9eca197409 Minor logging change 2024-03-11 16:31:13 -07:00
oobabooga
cf0697936a Optimize StreamingLLM by over 10x 2024-03-08 21:48:28 -08:00
oobabooga
afb51bd5d6
Add StreamingLLM for llamacpp & llamacpp_HF (2nd attempt) (#5669) 2024-03-09 00:25:33 -03:00