matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 16:26:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
da8e2a04479f96ad9c57eaf25ed26b79b239b05c
ollama37/llm/ext_server/server.cpp
Jeffrey Morgan 717f7229eb Do not shift context for sliding window models (#5368) 
* Do not shift context for sliding window models

* truncate prompt > 2/3 tokens

* only target gemma2
2024-06-28 19:39:31 -07:00

123 KiB
Vendored
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink