pr comments

- default to embeddings enabled
- move embedding logic for loaded model to request
- allow embedding full directory
- close llm on reload
This commit is contained in:
Bruce MacDonald
2023-08-08 13:49:37 -04:00
parent a6f6d18f83
commit 21ddcaa1f1
3 changed files with 97 additions and 82 deletions

View File

@@ -275,6 +275,7 @@ func DefaultOptions() Options {
UseMLock: false,
RopeFrequencyBase: 10000.0,
RopeFrequencyScale: 1.0,
EmbeddingOnly: true,
RepeatLastN: 64,
RepeatPenalty: 1.1,