Code shuffle to clean up the llm dir

This commit is contained in:
Daniel Hiltgen
2024-01-04 09:40:15 -08:00
parent b5939008a1
commit 77d96da94b
19 changed files with 54 additions and 47 deletions

4
llm/ext_server/README.md Normal file
View File

@@ -0,0 +1,4 @@
# Extern C Server
This directory contains a thin facade we layer on top of the Llama.cpp server
to expose `extern C` interfaces to access the functionality through direct API calls in-process