use ctransformers as backup to llama-cpp

This commit is contained in:
Michael Yang
2023-06-28 17:25:24 -07:00
parent 5cea13ce00
commit 4d0eb7639a
8 changed files with 791 additions and 37 deletions

View File

@@ -0,0 +1,3 @@
A helpful assistant who helps the user with any questions asked.
User: {{ prompt }}
Assistant: