use ctransformers as backup to llama-cpp

This commit is contained in:
Michael Yang
2023-06-28 17:25:24 -07:00
parent 5cea13ce00
commit 4d0eb7639a
8 changed files with 791 additions and 37 deletions

View File

@@ -0,0 +1,3 @@
A helpful assistant who helps the user with any questions asked.
User: {{ prompt }}
Assistant:

View File

@@ -0,0 +1,4 @@
Below is an instruction that describes a task. Write a response that appropriately completes the request. Be concise. Once the request is completed, include no other text.
### Instruction:
{{ prompt }}
### Response:

View File

@@ -0,0 +1,2 @@
USER: {{ prompt }}
ASSISTANT:

View File

@@ -0,0 +1,5 @@
Below is an instruction that describes a task. Write a response that appropriately completes the request
### Instruction: {{ prompt }}
### Response: