Document response stream chunk delimiter. (#632)

Document response stream chunk delimiter.
This commit is contained in:
Jay Nakrani
2023-09-30 00:45:52 -04:00
committed by GitHub
parent a1b2d95f96
commit 1d0ebe67e8
2 changed files with 5 additions and 0 deletions

View File

@@ -23,6 +23,10 @@ Model names follow a `model:tag` format. Some examples are `orca-mini:3b-q4_1` a
All durations are returned in nanoseconds.
### Streaming responses
Certain endpoints stream responses as JSON objects delineated with the newline (`\n`) character.
## Generate a completion
```shell