API check returns the whole string every time #932
Unanswered
JimmyInsane
asked this question in
Q&A
Replies: 1 comment
-
Yes, this is intended. The polling is intended to check progress on an ongoing sync generate. For SSE streaming, you can use the /api/extra/generate/stream instead. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm currently writing a small python script to access the API.
Currently on one thread I start the generation while the other periodically checks if there is new content.
I'm using a post on this localhost:5001/api/extra/generate/check
But this always returns the whole current string and not just the part that hasn't been polled yet.
For example the full output string would be "Hey there, I am your personal AI"
The result would be:
"Hey there,"
"Hey there, I am your"
"Hey there, I am your personal AI"
Which I guess would be fine if i just update a div in a webpage but for a console application i have to carriage return every time I get a message.
Is this intended?
Beta Was this translation helpful? Give feedback.
All reactions