Skip to content

Commit

Permalink
fix: Add logging.
Browse files Browse the repository at this point in the history
  • Loading branch information
Hugoch committed Oct 10, 2024
1 parent ecaa400 commit 63da39f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/requests.rs
Original file line number Diff line number Diff line change
Expand Up @@ -244,7 +244,7 @@ impl TextGenerationBackend for OpenAITextGenerationBackend {
}
if aggregated_response.end_time.is_none() {
// server closed the connection before we received the final response
warn!("Connection closed before completion");
warn!("Connection closed before completion. Received :: {num_tokens}/{max_tokens} tokens. Response: {final_response}", num_tokens = aggregated_response.num_generated_tokens, max_tokens = request.num_decode_tokens.unwrap_or(0));
aggregated_response.fail();
}
}
Expand Down

0 comments on commit 63da39f

Please sign in to comment.