Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE REQ]o1 should support streaming response #47663

Open
sdcb opened this issue Dec 26, 2024 · 2 comments
Open

[FEATURE REQ]o1 should support streaming response #47663

sdcb opened this issue Dec 26, 2024 · 2 comments
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team.

Comments

@sdcb
Copy link

sdcb commented Dec 26, 2024

Library name

Azure.AI.OpenAI

Please describe the feature.

Currently, the Azure OpenAI o1 model does not support streaming responses, while the same o1 model on OpenAI's platform already supports this functionality. I understand that this limitation might not be directly related to the SDK itself, but I would like to know if there is any timeline or plan for Microsoft to enable streaming output for the o1 model in Azure OpenAI, similar to how it works in OpenAI's implementation.

Streaming responses are incredibly important for improving user experience in real-time applications, and having this feature on Azure would greatly enhance the usability of the o1 model in various scenarios.

Thank you for your consideration, and I look forward to any updates on this!
@github-actions github-actions bot added Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team. labels Dec 26, 2024
@github-actions GitHub Actions
Copy link

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @jpalvarezl @ralph-msft @trrwilson.

@h1xy
Copy link

h1xy commented Dec 27, 2024

I notice the same problem. Please fix asap thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sdcb @h1xy