Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Anthropic isn't working #958

Open
aingestigate opened this issue Dec 31, 2024 · 4 comments
Open

Anthropic isn't working #958

aingestigate opened this issue Dec 31, 2024 · 4 comments

Comments

@aingestigate
Copy link

Describe the bug

I have bolt.diy running with pnpm run dev. (I wasn't able to get it working properly with Docker.) I am able to get the application to work so far with LM Studio, Ollama, and OpenAI. But I am unable to get it to work with Anthropic. I am using the correct API key. Test curl commands work just fine. There are no errors output in the terminal. I worked hard to add logging to anthropic.ts, stream-text.ts, and base-provider.ts, but I can't get any output that would properly show me the payload as well as the response. Therefore I am at a loss for why this isn't working.

Link to the Bolt URL that caused the error

http://localhost:5173

Steps to reproduce

  1. Running on macOS Macbook Pro M3 Max 64GB Memory.
  2. running via pnpm run dev.
  3. Cloned from github.
  4. Added API keys for OpenAI and Anthropic.
  5. Logging is set at debug.
  6. If I choose an Anthropic model, it fails.

Expected behavior

I expect to get a response from the Anthropic model(s), but I don't.

Screen Recording / Screenshot

image
image
image

Platform

  • OS: Running on macOS Macbook Pro M3 Max 64GB Memory.
  • Browser: Chrome Canary Version 133.0.6929.0 (Official Build) canary (arm64)
  • Version: 389eedc(v0.0.3) - nightly

Provider Used

Anthropic

Model Used

Claude 3.5 Sonnet (New)

Additional context

The program seems unusable with glitches in regular Chrome and in Edge. It does work with Canary -- but NOT for Anthropic.

@aingestigate
Copy link
Author

Edit-- I just updated to v0.0.5. Same problem. Is this a macOS thing vs Windows?

@digital-soul18
Copy link

Mine works fine

@aingestigate
Copy link
Author

I'm glad yours works. It's apparent based on how many similar issues have been posted that mine "not working" is not an anomaly. It's a frequent issue.

@aingestigate
Copy link
Author

I would like to apologize. It has taken me days of testing, but I figured out that if I run my services while connected to WiFi, it fails. But if I run them when connected to a phone hotspot, it works. I have done considerable testing. Given it works on OpenAI, and not Anthropic,I think it has to do with the way Anthropic streaming works (vs OpenAi). But in the end,I think perhaps my ISP router is causing issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants