Claude Sonnet 8K context error

[KyleBehrend]

Hi all

Sonnet has an 8k context output now but getting an error. Anyone know why?

[mszymkowiak]

Hi,

To have 8192 output tokens, you must use anthropic-beta header:

1. 8192 output tokens is in beta and requires the header anthropic-beta: max-tokens-3-5-sonnet-2024-07-15. If the header is not specified, the limit is 4096 tokens.

Source

So you must build a custom request using the HTTP module, as there is no “Make an API Call” option for Anthropic’s connection.

API docs are here.

[KyleBehrend]

Ahhh ok great thank you! Hopefully when it’s out of beta it will be default?

[mszymkowiak]

Ahhh ok great thank you!

If it solved your problem, please mark it as solved. Thanks!

Hopefully when it’s out of beta it will be default?

Only Anthropic knows it for sure, it should be default- maybe with model update.