Hitting any supported model for a structured output is as simple as requesting a "response_format"
Get started with the example in our docs! openrouter.ai/docs/structu...
Multi-model routing is a lot easier if you can constrain parts of the output.
Supported models include OpenAI, Gemini (including 2.0), Cohere, Llama 3, QwQ, Mixtral, and more.
Browse here, and filter by price or context length: openrouter.ai/models?fmt=c...
Structured outputs are very underrated. It's often much easier to constrain LLM outputs to a JSON schema than asking for a tool call.
OpenRouter now normalizes structured outputs for
- 46 models
- 8 different model companies
- 8 free models!
Demo:
Llama 3.3 (shown in brown) is now 35% of Llama token traffic 👀
openrouter.ai/meta-llama
PydanticAI now supports OpenRouter!
You can now filter for LLM providers on our /models page
OpenRouter has prevented 13k Sonnet requests from failing in the last 2 days
LLMs are getting insanely cheap – just analyzed 500+ websites for under $0.01 via @openrouter.bsky.social using llama3.1 🤯
First post here, and we're excited to announce that Discourse AI now supports @openrouter.bsky.social!
With hundreds of models, including free options, AI is now more accessible. Select your provider and fine-tune results in the Discourse UI.
Learn more 👇
meta.discourse.org/t/openrouter...
🍊Mistral 7B Instruct v0.3: 50% cheaper, now $0.03 (was $0.055)
🍊Mistral Nemo: 70% cheaper, now $0.04 (was $0.13)
🍏Gemma 2 9B: 50% cheaper, now $0.03 (was $0.06)
👼Hermes 3B: $0.03 (was $0.14)
👼Hermes 70B: $0.20 (was $0.40)
👼Hermes 405B: $0.90 (was $1.80)
See the whole catalogue: openrouter.ai/models
🔷Qwen2.5 Coder 32B Instruct: 10% cheaper, now $0.08 (was $0.09)
🔷Qwen2.5 72B Instruct: 40% cheaper, now $0.23 (was $0.35)
🔷Qwen 32B Coder: $0.09 (was $0.18)
ICYMI, lots of price cuts last week. helping you get best-in-market:
🦙Llama 3.2 3B Instruct: 40% cheaper, now $0.018 (was $0.03)
🦙Llama 3.1 Nemotron: $0.20 (was $0.35)
🦙Llama 3.1 8B: $0.30 (was $0.60)
🦙Llama 3.1 70B: $0.20 (was $0.40)
🦙Llama 3.1 405B: $0.90 (was $2.80)
Amazon Nova is now live on OpenRouter ☄️
...along with Bedrock! more coming soon
Only took 40 minutes
Llama 3.3 is live! 🦙🦙🦙
openrouter.ai/meta-llama/l...
OpenRouter now generates about 'one Wikipedia' worth of words every day
Incredible work! love seeing the live progress
Overall $ volume on OpenRouter is up by over 2300% 📈
even though LLM prices declined by 90% 📉
due to a lotta tokens:
“My AI startups is just a GPT Wrapper”
The Reality for AI Startups
QwQ 32B, an open-source model comparable with o1-preview and Claude 3.5 Sonnet, is now live!
Scores 50 on the AIME, compared to
- 44.6 for o1-preview
- 16 for Sonnet
Try it out here: openrouter.ai/qwen/qwq-32b...
