OpenRouter Launches Tech to Slash AI Multi-Turn Conversation Costs
As AI conversation technology evolves, OpenRouter has launched two new features—Prompt Caching and Sticky Routing—designed to cut token costs in multi-turn agent conversations. This innovation allows developers to reduce expenses during extended interactions with agents, encouraging wider adoption of agent applications.
In multi-turn conversations, agents frequently resend the same system prompts, tool definitions, and strategy instructions. Even if the user only changes one input across six rounds, each repeated prompt incurs charges. Prompt Caching lets OpenRouter retrieve cached data, bypassing the cost of re-sending identical prompts. Depending on the provider, cached reads cost 0.1 to 0.5 times the standard input price, significantly lowering expenses. For instance, on Claude Sonnet 4.6, cached reads are just $0.30 per million tokens, compared to $3.00 for normal input.

To maintain cache effectiveness across multiple turns, OpenRouter's Sticky Routing sends subsequent requests to the same provider that holds the hot cache, enabling developers to consistently enjoy low-cost cache reads throughout the conversation.
However, to take full advantage of this innovation, developers must keep the same session throughout. For optimal caching, OpenRouter recommends setting a session_id, which activates Sticky Routing immediately after the first successful request—not only after a cache hit. Developers can also verify cache usage by checking the response data.
As AI technology progresses, OpenRouter's latest feature not only gives developers a powerful cost-control tool but also opens new possibilities for agent applications.
Related article
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur
Google Tests Remy AI Agent for Gemini as Focus Shifts to User Control
According to Business Insider, Google is testing Remy, a new AI personal agent for Gemini. This tool aims to execute tasks on behalf of users, streamlining both professional workflows and daily routines.Currently, Remy is undergoing testing in an int
How to fix Core Web Vitals for better SEO rankings
Streamline Report Card Comments with AI ToolsIntroductionAI Tools for Generating Report Card CommentsMagic SchoolAlmanac AIChat GPTUsing Magic School to Generate Report Card CommentsLogging into Magic SchoolSelecting the Report Card Comments ToolCust
Related Special Topic Recommendations
Comments (0)
0/500
As AI conversation technology evolves, OpenRouter has launched two new features—Prompt Caching and Sticky Routing—designed to cut token costs in multi-turn agent conversations. This innovation allows developers to reduce expenses during extended interactions with agents, encouraging wider adoption of agent applications.
In multi-turn conversations, agents frequently resend the same system prompts, tool definitions, and strategy instructions. Even if the user only changes one input across six rounds, each repeated prompt incurs charges. Prompt Caching lets OpenRouter retrieve cached data, bypassing the cost of re-sending identical prompts. Depending on the provider, cached reads cost 0.1 to 0.5 times the standard input price, significantly lowering expenses. For instance, on Claude Sonnet 4.6, cached reads are just $0.30 per million tokens, compared to $3.00 for normal input.

To maintain cache effectiveness across multiple turns, OpenRouter's Sticky Routing sends subsequent requests to the same provider that holds the hot cache, enabling developers to consistently enjoy low-cost cache reads throughout the conversation.
However, to take full advantage of this innovation, developers must keep the same session throughout. For optimal caching, OpenRouter recommends setting a session_id, which activates Sticky Routing immediately after the first successful request—not only after a cache hit. Developers can also verify cache usage by checking the response data.
As AI technology progresses, OpenRouter's latest feature not only gives developers a powerful cost-control tool but also opens new possibilities for agent applications.
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur
How to fix Core Web Vitals for better SEO rankings
Streamline Report Card Comments with AI ToolsIntroductionAI Tools for Generating Report Card CommentsMagic SchoolAlmanac AIChat GPTUsing Magic School to Generate Report Card CommentsLogging into Magic SchoolSelecting the Report Card Comments ToolCust





Home






