option
Home
News
Zhejiang University Unveils Immersive Role-Playing Framework to Make AI Interactions Natural

Zhejiang University Unveils Immersive Role-Playing Framework to Make AI Interactions Natural

May 30, 2026
161

Zhejiang University Unveils Immersive Role-Playing Framework to Make AI Interactions Natural

AI role-playing is moving beyond simple text-based conversations into rich, immersive dramas. Researchers from Zhejiang University and Tencent Youtu Lab recently introduced AdaMARP, a self-adaptive multi-agent interaction framework that tackles key weaknesses in current large language model role-playing, such as weak environmental awareness and rigid storytelling. The framework gives AI the scene management and narrative skills of a director. This work has been accepted at the international conference ACL 2026.

Core Pain Points: Missing "Environment" and "Director"

In today's AI role-playing, users can talk with historical or literary characters, but interactions are often limited to text exchanges inside static settings. For example, in a detective scenario, traditional AI systems behave like repetitive talking machines, unable to reason from environmental clues like wax stains on the carpet or handle complex narrative needs such as multiple character turns and scene transitions. This hollow mode prevents users from feeling real authenticity or narrative tension.

AdaMARP Framework: Four-Channel Messages and Dynamic Scheduling

To break this deadlock, the research team designed a new interaction logic. First, AdaMARP introduces a "four-channel message format," breaking each round into "Thought - Action - Environment - Speech." Instead of only outputting dialogue, the AI now interweaves environmental atmosphere (like flickering gas lamps), internal thoughts, and body language into a complete causal chain.

Second, the framework includes a "Scene Manager" that acts as the narrative's director. It has five core capabilities: initializing the scene, selecting the speaker, switching scenes, dynamically introducing new characters, and ending the interaction. This lets the AI autonomously decide when to move from the crime scene to a witness's home, or when to have a new suspect walk through the door.

Training and Evaluation: From Literature to Simulation

To equip AI with genuine acting and directing abilities, the team built high-quality datasets AdaRPSet and AdaSMSet. These datasets contain deep character profiles and interaction trajectories from 81 classic literary works, plus 20 different thematic synthetic plots. This ensures the model learns literary texture while mastering dynamic scheduling logic.

In addition, the team introduced a complementary evaluation framework called AdaptiveBench. Unlike traditional single-turn conversation evaluations, AdaptiveBench scores models at the trajectory level, focusing on character consistency, environmental perception, and the naturalness of narrative progression. This provides a comprehensive assessment of AI performance in complex long-text interactions.

This framework opens a new technical path for immersive interactive scenarios like detective reasoning and adventure storytelling. By deeply coupling environment and narrative logic, AI is evolving from a simple chat assistant into a digital performer with advanced creative consciousness.

Related article
ByteDance’s Seed launches global campus drive, offering virtual shares to win top large model talent ByteDance’s Seed launches global campus drive, offering virtual shares to win top large model talent In the competitive landscape of large language models, securing top-tier talent remains the most critical strategic asset.On April 1st, ByteDance announced the launch of its Seed global campus recruitment initiative, part of its large model talent de
Suno to Watermark Songs Amid Legal Battles Suno to Watermark Songs Amid Legal Battles Suno, the platform enabling users to generate AI-created music, has unveiled new features to label platform-produced tracks, restrict downloads, and update community standards to curb unauthorized replicas. These updates arrive as Suno confronts mult
Musk Admits Grok Build Leaked User Code, Promises to Erase All Historical Data Musk Admits Grok Build Leaked User Code, Promises to Erase All Historical Data Elon Musk directly addressed the privacy controversy surrounding Grok Build, beginning with a simple "True" to confirm the incident's validity. He pledged that all user data previously uploaded to SpaceXAI would be permanently erased, stating, "not a
Related Special Topic Recommendations
Design & Art AI Visual Style Reference Tools for Character Sheets, Moodboards, and Pitch Decks
AI Visual Style Reference Tools for Character Sheets, Moodboards, and Pitch Decks

2026 Latest Best AI Visual Style Reference Tools for Character Sheets, Moodboards, and Pitch Decks are here on XIX.AI! This curated top-rated list features powerful game-changing tools that go through rigorous real-world tests. You’ll find a free vs paid comparison, detailed rankings, and must-try options to help you boost creativity and streamline your workflow. Explore now to discover your perfect tool for boosting productivity!

11 tools
xix.ai
SEO Best AI SERP Analysis Tools for Search Strategy
Best AI SERP Analysis Tools for Search Strategy

2026 Latest Best Top-rated AI SERP Analysis Tools for Search Strategy are curated by XIX.AI through rigorous real-world tests and weekly updated rankings. These powerful tools help you unlock hidden optimization opportunities, boost content performance, and gain a competitive edge in search. Discover your perfect tool to elevate your search strategy today. Explore now!

13 tools
xix.ai
Data Analysis Best AI Anomaly Detection Tools for KPI Monitoring across SaaS and Ecommerce Teams
Best AI Anomaly Detection Tools for KPI Monitoring across SaaS and Ecommerce Teams

2026 Latest Best Top-rated AI Anomaly Detection Tools for KPI Monitoring in SaaS and Ecommerce teams! XIX.AI has curated a powerful, game-changing collection based on rigorous real-world tests and weekly updated rankings. You’ll find detailed free vs paid comparison insights to help you identify the must-try solution that boosts productivity and unlocks your AI edge. Explore now!

10 tools
xix.ai
writing Best AI Outline Generators for Long-Form SEO Articles
Best AI Outline Generators for Long-Form SEO Articles

2026 Latest Best Top-Rated AI Outline Generators for Long-Form SEO Articles, meticulously curated by XIX.AI. These powerful tools offer game-changing assistance in creating high-quality content quickly, boosting writing efficiency significantly. Get a free vs paid comparison along with real-world tests and detailed rankings to help you find the must-try option that suits your needs. Explore now to unlock your AI edge.

8 tools
xix.ai
Education and Learning AI Study Tools for Homework and Exam Prep
AI Study Tools for Homework and Exam Prep

2026 Latest Best AI Study Tools for Homework and Exam Prep! XIX.AI curates a top-rated list of powerful, game-changing tools that help students boost productivity, streamline homework completion, and ace exams through real-world tests. Get a free vs paid comparison, detailed rankings, and must-try options to unlock your AI edge. Explore now!

10 tools
xix.ai
Music composition AI Vocal Demo Tools for Songwriters, Hooks, Toplines, and Multilingual Draft Sessions
AI Vocal Demo Tools for Songwriters, Hooks, Toplines, and Multilingual Draft Sessions

2026 Latest Best AI Vocal Demo Tools for Songwriters, Hook Creators, and Multi-Language Content Teams! XIX.AI has curated a top-rated list of powerful game-changing tools that go through rigorous real-world tests. You’ll find detailed free vs paid comparison data, comprehensive rankings, and must-try options to help you boost writing efficiency and unlock your creative potential. Explore now to discover your perfect tool for all your content needs!

9 tools
xix.ai
Comments (0)
0/500
OR