Tongyi Unveils First Film-Level Voice AI Model: Emotionally Intelligent Speech Achieved

After AIGC revolutionized image and text generation, the final frontier in film and television—voice acting—is now being breached by Alibaba's Tongyi Lab. On March 16, Tongyi Lab officially launched and open-sourced the world's first multimodal large model for cinematic, multi-scenario voice acting, Fun-CineForge.
For years, AI voice synthesis has been plagued by "robotic" and "announcer-style" tones. In film and television, capturing emotional depth, ambient sound mixing, and lip sync remained significant hurdles. Fun-CineForge was created specifically to overcome these challenges.
This model introduces a groundbreaking "data + model" integrated design. Alongside the model, Tongyi Lab provided a method for constructing high-quality datasets. This enables AI to move beyond mere text reading to deeply understand complex cinematic contexts, replicating subtle emotional nuances and spatial audio effects.
As the newest member of the Alibaba Tongyi family, the open-source Fun-CineForge is a game-changer. It offers video creators a "cinema-grade" post-production tool and, through accessible technology, allows indie creators and mid-budget productions to achieve high-quality, multilingual dubbing at minimal cost.
From the earlier Qwen3-Omni to the current Fun-CineForge , the Tongyi series is rapidly completing the multimodal puzzle. As AI learns to "perform like a human," the entire landscape of film translation and post-production could be reshaped. The model and its dataset construction plan are now available on major open-source platforms, signaling that the era of "cinema-grade AI" is arriving sooner than anticipated.
Related article
U.S. Stocks Hit Historic Milestone as AI and Aerospace Giants Prepare for Trillion-Dollar Debut
Elon Musk, Sam Altman, and Dario Amodei, three titans of the technology sector, are advancing toward initial public offerings for their respective ventures. With SpaceX, OpenAI, and Anthropic—three industry behemoths nearing trillion-dollar valuation
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur
Google Tests Remy AI Agent for Gemini as Focus Shifts to User Control
According to Business Insider, Google is testing Remy, a new AI personal agent for Gemini. This tool aims to execute tasks on behalf of users, streamlining both professional workflows and daily routines.Currently, Remy is undergoing testing in an int
Related Special Topic Recommendations
Comments (0)
0/500

After AIGC revolutionized image and text generation, the final frontier in film and television—voice acting—is now being breached by Alibaba's Tongyi Lab. On March 16,
For years, AI voice synthesis has been plagued by "robotic" and "announcer-style" tones. In film and television, capturing emotional depth, ambient sound mixing, and lip sync remained significant hurdles.
This model introduces a groundbreaking "data + model" integrated design. Alongside the model,
As the newest member of the Alibaba Tongyi family, the open-source
From the earlier
U.S. Stocks Hit Historic Milestone as AI and Aerospace Giants Prepare for Trillion-Dollar Debut
Elon Musk, Sam Altman, and Dario Amodei, three titans of the technology sector, are advancing toward initial public offerings for their respective ventures. With SpaceX, OpenAI, and Anthropic—three industry behemoths nearing trillion-dollar valuation
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur





Home






