HomeXiaomi's OmniVoice Open-Source TTS Model Enables Zero-Shot Cloning Across 600+ Languages
Recently, the next-generation Kaldi team (k2-fsa) at Xiaomi officially open-sourced OmniVoice, a massive multilingual zero-shot text-to-speech model that supports over 600 languages. It achieves state-of-the-art results across multiple key benchmarks for Chinese, English, and multilingual synthesis, marking a significant breakthrough in the field.
Leading Performance: Chinese WER as Low as 0.84%, Outperforming Mainstream Models in Multilingual Tests
On the Seed-TTS Chinese test set, OmniVoice achieves a remarkably low word error rate (WER) of just 0.84%. In multilingual evaluations, its similarity (SIM-o) and WER scores surpass well-known commercial models like ElevenLabs v2 and MiniMax, demonstrating exceptional speech naturalness and clarity.
Ultra-Fast Inference: RTF as Low as 0.025, 40x Faster Than Real-Time
OmniVoice boasts a real-time factor (RTF) as low as 0.025, meaning its synthesis speed far exceeds real-time requirements. This massive efficiency gain enables the rapid generation of long-form speech in practical applications, greatly enhancing the user experience.
Core Architectural Innovation: Discrete Non-Autoregressive Design Inspired by Diffusion Models
OmniVoice employs a novel discrete non-autoregressive architecture inspired by diffusion language models. It generates speech from text in a single step, bypassing traditional intermediate semantic tokens. This streamlined design simplifies the pipeline while maintaining high output quality. A full codebook random masking strategy, combined with pre-trained LLM initialization, further boosts training efficiency and improves the final speech's clarity and intelligibility.
Flexible Voice Cloning & Customization: Works with Just 3-10 Seconds of Audio
The model supports high-quality zero-shot voice cloning using only 3-10 seconds of reference audio. Users can also customize voice attributes through natural language prompts, specifying gender, age, pitch, accent, dialect, and even special effects like whispering.
Handles Non-Linguistic Symbols & Fine-Grained Pronunciation Control
OmniVoice can process non-linguistic symbols, such as [laughter], and supports pronunciation correction via pinyin or phonetic symbols. This makes it particularly well-suited for precise synthesis in Chinese and various dialects.
Support for 600+ Languages: Aiding Digital Preservation of Minority and Endangered Languages
A key highlight of OmniVoice is its extensive language coverage, efficiently supporting both major and numerous low-resource languages. For minority and endangered languages, it can generate high-quality speech with minimal data samples, offering significant potential for digital language preservation and cultural protection.
OmniVoice's code and pre-trained models are now open-sourced on GitHub and Hugging Face, enabling developers to deploy it locally or integrate it into applications. AIbase will continue to monitor community feedback and real-world use cases. Developers are encouraged to share their experiences.
Project Link: https://github.com/k2-fsa/OmniVoice
Related article
Google Tests Remy AI Agent for Gemini as Focus Shifts to User Control
According to Business Insider, Google is testing Remy, a new AI personal agent for Gemini. This tool aims to execute tasks on behalf of users, streamlining both professional workflows and daily routines.Currently, Remy is undergoing testing in an int
How to fix Core Web Vitals for better SEO rankings
Streamline Report Card Comments with AI ToolsIntroductionAI Tools for Generating Report Card CommentsMagic SchoolAlmanac AIChat GPTUsing Magic School to Generate Report Card CommentsLogging into Magic SchoolSelecting the Report Card Comments ToolCust
Slackbot Becomes an AI Agent
Slackbot, the automated assistant embedded in Salesforce’s corporate messaging platform Slack, is evolving into an AI agent. Salesforce CTO Parker Harris envisions it achieving viral status comparable to OpenAI’s ChatGPT.The cloud software giant laun
Related Special Topic Recommendations
writing
Best AI Outline Generators for Long-Form SEO Articles
2026 Latest Best Top-Rated AI Outline Generators for Long-Form SEO Articles, meticulously curated by XIX.AI. These powerful tools offer game-changing assistance in creating high-quality content quickly, boosting writing efficiency significantly. Get a free vs paid comparison along with real-world tests and detailed rankings to help you find the must-try option that suits your needs. Explore now to unlock your AI edge.
8 tools
xix.ai
Education and Learning
AI Study Tools for Homework and Exam Prep
2026 Latest Best AI Study Tools for Homework and Exam Prep! XIX.AI curates a top-rated list of powerful, game-changing tools that help students boost productivity, streamline homework completion, and ace exams through real-world tests. Get a free vs paid comparison, detailed rankings, and must-try options to unlock your AI edge. Explore now!
10 tools
xix.ai
Music composition
AI Vocal Demo Tools for Songwriters, Hooks, Toplines, and Multilingual Draft Sessions
2026 Latest Best AI Vocal Demo Tools for Songwriters, Hook Creators, and Multi-Language Content Teams! XIX.AI has curated a top-rated list of powerful game-changing tools that go through rigorous real-world tests. You’ll find detailed free vs paid comparison data, comprehensive rankings, and must-try options to help you boost writing efficiency and unlock your creative potential. Explore now to discover your perfect tool for all your content needs!
9 tools
xix.ai
Business
Best AI Competitive Research Tools for Small Businesses
2026 Latest Best Top-rated AI Competitive Research Tools for Small Businesses! XIX.AI has curated a highly powerful game-changing collection, updated weekly with rigorous real-world tests and detailed rankings. You can find a comprehensive free vs paid comparison to help you identify the must-try tools that boost your productivity and give you a competitive edge. Explore now to discover your perfect tool!
9 tools
xix.ai
Image editing
Photoshop AI Retouch Tools for Ecommerce Apparel, Skin Cleanup, and Color Consistency
2026 Latest Best Photoshop AI retouch tools for ecommerce apparel, skin cleanup, and color consistency! This top-rated curated list features powerful game-changing solutions that help you boost writing efficiency, streamline content creation, and achieve perfect visual results effortlessly. Each tool has undergone real-world tests through weekly updated rankings, complete with free vs paid comparison details. Backed by XIX.AI, it’s the must-try guide for anyone aiming to unlock your AI edge. Explore now!
10 tools
xix.ai
Prompt
Best AI Prompt Libraries for ChatGPT Workflows
2026 Latest Best Top-Rated AI Prompt Libraries for optimizing all types of ChatGPT workflows. XIX.AI has curated a powerful, game-changing collection that goes through rigorous real-world tests to ensure top performance. You can find detailed free vs paid comparisons and expert rankings to help you choose the must-try tools that boost your productivity and unlock your AI edge. Explore now!
11 tools
xix.ai
Comments (0)
0/500
Recently, the next-generation Kaldi team (k2-fsa) at Xiaomi officially open-sourced OmniVoice, a massive multilingual zero-shot text-to-speech model that supports over 600 languages. It achieves state-of-the-art results across multiple key benchmarks for Chinese, English, and multilingual synthesis, marking a significant breakthrough in the field.
Leading Performance: Chinese WER as Low as 0.84%, Outperforming Mainstream Models in Multilingual Tests
On the Seed-TTS Chinese test set, OmniVoice achieves a remarkably low word error rate (WER) of just 0.84%. In multilingual evaluations, its similarity (SIM-o) and WER scores surpass well-known commercial models like ElevenLabs v2 and MiniMax, demonstrating exceptional speech naturalness and clarity.
Ultra-Fast Inference: RTF as Low as 0.025, 40x Faster Than Real-Time
OmniVoice boasts a real-time factor (RTF) as low as 0.025, meaning its synthesis speed far exceeds real-time requirements. This massive efficiency gain enables the rapid generation of long-form speech in practical applications, greatly enhancing the user experience.
Core Architectural Innovation: Discrete Non-Autoregressive Design Inspired by Diffusion Models
OmniVoice employs a novel discrete non-autoregressive architecture inspired by diffusion language models. It generates speech from text in a single step, bypassing traditional intermediate semantic tokens. This streamlined design simplifies the pipeline while maintaining high output quality. A full codebook random masking strategy, combined with pre-trained LLM initialization, further boosts training efficiency and improves the final speech's clarity and intelligibility.
Flexible Voice Cloning & Customization: Works with Just 3-10 Seconds of Audio
The model supports high-quality zero-shot voice cloning using only 3-10 seconds of reference audio. Users can also customize voice attributes through natural language prompts, specifying gender, age, pitch, accent, dialect, and even special effects like whispering.
Handles Non-Linguistic Symbols & Fine-Grained Pronunciation Control
OmniVoice can process non-linguistic symbols, such as [laughter], and supports pronunciation correction via pinyin or phonetic symbols. This makes it particularly well-suited for precise synthesis in Chinese and various dialects.
Support for 600+ Languages: Aiding Digital Preservation of Minority and Endangered Languages
A key highlight of OmniVoice is its extensive language coverage, efficiently supporting both major and numerous low-resource languages. For minority and endangered languages, it can generate high-quality speech with minimal data samples, offering significant potential for digital language preservation and cultural protection.
OmniVoice's code and pre-trained models are now open-sourced on GitHub and Hugging Face, enabling developers to deploy it locally or integrate it into applications. AIbase will continue to monitor community feedback and real-world use cases. Developers are encouraged to share their experiences.
Project Link: https://github.com/k2-fsa/OmniVoice
Google Tests Remy AI Agent for Gemini as Focus Shifts to User Control
According to Business Insider, Google is testing Remy, a new AI personal agent for Gemini. This tool aims to execute tasks on behalf of users, streamlining both professional workflows and daily routines.Currently, Remy is undergoing testing in an int
How to fix Core Web Vitals for better SEO rankings
Streamline Report Card Comments with AI ToolsIntroductionAI Tools for Generating Report Card CommentsMagic SchoolAlmanac AIChat GPTUsing Magic School to Generate Report Card CommentsLogging into Magic SchoolSelecting the Report Card Comments ToolCust
Slackbot Becomes an AI Agent
Slackbot, the automated assistant embedded in Salesforce’s corporate messaging platform Slack, is evolving into an AI agent. Salesforce CTO Parker Harris envisions it achieving viral status comparable to OpenAI’s ChatGPT.The cloud software giant laun
2026 Latest Best Top-Rated AI Outline Generators for Long-Form SEO Articles, meticulously curated by XIX.AI. These powerful tools offer game-changing assistance in creating high-quality content quickly, boosting writing efficiency significantly. Get a free vs paid comparison along with real-world tests and detailed rankings to help you find the must-try option that suits your needs. Explore now to unlock your AI edge.
8 tools
xix.ai
2026 Latest Best AI Study Tools for Homework and Exam Prep! XIX.AI curates a top-rated list of powerful, game-changing tools that help students boost productivity, streamline homework completion, and ace exams through real-world tests. Get a free vs paid comparison, detailed rankings, and must-try options to unlock your AI edge. Explore now!
10 tools
xix.ai
2026 Latest Best AI Vocal Demo Tools for Songwriters, Hook Creators, and Multi-Language Content Teams! XIX.AI has curated a top-rated list of powerful game-changing tools that go through rigorous real-world tests. You’ll find detailed free vs paid comparison data, comprehensive rankings, and must-try options to help you boost writing efficiency and unlock your creative potential. Explore now to discover your perfect tool for all your content needs!
9 tools
xix.ai
2026 Latest Best Top-rated AI Competitive Research Tools for Small Businesses! XIX.AI has curated a highly powerful game-changing collection, updated weekly with rigorous real-world tests and detailed rankings. You can find a comprehensive free vs paid comparison to help you identify the must-try tools that boost your productivity and give you a competitive edge. Explore now to discover your perfect tool!
9 tools
xix.ai
2026 Latest Best Photoshop AI retouch tools for ecommerce apparel, skin cleanup, and color consistency! This top-rated curated list features powerful game-changing solutions that help you boost writing efficiency, streamline content creation, and achieve perfect visual results effortlessly. Each tool has undergone real-world tests through weekly updated rankings, complete with free vs paid comparison details. Backed by XIX.AI, it’s the must-try guide for anyone aiming to unlock your AI edge. Explore now!
10 tools
xix.ai
2026 Latest Best Top-Rated AI Prompt Libraries for optimizing all types of ChatGPT workflows. XIX.AI has curated a powerful, game-changing collection that goes through rigorous real-world tests to ensure top performance. You can find detailed free vs paid comparisons and expert rankings to help you choose the must-try tools that boost your productivity and unlock your AI edge. Explore now!
11 tools
xix.ai
