Home
M6 Intelligence and Tsinghua Open-Source BitCPM-CANN to Run Large Models on Mobile Devices
MBLab, in collaboration with Tsinghua University and the OpenBMB open-source community, has recently released and open-sourced a major breakthrough in low-bit large model training: BitCPM-CANN. Developed natively on Huawei’s Ascend platform, this milestone advances the lightweighting and engineering deployment of edge-side AI large models.

Sixfold Memory Advantage Breaks Hardware Barriers
BitCPM-CANN, now open-source, comes in four sizes: 0.5B, 1B, 3B, and 8B. In direct comparisons with full-precision models of equivalent size, it delivers outstanding performance. Relative to conventional BF16 precision, it achieves approximately six times the memory savings during inference, drastically reducing the hardware needed to run large models.
For mobile devices, this sixfold memory advantage means that 8B-parameter large models—once requiring top-tier hardware—can now run smoothly on mainstream flagship smartphones. This remarkable memory headroom directly accelerates the adoption and commercial deployment of edge-side AI technology on mobile platforms.
High Retention Rate Validates Engineering Reproducibility
Despite the reduction in model size, BitCPM-CANN retains exceptionally high performance, with ability retention rates ranging from 90% to 97.2%. For the three larger model sizes, retention rates stand between 95.7% and 97.2%, while even the smallest 0.5B variant exceeds 90%.
These impressive results systematically demonstrate that the low-bit training approach offers strong scalability and engineering reproducibility. MBLab has established a comprehensive low-bit training foundation using these core technologies, encompassing the full engineering stack—including environment adaptation, 32K long-sequence support, and fused operators—thereby providing a robust public infrastructure for future low-bit training work on the Ascend platform.
Related article
U.S. Stocks Hit Historic Milestone as AI and Aerospace Giants Prepare for Trillion-Dollar Debut
Elon Musk, Sam Altman, and Dario Amodei, three titans of the technology sector, are advancing toward initial public offerings for their respective ventures. With SpaceX, OpenAI, and Anthropic—three industry behemoths nearing trillion-dollar valuation
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur
Google Tests Remy AI Agent for Gemini as Focus Shifts to User Control
According to Business Insider, Google is testing Remy, a new AI personal agent for Gemini. This tool aims to execute tasks on behalf of users, streamlining both professional workflows and daily routines.Currently, Remy is undergoing testing in an int
Related Special Topic Recommendations
Comments (0)
0/500
MBLab, in collaboration with Tsinghua University and the OpenBMB open-source community, has recently released and open-sourced a major breakthrough in low-bit large model training: BitCPM-CANN. Developed natively on Huawei’s Ascend platform, this milestone advances the lightweighting and engineering deployment of edge-side AI large models.

Sixfold Memory Advantage Breaks Hardware Barriers
BitCPM-CANN, now open-source, comes in four sizes: 0.5B, 1B, 3B, and 8B. In direct comparisons with full-precision models of equivalent size, it delivers outstanding performance. Relative to conventional BF16 precision, it achieves approximately six times the memory savings during inference, drastically reducing the hardware needed to run large models.
For mobile devices, this sixfold memory advantage means that 8B-parameter large models—once requiring top-tier hardware—can now run smoothly on mainstream flagship smartphones. This remarkable memory headroom directly accelerates the adoption and commercial deployment of edge-side AI technology on mobile platforms.
High Retention Rate Validates Engineering Reproducibility
Despite the reduction in model size, BitCPM-CANN retains exceptionally high performance, with ability retention rates ranging from 90% to 97.2%. For the three larger model sizes, retention rates stand between 95.7% and 97.2%, while even the smallest 0.5B variant exceeds 90%.
These impressive results systematically demonstrate that the low-bit training approach offers strong scalability and engineering reproducibility. MBLab has established a comprehensive low-bit training foundation using these core technologies, encompassing the full engineering stack—including environment adaptation, 32K long-sequence support, and fused operators—thereby providing a robust public infrastructure for future low-bit training work on the Ascend platform.
U.S. Stocks Hit Historic Milestone as AI and Aerospace Giants Prepare for Trillion-Dollar Debut
Elon Musk, Sam Altman, and Dario Amodei, three titans of the technology sector, are advancing toward initial public offerings for their respective ventures. With SpaceX, OpenAI, and Anthropic—three industry behemoths nearing trillion-dollar valuation
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur











