DataGemma Tackles AI Hallucinations with Real-World Data

Large language models (LLMs) are at the heart of today's AI breakthroughs, capable of sifting through massive text datasets to produce summaries, spark creative ideas, and even write code. Yet, despite their prowess, these models can sometimes deliver information that's just plain wrong, a problem we call "hallucination." It's a big hurdle in the world of generative AI.
We're excited to share some cutting-edge research that's tackling this issue head-on, aiming to curb hallucinations by grounding LLMs in real-world stats. And we're thrilled to introduce DataGemma, the first open models that link LLMs with a wealth of real-world data from Google's Data Commons.
Data Commons: A Treasure Trove of Trustworthy Data
Data Commons is like a giant, ever-growing library of public data, boasting over 240 billion data points on everything from health to economics. It pulls this info from reliable sources like the UN, WHO, CDC, and Census Bureaus. By merging these datasets into a single, powerful toolset and AI models, Data Commons helps policymakers, researchers, and organizations get the accurate insights they need.
Imagine a vast database where you can ask questions in plain English, like which African countries have seen the biggest jump in electricity access, or how income relates to diabetes across US counties. That's Data Commons for you.
How Data Commons Helps Fight Hallucination
As more folks turn to generative AI, we're working to make these experiences more grounded by weaving Data Commons into Gemma, our family of lightweight, top-notch open models. These DataGemma models are now available for researchers and developers to dive into.
DataGemma boosts Gemma's capabilities by tapping into Data Commons' knowledge, using two cool methods to improve the accuracy and reasoning of LLMs:
RIG (Retrieval-Interleaved Generation) amps up our Gemma 2 model by actively checking facts against Data Commons. When you ask DataGemma a question, it hunts down statistical data from Data Commons to give you a solid answer. While RIG isn't a new idea, the way we're using it in DataGemma is pretty special.
Example query: ''Has the use of renewables increased in the world?'' applying DataGemma RIG methodology leverages Data Commons (DC) for authoritative data.
RAG (Retrieval-Augmented Generation) lets language models pull in extra info beyond what they've been trained on, making their answers richer and more accurate. With DataGemma, we use Gemini 1.5 Pro's long context window to fetch relevant data from Data Commons before the model starts crafting its response, cutting down on hallucinations.
Example query: ''Has the use of renewables increased in the world?'' applying DataGemma RAG methodology showcases greater reasoning and inclusion of footnotes.
Promising Results and What's Next
Our early tests with RIG and RAG are looking good. We're seeing better accuracy in our models when dealing with numbers, which means fewer hallucinations for folks using these models for research, decision-making, or just to satisfy their curiosity. You can check out these results in our research paper.
Illustration of a RAG query and response. Supporting ground truth statistics are referenced as tables served from Data Commons. *Partial response shown for brevity.
We're not stopping here. We're all in on refining these methods, scaling up our efforts, and putting them through the wringer with more tests. Eventually, we'll roll out these improvements to both Gemma and Gemini models, starting with a limited-access phase.
By sharing our research and making this new Gemma model variant open, we hope to spread the use of these Data Commons-based techniques far and wide. Making LLMs more reliable and trustworthy is crucial for turning them into essential tools for everyone, helping to build a future where AI gives people accurate info, supports informed choices, and deepens our understanding of the world.
Researchers and developers can jump right in with DataGemma using our quickstart notebooks for both RIG and RAG. To dive deeper into how Data Commons and Gemma work together, check out our Research post.
Related article
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Related Special Topic Recommendations
Comments (42)
0/500
Interesting approach! Using real-world data to ground the model seems like a practical step beyond just scaling parameters. Hope it doesn't just trade hallucinations for boring, overly-cautious outputs though. The 'Gemma' naming trend continues! 🤔
Finally! A real solution to AI hallucinations? DataGemma sounds promising, but I'm honestly a bit skeptical. 🤔 How do they ensure the "real-world data" isn't biased itself? Would love to see a breakdown of their methodology compared to other approaches like Retrieval-Augmented Generation.
Me pregunto si DataGemma realmente podrá resolver el problema de las alucinaciones en IA. Parece prometedor, pero ya hemos visto muchas soluciones 'milagrosas' que luego no cumplen. Ojalá esta vez sea diferente, porque los errores en los modelos actuales pueden ser bastante graves 😅
This article on DataGemma is super intriguing! It's wild how LLMs can churn out so much but still trip up on facts sometimes. 😅 Makes me wonder if grounding them in real-world data could finally make AI as reliable as we hope!

Large language models (LLMs) are at the heart of today's AI breakthroughs, capable of sifting through massive text datasets to produce summaries, spark creative ideas, and even write code. Yet, despite their prowess, these models can sometimes deliver information that's just plain wrong, a problem we call "hallucination." It's a big hurdle in the world of generative AI.
We're excited to share some cutting-edge research that's tackling this issue head-on, aiming to curb hallucinations by grounding LLMs in real-world stats. And we're thrilled to introduce DataGemma, the first open models that link LLMs with a wealth of real-world data from Google's Data Commons.
Data Commons: A Treasure Trove of Trustworthy Data
Data Commons is like a giant, ever-growing library of public data, boasting over 240 billion data points on everything from health to economics. It pulls this info from reliable sources like the UN, WHO, CDC, and Census Bureaus. By merging these datasets into a single, powerful toolset and AI models, Data Commons helps policymakers, researchers, and organizations get the accurate insights they need.
Imagine a vast database where you can ask questions in plain English, like which African countries have seen the biggest jump in electricity access, or how income relates to diabetes across US counties. That's Data Commons for you.
How Data Commons Helps Fight Hallucination
As more folks turn to generative AI, we're working to make these experiences more grounded by weaving Data Commons into Gemma, our family of lightweight, top-notch open models. These DataGemma models are now available for researchers and developers to dive into.
DataGemma boosts Gemma's capabilities by tapping into Data Commons' knowledge, using two cool methods to improve the accuracy and reasoning of LLMs:
RIG (Retrieval-Interleaved Generation) amps up our Gemma 2 model by actively checking facts against Data Commons. When you ask DataGemma a question, it hunts down statistical data from Data Commons to give you a solid answer. While RIG isn't a new idea, the way we're using it in DataGemma is pretty special.
Example query: ''Has the use of renewables increased in the world?'' applying DataGemma RIG methodology leverages Data Commons (DC) for authoritative data. RAG (Retrieval-Augmented Generation) lets language models pull in extra info beyond what they've been trained on, making their answers richer and more accurate. With DataGemma, we use Gemini 1.5 Pro's long context window to fetch relevant data from Data Commons before the model starts crafting its response, cutting down on hallucinations.
Example query: ''Has the use of renewables increased in the world?'' applying DataGemma RAG methodology showcases greater reasoning and inclusion of footnotes.
Promising Results and What's Next
Our early tests with RIG and RAG are looking good. We're seeing better accuracy in our models when dealing with numbers, which means fewer hallucinations for folks using these models for research, decision-making, or just to satisfy their curiosity. You can check out these results in our research paper.
By sharing our research and making this new Gemma model variant open, we hope to spread the use of these Data Commons-based techniques far and wide. Making LLMs more reliable and trustworthy is crucial for turning them into essential tools for everyone, helping to build a future where AI gives people accurate info, supports informed choices, and deepens our understanding of the world.
Researchers and developers can jump right in with DataGemma using our quickstart notebooks for both RIG and RAG. To dive deeper into how Data Commons and Gemma work together, check out our Research post.
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Interesting approach! Using real-world data to ground the model seems like a practical step beyond just scaling parameters. Hope it doesn't just trade hallucinations for boring, overly-cautious outputs though. The 'Gemma' naming trend continues! 🤔
Finally! A real solution to AI hallucinations? DataGemma sounds promising, but I'm honestly a bit skeptical. 🤔 How do they ensure the "real-world data" isn't biased itself? Would love to see a breakdown of their methodology compared to other approaches like Retrieval-Augmented Generation.
Me pregunto si DataGemma realmente podrá resolver el problema de las alucinaciones en IA. Parece prometedor, pero ya hemos visto muchas soluciones 'milagrosas' que luego no cumplen. Ojalá esta vez sea diferente, porque los errores en los modelos actuales pueden ser bastante graves 😅
This article on DataGemma is super intriguing! It's wild how LLMs can churn out so much but still trip up on facts sometimes. 😅 Makes me wonder if grounding them in real-world data could finally make AI as reliable as we hope!





Home






