Google Rolls Out Real-Time Gemini AI Video Features

Google is now rolling out new AI features for Gemini Live, allowing it to analyze your smartphone screen or camera feed and answer related questions in real time, Google spokesperson Alex Joseph confirmed to The Verge via email. These capabilities arrive almost a year after Google's initial "Project Astra" demonstration, which serves as their foundation.
A Reddit user first reported seeing the feature appear on their Xiaomi device, as noted by 9to5Google. That same user has now shared a video showcasing Gemini's new screen-reading function. This is one of the two features Google announced in early March would "begin rolling out to Gemini Advanced subscribers as part of the Google One AI Premium plan" later that month.
The second Astra feature now launching is live video interpretation. It enables Gemini to process the feed from your phone's camera in real time and respond to questions about what it sees. In a demonstration video published by Google this month, a user asks Gemini for advice on choosing a paint color for a newly glazed pottery piece.
This rollout highlights Google's significant lead in the AI assistant space. The launch comes as Amazon prepares a limited early access phase for its upgraded Alexa Plus, and Apple has delayed its enhanced Siri. Both competitors aim to offer capabilities similar to what Astra is now deploying. Samsung continues to offer Bixby, though Gemini remains the default assistant on its latest phones.
Related article
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Related Special Topic Recommendations
Comments (2)
0/500
Finally, a real use case for Gemini Live! 📱 Being able to point my camera at a weird gadget and get instant answers without typing feels like magic. This could save so much time when I'm shopping or fixing things around the house. Can't wait to test it out on my daily commute!

Google is now rolling out new AI features for Gemini Live, allowing it to analyze your smartphone screen or camera feed and answer related questions in real time, Google spokesperson Alex Joseph confirmed to The Verge via email. These capabilities arrive almost a year after Google's initial "Project Astra" demonstration, which serves as their foundation.
A Reddit user first reported seeing the feature appear on their Xiaomi device, as noted by 9to5Google. That same user has now shared a video showcasing Gemini's new screen-reading function. This is one of the two features Google announced in early March would "begin rolling out to Gemini Advanced subscribers as part of the Google One AI Premium plan" later that month.
The second Astra feature now launching is live video interpretation. It enables Gemini to process the feed from your phone's camera in real time and respond to questions about what it sees. In a demonstration video published by Google this month, a user asks Gemini for advice on choosing a paint color for a newly glazed pottery piece.
This rollout highlights Google's significant lead in the AI assistant space. The launch comes as Amazon prepares a limited early access phase for its upgraded Alexa Plus, and Apple has delayed its enhanced Siri. Both competitors aim to offer capabilities similar to what Astra is now deploying. Samsung continues to offer Bixby, though Gemini remains the default assistant on its latest phones.
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Finally, a real use case for Gemini Live! 📱 Being able to point my camera at a weird gadget and get instant answers without typing feels like magic. This could save so much time when I'm shopping or fixing things around the house. Can't wait to test it out on my daily commute!





Home






