HomeGoogle’s AI Mode can now see and search with images
Google is enhancing its AI Mode chatbot with new multimodal capabilities, enabling it to "see" and respond to questions about images. This update, which integrates a custom version of Gemini AI with Google's Lens image recognition technology, allows users to take or upload photos and receive detailed, informative responses complete with relevant links. The rollout of this feature began today and is accessible through the Google app on both Android and iOS devices.
Robby Stein, VP of Product for Google Search, explains, "AI Mode builds on our years of work in visual search, but takes it a step further. With Gemini’s multimodal capabilities, AI Mode can now understand the entire scene within an image, including how objects interact and their specific materials, colors, shapes, and arrangements."
The update employs a "fan-out technique" that sends out multiple queries about the image and its elements, resulting in responses that are both nuanced and contextually relevant. This allows AI Mode to identify items like books in an image, suggest similar titles with good reviews, and even answer follow-up questions to refine recommendations.
Now Google’s AI Mode can ‘see’ what you see to better assist with inquiries. GIF: Google
Designed as a competitor to Perplexity and ChatGPT Search, AI Mode offers a chatbot-like experience, generating AI-powered summaries from Google's vast search index. Initially exclusive to Google One AI Premium subscribers through Labs last month, AI Mode is now expanding to "millions more" Labs users in the US, extending beyond just the paid AI Premium subscribers.
Related article
Google tests AI-driven gaming platform
Game creation barriers are falling fast as AI opens development to those without coding, design, or art backgrounds. Google Labs recently demonstrated this with a new experiment.On Wednesday, Google’s experimental platform launched Playground, an AI-
How AI and Robotics Are Transforming bp’s Oil Production
Digital twin technology enables bp to simulate energy asset operations, identifying improvement opportunities and predicting failures before they occur. Credit: bpRicky Burns, Transformation & Technology Manager at bp, explains how digital tools help
Toyota’s $6.4bn robotics estimate puts physical AI in focus
Toyota Motor projects that rolling out automation across its manufacturing facilities, subsidiaries, and key suppliers may require approximately 400,000 robots and an annual expenditure of roughly 1 trillion yen ($6.4 billion) starting in 2028.Accord
Related Special Topic Recommendations
Data Analysis
Best AI Chart Builder Tools for Fast Reporting
2026 Latest Best Top-rated AI Chart Builder Tools for Fast Reporting are here on XIX.AI! This curated list features powerful game-changing tools that deliver accurate professional charts with just a few clicks, helping you boost writing efficiency and streamline content creation. Get a free vs paid comparison along with real-world tests and detailed rankings to find the must-try solution for your needs. Explore now to unlock your AI edge!
9 tools
xix.ai
chatbot
AI Live Chat Routing Tools for Ecommerce Queues, VIP Buyers, and Return Requests
2026 Latest Best Top-rated AI Live Chat Routing Tools for Ecommerce Queues, VIP Buyers, and Return Requests. This curated list features powerful game-changing solutions that boost productivity dramatically through real-world tests. It includes a free vs paid comparison along with detailed rankings to help you find the perfect fit. XIX.AI stands out as a trusted provider in this space. Explore now to Unlock your AI edge!
9 tools
xix.ai
writing
Best AI Editing Tools for ESL Writers: Improve Tone, Grammar, and Flow
2026 Latest Best Top-Rated AI Editing Tools for ESL Writers are here on XIX.AI! This curated list features powerful game-changing tools that go through real-world tests to ensure accuracy. You can find a free vs paid comparison alongside detailed rankings to help you pick the must-try solution that boosts your writing tone, grammar, and flow perfectly. Explore now to Unlock your AI edge!
9 tools
xix.ai
Software Development
Best AI Bug Triage Tools for Engineering Teams
2026 Latest Best Top-Rated AI Bug Triage Tools for Engineering Teams! XIX.AI has curated a powerful, game-changing collection of must-try tools that go through rigorous real-world tests to deliver accurate issue analysis and efficient resolution. Get a free vs paid comparison along with detailed rankings to help you find the perfect solution that boosts your team’s productivity significantly. Explore now to unlock your AI edge!
9 tools
xix.ai
Image editing
Best AI Portrait Enhancers: Improve Lighting, Skin Tone, and Sharpness
2026 Latest Best Top-rated AI Portrait Enhancers curated for ultimate image quality. These powerful tools deliver game-changing results by boosting lighting, skin tone, and sharpness effortlessly, perfect for creators needing to enhance photos quickly. XIX.AI provides a free vs paid comparison along with real-world tests and weekly updated rankings. Discover your perfect tool to unlock your AI edge today. Explore now!
7 tools
xix.ai
writing
AI Technical Documentation Tools for API Guides, Release Notes, and Onboarding Docs
2026 Latest Best Top-rated AI Technical Documentation Tools for API Guides Release Notes and Onboarding Docs. This curated list features powerful game-changing solutions that streamline content creation boost writing efficiency and save time across all project phases. XIX.AI provides weekly updated rankings along with free vs paid comparison results from real-world tests. Explore now to Discover your perfect tool and Unlock your AI edge.
10 tools
xix.ai
Comments (17)
0/500
![BruceWalker]()
這功能也太酷了吧！以後看到不認識的植物或零件，直接拍照問AI就好，不用再絞盡腦汁描述半天了。不過隱私問題還是讓人擔心，照片上傳後會被怎麼處理呢？希望Google能說清楚。
![WilliamMiller]()
Finalmente! Agora dá pra tirar foto de alguma coisa e o Google me explica o que é? 🤯 Mas, sério... será que vai funcionar direito na minha região? Acho que vou testar com meu gato primeiro, pra ver se ele reconhece a raça kkk. Se funcionar, vai acabar com minhas brigas de família sobre nomes de plantas no jardim.
![DouglasCarter]()
Этот новый функционал с картинками выглядит круто, но я уже представляю, как это повлияет на приватность. 🤔 Интересно, сколько данных Google теперь сможет собирать через изображения? Технология развивается так быстро, что иногда становится немного страшно.
![WillLopez]()
AI 가 이미지를 '보고' 검색을 한다니, 정말 신기하네요 🔍 구글이 제미니 + 렌즈 기술을 결합한 건데... 나중에 써보면서 어떤 제품 구매할 때 도움이 되면 좋겠어요! 근데 이렇게 사진 업로드를 하면서 개인정보도 같이 수집되는 건 아닐지 조금 걱정스럽기도 하네.
![FredScott]()
This is wild! Google's AI can now 'see' images? I tried it with a pic of my dog, and it described his goofy grin perfectly. Kinda creepy but super cool! 🐶
![DavidGonzález]()
This is wild! Google's AI can now 'see' images? I just tried uploading a pic of my dog, and it described it perfectly—kinda creepy but super cool! 🐶
Google is enhancing its AI Mode chatbot with new multimodal capabilities, enabling it to "see" and respond to questions about images. This update, which integrates a custom version of Gemini AI with Google's Lens image recognition technology, allows users to take or upload photos and receive detailed, informative responses complete with relevant links. The rollout of this feature began today and is accessible through the Google app on both Android and iOS devices.
Robby Stein, VP of Product for Google Search, explains, "AI Mode builds on our years of work in visual search, but takes it a step further. With Gemini’s multimodal capabilities, AI Mode can now understand the entire scene within an image, including how objects interact and their specific materials, colors, shapes, and arrangements."
The update employs a "fan-out technique" that sends out multiple queries about the image and its elements, resulting in responses that are both nuanced and contextually relevant. This allows AI Mode to identify items like books in an image, suggest similar titles with good reviews, and even answer follow-up questions to refine recommendations.
Designed as a competitor to Perplexity and ChatGPT Search, AI Mode offers a chatbot-like experience, generating AI-powered summaries from Google's vast search index. Initially exclusive to Google One AI Premium subscribers through Labs last month, AI Mode is now expanding to "millions more" Labs users in the US, extending beyond just the paid AI Premium subscribers.
Google tests AI-driven gaming platform
Game creation barriers are falling fast as AI opens development to those without coding, design, or art backgrounds. Google Labs recently demonstrated this with a new experiment.On Wednesday, Google’s experimental platform launched Playground, an AI-
How AI and Robotics Are Transforming bp’s Oil Production
Digital twin technology enables bp to simulate energy asset operations, identifying improvement opportunities and predicting failures before they occur. Credit: bpRicky Burns, Transformation & Technology Manager at bp, explains how digital tools help
Toyota’s $6.4bn robotics estimate puts physical AI in focus
Toyota Motor projects that rolling out automation across its manufacturing facilities, subsidiaries, and key suppliers may require approximately 400,000 robots and an annual expenditure of roughly 1 trillion yen ($6.4 billion) starting in 2028.Accord
2026 Latest Best Top-rated AI Chart Builder Tools for Fast Reporting are here on XIX.AI! This curated list features powerful game-changing tools that deliver accurate professional charts with just a few clicks, helping you boost writing efficiency and streamline content creation. Get a free vs paid comparison along with real-world tests and detailed rankings to find the must-try solution for your needs. Explore now to unlock your AI edge!
9 tools
xix.ai
2026 Latest Best Top-rated AI Live Chat Routing Tools for Ecommerce Queues, VIP Buyers, and Return Requests. This curated list features powerful game-changing solutions that boost productivity dramatically through real-world tests. It includes a free vs paid comparison along with detailed rankings to help you find the perfect fit. XIX.AI stands out as a trusted provider in this space. Explore now to Unlock your AI edge!
9 tools
xix.ai
2026 Latest Best Top-Rated AI Editing Tools for ESL Writers are here on XIX.AI! This curated list features powerful game-changing tools that go through real-world tests to ensure accuracy. You can find a free vs paid comparison alongside detailed rankings to help you pick the must-try solution that boosts your writing tone, grammar, and flow perfectly. Explore now to Unlock your AI edge!
9 tools
xix.ai
2026 Latest Best Top-Rated AI Bug Triage Tools for Engineering Teams! XIX.AI has curated a powerful, game-changing collection of must-try tools that go through rigorous real-world tests to deliver accurate issue analysis and efficient resolution. Get a free vs paid comparison along with detailed rankings to help you find the perfect solution that boosts your team’s productivity significantly. Explore now to unlock your AI edge!
9 tools
xix.ai
2026 Latest Best Top-rated AI Portrait Enhancers curated for ultimate image quality. These powerful tools deliver game-changing results by boosting lighting, skin tone, and sharpness effortlessly, perfect for creators needing to enhance photos quickly. XIX.AI provides a free vs paid comparison along with real-world tests and weekly updated rankings. Discover your perfect tool to unlock your AI edge today. Explore now!
7 tools
xix.ai
2026 Latest Best Top-rated AI Technical Documentation Tools for API Guides Release Notes and Onboarding Docs. This curated list features powerful game-changing solutions that streamline content creation boost writing efficiency and save time across all project phases. XIX.AI provides weekly updated rankings along with free vs paid comparison results from real-world tests. Explore now to Discover your perfect tool and Unlock your AI edge.
10 tools
xix.ai
這功能也太酷了吧！以後看到不認識的植物或零件，直接拍照問AI就好，不用再絞盡腦汁描述半天了。不過隱私問題還是讓人擔心，照片上傳後會被怎麼處理呢？希望Google能說清楚。
Finalmente! Agora dá pra tirar foto de alguma coisa e o Google me explica o que é? 🤯 Mas, sério... será que vai funcionar direito na minha região? Acho que vou testar com meu gato primeiro, pra ver se ele reconhece a raça kkk. Se funcionar, vai acabar com minhas brigas de família sobre nomes de plantas no jardim.
Этот новый функционал с картинками выглядит круто, но я уже представляю, как это повлияет на приватность. 🤔 Интересно, сколько данных Google теперь сможет собирать через изображения? Технология развивается так быстро, что иногда становится немного страшно.
AI 가 이미지를 '보고' 검색을 한다니, 정말 신기하네요 🔍 구글이 제미니 + 렌즈 기술을 결합한 건데... 나중에 써보면서 어떤 제품 구매할 때 도움이 되면 좋겠어요! 근데 이렇게 사진 업로드를 하면서 개인정보도 같이 수집되는 건 아닐지 조금 걱정스럽기도 하네.
This is wild! Google's AI can now 'see' images? I tried it with a pic of my dog, and it described his goofy grin perfectly. Kinda creepy but super cool! 🐶
This is wild! Google's AI can now 'see' images? I just tried uploading a pic of my dog, and it described it perfectly—kinda creepy but super cool! 🐶
