Google AI Enhances Android Experience

We're living through an exciting time where AI is pushing the boundaries of what smartphones can do. With Google AI seamlessly integrated into Android's operating system, billions of users are discovering new ways to interact with their devices. Today, we're excited to share some updates that bring Google AI even closer to your Android experience.

Circle to Search now helps students with homework

Circle to Search has become a game-changer since its debut at Samsung Unpacked, allowing you to search anything on your screen with a simple gesture. We've enhanced it with features like full-screen translation and expanded its availability to more Pixel and Samsung devices. Now, we're taking it a step further: starting today, Circle to Search can assist students with their homework. When you're stuck on a problem, just circle it, and you'll receive step-by-step guidance to solve physics and math word problems right from your phone or tablet. This feature, powered by our LearnLM initiative, aims to deepen understanding rather than just providing answers. Later this year, we'll expand this capability to tackle even more complex problems involving symbolic formulas, diagrams, and graphs. Circle to Search is already on over 100 million devices, and we're set to double that number by year's end.

[ttpp]Gemini will get even better at understanding context to assist you in getting things done[yyxx]

Gemini on Android is redefining what an assistant can do, using generative AI to boost your creativity and productivity. It's getting smarter at understanding the context of what's on your screen and the app you're using. Soon, you'll be able to overlay Gemini on top of any app, making it easier to use in various ways. For instance, you can drag and drop generated images into Gmail, Google Messages, and other apps, or use "Ask this video" to get specific information from a YouTube video. If you're a Gemini Advanced user, you'll also have the option to "Ask this PDF" for quick answers without scrolling through pages. This update will reach hundreds of millions of devices in the coming months, and we'll keep enhancing Gemini to offer more dynamic suggestions based on what's on your screen.

[ttpp]Full multimodal capabilities coming to Gemini Nano[yyxx]

Android is pioneering as the first mobile OS with a built-in, on-device foundation model. With Gemini Nano, we're bringing you faster experiences while keeping your data private. Later this year, we'll introduce Gemini Nano with Multimodality on Pixel devices, allowing your phone to process not just text but also sights, sounds, and spoken language.

[ttpp]Clearer descriptions with TalkBack[yyxx]

Later this year, Gemini Nano's multimodal capabilities will enhance TalkBack, providing richer and clearer descriptions of images for users with blindness or low vision. On average, TalkBack users encounter 90 unlabeled images daily. This update will fill in the gaps, offering more details about photos from friends or the style of clothes when shopping online. Since Gemini Nano operates on-device, these descriptions are quick and work without a network connection.

[ttpp]Receive alerts for suspected scams during phone calls[yyxx]

A recent report highlighted that over $1 trillion was lost to fraud in a year. We're testing a new feature using Gemini Nano to alert you in real-time during calls if it detects patterns commonly associated with scams. For example, if a "bank representative" asks you to urgently transfer funds, pay with a gift card, or requests personal information like card PINs or passwords, you'll get an alert. This protection happens on-device, keeping your conversation private. We'll share more about this opt-in feature later this year.

[ttpp]More to come on Android[yyxx]

We're just scratching the surface of how on-device AI can transform your smartphone experience. We'll keep integrating Google AI into every aspect of the smartphone experience with Pixel, Samsung, and more. If you're a developer, check out the Android Developers blog to learn how to build with our latest AI models and tools, like Gemini Nano and Gemini in Android Studio.

[ttpp][yyxx] [ttpp][yyxx] [ttpp][yyxx] [ttpp][yyxx] [ttpp][yyxx] [ttpp][yyxx]

Get more stories from Google in your inbox.

Email address Your information will be used in accordance with Google's privacy policy.

Subscribe Done. Just one step more.

Check your inbox to confirm your subscription.

You are already subscribed to our newsletter.

You can also subscribe with a different email address.