Google’s new ‘Pixel Screenshots’ can search your screenshot library — and it’s the most useful AI feature of 2024

[[{“value”:”

You, like myself, likely have a massive library of screenshots that includes everything from funny social media posts and saved order confirmations.

However, scrolling through a gigantic collection of screenshots for that one saved picture is a pain. That’s why Google launched the new Pixel Screenshots app, which can be found across all new Pixel 9 series devices, including the Pixel 9, the Pixel 9 Pro, the Pixel 9 Pro XL, and the Pixel 9 Pro Fold.

Google walked me through how the Screenshot app works — and it may be one of the most useful AI tools I’ve seen all year.

Google’s new ‘Pixel Screenshots’ uses AI search to help you find screenshots

At the Made by Google event, the search engine just dropped the Pixel 9 devices, and along with them, Google dropped the new Pixel Screenshots app. Using on-device AI that Google calls “Gemini Nano,” the app generates a title and summary for each screenshot.

For example, at a recent press event, a Google rep showed me a screenshot of an article that delved into how one can “dip dye” their hair for a pop of color. The Pixel Screenshots app, just like I mentioned, delivered a headline and a summary for the hair guide.

A screenshot of an article about dip dyeing one’s hair.
Credit: Kimberly Gedeon / Mashable

(The Google rep didn’t point this out, but I did notice an “Add a note” option, so I take it that users will be able to add their own annotations in addition to the AI-generated summaries.)

Next, the Google rep demonstrated that if users want to find a saved screenshot, they can use the search bar at the bottom of the app to find it.

Use the search bar on the bottom to find your screenshots.
Credit: Kimberly Gedeon / Mashable

For example, the word “boots” was typed into the search bar, which prompted the app to populate screenshots that featured images of boots from a user’s shopping journey.

After typing in “boots,” Gemini Nano did its job and recognized screenshots with images of boots in them.
Credit: Kimberly Gedeon / Mashable

To my surprise, not only can you type in a query, but you can tap on the microphone to speak your request into the search bar. For example, the Google rep asked, “What’s the Wi-Fi code at Jared’s house?”

The Screenshot app surfaced a Wi-Fi code after a spoken request.
Credit: Kimberly Gedeon / Mashable

And just like that, after searching through the user’s screenshots, the search was able to surface the right screenshots and reveal Jerrod’s Wi-Fi credentials front and center — without requiring much digging.

Just when I thought that the Screenshot couldn’t get any better, Google said there are suggested actions for certain screenshots. For example, if you save a screenshot with an address in it, a button that says, “Search in Maps” may appear, allowing you to surface directions via Google Maps.

You may see the “Search in Maps” button if Gemini Nano detects directions in your screenshots.
Credit: Kimberly Gedeon / Mashable

As a cherry on top, the Screenshots app lets you set reminders for yourself. Let’s say you saved a screenshot of an article, but you’re too busy to read it. You can tap on the alarm button to remind yourself to read said screenshot. You can’t tell me that’s not brilliant!

Google rep sets a reminder to help him remember to read an article about dip dyeing one’s hair.
Credit: Kimberly Gedeon / Mashable

This isn’t the only AI-powered feature that had our jaws dropping. Check out all the other new Google features, including Made You Look, Add Me, Reimagine, Gemini Live, and more.

Featured Video For You

The Pixel 9, Pixel 9 Pro, and Pixel 9 Pro Fold tech and specs

“}]] Mashable Read More

There’s a new ‘Screenshots’ app on Pixel 9 series phones, and thanks to the power of AI,