Google’s new ‘Pixel Screenshots’ can search your screenshot library — and it’s essentially the most helpful AI function of 2024

You, like myself, possible have an enormous library of screenshots that features the whole lot from humorous social media posts and saved order confirmations.

Nevertheless, scrolling by means of a huge assortment of screenshots for that one saved image is a ache. That is why Google launched the brand new Pixel Screenshots app, which might be discovered throughout all new Pixel 9 collection gadgets, together with the Pixel 9, the Pixel 9 Professional, the Pixel 9 Professional XL, and the Pixel 9 Professional Fold.

Google walked me by means of how the Screenshot app works and it could be one of the crucial helpful AI instruments I’ve seen all yr.

Google’s new ‘Pixel Screenshots’ makes use of AI search that can assist you discover screenshots

On the Made by Google occasion, the search engine simply dropped the Pixel 9 gadgets, and together with them, Google dropped the brand new Pixel Screenshots app. Utilizing on-device AI that Google calls “Gemini Nano,” the app generates a title and abstract for every screenshot.

For instance, at a latest press occasion, a Google rep confirmed me a screenshot of an article that delved into how one can “dip dye” their hair for a pop of coloration. The Pixel Screenshots app, identical to I discussed, delivered a headline and a abstract for the hair information.

Mashable Gentle Velocity

Pixel Screenshot on a Pixel 9 series device

A screenshot of an article about dip dyeing one’s hair.
Credit score: Kimberly Gedeon / Mashable

(The Google rep did not level this out, however I did discover an “Add a be aware” possibility, so I take it that customers will have the ability to add their very own annotations along with the AI-generated summaries.)

Subsequent, the Google rep demonstrated that if customers wish to discover a saved screenshot, they will use the search bar on the backside of the app to search out it.

Pixel Screenshot on a Pixel 9 series device

Use the search bar on the underside to search out your screenshots.
Credit score: Kimberly Gedeon / Mashable

For instance, the phrase “boots” was typed into the search bar, which prompted the app to populate screenshots that featured pictures of trainers from a person’s purchasing journey.

Pixel Screenshot on a Pixel 9 series device

After typing in “boots,” Gemini Nano did its job and acknowledged screenshots with pictures of trainers in them.
Credit score: Kimberly Gedeon / Mashable

To my shock, not solely are you able to kind in a question, however you may faucet on the microphone to converse your request into the search bar. For instance, the Google rep requested, “What is the Wi-Fi code at Jared’s home?”

Pixel Screenshot on a Pixel 9 series device

The Screenshot app surfaced a Wi-Fi code after a spoken request.
Credit score: Kimberly Gedeon / Mashable

And identical to that, after looking out by means of the person’s screenshots, the search was capable of floor the fitting screenshots and reveal Jerrod’s Wi-Fi credentials entrance and heart with out requiring a lot digging.

Simply once I thought that the Screenshot could not get any higher, Google mentioned there are recommended actions for sure screenshots. For instance, in case you save a screenshot with an deal with in it, a button that claims, “Search in Maps” could seem, permitting you to floor instructions by way of Google Maps.

Pixel Screenshot on a Pixel 9 series device

You may even see the “Search in Maps” button if Gemini Nano detects instructions in your screenshots.
Credit score: Kimberly Gedeon / Mashable

As a cherry on high, the Screenshots app enables you to set reminders for your self. For instance you saved a screenshot of an article, however you are too busy to learn it. You possibly can faucet on the alarm button to remind your self to learn mentioned screenshot. You possibly can’t inform me that is not sensible!

Pixel Screenshot on a Pixel 9 series device

Google rep units a reminder to assist him bear in mind to learn an article about dip dyeing one’s hair.
Credit score: Kimberly Gedeon / Mashable

This is not the one AI-powered function that had our jaws dropping. Take a look at all the opposite new Google options, together with Made You Look, Add Me, Reimagine, Gemini Reside, and extra.