A Week After Apple’s AI Flounders, Google’s Gemini Can Now ‘See’ the World on Phones

Google has beaten Apple to the AI punch . We knew it was likely what with the news some of the most challenging Apple Intelligence featureshad been delayedand the resultingSiri executive shakeups . But now Google is rolling out more contextual ability to Gemini on select Android gadget .

Google confirm thatit begin roll outGemini‘sProject Astra - poweredcamera and screen share capabilities this workweek . It ’s useable for those paying for Gemini Advanced and those on the Google One AI Premium program . The features let you share your screen like you ’re broadcasting it to a class or use the live camera to get Gemini ’s input on stuff around you . you’re able to take Gemini into the real globe and use it to name things , a laGoogle Lens , or get its guidance on your own projects – the example Google use is have it help you stag for tiles at a store .

There are only a few reports dispel around the cyberspace from userswho can invoke the features thus far , include this one from auser on Reddit , which is making this seem like less of a rollout than it is . I ’ve confirmed with Google that the rollout is afoot , though I ’ve been ineffectual to access it myself . The first user to report using it is n’t even on a Google Pixel twist . They ’re on a Xiaomi smartphone.9to5Googlehas managed to get Gemini Live with silver screen - part going , enough to show in aYouTube video recording .

Gemini’s Project Astra-infused screen sharing capabilities have slowly begun rolling out.

Gemini’s Project Astra-infused screen sharing capabilities have slowly begun rolling out.© Florence Ion / Gizmodo

© YouTubeA screenshot from a video Google put together to show Gemini Live in action with camera entree . Gemini ’s power to “ see ” the world around it offer up an bound . The iPhone has what Apple Intelligence call off “ Visual Intelligence , ” which use a photographic camera to discover objects and text . Its current implementation is pretty limited and does not converse with you or engage in a back - in - forth about the colors of the tile the agency that Gemini is express doing in Google ’s demonstrations . It ’ll be interesting to see how Google hones on these power . Heck maybe it will even finally convince exploiter of its utility , which would only further drive the stinger into Apple for trailing behind .

I sawProject Astralast class during Google ’s one-year developer group discussion , where I experienced the camera identification boast in activity . It did n’t move the needle for me then , but it ’s decently telling Google has pushed Gemini ’s ability to see through the camera lens less than a twelvemonth after debuting it when you study how badly Apple has apparently fumbled similar features .

I look forward to when live video recording and screen - sharing capability roll out to myPixel 9 Proto get a smell for how I ’ll apply it to my real biography . Google did n’t specify the devices that were get it , but I ’d learn your Pixel or Samsung Galaxy machine in the coming weeks .

Gemini Live With Video 0 12 Screenshot