Gemini now can 'talk Live' with you while you show it things

So a new feature (they say Pixel Drop, but I don't have the latest April update yet, and I'm able to use it) just has been announced where you can now use your live video camera, or screen sharing to interact and get feedback from Gemini

The idea here is that you start up the Gemini Live and you can hit the buttons to either open your camera or share your screen with it.

Once you do (or don't, you can just still talk) you just talk to Gemini and you can ask it questions about what you're seeing and what it might know.

I've asked it about a specific Elk on my desktop, what it thought of a microphone on my desk, and did pretty well.

I tried with screensharing and it was 'meh'.  It knew Pokemon Go, but said a low CP stat monster as was 'perfect stats'.

Early days yet, but looking forward to seeing how it continues to grow.

--

We have an exciting new Gemini feature update to share with you. 

 

Today, Google began rolling out video input and screen sharing to the Gemini Live experience. That means you can talk with Gemini Live about anything you see, whether it’s through your phone’s screen or through the camera, and the feature is available in 45 different languages

 

Starting today, Gemini Live with video and screen sharing is rolling out to all Gemini Advanced subscribers on Android devices, and to Gemini app basic users on all Pixel 9 series phones and the Samsung Galaxy S25!

 

You can find more details in the Keywords blog here

Comments