Gemini Live — Features available and coming soon

Gemini Live — Features available and coming soon

This past Tuesday, Google announced a new artificial intelligence product on Gemini Live. Like the recently announced GPT-4o from OpenAI, Gemini Live is a native multimodal AI model with impressive voice and video capabilities. 

Gemini Live is just part of "Project Astra," a universal AI agent that may appear in smart glasses. For now, Gemini Live will be the first iteration in the wild on smartphones. 

During the Google I/O2024 demo, I was able to see a test of audio and video conversations.

However, Gemini Live is not currently available. So what features will be available and when will Gemini be able to watch live on Android devices? Read on to find out. Google has made gemini1.5 available to paid Gemini advanced users.

This allows Gemini to parse multiple large documents or, for example, summarize up to 100 emails. 

In 1.5, improvements have been added to understanding and visualizing images and building charts. Unlike GPT-4o, Gemini relies on other models such as Imagen3 and Google Veo to output images and videos. 

With the 1.5 update, you can now upload Google Docs, PDFs, and other documents to gemini for summaries, feedback, and answers.  Gemini Advanced For paid users, Gemini Live will be part of the update.

You can try it for free for 2 months, but then Gemini Advanced takes month19.99 a month. 

Gemini Live is the Gemini app on both Android and iOS, accessible through the app's voice icon. It will be full screen and allows users to have a two-way conversation with Gemini.

Similar to GPT-4o, users can talk at their own pace and interrupt Gemini to add new information or clarify prompts. Most of the demos and videos exhibited at Google I/O2024 featured a female voice and a male voice 1. It is supposed to be possible to choose from 10 different voices. Gemini Live gets Google's lens-esque feature that allows users to use the camera on their phones. This allows Gemini Live to "see" the world through the camera, providing feedback and answers.It's a precursor to the potential project Astra smart glasses, which Google has infiltrated into live demo videos.

Even for Gemini advanced users, Gemini Live is not immediately available. A blog post from Google reads, "The coming months."We found a tweet from Google during i/O claiming "this summer." 

Not everyone expects to live Gemini on 6 May. It seems that Gemini can not be seen alive until the late 7th month at the earliest. 

In addition to that, the ability to use the camera has not come until "later this year", which probably means a late autumn update. Unfortunately, we haven't seen any updates on when anyone will be able to access Gemini Live. The best we've seen is the "near future," which could be any time from 2024 to next year. 

Categories