I just played Pictionary on Google's Project Astra - and now I understand the hype for Gemini1.5

I just played Pictionary on Google's Project Astra - and now I understand the hype for Gemini1.5

Project Astra stole the show with Google I/O, giving us a glimpse of what it would look like to interact with the world powered by google's next-generation AI model, Gemini1.5. It may take some time for a public version of Project Astra to reach the device, but it will demonstrate a variety of capabilities while attending Google's annual developer conference.

In short, Project Astra is a real-time camera-based AI that can handle everything from identifying objects in a frame to creating fictional stories about that object. Making a story No seriously, when prompted with a plastic apple, it made the toy romantic (probably held from a children's play set)."

For demonstration purposes, Google connected a stationary top-down camera to a machine running Gemini1.5. Only the camera feed was used for this all-rounder game, but the model's object identification chops were also shown. When an array of dinosaur figurines was presented, Gemini not only named each classification, but also posed with a surprisingly suitable name and adventurous strike

less meditative challenge, a fellow reporter read a relatively small tattoo printed on their forearms to the agent and it nodded to the TV show Gemini. At first I was guessing "Game of Thrones" incorrectly, but on the 2nd attempt I landed on "Battlestar Galactica". (In case you're wondering, the quote says "So we all."

Google had a touchscreen display supplied to the Gemini model as well, equipped for a Pictionary friendly round. I stepped up to challenge Project Astra, offering my best attempt at a particular ball-shaped droid from the Star Wars Universe to stay on the sci-fi theme.This doodle definitely didn't deserve a place on the fridge, but when asked, "What do you see?"The agent nailed it — BB-8 from the trilogy of the sequel.

The demo had a quiz-like nature, but the idea is to prove how Gemini can help with vision abilities. Google said that it will first come to Android phones in the form of Gemini Live, but this official demo video suggests that a fresh form factor is in the works, "

In an ideal scenario, Gemini Live will be able to see things that help answer questions, stimulate creativity, and find invisible objects." You can do it. It makes enough sense to do so with the Gemini app and the smartphone camera app, but eyeglass designs like Ray-Ban Meta Smart Glasses will eventually become friction

as a "look and tell" style tool, and Project Astra and Gemini seem to be responding to the hype. There are both competing versions currently available, but if one company knows how to do the search correctly, it's Google. 

Categories