There are some surface improvements, such as the fact that search circles will soon be able to solve even more complex problems later this year.First launched on the Samsung Galaxy S24Ultra and Pixel8, this feature will be extended to understand iconic formulas, diagrams, graphs and more. Google says this will be of great help to students because AI tools can guide them step by step through a variety of physics and math-based problems.
Google also confirmed that more and more devices will be searching for Circle, but did not announce which devices to announce.
Another feature, TalkBack, is also being boosted by artificial intelligence.1 The accessibility feature helps those with blindness or vision problems with a description of what is happening with the images displayed on the screen. According to Google, TalkBack users encounter 90 unlabeled images per day on average. This new performance update will help fill in the missing information, such as the content of photos sent by family and friends, as well as the style and cut of clothes when shopping online.
That added power is thanks to google's Gemini Nano—LLM, which google has developed to run on devices. And while it's not exactly a nut n'volt feature, Google Nano is getting significant performance gains that will pay dividends across the Android OS. Google has confirmed that from the Pixel "later this year", Android phones will be able to access Gemini Nano in multi-mode.
This is the company's latest version of the model, and your phone not only handles text input, but also understands more information in the context, things like sight, sound and spoken words are now understood in an even greater context.
In a nutshell, Gemini will be the new assistant and will be easily accessible at the system level to assist with inter-app queries. For example, you could call Gemini overlay in an app like Gmail or Google Messages to ask something based on the content on the screen. A Google demo explaining Pickleball's rules could mean asking Gemini for specific information about the YouTube video they're discussing with their contacts.
Another example was translating the language into the image you sent.
Finally, Google has announced a new AI feature that will help protect android users from fraud in real time. The company revealed that it is testing Gemini Nano's ability to provide alerts during calls if it detects conversation patterns commonly associated with fraud during i/O.
For example, a "bank representative" asked to urgently transfer funds, made a payment with a gift card, or requested personal information such as a Pin or password on the card. The user will receive an alert. Since we're using Nano, Google says that all this protection is done on the device, so the conversation will remain private.
This feature is not yet available, but will be used as an opt-in option later in the year. And while most of us definitely think we're too savvy to get involved in scams, Google cites a recent report last year that states that about11 trillion was lost through scams. Nevertheless, I find this to be a very useful feature for elderly or more vulnerable Android phone owners.
Check out our live blog of Google I/O2024 keynote right here for the full lowdown on all the new AI features that Google is bringing to the table
Comments