Google is using AI to make its Nest Security cameras smarter.

Google is using AI to make its Nest Security cameras smarter.

Alongside the announcement of the fourth generation Nest Learning Thermostat and Google TV Streamer, the search giant leveraged AI to make some of the best home security cameras, video doorbells, and other smart home devices easier to use It also revealed several improvements coming to the Google Home app that will.

Coming this fall, Gemini will be used to analyze videos connected to the Google Home app and generate a detailed summary of each clip. So, for example, instead of just identifying the animals in the garden, the clip will be able to produce a summary that says "the dog is peeing on the flowers."

As a result, Google Home users will be able to more easily search for video clips using natural language queries.

This should make it easier to find the exact clip they are looking for among the hundreds of hours of video stored.

Of course, using AI to analyze videos raises many privacy concerns.

(Updated August 7): In response to some questions by Tom's Guide, a Google spokesperson said the company does not use video or data from consumers to train its Gemini model.

We also asked if we could opt out of this feature on a per-camera basis, but the company initially said that was not possible. The company said, "We are continually seeking feedback from our users and will iterate the experience based on what has the most impact for them."

Google also said it will extend Gemini to other parts of the Google Home app, making it easier to create more complex home automation. So instead of using a script editor to create routines, one could simply type in a phrase such as "turn on the lights when you get home and set the thermostat to 72 degrees," and the app would set it all up for you.

Gemini can also suggest routines based on what you can do with your smart home devices. One example Google cites is, "Make sure the kids remember to put their bikes away when they get home from school," which broadcasts a reminder to the Google Smart Speaker when the kids get home.

Similar to what Amazon is working on with Remarkable Alexa, Google is trying to make its assistant more like everyday conversation.

It will also be able to ask more complex questions, such as "Play me a song from Ice Spice's Eras tour with Taylor Swift."

I heard a brief demo where Google Assistant was asked about Pluto, and the new and improved Assistant had much more inflection and emotion in its voice than the current model.

Google said that all of these new smart features will be rolled out to Nest Aware subscribers as a public preview later this year, but did not say when they would be available to the general Google Home user.

I am interested to see how well these new features work. There is nothing more tedious than poring over hours and hours of surveillance footage to find a particular event. Given that many companies have used YouTube to train their AI without people's knowledge, we should be cautious about granting permission to use more personal videos unless there are strict guardrails in place.

And as we await the arrival of Remarkable Alexa, we are curious to see how Amazon's revamped assistant will compare to this new and improved Google Assistant, and which will be best suited for the smart home.

Categories