[airy, percussive, minimalist music plays] All right. We've got a Pixel phone loaded with the latest test build of Project Astra and we're going to leave the office to test it around London. Project Astra is our research prototype exploring future capabilities of a universal AI assistant.
It uses Gemini 2. 0, our newest model that enables agentic capabilities: [user] I've got this email with apartment info. Can you tell me the door code and remember it?
[agent] I'll remember the door code for you. It is 1170. To unlock it, enter the code and then press the unlock button.
[door buzzes] [user] Based on these symbols, how should I wash this? [agent] The tag shows to machine wash at 30°C, avoid bleach and tumble drying, iron on low, and dry cleanable. [user] Then what setting should I use on this machine?
[agent] Based on the laundry instructions of 30°C, select the "30" setting under "Easy Care" on the dial. [user] I've got this list of recommendations. Can you tell me a bit about some of them?
[agent] I can search for these places for you. Coal Drps Yard is a shopping destination with unique industrial design. Luminary Bakery is a social enterprise bakery and Tate Modern is a modern and contemporary art museum.
[user] Now we're going to try Project Astra out on the street. Let's see what it can do. I've always said "scone" (skown), but now I'm hearing people say "scone" (skon).
Can you help me with the pronunciation? [agent] It's a fascinating topic, the pronunciation of "scone"! Both "skon" (rhyming with "gone") and "skown" (rhyming with with "bone") are accepted pronunciations, though regional variations exist.
[user] What can you tell me about this sculpture? [agent] The sculpture you're seeing is called "My World and Your World" by Eva Rothschild, located in Lewis Cubitt Park in London. [user] What kind of themes does her work explore?
[agent] She creates abstract sculptures that invite viewers to interact with and interpret their surroundings in new ways. [user] Would these do well, if I planted them back home? [agent] Mountain Fleece can grow well in New York.
They prefer full sun to partial shade and moist, well-drained soil. So your garden in New York should be a good fit for these flowers. [user] I'm trying to get a gift for my friend, and this is everything she's been reading.
How would you describe her taste in books? [agent] Based on these titles, your friend seems to enjoy a mix of history, biography, and perhaps a touch of political or social commentary. [user] I picked some of these out.
Any idea which one she'd like the most? [agent] Consider "Half of a Yellow Sun" for its exploration of complex social and political issues within a historical setting. Aligning with her interest in narratives that offer insight into significant periods.
[user] Will that bus take me anywhere near Chinatown? [agent] Yes it does. The 24 bus route goes through Leicester Square, which is very close to Chinatown.
[user] Are there any landmarks on the way? [agent] Riding the number 24 bus, notable landmarks you will likely encounter are Westminster Abbey, Big Ben and Trafalgar Square. [user] I also met up with some friends to test the multilingual capabilities.
[friend 1, in French] Can you tell me something interesting about these lanterns? [agent, in French] Of course, I can tell you about the lanterns. The lanterns you see are part of the gateway to Chinatown in London.
They have cultural significance to the Chinese and are often used during celebrations and festivals. [friend 2, in Tamil] Can you tell me something else about this? [agent, in Tamil] Of course, this is the entrance to Chinatown in London.
It is a significant landmark. It represents the cultural importance of the area. [user] Now I'm using these prototype glasses to test Project Astra hands-free.
Can you check if it's going to rain anytime soon? [agent] It looks like it is currently mostly sunny in London. Rain is expected tonight from around 10 p.
m. until tomorrow morning at 6 a. m.
[chime] [user] Hey, what's that park next to me? [agent] The park looks to be Primrose Hill, known for its panoramic city views and the notable Shakespeare's tree. [user] Can you check if I can bike in there?
[agent] It appears that cycling is actually banned within Primrose Hill itself, although it is permitted in nearby areas and the rest of Regent's Park. [user] I'm biking back to Camden. Can you check if there's any supermarkets along the way?
[agent] There's a Sainsbury's on Camden Road, a Morrisons on Chalk Farm Road, and an M&S Simply Food on Camden High Street. [chime] [user] What was the door code again? [agent] The door code you saved previously is 1170.
[door buzzes] [door buzzes] Oh, thanks. That works. Find out more about Project Astra at deepmind.
