First, let’s look at whisper shout. We wanted to give you a way to add more emotion to your words. Sometimes you want to get your point across big and bold. Other times you want to say things a bit more softly. Whisper shout lets you express how you really feel by making your replies very big or very small.
Amit, can you show everyone how that works? So Amit has typed “yay” and throws a smiley face in there. Now watch, rather than tapping the send button, he slides it down to whisper and slides it up again to shout. Down to whisper and up again to shout. I think it’s pretty cool, too. No more yelling in all caps to get your point across.
It’s also fun to add emotion to your photos. And Ink lets you get creative with the photos you send. Amit’s picked a photo of his adorable baby girl and wrote ahoy on the little sailor. Posted it. It’s that simple. I use Ink all the time. It’s really fun.
Another way Allo helps you express yourself is by letting you type less, a lot less. We’ve taken a page from the inbox playbook and built Smart Reply right into your chat conversations. This is especially powerful in messaging when you’re on the go. So now you can keep your conversations going with just a quick tap.
So you can see when Joy asks: dinner later? That Amit has offered two Smart Reply suggestions: I’m busy and I’m in! Okay. I promise I won’t act out any more emojis. So Allo uses machine learning to suggest replies on the fly, anticipating what you might want to say next. Now, these aren’t just canned replies. Allo learns over time and will suggest responses based on how you like to express yourself. The more you use Allo the better the suggestions will become. So the suggestions you see are unique to you. You can say the things you want without having to type a single word. And since messaging isn’t just about texts, smart replies contain stickers and emojis, too, because as they say, an emoji’s worth a thousand words. Do they say that?
Now I want to show you something really cool. Allo even offers smart replies when people send photos to you. This works because in addition to understanding text, Allo builds on Google’s computer vision capabilities to understand of the content and the context of images. In this case, Allo understood that the picture was of a dog, that it was a cute dog, and even the breed of the dog. In our internal testing, we found that Allo is 90% accurate in determining whether a dog deserves the “cute dog” response.
So let’s try something even harder. When Joy sends a photo of pasta, we’re able to identify the precise details of the image and create smart replies mentioning both linguini and the clams. What’s really cool here is that we don’t just identify what’s in the image. Smart Reply actually creates a conversational response, something like “yummy,” the kind of thing you would actually say in response to a photo of food. This is only possible because we’ve married our strengths in computer vision and natural language processing. And if you think about it, there’s a lot of complex technology at work here just to help you say something as fun — as simple and natural as “I love linguini.”
So, that’s a little how Allo helps you express yourself and keep your conversations going. The intelligence behind Smart Reply also gives you a taste at how assistive technology can make your message experience simpler and more productive. The Google Assistant built right into Allo takes it even farther, so I’m pleased to introduce one of our leads, Rebecca, to tell you more about the Assistant in Allo.
Rebecca Michael – Head of Marketing, Communication Products at Google
Thanks, Erik. As you heard earlier, the Google Assistant is an ongoing dialogue between you and Google that helps you get things done in your world. It’s also designed as an ambient experience. It’s there for you whenever you need it. And in messaging that really means bringing the Google Assistant right into your conversation with friends. So I’m going to show you how the Assistant can help in Amit’s and Joy’s conversation.
So they’re planning a dinner and Joy now says she would like Italian food. The Assistant intelligently recognizes that they could use some tips for Italian restaurants nearby and you can see its proactive suggestions at the bottom of the screen there. Tapping this brings up restaurant cards that everyone in the chat can see. These are powered by Google’s Knowledge Graph which means that Allo can help with all kinds of information in the real world. So there’s some back and forth about which restaurant to go to. And it looks like they’re leaning towards Cucina at 7 o’clock.
So Amit taps on the restaurant card to bring up more details. Looks good. Serves pasta which we know Joy fancied. So Amit can now go ahead and make a reservation right there through OpenTable. The Assistant prompts him to confirm the number of diners and what time they want to eat. And now they’re booked and ready to go.
So what we’re seeing here — what we’re seeing here is completely new. In the past, Amit would have had to leave the chat to do a Google search, return with some restaurant options, switch back again to share the options, go out again to make the reservation at OpenTable and then come back in to share the details with the rest of the group.