And here’s how this works: so you’re going to build to easily create anything you want; you can write a fun message next to your breakfast and you can build a slot on to the table. And since we understand the depth of the table, you saw it was a clue, did in the right place as it came up and you’re going to build to pan around and it’s going to maintain its position on the table exactly as if it were a real object in the world. So we make this more fun, we’ll add some breakfast sharks swirling around my ball, some clouds, and you know, there you go. It’s got the depth right, so when they go behind the ball, that they’re included, it gets the depth of the table and all that.
All right. So there’s some pretty bulk AI work to make this all work and we can do this on a phone. So now — but we’re just going to start, this is the first one that I want to show you. These are the technological foundations for advanced AI. Let’s go to the next one.
Now since we’re mapping out these scenes in 3D, right? Since we have the depth of an image, we can go from taking a still photo to mapping out a whole 3D scene. So this actually was taken from a 2D still image in our office in Seattle. And from the still photo we constructed a 3D scene. And now because it’s a 3D scene we can pan around. How crazy is that? Crazy. All right. We can change the lighting, we can turn the lighting down, we can move the lighting from the front of the room to the back. And you can add all kinds of effects — we can fill the room up with water if we want; again it’s got the depth right, you can add a lot of bouncy balls – we’re fond of bouncy of balls. And we could fill the room up with skittles, because the future is delicious. I can’t help it.
All right, Now, look, we also have some of the best computer vision and object recognition work in the world, so that’s going to help you identify different things in the scene to help you surface relevant effects that you want to check out. So you’re going to build the top on the coffee mug and we’re going to surface effects that are relevant to coffee, you can have steam. You can add a second coffee mug, so it looks like you’re not drinking — you know, you’re not having breakfast alone. And since it’s a digital object, you can you make it bigger if you want or smaller; you can make it any size you want. You can top on a plant. You can add flowers that are blooming; you can water the plant with a raincloud or whatever else it is that you do with plants I guess. You can tap on the wine bottle and you can add an information card, where that shows what the vintage of the wine is, and you know what the rating is, and maybe where to get it or maybe in the future you’re going to like to buy it. So some of these effects are going to be fun and others are going to be useful.
So in augmented reality, you’re going to be able to do all this different stuff. So these are three of the technological building blocks for building augmented reality: precise location, 3D effects and object recognition.
But now that we’ve gone through some of the technology, let’s take a look at some of the use cases that you’re going to be able to build and do. All right. So let’s start with the most basic. This is an AR tool that Nike created for helping you visualize and share your runs in some fun new ways. Now in augmented reality we’re going to face near constant reminders that Ime is in better shape than us. Ime is probably out for a run right now before he comes on stage in twenty minutes.
Now, look, we all do things like this every day, like running — everyday things, running, cleaning our home, doing laundry, and changing diapers. And the reality is we’re proud of these things where we want to express them but we often don’t get a chance to do that because they feel mundane, and it doesn’t feel special enough to share it. So too often we don’t share them unless we have something that makes that moment funny or feel like it’s going to be relevant to other people. So as silly as effects like this might seem, they actually are really important and meaningful because they give us the ability to share what matters to us on a daily basis.
Let’s talk about games. Now more than a billion of us play games, and I think that there’s going be a whole new genre of augmented reality games coming. So here’s an example of father playing an augmented reality game with his kids in the waiting room at the doctor’s office, where he’s using the table in the waiting room as the game board for a tower defense game and the kids can kind of slap the bad guys before they get to you. Now there’s going to be a lot of awesome stuff like this that comes and I’m pretty excited about this – this part of the platform is going to come a bit later this year.
Let’s talk about art. Now, with augmented reality you’re going to be able to create and discover all kinds of new art around your city. So you know, this is actually — this is a piece at Facebook headquarters and without augmented reality this actually just looks like a blank wall. But when you are in augmented reality, you get this beautiful piece of art; it’s not just a painting on the wall but it fills up the whole space; it’s 3D. And not only that, it’s going to be impossible to build or make in reality because you have this infinite waterfall of paint coming down and it’s really quite something to look at.