Here is the full transcript of Kevin Slavin’s talk titled “How Algorithms Shape Our World” at TED conference.
Kevin Slavin’s talk “How Algorithms Shape Our World” explores the pervasive influence of algorithms on various aspects of life, from the financial markets to personal environments. He discusses how algorithms are not just tools for processing information but have become active agents in shaping reality, from the design of buildings to the dynamics of the stock market.
Slavin highlights the role of algorithms in the financial sector, emphasizing their reliance on speed and how this has led to significant physical changes, such as the hollowing out of buildings for server space and the construction of a fiber optic cable between New York and Chicago to gain microseconds of advantage.
He points out the unseen, often misunderstood impact of algorithms, illustrating this with examples like destination control elevators and the peculiar behaviors of algorithmic trading, which can lead to phenomena like the flash crash. The talk further delves into the concept of algorithmic efficiency reaching beyond the digital realm, influencing cultural and physical landscapes, such as the speculative positioning of servers across the globe for financial gain.
Slavin argues that these algorithms, which now co-exist with natural and human systems, should be considered a new form of nature. Ultimately, his talk serves as a prophecy about the deep and irreversible integration of algorithmic logic into the fabric of our world, urging a reevaluation of their role and impact.
Listen to the audio version here:
TRANSCRIPT:
This is a photograph by the artist Michael Najjar, and it’s real in the sense that he went to Argentina to take the photo. However, it’s also a fiction; there’s a lot of work that went into it after that. What he’s done is he’s actually reshaped digitally all of the contours of the mountains to follow the vicissitudes of the Dow Jones Index. So, what you see, that precipice, that high precipice with the valley, is the 2008 financial crisis. The photo was made when we were deep in the valley over there.
I don’t know where we are now. This is the Hang Seng Index for Hong Kong and similar topography, I wonder why. And this is art, right? This is metaphor. But I think the point is that this is a metaphor with teeth, and it’s with those teeth that I want to propose today that we rethink a little bit about the role of contemporary math, not just financial math, but math in general. That it’s transitioned from being something that we sort of extract and derive from the world to something that actually starts to shape it.
The world around us and the world inside us, and it’s specifically algorithms, which are basically the math that computers use to decide stuff. They acquire the sensibility of truth because they repeat over and over again and they kind of ossify and calcify and they kind of become real. And I was thinking about this of all places on a transatlantic flight a couple of years ago because I happened to be seated next to a Hungarian physicist about my age. We were talking about what life was like during the Cold War for physicists in Hungary.
Stealth and Signals
And I said, “So, what were you doing?” And he said, “Well, we were mostly breaking stealth.” And I said, “That’s a good job. That’s interesting. How does that work?” And so to understand that, you have to understand a little bit about how stealth works. And so this is an oversimplification, but basically, it’s not like you can just pass a radar signal right through 156 tons of steel in the sky. It’s not just going to disappear.
But if you can take this big, massive thing and you could turn it into a million little things, something like a flock of birds, well, then the radar that’s looking for that has to be able to see every flock of birds in the sky. And if you’re a radar, that’s a really bad job. And he said, “Yeah.” He said, “But that’s if you’re a radar.” He said, “So we didn’t use a radar. We built a black box that was looking for electrical signals, electronic communication. And whenever we saw a flock of birds that had electronic communication, we thought probably has something to do with the Americans.”
And I said, “Yeah, that’s good. That’s good.” So you’ve effectively negated 60 years of aeronautic research. “What’s your act two, you know, like, what do you do when you grow up?” And he said, “Well, you know, financial services.” And I said, “Oh, because those have been in the news lately.” And I said, “How does that work?” And he said, “Well, there’s 2000 physicists on Wall Street now.”
The Physics of Finance
And I’m one of them. And I said, “Well, so what’s the black box for Wall Street?” And he said, “Well, it’s funny that you asked that because it’s actually called black box trading. And it’s also sometimes called algo trading, algorithmic trading and algorithmic trading involved in parts because institutional traders have the same problems that the United States Air Force had, which is that they’re moving these positions, whether it’s Procter & Gamble or Accenture or whatever, they’re moving like a million shares of something through the market. And if they do that all at once, it’s like playing poker and just going all in right away. Right. You just tip your hand.”
And so they have to find a way, and they use algorithms to do this, to break up that big thing into a million little transactions. And the magic and the horror of that is, is that the same math that you use to break up the big thing into a million little things can be used to find a million little things and sew them back together and figure out what’s actually happening in the market.
So if you need to have some image of what’s happening in the stock market right now, what you can picture is a bunch of algorithms that are basically programmed to hide and a bunch of algorithms that are programmed to go find them and act. And all of that’s great, and it’s fine. And that’s 70 percent of the United States stock market, 70 percent of the operating system formerly known as your pension, your mortgage.
And what could go wrong? Right. What could go wrong is, is that a year ago, nine percent of the entire market just disappears in five minutes. And they called it the flash crash of 245. Right. All of a sudden, nine percent just goes away and nobody to this day can even agree on what happened because nobody ordered it. Nobody asked for it. Nobody had any control over what was actually happening. All they had was just a monitor in front of them that had the numbers on it and just a red button that said stop.
Algorithms and Culture
And that’s the thing, right, is that we’re writing things. We’re writing these things that we can no longer read. And we’ve rendered something kind of illegible. And we’ve lost the sense of what’s actually happening in this world that we’ve made. And we’re starting to make our way. There’s a company in Boston called Nanex and they use math and magic and I don’t know what. And they reach into all the market data and they find actually sometimes some of these algorithms. And when they find them, they pull them out and they pin them to the wall like butterflies.
And they do what we’ve always done when confronted with huge amounts of data that we don’t understand, which is that they give them a name and a story. So this is one that they found. They called the knife the carnival, the Boston shuffler, twilight. And the gag is that, of course, these aren’t just running through the market. You can find these kinds of things wherever you look once you learn how to look for them. You can find it here, this book about flies that you may have been looking at on Amazon. You may have noticed it when its price started at 1.7 million dollars.
It’s out of print still. If you had bought it at 1.7, it would have been a bargain. A few hours later, it had gone up to 23.6 million dollars plus shipping and handling. And the question is, nobody was buying or selling anything. What was happening? And you see this behavior on Amazon as surely as you see it on Wall Street. And when you see this kind of behavior, what you see is the evidence of algorithms in conflict, algorithms locked in loops with each other without any human oversight, without any adult supervision to say, “Actually, 1.7 million is plenty. You stick with that.”
And as with Amazon, so it is with Netflix. And so Netflix has gone through several different algorithms over the years. They started with Cinemash, and they’ve tried a bunch of others. There’s Dinosaur Planet, there’s Gravity, they’re using Pragmatic Chaos now. Pragmatic Chaos is, like all of Netflix algorithms, trying to do the same thing. It’s trying to get a grasp on you, on the firmware inside the human skull, so that it can recommend what movie you might want to watch next, which is a very, very difficult problem.
But the difficulty of the problem and the fact that we don’t really quite have it down, it doesn’t take away from the effects that Pragmatic Chaos has. Pragmatic Chaos, like all Netflix algorithms, determines, in the end, 60% of what movies end up being rented.
So one piece of code with one idea about you is responsible for 60% of those movies. But what if you could rate those movies before they get made? Wouldn’t that be handy? Well, so a few data scientists from the UK are in Hollywood, and they have story algorithms, a company called Epigogix, and you can run your script through there and they can tell you, quantifiably, that that’s a $30 million movie or a $200 million movie. And the thing is, is that this isn’t Google, right? This isn’t information. These aren’t financial stats. This is culture.
And what you see here, or what you don’t really see normally, is that these are the physics of culture. And if these algorithms, like the algorithms on Wall Street, just crashed one day and went awry, how would we know? What would it look like? And they’re in your house, right? These are two algorithms competing for your living room. These are two different cleaning robots that have very different ideas about what clean means. And you can see it if you slow it down and attach lights to them.
And they’re sort of like secret architects in your bedroom, you know? The idea that architecture itself is somehow subject to algorithmic optimization is not far-fetched. It’s super real, and it’s happening around you. You feel it most when you’re in a sealed metal box, a new style elevator.
They’re called destination control elevators. These are the ones where you have to press what floor you’re going to go to before you get in the elevator, and it uses what’s called a bin packing algorithm. So, none of this mish-mash of just letting everybody go into whatever car they want. Everybody who wants to go to the 10th floor goes into car 2, and everybody who wants to go to the 3rd floor goes into car 5.
And the problem with that is that people freak out. People panic. And you see why, right? You see why. It’s because the elevator is missing some important instrumentation, like the buttons, right? Like the things that people use. All it has is just the number that moves up or down and that red button that says stop. And this is what we’re designing for.
Machine Dialect and Wall Street
We’re designing for this kind of machine dialect. And how far can you take that? How far can you take it? You can take it really, really far. So, let me take it back to Wall Street. Because the algorithms of Wall Street are dependent on one quality above all else, which is speed. And they operate on milliseconds and microseconds.
Just to give you a sense of what microseconds are, it takes you 500,000 microseconds just to click a mouse. But if you’re a Wall Street algorithm and you’re five microseconds behind, you’re a loser. So, if you were an algorithm, you’d look for an architect like the one that I met in Frankfurt who was hollowing out a skyscraper, throwing out all the furniture, all the infrastructure for human use, and just running steel on the floors to get ready for the stacks of servers to go in. All so that an algorithm could get closer to the internet.
And you think of the internet as this kind of distributed system. And of course, it is. But it’s distributed from places, right? In New York, this is where it’s distributed from. It’s a carrier hotel located on Hudson Street. And this is really where the wires come right up into the city. And the reality is that the further away you are from that, you’re a few microseconds behind every time.
Infrastructure for Speed
These guys down on Wall Street, Marco Polo and Charity Nation, they’re eight microseconds behind all these guys going into the empty buildings being hollowed out up around the carrier hotel. And that’s going to keep happening. We’re going to keep hollowing them out because you, inch for inch, and pound for pound, and dollar for dollar, none of you could squeeze revenue out of that space like the Boston Shuffler could. But if you zoom out, if you zoom out, you would see an 825-mile trench between New York City and Chicago.
It’s been built over the last few years by a company called Spread Networks. This is a fiber optic cable that was laid between those two cities to just be able to traffic one signal 37 times faster than you can click a mouse, just for these algorithms, just for the carnival and the knife. And when you think about this, that we’re running through the United States with dynamite and rock saws so that an algorithm can close the deal three microseconds faster, all for a communications framework that no human will ever know. That’s a kind of manifest destiny.
And we’ll always look for a new frontier. And fortunately, we have our work cut out for us. This is just theoretical. This is some mathematicians at MIT. And the truth is, I don’t really understand a lot of what they’re talking about. It involves light cones and quantum entanglement.
Algorithmic Terraforming
And I don’t really understand any of that, but I can read this map. And what this map says is that if you’re trying to make money on the markets where the red dots are, that’s where people are, where the cities are, you’re going to have to put the servers where the blue dots are to do that most effectively. And the thing that you might have noticed about those blue dots is that a lot of them are in the middle of the ocean. So that’s what we’ll do.
We’ll build bubbles or something or platforms. We’ll actually part the water, right, to pull money out of the air because it’s a bright future if you’re an algorithm. And it’s not the money that’s so interesting, actually. It’s what the money motivates, right, that we’re actually terraforming the earth itself with this kind of algorithmic efficiency. And in that light, you go back and you look at Michael Najjar’s photographs and you realize that they’re not metaphor.
They’re prophecy, right? They’re prophecy for the kind of seismic terrestrial effects of the map that we’re making. And the landscape was always made by this sort of weird, uneasy collaboration between nature and man. But now there’s this kind of third co-evolutionary force: algorithms, the Boston Shuffler, the carnival. And we will have to understand those as nature. And in a way, they are. Thank you.