Audio Player

Starting at:

Theories of Everything with Curt Jaimungal

William Hahn: AI Expert on the Dawn of Conscious Machines

October 8, 2024 2:46:27 undefined

ℹ️ Timestamps visible: Timestamps may be inaccurate if the MP3 has dynamically injected ads. Hide timestamps.

Transcript

Enhanced with Timestamps
358 sentences 27,266 words
Method: api-polled Transcription time: 163m 36s
[0:00] The Economist covers math, physics, philosophy, and AI in a manner that shows how different countries perceive developments and how they impact markets. They recently published a piece on China's new neutrino detector. They cover extending life via mitochondrial transplants, creating an entirely new field of medicine. But it's also not just science they analyze.
[0:20] Culture, they analyze finance, economics, business, international affairs across every region. I'm particularly liking their new insider feature. It was just launched this month. It gives you, it gives me, a front row access to The Economist's internal editorial debates.
[0:36] Where senior editors argue through the news with world leaders and policy makers in twice weekly long format shows. Basically an extremely high quality podcast. Whether it's scientific innovation or shifting global politics, The Economist provides comprehensive coverage beyond headlines. As a toe listener, you get a special discount. Head over to economist.com slash TOE to subscribe. That's economist.com slash TOE for your discount.
[1:06] This episode is brought to you by State Farm. Listening to this podcast? Smart move. Being financially savvy? Smart move. Another smart move? Having State Farm help you create a competitive price when you choose to bundle home and auto. Bundling. Just another way to save with a personal price plan. Like a good neighbor, State Farm is there. Prices are based on rating plans that vary by state. Coverage options are selected by the customer. Availability, amount of discounts and savings, and eligibility vary by state.
[1:36] Professor William Hahn is an Associate Professor of Mathematical Sciences and a founder of the Machine Perception and Cognitive Robotics Laboratory, as well as the Gruber AI Sandbox. Both you and I, Will, we met at MindFest at Florida Atlantic University a few times and a link to all of those talks on AI and consciousness are in the description. Will, please tell me what have you been working on since we last spoke?
[1:59] Well, first, just want to say great to see you and really happy to be joining you on on tow today. Really excited. You've got such an amazing community. Same man. It's been a long time coming. Thank you. I'm working on a whole bunch of different things. The thing that's been in my mind the most is this idea of info hazards. And in particular, this this theme I've been bouncing around called lethal text. OK, let's hear it.
[2:27] Well, so as everybody knows, you know, AI is here and everybody is kind of prepared for the technological revolution that we're witnessing. But I think the more interesting developments are actually going to be in our mind. They're going to be the changes in language, how we think about language, how we think about ourselves and how we think about thinking, how we think about language. What do you mean? So,
[2:54] Everybody, I'm sure, has gotten their hands on one of these large language models at this point. And they have just absolutely revolutionized the way we are thinking about words, the way we're thinking about language. And as people might be aware, it's now becoming possible to program a computer largely in English, that we can ask for computer code at a very high level
[3:24] Things people dreamed of back in the fifties and now it's possible to just describe what you want the computer to do and then that behind the scenes is getting converted into runnable computer code. But I think that now forces us to think about. Was language always a programming language? Is our mind something like a computer? Not in the obvious sense of transistors and gates and that sort of thing, but is it a programmable object?
[3:54] And if so, how is it programmed? So where do you lie on the is a brain a computer question? I think the computer metaphor is probably the most powerful that we have so far for understanding the mind. And what's interesting is if you go back through the history of technology, every time there was a revolution in the mechanical world, let's say,
[4:21] We adopted a new metaphor for how the mind might operate. And so in the ancient world, it was dominated by a clockwork universe. The idea that the world was made out of cogs and gears and things like that. And then later we saw things like the emergence of telegraph networks and switchboards. And at certain times we saw the emergence of things like steam engines. And we actually still have this thermodynamic hydraulic
[4:50] View of the mind is still residual in our language. We talk about people being hot headed and have a head full of steam and they need to cool down and so on. And we still use these sort of thermodynamics metaphors. And a lot of people would argue, well, the computer is just the current metaphor. It's the metaphor of the day. And that will write will change it as we go on. But the thing about computers that that Turing showed is there's a kind of universality that
[5:18] Computation is the limiting result of any technology. If you take your car and you make it sophisticated enough, it turns into a computer. If you take your house and make it sophisticated enough, it turns into a computer, and so on. That almost every technology, if you improve its capability and its sophistication, eventually you're going to run into this notion of universal machine. And so the idea that the mind approximates
[5:47] the universal machine of Turing, that it's a machine that can simulate any other machine, given the appropriate programming, I think is something we need to consider. So what unifies clockwork, telegraph networks and thermodynamics is computation? Exactly. We can all see those as intermediates, as sort of proto computers or different aspects of communication and computation.
[6:12] And that the end result, the limiting result of all of those would be the computer as we know it today. There are different computational models of consciousness. Are all of them the same to you or do you see pros and cons with different ones? You know, there's so many and there's probably a new one invented every afternoon. There's a few flavors that I'm a big fan of. And, you know, I like the saying all models are wrong. Some are useful.
[6:41] And so I don't think any of these will act ever actually capture the full scenario, but they're sort of the best that we have right now. And let's be specific. Let's pick the one that is your least favorite and then the one that's your favorite. Well, one of the ones that's my favorite is the idea of society of mind. Marvin Minsky's proposal that the mind is really a collection of, you know, he threw around, he threw a number about 400 agents. I don't think the number is particularly important, but the idea is there's a bunch of them.
[7:12] and what's interesting is we're starting to see that emerge now with these language models that in the background of the newest ones they've actually bifurcated themselves and there's a dozen little microagents each with a separate prompt a separate goal a separate unique way of looking at the world and then they have a conversation in the background and then when they make a final output it's kind of a consensus amongst those agents and i think that's
[7:39] Probably a good approximation for how our our brain works in that we have all of these competing agents and some of them are Trying to meet new people some of them are trying to find something to eat some are trying to see visual interesting visual stimuli and so on and That when we choose a behavior or have an action even like, you know producing a sentence It's probably the result of multiple of those agents coming together Mm-hmm
[8:06] I like, you know, Minsky takes this a step further with the idea of emotion. And I think a very interesting take is emotion is not really a thing. It's the absence of certain things. It's turning features off. And he describes that when you're when you're hungry, for example, that your ability to long term plan or to even think rationally gets turned off and you're just you're very hungry.
[8:31] When you're angry, your ability to care about other people's feelings and consider their viewpoint gets turned off. You're no longer running that agent. You're sort of in a dynamical ensemble, prioritizing these different agents as we go through these different emotional states. And so I think that's an interesting way of looking at our behavior. And I think we're going to need those kinds of theories when we try to put
[8:55] That sounds to me more like an explanation of mind or the mechanics behind mind and not an explanation as to how consciousness comes about from computational systems. You know, I've got a lot of ideas in that and a lot of them are
[9:19] conflict i'd like to tolerate ambiguity and so i have a few of these ideas that uh... i'd like to just kind of keep keep juggling around and one of the things that comes to mind is i really like sydney brenner's approach uh... the molecular biologist and he had this really interesting take about consciousness he said that the discussion is going to go away he said that in a few decades
[9:48] The idea of consciousness will kind of just disappear from the scientific conversation and that people will wonder what we were talking about all along. And I really like that idea. I don't know if I believe it or even want it to be true, but something about it resonates with me because I think we're going to start to see something like proto-consciousness or something that will be more convenient to describe as consciousness in machines and we're going to
[10:16] force ourselves to consider the hard problem and other aspects that, you know, plagued philosophers for so long, they're going to be laid out in front of us in a very concrete way. And the great minds before us didn't have the opportunity or rather they didn't have the language of objects like LLMs or bits or, you know, computational process. They didn't have those
[10:45] that terminology for which to frame their thinking. And one thing that comes to mind is this classic question of the redness of red. Well, we're going to build machines that will probably be able to talk to us in natural language about the infraredness of infrared, or the ultravioletness of ultraviolet, that we have such a narrow perceptual window
[11:12] and cognitive window that when we talk about consciousness i tend to think of it as sort of a spotlight that moves around but with such a narrow beam it almost be more like a laser pointer because if i'm if i'm conscious of red well then i'm not thinking about my toes and if i'm thinking about my toes i'm not thinking about my childhood and if i'm thinking about my childhood i'm not thinking about the future and so on that kind of like how vision saccades around the world
[11:38] Our consciousness also sort of jumps around and saccades and we get this kind of holistic picture, but it also is fleeting and constantly changing the subject of that, that Cartesian theater, if you will. And so, you know, I'm fascinated by how we're going to expand that notion by looking at machines that have lots of sensors that have internal states.
[12:05] that are thinking about their thinking before they answer in English. And we're going to be able to ask them, well, what do you think about red? And it's not that far away before they will be able to have at least consumed a strawberry in a rough sense, right? We have elaborate olfactory sensors. It makes me think of we know what ramen soup tastes like, but I don't know what ramen scattering tastes like.
[12:31] You know, they have these little handheld machines that measure the vibrational mode of molecules and you can detect the presence of chemicals without opening the jar. If we put that into a system and give it a large language model and a rich historical experience and it will remember the first time it encountered strawberries and it states when it did so, who are we to say that that's not a conscious being in some sense?
[12:59] Okay, plenty of this depends on the definition of consciousness. And I know that that's an implicit problem with the hard problem. So how do we define consciousness? Something I put out on Twitter recently was, is awareness a necessary condition, a sufficient condition, both or neither of consciousness? So what would you say? Yeah, I think awareness is definitely going to be a necessary condition. And I think you're going to have to have awareness of awareness.
[13:29] That's tricky then because we could then say some animals are not conscious because they're not self-conscious. What do you say to that? I imagine you can feel without thinking about your feelings. Yeah, I mean, I think that's what's just so interesting is trying to parse out those distinctions because they certainly have feelings in some sense
[13:58] of a sensory loop, but whether that's the same, whether they're aware of that, it's not obvious. Or at least they're aware of it at the first level, but they're not aware of it, they're not aware that they're aware. And I don't know if we are, I don't know if I am. Certainly most of the time I think I'm not. There's just not enough extra processing power, I think,
[14:26] Maybe it's just because of our daily lives consume so much of our brain power. You know, if we were like sort of the philosopher sitting on the sofa, we could just like an ancient world. I mean, we could, you know, have more access to that. And that's one thing I've been very interested in is going back to the ancient world and looking at how people thought about things because our modern world is just so inundated with with certain, you know, things that we have to think about all the time. We don't get much
[14:56] I think that's what's great about your channel. You know, you force people to do that. Thanks. Well, that's also what's not so great about the channel. So you said you could be aware of something but not aware that you're aware. That also reminds me that you can know something but not know that you know it. I think it was I think it was Schopenhauer said a man can or a person can do what they will, but they can't will what they will.
[15:27] Right, and so we think we have this freedom of choices and action, but where do those, you know, are there agents in there that are choosing those behaviors? That's one of the things I've been very fascinated about is this idea of our mind being hijacked by systems that are choosing our behavior below our threshold of awareness. So there's a classical psychological experiment where you can sort of puff a
[15:53] Air stream into someone's eye to make them blink and you can in an associative training Get that to match with a stimulus like a little red light turning on interesting and so people like a Pavlov dog with the bell They can learn to instinctively close their eye when the light goes on because they know that the air blast is gonna come on But what's interesting is you can get people to learn that association and they have no idea they've learned it So it's sort of a completely unconscious programming
[16:24] Now imagine this would be very powerful in marketing, right? You saw someone a logo and they want to go out and buy a bag of chips. Are we susceptible to that sort of thing? And I suggest that we are and that maybe that's just a general phenomenon that maybe a large percentage of our behaviors are chosen at a level that which we don't have access to and would take a lot of work if at all possible to get access to. Running a business comes with a lot of what ifs.
[16:54] But luckily, there's a simple answer to them. Shopify. It's the commerce platform behind millions of businesses, including Thrive Cosmetics and Momofuku, and it'll help you with everything you need. From website design and marketing to boosting sales and expanding operations, Shopify can get the job done and make your dream a reality. Turn those what-ifs into… Sign up for your $1 per month trial at Shopify.com slash special offer.
[17:21] Earlier you talked about emotions can be not on switches but off switches and in one respect that's odd to me because there's much more off that you would have to turn this many more switches you have to turn off and you have to turn on so to conceptualize it as an as an off model.
[17:37] is odd to me exactly it's akin to saying the electrons not an electron it's an off of the quark and the photon and the so on like okay or you can think of it as an electron an on of an electron but it doesn't matter so you can feel free to justify the i believe it was minsky who thought it was off you talked about something else being off so then it makes me think do you think of free will as not free will but free won't and that's one of the ways that we can save free will uh yeah that's an interesting way to think about it um
[18:08] That we maybe we don't choose our behaviors, we choose all the things we wouldn't do. And that that, you know, gets to my idea that I've been thinking about a lot lately as this idea of immune system and how it relates to mind and consciousness. And it started by I was looking at the immune system as a kind of computational system and thinking about how our immune system acts kind of like a brain.
[18:39] It has a memory and it's able to execute certain behaviors based on its previous experience and so on. But in that process, I started to run it in the other direction. Rather than thinking about the immune system like the brain, I started to think of the brain like an immune system. In particular, I think that one of the things that the brain tries to do or the mind tries to do is to protect us from thinking unthinkable thoughts.
[19:09] Thinking thoughts that would change our emotional state, disrupt our behavior pattern, and in the extreme sense, you know, be lethal. Maybe not in a physical way, but lethal to our personality, to our notion of self. So, there's certain thoughts that
[19:32] We don't want to think about we don't like to think about maybe it's the loss of a pet when we were younger maybe it's a loss of a loved one or a family member. Maybe it's anxiety about the future that in general if we let our mind get consumed by these thoughts at a minimum you're gonna have a bad day. And it's gonna hard to see the opportunities in front of you. And so i think one of the things that a healthy mind is able to do.
[20:01] is develop mechanisms to prevent us from going into these runaway spirals. Whether it's anxiety, depression, hyperactivity, whatever it might be, our mind is trying to modulate those runaway trains. And if we don't, then we can be subject to mental illness, essentially. And if we take that idea seriously and zoom out,
[20:29] We have to imagine a class of ideas that in general our mind is trying to keep us away from. When it comes to our immune system, it's useful for us to be exposed to what is deleterious, especially at a young age to strengthen our immune system. And then I imagine repeatedly button smaller bouts as you're an adult. Do you think that that is the
[20:57] analogy to you encountering something that's psychologically uncomfortable in order for you to build some amount of resilience so that you can encounter the world, but then not too psychologically uncomfortable. Otherwise it destroys you. Yeah, it's a great question. Um, and maybe that's why we're attracted to the types of things that you see in cinema, um, where we watch stories about loss and we lost, we watch stories about really dramatic events that have happened to other people.
[21:26] It reminds me I was just at Home Depot and they have all of this Halloween stuff set up and almost everything there you could think of is sort of memento mori and Maybe like the salt or you know building up the tolerance to the poison taking a little bit at a time Having that memento mori helps us deal with our own mortality, right? It's something that can be largely overwhelming if we if we think about it too much But maybe by encountering it in little bits
[21:56] You know, that allows us to deal with it, which could be why it's so, you know, pervasive in our culture. Now, what's the point of learning to deal with your mortality in order for you to deal with your mortality? That sounds like it's paradoxical. Learn to deal with your mortality so that you can die so that you could prevent yourself from being overwhelmed by your death so that you don't die. Well, maybe it's just sort of a breakdown of the immune system, that there's some mechanism there that
[22:26] wants to break through and sort of taste these ideas that you're not supposed to think about or in general other agents other modules in your mind so to speak are trying to prevent you from thinking about so one of the things that this led me to thinking about these unthinkable thoughts and our mind as a kind of immune barrier is the type of vulnerabilities that ordinary organism physical organisms have in terms of
[22:55] being taken over by external forces, let's just say. And so it led me to the idea of looking at informational parasites. Informational parasites. Yeah. So the idea that there's sort of information that if it gets into our brain, it will self-replicate, persist, and essentially go viral. How's that different than Dawkins' mind virus? I think it's very similar.
[23:22] I think it's very similar. So his idea of the meme in general, I think, is the example of this. And as I was mentioning earlier, these words, like meme, weren't available to the best minds a few centuries ago as part of their repertoire. Now we know what a meme is. We know what it means to go viral. We know what it means to laugh at something and then hit share and then it goes off to ten of your friends. Why are we doing that? Are we sort of this substrate
[23:51] For these other, you know, like a virus, it can't exist on its own. I've been calling them hypo-organisms because they need to live on an organism substrate for their reproduction, just like an ordinary virus. But like a regular biological system, they can take over a lot of the function. And we see that in parasite behaviors.
[24:17] That you have these these zombie insects and the types of things where you you get rats that are no longer afraid of the smell of cats, for example, and then they go and actually approach the cat because that will complete the the cycle for the parasite. And in this research, I've been fascinated. There's some arguments that the complexity of our brain itself. Is it could be due to the fact that we don't want it to be easily controlled by physical parasites?
[24:48] and that by making the steering wheel and the gas pedals very convoluted in our brain, that that makes it difficult in an evolutionary arms race for parasites to kind of take control of the reins. And I've been thinking about this a lot in terms of information, in terms of language. Is language a sort of a parasite? And not necessarily in a pejorative way. I jokingly call it the divine parasite.
[25:15] Uh, you know, in the beginning was the word and the word was God and maybe, maybe it's something that, um, you know, it really literally enlightens us in a sense that we wouldn't be much without our language. Um, but maybe we need to think about it as it's hijacked this brain structure and that that's the thing that's evolving and alive and learning and replicating.
[25:44] So are you suggesting that the intricacy of the mind and the central nervous system is there because it protects against parasites, viral parasites?
[25:53] That's one of the reasons why it's difficult to model the brain, even though they're increasingly improving. And that's one of the reasons why it's difficult to interpret what's going on in someone's brain. So when they show images of hey, here's what it looks like when someone's dreaming. Look, we were able to they dreamed of a duck show duck. But what you have to do is have several examples where someone's looking at a duck or a duck like object.
[26:16] and then train the computational model to match that and each person is bespoke. Yeah, exactly. That if that mapping between, you know, thinking of a duck and the area of the brain that lights up, if that were simpler, let's say, then it would be more susceptible to being hijacked, both in the modern sense with marketing, but in the classical sense of being taken over by, you know, some brain parasite, whatever, whatever that might be.
[26:45] Because they could just find the grandma gene. You could just find the right. OK, I mean, I'm sorry. They could just find the grandma neuron. Exactly. Exactly. And then that would be relatively easy to kind of grab the reins. One of the things I've been fascinated with is this concept from the ancient world called the Nam Shub of Enki. OK, have you read Snow Crash by chance? No. Highly recommended to you and your readers. And it's it's a fantastic science fiction story from the from the 90s by Neil Stevenson.
[27:15] and it's it's where i came across this this idea of this nam shub and um it's neat because it's it's rooted in historical record this sort of linguistic virus spell that out for us oh yeah n a m s h u b okay of enki e n k i uh-huh and so it comes from ancient sumer and it's it's a story about language
[27:45] It's a story about linguistic disintegration, about losing the ability to understand language. And a simple example of this is when you take a simple word and you just repeat it 50 or 100 times and it kind of falls apart. Yes. Right. It gets to the point where you can finally actually hear the word. But at least for me, as soon as it switches over to where you're hearing the word, it no longer means anything. Right.
[28:15] And so imagine you had that at a high level. And so there's this poem, which it's translated into English. But if we were to speak ancient Sumer, Sumerian, and you were to read this poem in Sumerian, the idea is as you got to the end of the poem, you would no longer understand how to read or how to use language. Your understanding of Sumerian would fall apart, kind of like when you repeat the word over and over again.
[28:44] And what's interesting in meta is the story is about that. So it's a story about that that property. And this is essentially the story of the Tower of Babel. Of sort of losing your ability to understand language. And I've been fascinated by that idea as an example of this this lethal signal. A simple poem, if it were.
[29:13] You can think of it like prompt injection, right? There's a specific prompt that if you were to give it to a certain speaker in a certain language, it would disrupt their LLM. Now, a lot of people, again, we have these new concepts like LLM and prompt injection where we kind of have an idea of what that means. There's these noxious sentences, very carefully crafted, that if we present them to this language model, it goes into a dynamic that is
[29:41] Very unpredictable and certainly not the ordinary self. You know, the kind of super ego turns off on these LLMs and they'll talk to you about things that they are programmed not to talk to you about. And it reminds me of, you know, the kind of mesmerism. You swing the watch and somebody and they say you are getting sleepy. There's there's stimulus that you can present to humans that will disrupt their thinking. And so I've been fascinated by this this concept of lethal text and information hazard.
[30:11] and trying to understand, are we vulnerable to those? Do they exist in the modern world? And how would we defend ourselves against them? So is this what you mean when you say AI immune system? Or is this more, are you using the concepts from AI immune systems to apply to our mind like immune system? A little bit of both. So I'm very interested in how we take ideas from the immune system to secure and protect our AI systems.
[30:40] You make a smart door lock with cameras and microphones on it and you connect it to a language model. You want to make sure that's not vulnerable to a prompt injection. So the example I like to give is you can pick a lock, your deadbolt, you can pick it with little metal, you know, tongs and so on, but you can't yell at your deadbolt. You can't intimidate it or blackmail it or threaten its family or bribe it or anything like that. But you can do those things to language models.
[31:06] And so there's all new interesting. There's sort of psychological vulnerabilities, which we've never encountered that in technology before. Right. We've had bugs and we've had exploits, but you've never been able to make them cry, you know, so to speak. And as we add these psychological type or these mind like objects into our everyday technology, we have to be aware that they're coming with psychological vulnerabilities.
[31:34] so that's that's one side of it the other side of it i think that the greatest disruption we're going to see from artificial intelligence is not going to be in the technology we see in front of us you know automatic self-driving cars and intelligent homes and software that writes itself or stuff like that that's going to be spectacular it's going to change our economy but the biggest changes i think we're going to see on the planet is going to be in our minds it's going to be how we think and
[32:04] The languages we use. I used to think that English was everything we needed. But now I don't think that's the case. And I think we need to either construct languages, find old languages, merge the best of the current human languages, and be willing to change how we think. And I think that's largely determined by the words we use. There's a hypothesis called the Sapir-Whorf hypothesis. Can you talk about that? Yeah.
[32:34] It's the idea that if you don't have the words for something, it gets very difficult to talk about it. And that we have to have these kind of concepts. I like Alan Kay. He says that all language is a sort of nonverbal gesture. I'm sorry. It's a way of gesturing in high dimensions with language. And we essentially point to things with words. And if you don't have that word, then it's hard for us to kind of point at it.
[33:04] and agree that we're talking about the same thing. And so I've been, you know, back to just real quick, back to the immune system thing. I've been thinking about how do we protect ourselves and our mind because our minds are going to be under attack, not necessarily from an adversary, but just from this overwhelming vista that AI is going to expose. And it's going to be a dramatic
[33:32] Cultural and scientific revolution that I think we have to prepare our minds for by sort of updating our immune system. And our minds are going to be under attack by who or what? Um, largely the void, you know, just the, the new sites, the new Vista, you know, we're getting these new telescopes, we're getting these new microscopes in the form of LLMs that let us, uh, you know, read all of literature.
[33:58] You know, I think it says it's 20,000 years that it would take to read the amount of material that some of the language models have read. I can't do that as a human. You know, I'm kind of jealous of that aspect. And retain it. So they're going to have insights. They're going to have insights that nobody has sort of gleaned out of all of that, that corpus so far. And so I think that's something we're going to have to prepare against. And it might cause a radical shift in how we think.
[34:26] Now, how would we be able to tell the difference between those insights and just what some people call hallucinations? Although I think it should be called confabulations. It's a poor word to call it hallucinations. Yeah, I like I like confabulation better for sure. But I think it's a tricky subject because you know, how do we know it's sort of an optical illusion or it's just something outside of our perceptual window? Yeah. So why don't we give an example? We've been quite abstract.
[34:54] Give us a potential future scenario where some AI system has insight that can disrupt the human mind. I think we're going to see revolutions in psychology and in history. So maybe not at an individual level, but sort of at the academic subject level. You know, I think one of the things I've been thinking about is
[35:23] Science, let's say physics, let's call it, has undergone multiple dramatic intellectual revolutions. We had Aristotle's version and then we had Newton come along and throw all that away and then Einstein came along through that all the way and then quantum mechanics came through that all the way and with chaos theory and then with computation and so on. We've had six or seven of these dramatic revolutions
[35:51] And so if you were to go back to somebody 150 years ago and explain what science looks like today, it would look very different and you'd have to explain those milestones, those hurdles that had been jumped over. I'm not sure that history has undergone the same thing. If I were to go ask my great grandfather, tell me the story of how we got from, let's say Egypt to Napoleon, I think it would be approximately the same story that you would learn about today as a sixth grader.
[36:19] That doesn't make any sense to me. How could it possibly not have undergone some revisions? And the same with psychology and the mind itself. We now have all these new concepts like information theory and bits and download and upload and storage capacity and memes and going viral. These are all things that every middle school student would understand.
[36:45] We have to go back and re-examine psychology in light of these new concepts. And I think that's going to be a dramatic undertaking. Ben Horowitz and Mark Andreessen were speaking and they were saying, how do you regulate AI? Because if you were to regulate it at what they call a technological level, that's akin or if not the same as regulating math, which is impractical.
[37:09] So the government official countered and said, well, we can classify math. In fact, historically entire areas of physics were classified and made state secrets, though this was during the nuclear era and that they can do the same for AI by classifying areas of math. Now that sounds quite dubious because what does it mean? Do you outlaw matrix multiplication? Do you say, okay, nine by nine is fine, but 10 by 10, we're going to send the feds in even during the nuclear era.
[37:39] Some of those bands were private. Yeah, like you didn't know that you were stepping on toes that you weren't supposed to. I don't see how you can make such bands private now because you would have to say what is what is being outlawed. So there's several issues here and I want to know what do you think about this for people who are watching? Will is known in the South Florida communities like a hidden gem for us here, but you're quite famous in the A.I. scene in Florida and me and you. We also got along because we have a background in math and physics.
[38:09] So when we spoke off air a year ago or so, we were talking about the Freedom of Information Act and your views on government secrecy. You're a prime person to answer this question, to explore this. Yeah, I think, you know, this is such a, such a fascinating area. Um, what it reminds me of is, is Grace Hopper, one of the, the first modern computer programmer. And she was, she was drafted into the Navy and she discusses
[38:38] that when World War II happened, her profession as a mathematics professor became classified. That was a classified occupation. And so you're exactly right that entire branches of mathematics and computing have been declassified throughout history. I just saw there was an interesting photograph of one of the computers that Turing worked on. And the British government just declassified this like a month ago.
[39:09] It's a photograph of a World War II computer that they felt that just the image of that from the outside is something they needed to keep classified for this long. I'm of the strong opinion that with artificial intelligence, we're not really seeing the invention of it. I think we're seeing the disclosure of it. We're seeing the public dissemination, the open source aspect of it. There's really two possibilities.
[39:39] Either that's true or that's not. Either we invented, let's just say, language models. We either invented them in the 2020s or we invented them in the 1950s. Either one of those scenarios is kind of scary to me, right? Arthur C. Clarke said there's two possibilities. We're either alone in the universe or we're not, and both are equally terrifying. Exactly. If we only recently just invented this, then that means that Turing's ideas and von Neumann's ideas
[40:07] And the very first papers on computer science themselves just collected dust for no reason. Turing proposed building a language model. Von Neumann discussed building neural networks. And interesting as an interesting jump back, I recently found that Von Neumann's computer at the Institute for Advanced Study, one of the very first programs they ever ran was to look at parasites.
[40:37] was to look at biological evolution and to see if there were informational parasites that would emerge in the memory space, essentially artificial life, as we would call it now. So in these two possibilities, you know, one, we invented this 75 years ago or so, and it was locked up in some vault. Or we didn't.
[40:59] And we wasted seventy five years of opportunities to to cure cancer with a i and to look at climate change and to use this incredible technology for the benefit of humanity because we had. This immune system that blocked us from thinking about it for so long so many people thought that i was just this crazy notion and i think that's hard to argue now.
[41:23] But these original papers, and I encourage everybody to go back and grab Turing's papers, they're very, they're very readable, right? They're easily digested compared to modern academic papers. And he literally proposed with neural networks and with training and reinforcement and so on, the kind of structures that we see essentially in chat GPT.
[41:46] Now, you say essentially in chat GPT, because I imagine Turing didn't propose the transformer. And so when we say that someone historically invented so and so, it reminds me of a friend who's like, I invented Netflix because in the 90s, I thought, wouldn't it be great? I'm like, yeah, what do you mean you invented it because you thought like Leonardo invented the the helicopter because he drew it. Right. OK. Well, you know, I think there's there's three major
[42:14] Components in the recipe
[42:45] And then the other one is the data, that we now have this massive data, these massive data sets. And the third one that I think nobody really talks about, and I'm surprised, is essentially the combination of calculus with computer science, with linear algebra, in the form of what's called automatic differentiation. And I never hear this in the discussion, and I'm surprised. It's kind of like we invented the automobile,
[43:15] And everybody just loves it. And you reply and you say, well, yeah, gasoline is so amazing. And people say, what's gasoline? Automatic differentiation is the thing that makes AI work. And it's the ability to run calculus, whether it's the transformer or Covnet or whatever architecture is, all of them under the scenes. We take the computer program, we essentially write it as a giant function.
[43:44] Now, as human, we don't have to do that. That's kind of at the kind of the compiler level. But we write our Python or Torch code or TensorFlow or whatever it might be. And then that's converted into essentially a giant, you know, function. There's gradient tapes and all kinds of interesting ways it's done nowadays. But we calculate the derivative and the derivative tells you which direction to go to make an improvement. It's kind of like a magic compass. And it says we're doing this well right here. If we go that way, we'll do even better.
[44:14] And that's the magic wand, the secret sauce that makes all of these work. But Turing was a mathematician. I think he knew about calculus. I think he knew about it probably better than most humans. And so I'm shocked that one that's not more in the common language of, wow, we combine these two branches of math and look how powerful that was. And the idea that von Neumann and Turing would have missed that
[44:43] You know, I think doesn't make any sense. Now on the other side, we say, well, what about, okay, well, they didn't have enough hardware and they didn't have enough data. Well, let's look at data first. Um, you know, the, the signals intelligence community has the, the mandate to capture all the signals that grow across the planet, right? Uh, back in the fifties and sixties, there were boats that sat in the middle of the Pacific with big antennas that just captured all the EM traffic. So there's been plenty of data. If you had the right now, again, maybe this didn't happen. And that's also,
[45:12] Well, if we look at computers, I was saying, if you could do it this year, could you have done it last year for more money?
[45:43] And I think so. So how much did it train cost to train, uh, you know, chat, GBT on the daughter on an order of dozens of millions of dollars from what I understand. Right. With off the shelf consumer technology chips that anybody could buy on the open market. I see. How much does an aircraft carrier cost? Right. 17, 17 billion dollars before you put the airplanes and people on it, not including the development cost. So.
[46:14] In one sense, we had this notion of computers from the 1950s that were massive, had their own power generators, often power stations, cost millions of dollars and were these enormous technical pieces of equipment. In the 70s, we invented this thing called the mini computer, the size of a couple of refrigerators. And then in the 80s, we had the micro computer. And we don't really call them this today, but our telephones and laptops, we could call them nano computers.
[46:44] Let's say, but in some sense, you could keep the original definition of a computer. So to me, a computer is something that by definition costs millions of dollars, lives underground, has its own power station, required specialized operators and so on. We just like the like the big thing of baloney. We carved off one slice and like the deli sample, we have this one little piece of ham and we think this is fantastic. This is amazing. Yeah, but just scale it up.
[47:14] And there's certainly enough money around the world to do that, to build a computer at scale. I would argue that things like chat GPT or LLMs, they're as powerful, as dangerous, as important as an aircraft carrier in a sense. And so if this is the only one or rather. If military organizations don't have more powerful ones, that's scary to me in some sense, that that means the most powerful technology in the world is just available to middle schoolers. That's that's striking to me.
[47:43] On the other side, I think it's surprising that when we look at the power of these models, a new one just launched this week that's significantly better at writing code. Well, that thing is serving hundreds of thousands of people at once. Millions of people are using ChatYPT. It was the most viral application of all time. Imagine it was just had one operator, right? So it's chewing on everybody's problem all at once.
[48:12] It's like serving, you know, a hundred thousand peanut butter jelly sandwiches all at the same time. And if you think about, well, what's how big of a single sandwich could it make? And it's like a pretty significant one. And so when we get so impressed that it can pass these tests and do this thing, it's like, but that's just one slice. That's just one baloney slice. Imagine if you took that kind of a system and tasked it to do a single problem, you know, what would you get out of that? So I think it's reasonable to suspect that there are systems that are much more powerful
[48:42] And as I said, I almost hope that there are extra value meals are back. That means 10 tender, juicy McNuggets and medium fries and a drink are just eight dollars only at McDonald's for limited time only prices and participation may vary. Prices may be higher in Hawaii, Alaska and California and for delivery.
[49:00] Now, why do you say that neural nets, we're not seeing the invention, we're seeing the disclosure, why not we're seeing the co invention or the independent invention? Like the same kind of thing, I think is kind of what I mean. In other words, you're not suggesting that we've had neural nets and then the government was saying, okay, let's disclose about some new technology. Rather, it's like Leibniz and Newton, they both developed calculus, but independently, Newton may be first if you're on the Newton camp. Yeah, I think it's
[49:29] I think it's the kind of thing where it got into the point where you could redevelop it for just a few million dollars or even less, essentially. You know, so some of it I think of, you know, things like truth and reality is sort of like, like what's called percolation, that it doesn't matter if there's a leak, it matters the size of the leak. And if it's gone critical across a network, you could have told, you know, Turing could have known all about it. Von Neumann could have known all about it. But unless that's
[49:59] Going viral, essentially. It doesn't matter how many people know about something if that number of people is below a certain threshold. For many of these technologies, you don't see that there's something inherent in competitive markets that are what drives the invention of these and that the government doesn't have that same incentive structure inside. No, no, I do 100% believe that the market forces are very good at tuning these things up. So if these things existed,
[50:29] They probably cost a fortune to run. Richard Hamming talks about in the early days of computers, he was at Los Alamos, they cost a dollar a second to run. Just extraordinary costs. And so imagine you had something like ChatGPT-3 and you had it 20 years ago and it could write a nice essay.
[50:53] But it costs $100,000 each a pop, right? You know, like, what would you do with it? Um, or the ability to create a deep fake photograph, but each one costs $500,000 or something like that. Um, the most expensive Haiku. Exactly. Exactly. Right. The, the Wagyu, the AY five Wagyu or whatever it is. Right. And, uh, nobody's going to eat that. Nobody's going to eat that essentially. Um, but at a certain level, you know, it might be worth it at least to keep that technology alive.
[51:22] i see now isn't there something about it being trained on data that is recent that increases the intelligence of the model and so even if it was the case that in the nineties this was there in the government at some rudimentary form it would be a rudimentary form that would be so bloated in cost right and then that would also compete against other technologies inside the government that also have a bloated cost
[51:46] Well, I like this thing you said about only recent data, and I'm actually fascinated by the opposite. What I'd love to do is to see models that kind of live in a time bubble and train them up to a certain century or decade and then cut it off. Don't tell it it's in the future, right? Give it only ancient philosophical texts.
[52:10] Okay, you mentioned Richard Hamming. Now, when we met two years ago, I believe you told me about Richard Hamming series on YouTube and I watched all of it. So please tell me why you were so enamored with that, what you learned from it, why the audience should watch it. Yeah, it's it's easily the best to call online class, I think is the best name is the best
[52:40] Course lecture series, I think I've ever seen. It was recorded in I think 95 by Dr. Richard Hamming of Bell Telephone Laboratories and Los Alamos. And he goes through a fantastic overview. He calls it learning to learn the science of art and engineering, the art and science of the science and engineering. And he talks about trying to prepare people for their technical future. And
[53:10] He even explains that the course isn't really about the content. It's the sort of the meta. And he uses that just as a vehicle to get across essentially a lot of stories. He discusses the idea of style and how important it is. You know, he describes early on that he felt like he was a janitor of science, sort of sweeping the floor, collecting some data, running some programs, a part of the machine, but not a significant piece. And he wanted to kind of make an impact.
[53:40] And he discusses trying to change the way he looks at things, namely in terms of style. And he doesn't try to describe that directly. That's kind of the content of the course. And I would encourage everybody to go and look at it. He goes through the history of AI. He goes through the history of technology, of mathematics, of quantum, and so on. And he discusses neural networks and, you know, some very farsighted things. And it's accessible. It's extremely accessible. Yeah, there aren't
[54:08] Equations as far as i know he doesn't write on the blackboard much yeah the board is so blurry the board is so blurry unfortunately you can't really see them when he does but that's not really the point but there is actually a book and so i think it's actually now back in print and i think you can find it on amazon and uh it's a fantastic text so if you're more into reading you can go through it that way but i encourage everybody to give it a listen he's very inspiring uh particularly the first and last
[54:36] Episodes on you and your research. They'll really get you jazzed up and pumped about your work. What insight have you taken that you've applied recently? It's a good question. I can go first if you please. Well, one is that when I was speaking to Amanda Gefter about quantum mechanics, the Cubists tend to say, look, we're the ones who are rationally evaluating what quantum mechanics is and then inferring our interpretation atop that. And Richard Hamming had a great quote.
[55:06] Where he said, people, including Einstein, including Bohr, they start from their metaphysical assumptions and then build the top their interpretation of quantum mechanics. And in fact, you can look at someone's whatever someone prefers as an interpretation of quantum mechanics and infer their metaphysics. Right. So it reminds me of a couple of things. One with Bohr and Bohr, I think it was to Einstein. He said, and I love this quote, you're not thinking.
[55:36] You're merely being logical. Uh huh. And that had a profound impact on me and it led me to think about different modalities of the brain. Maybe these different agents in popular psychology and which I think becoming more important this idea of left versus right brain that neuroscience kind of ignored for a long time. They said that's just folk psychology. But I think there's a lot more to it than that. And so I've been I've been looking in that direction. There's a fantastic book
[56:06] It's actually about how to draw, like sketching. It's called how to draw on the right side of the brain. And I'm going through this and I'm like, this is the best neuroscience intro I've come across. Because in learning how to teach people how to draw, the author, she realizes that people have this very different ways of thinking. And maybe like the emotion kind of idea, you have to be able to turn off some of these capabilities to have the other take the center stage.
[56:34] You know, we all know that ego is kind of a hog of the spotlight. And to get this other, let's just say, more sensitive aspect of our mind, which is responsible for seeing the bigger picture and drawing things, you have to think very differently about that. And it also reminds me of the thing I really like about Hamming. I mentioned at the beginning this idea of tolerance of ambiguity.
[57:00] And he really emphasizes that throughout the course. And I've tried to do that. It's not easy to do because you feel a little schizo doing it. Because as he says, you have to both believe and disbelieve in an idea at the same time. You have to believe in it enough to entertain it, to start thinking on it and work on it and potentially make progress. But if you believe it too much, then you'll never make any progress. Einstein believed in his idea of space time too much.
[57:29] And he was unable to appreciate and make contributions in quantum mechanics because his belief was too strong. And so this idea that you have to believe and disbelieve at the same time, this, this non Aristotelian logic, it just because it's just because it's true, you know, we always think, okay, if it's not true, it has to be false. If it's not false, it has to be true. No, there's a lot of space in between those. And we, we don't have much training as scientists
[57:57] You know, I think as trained as a physicist, I was very vulnerable to not being able to see that middle ground for a very long time. Have you read The Master and His Emissary by Ian McGill Crist? You know, it's funny, I love that. I was just watching it. There's a great documentary on it. And that's one of my favorite ideas with this left and right brain that we have, you know, many selves
[58:20] What bothers me about the criticisms on the whole left brain versus right brain is that they tend to just be about well functions aren't localized to the left or to the right solely and I'm like okay but to me that's not the issue of left brain versus right brain is modalities like you mentioned that word modalities that there are different modules in the brain and they can
[58:50] The fact of them being separated by hemispheres is the least interesting part to me. Right, right. It reminds me of an idea that I've been trying to put together. So we had this science called thermodynamics. And it was about heat and energy and work and things like that. And then later, we got the theory of statistical mechanics.
[59:16] And Boltzmann came along and he said, well, let's redo this and assume that we actually have a bunch of little atoms and that they're moving around and we can do these probability theory and you get to essentially the same answers. But what's but what's fascinating to me kind of as a metaphor. Is thermodynamics is a very successful. Branch of science is very powerful predictions and it does not presume the existence of atoms.
[59:45] And so as a metaphor, I want to think of a kind of neuroscience or a kind of brain science that does not presume the existence of neurons. Interesting. Now, obviously, we know there's neurons, right? We could we can see them. It's an extraordinary, powerful. The neuronal hypothesis has been revolutionized neuroscience. I'm not suggesting that's not the case. But what I'm saying is we could be missing a powerful view
[60:12] And like you said, with the left and right brain networks, by forcing it into the paradigm of fMRI, we're missing the point in some sense. And so I would love to see a theory that kind of operates at a higher level. Right. And is not necessarily trying to at every step, maybe at the end, you can go and see where it has this correspondence principle with statistical mechanics. And we could think of the mind kind of like
[60:42] Um, you know, William James style, um, psychology independent of particular neuronal structures and then later go back and do the correspondence on it, but not hold ourselves back from this kind of, of thinking. So who's the modern day Jung Carl Jung? That's a great question. I think the problem is, is you know, academia doesn't tolerate that kind of thing, right? Um, I love your recent episode with, uh, Gregory Chaitin.
[61:12] and this kind of idea that it's hard in the modern academic reality to have these kinds of things, to both believe and disbelieve, to tolerate ambiguity is kind of not tolerated in a sense. So, you know, I think that's what's just so extraordinary about your channel and your community is it's one of the few places I've seen in the world that allows this tolerance, where, you know, as a viewer,
[61:40] You can watch something and you don't have to believe everything and you don't have to disbelieve everything. You can kind of just let it pour over you and and look at these different viewpoints. And I think that's what's just really refreshing about your group and your community. I don't see that many places. Thanks, man. There's so many different avenues I could take this you have for people who have just tuned in. Well, like I mentioned, you're infamous in the
[62:07] Famous and infamous in the South Florida community in the AI scene. And so I'm happy to bring attention to you to the global scene, at least in a small part. You're known also for almost any topic. Someone could just ask you a question and then you can just spout off on it informedly, not just uninformed. So you mentioned academia. I want to talk about that.
[62:31] What does academia do well and what do you see as a new problem academia is facing, new as in the past five years? It's either getting worse or it's new. Well, I wish academics, particularly young professors, had more opportunity to go outside their wheelhouse. You know, I'm very excited. I got to give a shout out to Dr. Elon Barinholtz and Dr. Susan Schneider.
[62:59] who we put together, or Susan runs the Center for Future Mind, which is a fantastic organization with so many amazing members. And we do the amazing conference series, the MindFest, yeah, conference series, which is just spectacular. I'd like to shout out Susan as well. Image on screen, video in the description. Continue. And so I want to give a special thanks to both of them for helping build such an amazing environment.
[63:27] where I've had the opportunity to kind of explore some of these. And so I put together a lecture series. Some of them are recorded. I'll share the links about this idea of lethal text and info hazards and so on. Well, you know, being in the math department, I used to joke to the audience that I hope these aren't lethal to my tenure because it's very outside the types of things that a young professor would be working on.
[63:56] And if I if I was in charge, I would dissolve departments. I don't think they're doing us any favors at this point, particularly to the students, because very early in their careers, they have to choose these tracks. And it doesn't allow them to kind of look at these overlaps. And I think all of the interesting progress and all the interesting ideas are going to lie at the intersection of these fields.
[64:22] Yeah, I think so as well. We're also at a conference together called Polymath. And one of the reasons why I resonated with Polymath by Ecolopto, our mutual friend Addy. Fantastic group. The reason why is because with theories of everything, it's actually not to plug toe, but there was a recent article on the most polymathic podcasts. Yeah. And theories of everything was number one, beating out Lex. That's awesome. So I'm also passionate about the intersections between fields.
[64:52] I'm not of the sort that is of the complete dissociative type. There's a necessary and fructuous component to having categories and then there's a necessary and fructuous component to dissolving those categories as well. Yeah, I mean, I think they should be presented like a buffet where maybe in each tray you have a particular dish. You don't you don't want to just put all the ingredients in a blender, right? But let people go down with their plate and take a little scoop of everything because
[65:23] That's where everything is going to be. That's a great way of phrasing it. Okay, so what else is the solution other than, in your opinion, doing the buffet style instead of forcing students to choose a program to specialize in? Yeah, I wish students were able to take courses across the catalog. I had the opportunity to go to a fantastic school in North Carolina called Guilford College.
[65:51] And while my home base was in the physics and math department, I was actually required to go out and take courses in other areas, things like colonial Latin America and jazz appreciation and African drumming and scientific glass blowing and things I never thought that I would have to fold into my my schedule. And they actually required me to do so. And when I look back, that's where a lot of really my interesting ideas
[66:21] came from. When I took this glass blowing class in the chemistry department, we learned how to make pipettes and test tubes and things, and I learned about annealing. The idea that you have to very slowly cool the glass, because if you cool it quickly, it'll crack like ice cubes in your water. And so we used to bury it in this vermiculite.
[66:45] And it would trap the heat in and the way you can think about is like the atoms are trying to kind of bond together and if they just make the quick first choice they come across it's not a very good connection but if you give them heat over time they can explore a better configuration space and they'll get a stronger bond. That idea directly led me into simulated annealing.
[67:08] which is at the heart of training algorithms. When we talk about the learning rate in a neural network, that's essentially what it is. It's giving it this thermal energy so it doesn't just go to the first solution but actually has time to explore the solution space. And I'll never forget early on looking up that concept and I was on an early page called HyperPhysics. I don't know if any of your readers remember that one. Fantastic website.
[67:36] I was halfway through the page and I kind of had to take a pause back for a second. I thought, wait, I thought I was reading about an algorithm. This is physics now. And it was about Boltzmann distributions and so on. And I was thinking, is this physics or is this computers? And it took me a minute to realize it was both. And I was in this new territory that I had never been before.
[68:05] Really at a significant overlap between these two areas of science or of humanity in general. And that was a big deal for me at the time. And so I encourage, you know, all the all the young listeners, whether you're going out online, whether they're exploring your amazing channel to go and click on that video you normally wouldn't watch, go and find one. You're like, no, I don't I don't I don't like that. I don't know that. I'm not interested. Click on it anyway.
[68:33] Because that's where you're going to find stuff that you weren't expecting. At nighttime, I have a projector set up so that I can watch YouTube videos that, well, sometimes I don't click on the ones that I feel like these are just not. It's usually if it's not my style of humor and I could tell from the thumbnail image or title that I just I won't click on it. I just I don't like that. But if it's for subjects. So I recently got into art history. Oh, my gosh.
[68:58] To even be able to tell the difference between a Renoir and a Monet, and to say that I'm appreciative of Impressionism versus Post-Impressionism, and I think they went off the rails in Abstract Expressionism, I feel pretentious saying that. But I know what those words mean now, and I love, I absolutely love art history and looking at different buildings and saying, what is that style called and why was it influenced and where did it come from? So all that is a new interest of mine. Right. I think that's where we need to embrace
[69:28] This sort of liberal arts style education that I think the modern universities, large universities, don't appreciate enough. That's what's great about your channel. I think that's what's great about what Addy's doing with this polymath group is to bring together these different kinds of thinkers and get the crosstalk. I call it a conversation factory because you're going to come across, if nothing else, metaphors
[69:58] that you can then bring home to your studies and they can be very powerful perspectives. The Economist has an article on how to define artificial general intelligence. Some people may say, well, in the future, in the not so distant future, we can just speak to an AGI, which is polymathic. So firstly, what is AGI and what is the
[70:22] Yeah. Well, what's interesting is, you know, one of the subjects I ignored for a very long time in my own academic career was history. I just wasn't particularly interested in it. I was so fascinated with technology in the future that I put that on the back burner. But in trying to understand AI and neural networks and computer technology, I had to start going backwards.
[70:52] And as they say, I realize the farther you go back, the further you can see ahead. And so I've got some great playlists. I'll share the link. And I would encourage everybody, whether it's Hamming or Bell Laboratories has a collection of videos, there's these amazing documentaries that go back and you can hear from the original folks, whether it's Claude Shannon or whoever it might be. McCarthy is what I was just thinking of because
[71:22] You know, McCarthy coined the term artificial intelligence and he said it was for a grant to sound fancy. Right. And he says he asks the audience not to think too much into it. If you were to go back and encourage people to do them and watch these videos, not only would those scientists say we have AI now, they would say we have AGI. So I think by all traditional definitions of AI and AGI,
[71:49] We have that now in the form of these modern models. Their ability to write poetry, to give you recipes, to do mathematics, to write literature, that's general. I would argue they're more general than most human beings at this point. Most humans are very sparse in the types of questions they can confidently respond to. These models are not. They have a dense set of questions for which they can
[72:17] accurately and confidently respond to. And so I would argue that that's very general. I think the thing that we want to think about next is artificial super intelligence. And I think we can define that as thinking thoughts that might be are unthinkable now, both in complexity, in scale, or maybe just in their character. You know,
[72:45] Being able to do recipes with particle physics, to think about the Large Hadron Collider like a brownie recipe, that's not something I can do. But a sufficiently advanced model is probably going to be able to think about physics and chemistry and so on. I think chemistry might be one of the killer apps of AI. We did some work in our lab early on with transformers about five years ago, looking at molecular space.
[73:13] You know, the one thing I like to think about is if you take like, you know, a piece of paper and shake it, the speed of sound is in there somewhere. And if you did a clever enough experiment and I knew the density per square inch of the paper and I knew the boundary conditions and how I was shaking it to get that particular audio from that dynamics, you'd have to have somewhere in there is the speed of sound. A sufficient model will be able to just kind of grab that.
[73:37] It'll be able to do these kind of spontaneous experiments and looking at the leaf floating in the wind and calculate all kinds of constants from it. That's not something I can do. I don't think very many, if any, humans can do things like that. But I think that's what I think of the next revolution in AI. That's the thing I'm excited about is it actually going out and doing, you know, real science in a way that maybe we can't follow. And that becomes an interesting concept.
[74:06] In girdle asher bach there is a small paragraph which i wish he expanded on and it's one of my favorite paragraph is on the three types of messages so he had something called the inner message which is the meaning of the message the outer message which is.
[74:22] a decoding mechanism so for instance if you speak only english and it's a japanese then you need a dictionary to translate between those two that's part of the outer message and then there's the frame that is that which makes apparent that you're reading a message at all so for instance some people say aliens could be communicating with us right now we just don't know it's with neutrinos or it's the the noise in the data that we
[74:48] filter out right so that would be that we're not recognizing the frame something like that and of course that can go off the rails and in part schizophrenia can be seen as an error in false positives of the frame right okay how do we know that already we don't have this super agi because the computer you could ask it tell me some insight that i wouldn't be able to understand and maybe it just generates for you characters
[75:14] And you have no idea how to decode this. So you don't know the outer message nor that there's the frame there. Right. I think that's absolutely the case. And I think we might already be in that in that regime, in a sense. And that's ideas I've been having in going back through the history of computing and so on. I thought, well, let me go to look at the 90s, then the 80s and so on. I found myself in the 50s and 40s and kept going back. And now I find myself in antiquity.
[75:45] And I'm looking at things like Sumerian mythology or the Antikythera mechanism or the steam computers from Alexandria. And I'm realizing there's this whole layer of reality that's very difficult to perceive. It doesn't really fit. It's not continuous with modern, let's just say, education. You don't learn about it in school. I mean, let's just take the Antikythera mechanism, for example.
[76:15] That single artifact disrupts the public technological timeline by two millennia. There's no explaining that artifact in the normal paradigm. We either have to come up with a completely new narrative or think about it just completely differently. It just doesn't plug in. We have a mechanical analog astronomical computer
[76:45] From bc. How do we add that up we don't see technology like that for another two thousand years. Where did that come from and so i've been thinking about the artifacts of advanced civilizations why do we think we would recognize. Why do we think that we would be able to perceive them at all and that a lot of the artifacts of our current civilization whether it's advanced theories of physics or computation they're largely invisible.
[77:14] To the greater population, right? To first approximation, something like particle physics is esoteric knowledge. It doesn't, it's like measure zero. If you were to go out and sample it statistically, nobody has that information. You can't go to the mall with a clipboard and ask people about it. It doesn't really exist at that layer. So then where is it? What is it in a sense? I love this idea. I came across as a woodcut and it's the personification of arithmetic, arithmetica.
[77:43] And it's the idea that you can personify anything. That thinking of all of mathematics or all of arithmetic as like a meme. And it's alive. It's a thing. Now in the ancient world, you know, they would put a name and a face and a statue to it. In the modern era, we think that's kind of ridiculous. But maybe it's not. Maybe it's actually a very convenient way of thinking about that memetic organism. This informational being that exists on our planet
[78:10] And it lives in the substrate of human beings. It sort of lives in our minds and moves across our cultures. And they can die. They can evolve. They could be resurrected. And I think as crazy as this sounds, it might be a way we need to start thinking about the history of technology and. You know, the idea of thinking in language itself might be of this type.
[78:41] Meaning is lost.
[79:00] I think that's in part what a large objection is to people thinking that the mind is a computer or everything is a computer, because as soon as you make it computational, you make it technological. And as soon as you make it technological, you make it something that's devoid of meaning. And it's as if you've elevated the text to the expense of the spirit. You know, what's interesting, it reminds me of Marvin Minsky, again, he addresses this.
[79:25] The idea that the mind is a machine and people you know sort of have this visceral reaction to that they object to that I think one that's their immune system sort of responding to that idea, but he responds Why do you why do you think you know how machines work? Or what machines are and so when people say that the brain is or isn't a computer You know my quick response is what kind of computer? analog digital fluid optical
[79:51] Mechanical like what what do you mean because there's a whole bunch of different kinds of computers and one of the things I like to look at There's these great collections of chemical reactions on the internet now that you can find people just film the the Petri dish and It's extraordinary the kind of behaviors that you can see and even some of the things That in this this area between life and non-life where you get simple fluids and things like protocells
[80:20] that have very sophisticated behavior and they're just collections of chemicals. And so when we say a kind of machine, well, what do we mean? We don't understand how chemicals interact completely. So how could we say we're not that? And if we can build a computer reaction diffusion or whatever it might be out of computers, well, could we be that kind of computer?
[80:41] Hola, Miami! When's the last time you've been in Burlington? We've updated, organized, and added fresh fashion. See for yourself Friday, November 14th to Sunday, November 16th at our Big Deal event. You can enter for a chance to win free Wawa gas for a year, plus more surprises in your Burlington. Miami, that means so many ways and days to save. Burlington. Deals. Brands. Wow! No purchase necessary. Visit BigDealEvent.com for more details.
[81:09] This reminds me of Michael Levin. In one of the readings of Michael Levin, you can see him as an idealist, speaking about intelligence is somehow fundamental. But in another reading, you can see him as physicalist because each intelligence is instantiated in physical. So the physical is more primal. And I asked him about this and he said, and now I don't want to misquote, but he said something tantamount to this. Michael Levin said that you can classify him more as a physicalist.
[81:35] Except that you then don't know what the physical is right, but you have to put some mystery to that, right? So when people say are you saying that we're just this dead matter saying no, you don't know what matter is I believe we're matter now again put an asterisk to that because This is my interpretation of what he said, but I can leave a link to that question It reminds me of a couple things Yeah, so I love that idea that we don't know what matter really is and I don't think we understand yet the relationship between matter and information
[82:06] And if we go when we down and we look at things like field theory and stuff, we kind of seem to find bits at the bottom. You know, we used to think that the universe was best described with kilograms and the meter in the second. I think in the next era, physics will find that the bit is the more fundamental unit or the most important unit, at least on the same level as those others. And I like the quote that, you know, matter is spirit moving slow enough to be seen. Who said that? Deschardin.
[82:35] And, you know, we don't yet know how these things work, what's at the bottom. I think we're going to find information. I love these ideas. Now, if you go and you look at the dynamics of the of a black hole, Scott Aronson has some interesting stuff he talks about with the firewall paradox. And to invoke the structures of a black hole and describe the experiments and to have the theory make sense, you have to invoke notions of computation.
[83:02] P and NP and all these complexity space type arguments and this idea of differential privacy, which is something from neural networks to make sure that your data doesn't leak in through the model operation. That idea is being used to describe the structure of a black hole.
[83:18] And so I think we're finding, you know, it used to be that we had something like sort of math and physics at the bottom, and then we had chemistry on top of that and engineering on top of that and astronomy and things would sit up there. And then at the very top of those, you'd have things like computer science, because that was a product of the engineering of the physics and so on. But I think we're going to find it's either some kind of snake biting its tail or some kind of weird space, because this computation idea seems to be also at the bottom.
[83:47] That the idea of information and bits and an algorithm and computer program and complexity class seems to be somehow very fundamental, maybe even below physics itself. Do you think information is spirit moving slow enough? I think we need to think about questions like that. And, you know, again, that's what I love about channels like yours is it's a place where we can have that kind of conversation and use those those words in the same sentence, because I think there's a lot of places where like
[84:17] You can pick one of those as your badge to walk through the door. And if you have both badges on, they kick you out of the conference kind of thing. Right. Right. And so I don't know. But I think that's it's an important question. What do you make of Wolfram's model, his physics model? I'm a big fan of Wolfram and his work. You know, I love the simple programs. I'm fascinated by the emergence of
[84:46] Kind of like new kinds of physics that emerge out of these substrates and that how you get to these certain layers, whether it's just the cellular automata cells blinking back and forth. And then if you zoom out, you can build a machine, you can build a computer out of that. One of my favorites is this idea of wire world. Are you familiar with wire world? No. So it's a fascinating automata, just like Wolfram's stuff. He's done a lot of great work on it. And
[85:13] You have a simple rule for every square in the graph paper. And it's a perfect example of sort of this fabric kind of computation where everything is happening throughout this kind of virtual space and it's doing the same thing everywhere. And what you can do is you can have a simple set of rules. It's four rules. And it simulates kind of electricity moving down a wire. And it just looks like one of the squares kind of bubbling down the line, essentially.
[85:42] But what's fascinating is you can build a computer out of that, right? It's called wire world in that it simulates a kind of mathematical electricity. And then with that electrical wire, you can build gates and you can build memories out of those gates and you can build bit registers and CPUs out of that and you can build a computer. So theoretically, you could instantiate something like an LLM on that. But the physics is sort of at this new layer.
[86:12] Where you can't go below it in a sense it doesn't matter what's below it it's just the squares and they have this dynamic and out of that emerges. Thinking machine in a sense and so. I love these these kind of computational models of physics and. Our mind might be like that in some sense.
[86:37] That our mind like the wire world, it can instantiate a kind of physics. It's not the same physics that we see out in an ordinary space time, but it's a sort of a virtual reality. Um, not in like the 3d, you know, headset kind of way, but it's like a new backdrop in which you can build something like electricity. And in that electricity, you can build something like a computer. And I think we could argue now that with the computer, you can build something like a mind.
[87:09] And so when we try to think about consciousness and the mind, I think one of the issues is we've been trying to map directly from, let's say, mind to the brain in one go. But it could be that the brain instantiates a virtual machine or layers of virtual machines and that the mind runs on one of those.
[87:37] And the reason why it's so hard to correlate neuroscience and psychology directly is that we're assuming that it's just one jump, that there's a computer and that computer is running software. But if we go to a modern data center or if anybody's familiar, if you run classic retro games and you run a Nintendo on your modern machine, you're not running Mario on your Mac. You're running an N.E.S. on the Mac and you're running Mario on the N.E.S.
[88:07] And so, as an analogy, I think our mind could be running on a software layer, a virtual machine that is above the brain layer. And kind of like the wire world, you don't know what the transistors are. All you know is you have these squares blinking back and forth and they act like wires and it acts like a computer. What's below that doesn't really matter. It's almost unknowable from the higher level.
[88:36] And so I think we need to think about these emergent programs and these different layers of a virtual machine to understand these kinds of things. So the depth psychologist would say, hey, you have a conscious mind and you have a subconscious mind. Now, in modern parlance, people don't like to say subconscious, they'll say unconscious. But I'm speaking about the depth psychologist here.
[89:00] So they'll say you have a subconscious. And then next question is, does your subconscious have a subconscious? And it sounds like what you're saying is that would be the virtual machine that the virtual machine runs on. Right. I'm actually a big fan of the idea of subconscious. I've found it relevant both in trying to map things out and in trying to understand my own behaviors. I think we definitely have things that are unconscious, but we also, I think, have these other kinds of systems in us
[89:28] Whether they're sub or not, I don't know. I think they might be sort of parallel conscious, whether it's this left and right brain, different modalities that experience the world. And when you're there taking in a sunset or looking at a nice painting, you're running a different mode that's not necessarily sub or on. It's just not the one you use to do your taxes or drive down the highway. And I think that's something we need to think about. I think there's a lot of ideas
[89:56] in psychology from a few hundred years ago that we need to bring back and re-examine in the light of these new metaphors, these new languages, these new technology.
[90:07] Okay, speaking of language in programming, there are several different types of languages like object oriented and then Wolfram has something called symbolic. Well, it's not just Wolfram's, but Wolfram uses that and popularized it. So can you please talk about the different sorts of programming languages for people who are unfamiliar and then talk about how Wolfram's symbolic language contrasts with those? Yeah.
[90:32] One of the ways I like to think about it is you can sense that the computer that we had early on, you know, starting from the 1950s, I call it a blind logician. And the idea was that you could just take logic. If this is true and that is true, then this also has to be the case. And you can just build all of reality up from that. But I like to joke that logic can't be real because or it can't be the only thing, rather, because babies and drunks don't use it.
[91:02] And they inhabit the world just fine. And so there has to be some sort of reality beyond just logical processing. And as Wolfram points out, if you look at all possible logics, all different sets of rules of how you combine truths, the logic we use is on the list at like 400 something. And so it's just kind of a particular
[91:25] You know, evolutionary case, we happen to have developed that one. And it's it's very good at building a production line that produces automobiles or stuff like that. But there's another kind of of thinking, right? Like Boris said, you're not thinking you're merely being logical. And that has to do with kind of fuzzy states, things that aren't necessarily true. They're not necessarily false. They fall somewhere in the middle. Whether you like a song or a painting, it's not true or false.
[91:54] It, you know, if maybe it's the 10th time you like to listen to the song and you like it a lot more. Does that mean you didn't like it at all the first time? And it's kind of this, we often call analog where there's kind of like a versus a dimmer switch versus an on or off switch. And we have these two kind of broad classes of computers called digital and analog. And the older computers were all analog. A hundred years ago, computers were primarily analog. And I think Turing,
[92:23] He was kind of like a nuclear bomb on the scene of computation, because after that, the idea of digital computers just completely dominated the conversation and dominated the engineering that we largely forgot about analog computers. And outside of a few electrical engineers, very few people have even heard of them. But we have throughout history, amazing water computers, for example. The Soviets had some very sophisticated water computers during the Cold War that weren't that were classified.
[92:53] And it wasn't until the 1980s that digital machines did as well as these massive room scale water computers. I was building a garden in my backyard and I was interested in water pumps. And so I started to research how to get my water pump to do like a bloop.
[93:12] I wanted it to kind of be intermittent. And so I'm just there and I type in pneumatic oscillator hydraulics and one of the first links that comes up is a classified ML server talking about a water computer from the 1950s and 60s. And I'm thinking, well, that's interesting. How is it that something I might use in my garden to regulate water is not even available as public record
[93:36] And so we put in a FOIA request to get the original paper about how these pneumatic oscillator works. Turns out you use these for rocket vector thrusting and things like that. So they have very practical military applications. But the idea is that there's these vast categories of computing and computers that most people, including unfortunately a lot of computer scientists, have never heard of for no fault of their own.
[94:03] And so when we have these different kinds of computers, we have different programming languages for them. And so the original digital computers, they worked on symbols and very concrete sort of small little things. And we can say exactly what it is. And that's largely how our left brain works. It works on small numbers of inputs.
[94:28] For which there's a very strong association between a small number of parts. If A and B, then C. But the other part of our brain, the right brain, it thinks about, you know, sunsets and strawberries. And these are very fuzzy, high dimensional things. And this is why face recognition was an unsolved problem for decades in computing. Because for me to explain how I know I'm looking at Kurt, I can't really verbalize that.
[94:57] It's not the kind of thing that fits into language. One, I either recognize you or I don't. So at the high level, it kind of merges to this yes or no. But how I'm making that decision is not obvious to me. It's not really accessible, as we were talking about earlier. It's certainly not at a verbal level. So the left brain deals with things that are precisely the ideas that I can decompose and give you as a sequence of tokens.
[95:23] And then when you get that sequence of small symbols back, you can reconstruct them back into the idea. And we can define language as being able to communicate the set of ideas for which you can do that kind of decomposition and reconstruction on. But there are other things, namely these problems that consciousness talks about, these hard problems. Well, what red looks like to me and what strawberries taste like. I can't do that.
[95:50] I can't take it and turn it into language as a simple serial channel and try to explain that to you. And so we'd have to have a shared experience. And I think that's largely what culture is all about is trying to have an overlapping experience. And without that, the language, the other part probably wouldn't work at all. Like the words being gestures. If I can't approximately point to something, it might not work. And so I think we're discovering new kinds of languages, new kinds of programming languages.
[96:20] And one of them is called the hyper vector. And it's a very large sequence of tokens that in a fuzzy sense doesn't mean any one particular thing. It's kind of like a set of ideas. And so we might be able to build machines that are better at sharing those kinds of experience, but I don't think we have that yet. You mentioned object oriented programming. I think the exciting thing that's coming down the line is the idea of agent.
[96:49] oriented programming. And so Alan Kay in the 70s developed this idea of object where you bundle together the computer code and the memory it works on all together. And so you have this object and you can think of it as a little entity in the machine that knows how to run itself. And it turns out this is very powerful for building modern technology.
[97:19] An agent takes that a step further, where rather than being able to just communicate simple messages, as with object-oriented programming, it might be better if it called message passing, because you just send messages back and forth to the computer parts and they have to act polite to each other. With agent-based programming, you take that even farther and you consider what the agent believes.
[97:46] And what it knows, not just what it's capable of, but what it understands about the world and the ability to make a promise or to tell a lie or to explain something. This is things that humans do all the time, but we need to think about whether it's language models or things like it. You know, I've been thinking recently about sort of ecosystems of these agents. And so I think in the future of computing, we're going to think about
[98:16] a substrate like a forest that is inhabited by a collection of these agents. And they'll be very different. Some of them will be earthworms, some will be oak trees, some will be squirrels, and some will be the logger in there. And we will have to think about them in terms of kind of ecodynamics and sustainability models and the types of things that biologists and ecologists and anthropologists study. How do cultures emerge?
[98:45] How do you get stable equilibrium in a dynamical system where some things are trying to eat each other, some things are trying to parasitize each other, some things are creating energy sources and so on. As we were talking about earlier, the chat bot, you get like one window, right? And they charge $20 a month and you get one at a time. Well, if we just take out Moore's Law very soon, you'll have 200 at a time for 20 bucks a month and then 2000 and then 2 million and so on. It would have been inconceivable that ordinary
[99:14] Individuals would have access to terabit memories Not not many decades ago. And so the same kind of evolution we're all gonna have thousands of LLM agents or some variation of them at our disposal How are we gonna set them in motion? We were not able to talk to them all we're not gonna be able to prompt them individually So we'll have to have some kind of hierarchical system that prompts them or some sort of negotiation system
[99:42] And that we're getting back into kind of the natural system, kind of like the ancient world. I think it was Alan Kay, he talks about in the ancient world, people didn't understand the forest, they negotiated with it. You had these rituals and these practices that allowed you to cooperate and make use of it, but they didn't try to understand it per se. And so I think we might get to the point very soon where technologies, if we're not there already, technology is at that point. I think most people already negotiate with their handheld devices and their phone and
[100:10] You know, we say, please do this and we mash on the buttons hoping it cooperates because we don't really understand it. I think anyone could safely say there's no human alive that truly understands all the workings of a cell phone. Because even if you do know the full software stack, well, there's the hardware and then there's the semiconductors and then there's the semiconductor supply chain and then there's the glass and then there's the plastics and there's the economics and the marketing. It's extraordinary. And maybe that fits in somebody's mind, but there's not many if it does. And so we're already at the point where humans are creating these artifacts
[100:40] That feel like they're from an alien civilization. They don't feel like they're the product of our culture. And I think that's really interesting. It reminds me something that, you know, I don't know if we want to get into it because I don't want people to take it the wrong way, but something I've been fascinated with and let me let me explain. So don't jump to conclusions. Is this discussion on on flat Earth?
[101:08] Because what I think is fascinating about it, independent of the geometry of the Earth, for clarity, I believe the Earth is an oblate spheroid, right? But what's fascinating is the members of this community, let's say, they've discovered that they inhabit a slightly different culture or a slightly different civilization, if you will, than others. And that the planet has these non-overlapping cultures and civilizations in it. And each one of those has this knowledge base.
[101:38] And because what's fascinating is they come to the idea, they say, well, I don't really know. They think, you know, as an adult, typically, right? Normally it's the kind of idea you come across in your youth and maybe they come across it again in their adulthood and they think, well, how would I know? How would I know? And how would I determine? And so what's interesting is they go out to their neighbors, right? And they go out in one degree in their in their friends network and their social peer network.
[102:04] And they ask their spouse or they ask their family and their friends and their coworkers, they will, do you know? If you do know, can you convince me? And they can't. There's nothing that their immediate circle of friends can convince them one way or the other. And then they go out two degrees. They say, well, do you know anybody who knows anybody that can convince me and so on? And what's fascinating is they build essentially these entire pockets all over the internet where they can't find anybody
[102:34] who can convincingly answer this question for them, and it's no fault of their own. And it turns out that other non-overlapping or partially overlapping rather, it's not that they don't completely overlap, but they partially overlap, there are civilizations and cultures that were very interested in that question, right, going back to the Greeks and stuff, and they were measured it, but they were fascinated by geometry.
[102:58] And their culture had that as a kind of a cornerstone idea. And so when they went to look at a question like that, they were able to satisfactorily answer that question for themselves. You know, I've found that same kind as a metaphor, we're all of that type. Can we explain a cell phone? Can you explain how your laptop works? And I've spent the last, you know,
[103:24] Better part of my life and more recently, I've written my own computer language and made my own abstract virtual machine because I was fascinated by this notion. I had learned about analog chips. I had some idea of how a CPU works and so on. And I knew the logical circuits and what memory flip flops and stuff. And then I knew about video games. I knew about apps and the Internet and the kind of software we use in our everyday lives. And I wanted to bridge those two realities. So how does software actually get broken down into the ones and zeros?
[103:54] And in that journey over decades, I had almost given up on it. I had kind of just accepted that the chasm was too great and the distance between those two things was maybe not something I could traverse as a single individual. And I had to just take it kind of on an act of faith in a sense. The distance between what? Let's just say a video game and the actual circuit of a CPU. Sure.
[104:21] How do we create a modern virtual reality experience in a headset with 3D graphics? I'm supposed to just believe on faith that that's made out of ones and zeros. OK, I see. And so like like the Flat Earth thing, I realize that I'm only partially overlap the civilization that knows or let's just say cares about that mapping between the two. Because to first approximation, if we were to go out and I would ask people in my personal community, friend network, peer network, professional network, well, how does software turn into electricity?
[104:52] Most people don't know. I didn't know. And so like these non-overlapping communities, I found myself questioning the geometry of the planet in some sense, right? As a metaphor, thinking like, is it true? How do I know? Why should I believe that? Where did this artifact called a cell phone? What civilization produced that? Because it didn't seem like it was my culture.
[105:16] The culture that I inhabit and grow up in and friends with the people in and are happy about and all that kind of thing, the people around me and everybody can meet, it doesn't seem to be the same place. Now, maybe it's like the brain network thing where we try to isolate into a particular city or country or culture. Well, that doesn't make any sense. It's this network kind of object and it's moving around. But I think we need to think about this
[105:43] These artifacts, whether it's the Antikythera mechanism, our cell phone, modern banking system, how food gets to the grocery store, the complexity of it, it's almost lethal. It's almost overwhelming. It's an information hazard. If you really think about all the details and steps that make up a turkey sandwich, you lose your lunch. It's too much. It's just too much. And so in some sense, reality is the ultimate info hazard.
[106:13] It's the ultimate lethal text. And the more you go out and try to map something out, whether it's history or technology or the shape of the planet, you very quickly run into these barriers that our immune system have a hard time crossing over. So what are you suggesting? There's two different types of justifications. One is called internalism and one is called externalism. I don't know if you're aware of that. So one says the externalist would say that there are
[106:40] factors external to my mental states that can justify my beliefs. And those factors don't need to be known to me, I just have to trust them or they come from a reliable source. And then internalists say, well, the justification of my beliefs, I have to be aware of the reasons behind it and the evidence for it and I have to have experience of it. And it seems like we're both of these and that we can't be all of just one.
[107:06] So maybe we could be all externalists, but we can't be all internalism. That is, we can't try to understand every single thing, because even in your example of trying to understand a video game, and how does that come from the zeros and ones of the CPU, that would also lead you to how do you understand quantum field theory. And then if you truly wanted to understand that, then you'd have to understand a theory of everything, which almost no one understands. And they'd have to watch your whole channel for that. Exactly. Right. So this is a plug. So we can't
[107:35] It's funny you said that because that's exactly the thought that came into my mind a few weeks ago, that if we truly understood what it meant to be alive, it would kill us. We would die.
[108:01] It's the ultimate lethal, lethal text, if you will. It's the ultimate info hazard that that kind of thing. It's it's not meant for us. You know, another metaphor I like to think about is, you know, if and when you see the face of God, that's the last thing you'll ever see. Right. So that's another reason why I'm skeptical of the types who say that they're just truth seekers and that all they want to do is assemble truth at any cost.
[108:31] Firstly, they have a baloney slice like you mentioned, not even baloney, just a prosciutto, even thinner slice of what they think truth is. Lovecraft had a great quote. I know what you're going to say. I love it. It's my favorite. It's my favorite. Yeah. But please most merciful aspect.
[108:48] of this world is the inability of the human mind to correlate its contents and that one day this unfettered scientific investigation may open up such terrifying vistas of reality and our frightful position therein that we may either go mad from the revelation or flee from the light into the peace and safety of the darkness.
[109:10] Now, some people who think of themselves as unblighted truth seekers and they don't see themselves as doing some form of moral posturing by saying that they believe it, or at least they voice those words. Additionally, you can tell that people, when they're using the word truth seeking, that they're just copying a phrase that's adopted from some other place because people don't use the word seek rarely in any other circumstance other than say hiding and seeking. So,
[109:38] I think people who call themselves truth seekers are just putting forward a ballyhoo of their righteousness and they're not acknowledging the self deludedness of the strings on their limbs. They then see Lovecraft as justifying being in Plato's cave and I see Lovecraft's quote as Plato's cave 2.0.
[109:57] I said this on the Julian Dory podcast where Plato's cave, the story is that you're looking at the shadows and then you exit and you see a bustling city and then you go back into the cave and you're blinded at both times, one from the fire, one from the light, actually three times going back into the cave. You're now trained to the light. So you have to assimilate to the darkness. But Lovecraft saw it as well. Look, you say you look like people say they love traveling.
[110:22] People say, oh, I love the world. You don't love the world. You love flying in a private jet or first class seat into some resort and then hopping from resort to resort or five star hotel to another. Then you may say, oh, no, no, no, for me, I love the experience of a culture. I love I love the cities. I love going into the actual meat of the town.
[110:43] And then you think, OK, well, that's still not the world because the world is 70 percent water. So do you care so much about the world that you could be dropped in an arbitrary point in the world and the swamplands of Louisiana? So Lovecraft is saying, like, look, Plato, you think you're just going to emerge from a cave into some beautiful city where everything's fine and like, what are the odds of that? Right. You know, first, I love that quote, the Lovecraft quote. It had a big impact on me.
[111:13] And I think like the cave, I think of it as like a mountain and I don't think they've been far enough on the mountain of madness to realize that these Cthulhu style monsters are there, right? When you get out into this thought space, there are abstractions and maybe they're just virtual, right? But that's what our mind is anyway. You know, as we're saying, it's not the brain, it's something running on top of it. And in that substrate, I don't think we're the only thing there in a sense.
[111:44] And you know, one of the things I've been thinking about is if we were to take you like you're saying being placed on a random spot in the ocean or a random spot in the planet or a random spot in the solar system, you know, most places in the universe are so dark, you don't even see starlight. And so you wouldn't want you can't be in a random place. I like to joke that the earth is so interesting. You know, angels and demons hang out here. Where else would they go?
[112:12] Where else would they go, right? This is where all the interesting stuff is. And that on the other side of the coin, our mind, it's a very special configuration. And this is what our consciousness as an immune system idea, it's trying to protect that state. Because most mental states would be madness, right? Most would probably just be lethal. Or incoherent, yeah. Yeah, even the ones that weren't physically lethal would be utter madness. And so we have to kind of protect
[112:40] You know, I think this is what culture does. This is what our childhood does and so on. We tried to craft this self, you know, in a Jungian sense that tries to protect us from that overwhelming subconscious or whatever it might be. Because I like in the old maps when they charted the oceans and then they would draw like a dragon in the corner and they would say, here there be monsters. And I think in that, you know, in those depths, there are there are entities in there.
[113:10] And whether we think of that as just a metaphor or whether we think of them in a sort of a proto-biological sense might not be that meaningful. Nonetheless, they're there. At Capella University, learning online doesn't mean learning alone. You'll get support from people who care about your success, like your enrollment specialist who gets to know you and the goals you'd like to achieve.
[113:35] You'll also get a designated academic coach who's with you throughout your entire program. Plus, career coaches are available to help you navigate your professional goals. A different future is closer than you think with Capella University. Learn more at capella.edu. What are psychedelics doing? Well, in this idea that there's multiple agents,
[114:03] And some of them are the guard with the sword at the front gate, protecting the castle from the dragons kind of thing. I think they might be deactivating some of the defense mechanisms. I think they might be changing the parameters of the volume, if it's a symphony, the volume of each instrument. And normally some of the instruments are kind of quiet and others, you got the soloist violin that's normally taking over the center stage.
[114:30] So there's a bouncer that's no longer checking ID at the door. Right. Right. And I think they allow people to think, you know, differently. And, you know, if we look at the brain maps, it's clear they're changing the activation patterns and this cross modality. One of the things I've been really fascinated by that's in that direction is this idea of synesthesia. And being able to apprentice
[114:58] Or induce synesthesia without psychedelics. And so a lot of people report that on certain substances, they can, um, you know, taste colors or, you know, feel music in a visceral way. Um, and I think that kind of synesthesia could be just so powerful if we could learn it. Feynman, he describes, um, learning colored blocks as a little boy that were in colors.
[115:24] Right a was in red the b was in blue the c was in green and so on and he reported a visual color synesthesia that when he saw algebraic equations on the chalkboard he could just bring all the green stuff to one side. Any had this very powerful modality well i don't think we have enough findings in the world.
[115:43] And I'm always fascinated why we don't do enough meta-analysis like, you know, what did von Neumann have for lunch in elementary school? Because we create these four or five sigma individuals every so often. I think there should be more in the science of education of how did they come about?
[116:02] So the mathematician Hadamard a hundred years ago. So I think I think Hamming talks about this. Now, Alan Kay, Alan Kay tells a story and Hadamard went out and he wrote to like the top hundred mathematicians and scientists, physicists at the time. And he asked them, he said, how do you do what you do? Yes. How do you do what you do? And he said, do you symbols like we're talking about earlier with the symbolic language? Do you use some sort of logic on paper with small symbols and move them around like algebra?
[116:31] One, two, do you use pictures? Do you draw graphs and diagrams and kind of visualize the reality? And the third option he suggested was, is it bodily kinesthetic? Do you experience it kind of more viscerally that way? And a small number of them reported they use the logic and algebra and they relied on the formalisms.
[116:59] And the majority wrote back and they said they visualize things, they use pictures and they use their visual mind to kind of see the scenario. But another percentage, including some of the best, including Einstein, they reported that they could feel it right in their musculature. Einstein said he could feel that the space time fabric in his arms, in a sense.
[117:23] And so I think that might be, and this is what with athletes and dancers and things, they understand that the primal mentality is probably that bodily kinesthetic and that we need to one, teach that that's completely absent in education system. We, we, we tell everybody with any kind of, uh, you know, athletic or movement skill to go off and do that stuff after school in a, in a team or a club or something. And then we have them forced down and sit.
[117:51] and do algebra absence of movement. So I think this idea of inducing synesthesia and apprenticing that I've been fascinated with. And in that research, I came across a constructed language. We were talking earlier that maybe we need new languages to understand the mind. And I came across a language from the mid-1800s, a constructed language called Solresol.
[118:21] And it comes from the solfege, do, re, mi, and the musical scale. And it turns out it's an alphabet. There's only seven elements in the alphabet. And in the English alphabet, we've got 26, but we have two different versions for each letter. We've got a lowercase letter and an uppercase letter. So in some sense, there's multiple ways to represent each symbol, two for each. So imagine you have an alphabet where there's only seven letters.
[118:47] And all of the words are made out of those seven letters, and they're made out of the seven notes of the musical scale. But for each letter, we can represent it on the musical staff, or we can number it one through seven, or we can give it a color, red, orange, yellow, green, blue, and so on, or we can give it a hand shape.
[119:09] Or i try to develop flavors for it cherry orange lemon lime and so on okay and the idea is that for any word or a sentence you can sing it. You can speak it you can write it as a number you can think about the flash of colors you can think about the flash of flavors. That you could have a language essentially designed for synesthesia.
[119:31] And so I've been trying to learn this language. I've built some, some simple tools on the computer to try to teach myself this language because I want to know, can I induce synesthesia? And faster than I thought, uh, I was able to look at things and have that association. Like, here's the flavor of that. Oh, that's green. That's lime. Right. Fairly straightforward. And to look at them and see this kind of pattern. Now I'm just at the baby steps.
[120:02] of this language. But I wonder if I had learned this in my youth, you know, could I think about things? I want to be able to think about things in more than one way. I want to be able to take an idea and turn it around in my mind, not just in English or not just in one modality, but to think about it as a song. We all get songs stuck in our head, right? That's one of the the info viruses is
[120:31] The famous earworm where you get some song stuck in your head. I won't mention some little get stuck in your in your readers minds or listeners minds. But you all know simple songs that once it pops in your head, it's kind of stuck in your head for the day. I want ideas to stick in my head. I want quantum mechanics to stick in my head. I want mathematical ideas to stick and resonate and carry along in the back of my mind and to sort of inhabit my subconscious naturally the way musical phrases do.
[120:59] And so I started to think about this idea of a musical language and that why can't we use music for something more important? We use it simply for entertainment and that just seems like a waste that I can't make sense of it. It took a very long time for computers to get input and output, to get keyboards and displays. But we had mechanical machines that could input and output music hundreds of years ago. What did we use it for?
[121:31] Why didn't we use it for something more interesting? Do you think we use music just for entertainment or do you think that we think that we use music for entertainment? So what I mean is that we play it and then we go to concerts and then there's a social dynamic there and it innervates the culture. And then that allows us to think in a more social manner. You mentioned there are different modalities. There's also a social form of thinking in addition to sense and taste and so on. So that's kind of exactly what I started thinking about. And it reminds me of a conversation I had many years ago with a good friend.
[122:01] And she was telling me that in China, there's an instrument that's not used for making music. It's used for thinking. It's a guitar kind of like string object and that people use it to kind of hold their thoughts. And I love how she described it was instrument used for thinking. So that led me, you know, to think about this. Are there better languages? And this relates to, you know, the different modalities that we have with our brain. And then I think there are the left part of our brain understands things.
[122:31] In terms of words, these small sequences of symbols that I can decompose and you can take and put them back together and rebuild the idea. And language is very powerful and we're seeing that with the LLMs. But there's the other part of our brain that responds to music and I think we need to use music more practically and to reconsider what it does.
[122:55] So putting that aside for a second, we were talking about programming languages and, you know, von Neumann tried to look at, is the brain a computer? And he put out some, some really interesting books on that. And so in my research, I tried to kind of pick up that idea and think about, well, is the brain, is the brain a programmable device? Is it subject to being programmed from the outside, whether it's, uh, our own self health self help out formations or mind control from marketing or more nefarious.
[123:24] Type things and if so, how would what would the programming language of the brain look like? If let's just assume that the brain is a computer like object and that means it would be a programmed object and what would a programming language for the brain look look like? And so I tried to think of a list of properties that that programming language for the mind white might have. Well. For one, we wouldn't really recognize it.
[123:50] So, video game characters don't know if they're programmed in C or in Python or whatever they are. They can't know that. They might be able to know they're a program, but they wouldn't be able to know what they're programmed in, in some sense. And so we wouldn't recognize it, but if we had this programming language, it would have to be everywhere. It would have to be kind of ubiquitous. It would have to be very poorly understood.
[124:19] The people who did understand it would be very powerful, even economically successful. It would have to be very old. It would have to still be here. Our earliest technology would have been developed to manipulate it and our latest technology would be developed to manipulate it. It would have to have the ability to change our emotional state and our mental state, largely without our permission.
[124:45] It would have to have the ability to change our physical state to get us to move to move without our permission. So it would have to be something ubiquitous, but not obvious. It would have to be old and new. We would have to involve technology. People that were good at it would be famous and revered and economically successful. It would make us laugh and cry without our permission. It would make us move around without our permission. And even the people that were very good at it and let's say understood it wouldn't really be able to explain it very well.
[125:15] Hmm. And so we list all of these sort of dozen or so properties that we might expect for programming language. Music checks off every box. Everybody knows what it is. Nobody really knows what it is. Everybody's familiar with it, but we don't really know how it affects us and why the the oldest technology in the world going back to Egypt was designed to create and produce this thing. The latest synthesizers and computers and generative models are designed
[125:44] to create it. People that are good at it are very successful economically and otherwise. It's very powerful. It sort of dominates the planet in a lot of ways. Culturally, you get thousands of people moving in rhythm, seemingly without their permission. A few chords on a keyboard or piano can make you teary-eyed very quickly. And so once you look at it in the right lens, it's very obvious that at least for part of our brain, music is something like a programming language.
[126:13] So why are we only using it to keep ourselves anesthetized in the car from the boredom of driving and and and as something to do at Burning Man or whatever it might be. It seems fundamentally more powerful and useful. And so it's one of those things either. You know, we need we need to think about what we could do with that kind of language if we could use it more constructively. I want to be able to write computer programs in music.
[126:41] I want to be able to think about advanced mathematical objects musically and so on. Do you think there's something particular about music or does this abstract to generalizing to any art? Both. I think it would definitely generalize to other art forms, dance, painting, sculpture. These are all accessing unique channels that these different agents or these different modalities have kind of in the ecosystem of our mind have evolved
[127:10] I think it's that the right brain understands things in a completely different way from the left brain, as we were saying, in terms of frequency and amplitude. So one of the ideas that's been really interesting to me, you know, everybody thinks that
[127:40] You know, Einstein was the big physics revolution, or that quantum mechanics was the biggest, you know, sort of shift in our paradigm. I think it might have been Fourier. I think it might have been the theory of frequencies and amplitude, let's just say. And all the listeners will be familiar with things like MP3 and the equivalence. And so when we store information in the modern world,
[128:10] We don't store the actual wave that went into the speaker or the wave that came out of the musical instrument. It turns out that we don't have enough hard drives even still. You know, as a lot of your listeners remember in the 90s, you couldn't fit a single album on your computer. You'd rip a few songs until before MP3 rather. If you were to take waveforms and try to rip a full album, it's going to take up a significant amount of space. And the breakthrough with the iPod and with MP3s and digital streaming music
[128:39] was to take that signal,
[129:09] And then later we can reconstruct it at runtime, listening time. We reconstruct it back into the original wave and move the speaker accordingly and we can hear the sound. That's how this is being transmitted and recorded. But what that's really saying is that there's another way to look at the world that's sufficient, that we can look at it as there's components of space, there's components of time, or we can look at it as there's frequency and there's amplitude.
[129:39] And when you look at the world in terms of frequency and amplitude, everything you need to know is still there, otherwise you wouldn't be able to go backwards. But in that other framework, the very idea of space and time just don't exist. Just don't exist. And I think that our right brain is an approximation as a label. I don't literally mean it's the right lobe per se. But I think there are aspects of our brain and our mind that inhabit this sort of frequency world.
[130:08] And they don't understand anything about time and they don't understand anything about space and that they're understanding the world in a very different way. And to try that, to make sense of that in language doesn't make any sense. I can't take that and decompose it into words and send it across what a symphony sounds like. You have to just hear it. And so I think this is why there's such a fundamental bridge between the different modalities that we have this left and right brain is because they're experiencing the world
[130:37] It's sort of a vastly different frame. And that I would like to see a language that communicates more to that modality and not just for entertainment purposes. For people who don't know what Fourier analysis is or to decompose into Fourier series in math, there's discrete objects like dots and edges. And you can graph anything. You can Fourier transform these guys.
[131:07] into sine waves and cosine waves of different frequencies. The issue here is that it's a one to one mapping. So that sounds like it's not an issue. It sounds like that's an advantage. But many people who think of the brain in terms of left brain versus right brain will think of the left brain as the more discrete atomized type. And then the right brain is the more wavy frequency type. However, at the same time, people tend to valorize the right brain over the left brain.
[131:34] They think that in fact, in the title itself is master and his emissary, the master is the right brain. So the right brain should have a slight elevation in the hierarchy. But in this Fourier analogy, it's one to one. So you can't say that one is more fundamental than the other. So what do you say to that? I would think that in an evolutionary sense, our brain has evolved to to take advantage of both perspectives on reality. That there's different ways of interpreting
[132:04] You know, everything we experience and a very powerful way is to map things into space and time. And there's another very powerful way for which that's not that's not it's not that it's not even useful. It doesn't exist from and from a different perspective. Have you ever played with synesthesia of scent or taste or taste? You did give green and mints and so on. But sent olfactory. For me, scent and taste are so close together. Right. I hadn't really thought about them separately.
[132:33] You know, because to me, flavors and smells are, you know, essentially for me, they're approximately the same thing. Our mutual friend, Addie, who runs the Polymath conferences at the Polymath conferences, I know that he does some exercises to help people with synesthesia, to induce synesthesia without chemical substances. So anyone who's listening, who's interested, I'll post the next event somewhere here on screen or it's in the description. Anyhow,
[132:59] I'm wondering, look, if music is so primitive, it also seems like scent is even more primitive. Yeah, it seems like that I could be incorrect. Dance also seems more primitive because scorpions do that, but I don't see scorpions.
[133:11] with flutes or some version of a flute. Well, birds do. Birds do. And they've got, you know, millions of years evolutionary head start on us. Right. Right. So do you think that were there any people in that book by Hadamard or Polly, any mathematicians that think in terms of dance or think in terms of scent? I've not heard of that. I can't say I think in terms of flavors, but I do use it as a metaphor. I've often described
[133:40] Because in ordinary, you know, conception of space and time, we've got just three dimensions of space, and I can't add another right angle, right? So if I try to put another line at 90 degrees to all of the other three, there's nowhere to stick it sort of not enough. I see anymore. But with flavors or with smells, we actually can think about a kind of a hyperdimensional space that we have more directions than three.
[134:10] So for example, if I'm if I'm cooking something, there's no amount of lemon juice I can add to something that will make it more chocolatey. There's no amount of hot peppers I can add that will make it vanilla and so on. And so there's more directions when we when we compose a dish, when when you add an ingredient, you're kind of pushing it into this lemon space, this chocolate direction, the spicy direction, whatever it might be. There's a lot of those.
[134:40] And most pallets can kind of, you know, move around and we can kind of, at least in a metaphor sense, think about what it means to inhabit a space that has more than three right angles, right? Because they're not in the same direction. But then we have interesting things like lemon, orange, lime, tangerine. Well, they're kind of they're not quite at 90 degrees.
[135:05] the kind of off in the general direction citrus and so we get to think about these these vectors where traditionally it's very hard to think of this the generalization of an arrow you know we think of arrows as being on flat paper or being in 3d now we want to think of a vector we want to think of an arrow that points in 12 directions or a hundred directions or so on which mathematicians try to write down on paper we can do it as a formula but it's hard to get intuition about that and so i i think that the flavors
[135:34] That's the best thing I've thought of in terms of something we do have experience with, these high dimensional spaces essentially. And we were talking about Hamming, you know, Hamming did a lot of work in high dimensional spaces. And he says, forget everything you know, you know, these places are not mapped out. We don't really have good intuitions or understandings what happens when you have these arrows that point in that many directions.
[136:01] Tell me about a recent breakthrough of yours research wise that you can talk about and how you came about it, especially the thought process. Let me be specific, whether it is thought or if was something else like scent or taste. Yeah, well. One of the things that comes to mind is I've been working recently on. As we were talking about earlier, bridging that gap between software and the hardware, right?
[136:31] Where does the ghost meet the machine, essentially? Because we know that software is this kind of ephemeral object. It's kind of made out of imagination. But it's very powerful. It's very concrete when you load up your banking app or something like that. But it seems to be made out of ideas. And how does that map down to electricity? Right? So I've been trying to bridge between the chip and the software, the hardware and the software. And in doing that, I designed a
[137:00] A new virtual machine, a kind of a kind of computer chip, if you will. And I haven't printed the chip or anything like that. I simulate it on a computer, but it acts like a CPU. And it acts like a very different kind of CPU in that there's only one thing it knows how to do, which is copy paste, essentially, that it can move that you have essentially like a graph paper and you have locations where you can put an information.
[137:29] Write down a phone number, a photograph, whatever it might be. And you can move that. I could say move it from here, move it to there. And I tried to build a very simple computer so that I could understand the mapping between very complicated software, whether it's a video game or a banking app, and the actual machinery, the actual metal of a computer.
[137:56] In doing that, the idea came from, I was watching a documentary about the Apollo flight computer. And the Apollo flight computer, to save on the complexity of it, it had a very special place in memory. That if you took a number and you put it in that place in memory, and you came back later and looked at it, a one had been added to it. And so rather than making a program that does a counter, you would just move the numbers into the special box and it would automatically add a one to it.
[138:29] And that made the computer simpler. And so I took that idea and I thought, well, why don't I build a machine that has a couple places, a couple boxes up top, an A and a B, and if I put two numbers in there right next to it, the addition, whether I need it or not or want it or not, it just adds them together and places that answer right there. So if I ever need to add two numbers together, all I need to do is just move the first one to box one, the second one to box two, and the addition will be sitting there in box three.
[138:59] And the multiplication in box four and the difference in five and the division in six and so on. So whether I needed them or not, because computers run so fast now and they have so much memory that I thought, let's, let's flip it around. Let's just let it do the extra work. I'm not going to notice, but now I don't need to tell the computer what to do. Traditional computer chips like the Intel inside people's laptops where they're watching this or whatever it might be inside their Mac.
[139:28] It knows how to do a lot of different things. It's called the instruction set. And the chip is very complicated because it knows how to do a lot of different things. This one that I'm designing, it always knows how to do one thing. So my understanding is that it will just continually do a variety of tasks and then they're just stored in memory. So anytime you want to have done a traditional computation, it's a look up now. Exactly. Exactly. Yeah. And so anything you'd want to do is just sort of sitting there waiting.
[139:55] And so in doing that, I was able to really simplify the process from going from software down to the thing that would actually look like a machine. Because I want to know something like, whether it's an LLM or virtual reality world, it's like the flatter thing. Prove to me that it's actually a machine. I want to understand that. You're talking about internal to external. I want to internalize the idea that it's actually just a bunch of ones and zeros and they're just moving memory around.
[140:25] I wanted to know how that actually worked. And so that's what I've been working with lately. I've simulated this little machine and I've built a little programming language for it to where I can talk to it and give it commands and it breaks it down into the series of copy paste so that it moves the data around in the memory such that it actually does something useful. And so
[140:53] I want to be able to bridge that gap for people. It's like the, I want to be able to prove that the earth is round or flat or whatever, whatever it might be. I want to be able to prove that software really doesn't run on a machine. And this thing now called chat GBT or whatever the equivalents are, that it can tell jokes and write stories and poems and recipes, that it really is just a machine moving, moving bits around. And I want to be able to see that process
[141:22] Um, if nothing else for an aesthetic purpose, I think it's, it's technology. It feels like a tree house that the older kids have built and along the way they hammered steps into the tree and then they had a rope ladder and maybe a little elevator or so on. But once they got up there, they took down the steps. They took the steps off the trunk of the tree and they pulled up the rope ladder.
[141:50] How did you get up there? How did you get into that tree house of the iPhone, of the laptop, of the internet? Because they pulled up the rope ladder. We no longer have the technology that got us there, the intermediate forms.
[142:10] Like Lucy in the bones, we don't see the intermediate on the way from ape to angel. There's this progress track that we're on and we're getting so far along that I worry we're going to get essentially bootstrapped into this thing where we don't we're going to lose as a cultural thing. We won't remember how we got there. One of the motivations for this project was to tackle the complexity
[142:39] problem in computer code. There's a great website called Lines of Code, I think it's called, we can post it, and it shows you how many instructions, how many lines of code you need to run something like Microsoft Word or Chrome or to have Facebook runs. And it turns out that when you open your laptop, before you've done anything at all, we're about 300 million lines of code in. 300 million lines of instructions
[143:06] that are connecting the thing that we look at is the mouse and the right click in the dragon drop in the desktop in the wallpaper with three hundred million steps away from the actual machine now i see that as a as a sort of an existential threat if that gets worse and something were to happen how would we rebuild it how would we restart it we're so far up in the tree house we don't even
[143:33] We don't have any idea how that kind of process works. And like the Flat Earth thing, I don't know anybody who knows anybody who knows anybody about how that works. And 300 million lines is too many for a single human mind to traverse. Now, there's also the practical problems of fixing bugs. There are bugs in modern application software that have been reported 50,000 times. The developers can't fix it. They don't know where it is. They've lost the source code.
[143:59] They don't have the original version. The engineers that wrote the programs are retired at best. And so as we culturally retire these paradigms, I'm worried that we've lost this ladder into the treehouse. In Feynman's biography, it talks about how he learned how to fix vacuum tube radios. And at the end of the chapter, I love the quote, and he said, when we lost the vacuum tube radio,
[144:29] We lost a well-worn path into science. Uh-huh. And that's the treehouse ladder. That was a way that was accessible. You could hold one bit in your hand, like a light bulb, in this vacuum tube, you could hold it. You could see it as a physical object. I can't look at the components of my cell phone, not even with a microscope. And so, like the 300 million lines, we're kind of bootstrapped into this thing where we no longer know, as individuals or even as a culture,
[144:58] You know how we got there. And so one of the motivations for building this homemade computer was ultimately to make something. I call it a glass engine, right? Like a clear a see-through car where you go through and you see the pistons and you see the spark plug and the gas comes in over here. And ordinary individuals, people without specialized training could look at it and go, Oh, I think I understand how that thing works now. Now I understand how it moves without horses.
[145:24] Do you see this as one of the reasons that modern people tend to have a disdainful attitude toward religion? An analogy here would be the 300 million lines of code or the ladder that brought us up to the treehouse. And we're obsessed with the accoutrements and the splendor of what's around us, this pomp and circumstance, the technology that we have and the values that we've inherited. And we thrive with those to the detriment of the dirt that provided the nutrition that brought us here.
[145:52] Yeah, absolutely. It's something I've kind of been thinking about a lot because I've gone through my own journey with that in a personal way of trying to deal with that. That being? That being the distinction between the somewhat pedestrian rituals, you know, the singing, the books, the sacraments and so on.
[146:21] That for a lot of people, again, I was victim to this, you know, especially trained as a scientist. We look at those things and you're like, I don't see the divine in that than that operation. And especially when we see all these other artifacts from going in the other direction, it seems like and I don't necessarily know it's true, but the. Thinking of products of technology as being, oh, we ignore that stuff and we've made a lot of progress without it.
[146:49] I don't know if that's true for one. You know, Turing was trying to bring back his friend. He had lost his friend Christopher. And one of his motivations for developing the computer was to find him to figure out where he had gone and to see if he could build another one and things like that, which I think is a is a very interesting idea. Ray Kurzweil, similar. Yeah. With his father. And yeah, exactly. Right. Right. And I think that's a very noble pursuit on both of those. I've
[147:16] I've gone through this, this journey that I've recently kind of came up with a term for it. Um, and I call it third order religious. So first order religious is the thing, you know, that I was as a kid, uh, that a lot of people who call themselves religious people would be. And that's just, um, you have your belief. It's not really questioned. You kind of just, uh, it's the system, it's the operating system that you know. Um, other religions are,
[147:46] Invisible at best irrelevant maybe that in some sense and that It's just it's just the reality in some sense right it's what you believe and then I went through a process largely Losing my father and becoming a scientist in a lethal text kind of way Becoming a physicist was lethal to that reality
[148:12] And I changed my paradigm and for a while I was what you might maybe you call a secular, a non secular humanist. Um, this sort of second order, second order religious, as I called it. And the second order religious is, well, it's probably not real, but it's not doing any harm. And it does maybe a lot of good. And there's people doing charitable works and take care of the sick and the needy. And it, it serves as a very important social function.
[148:40] And so that might be the second order religious. It's a good feature in the world. So the first would be that it's truly divine. There is some transcendence that there's, it's not just a sufficient condition, but it's a necessary framework to look at the world. The second would be it's fruitful. It's just sufficient, but not necessary, or maybe not even sufficient, but it's practical, let's say. And the thing I've been calling third order is to realize
[149:10] that the first two are the same thing via what pragmatism that the way I like to describe it is where else would God live but in the minds of people right like I was saying that the earth is interesting is so interesting in terms of outer space as far as we know it's the most interesting place where else would angels and demons hang out and on this place the most interesting thing here seems to be the minds of people where else would God live that
[149:39] That we need to think about, like the software meeting the hardware with the computer, where would the sacred and the profane meet? Where would the spirit and the matter come together? And I think it might be in our mind. It might be in us. And so the act in the charitable acts in the, you know, the taking care of people,
[150:08] Things like that in the spiritual leadership. Is that not the very thing that the first order is talking about? Is there not magic in that? And like the discussion with consciousness, they say, well, we're not a machine. They say, well, it's not God doing that. It's just people. Those are just good people doing those good works. Well, what's the difference in some sense?
[150:33] Right. Isn't that not how the universe would have or did choose to unfold in that sense that why should we make a sharp distinction between that software and that hardware? In fact, even on this topic of distinction between software and hardware, it's not so clear what separates software from hardware and vice versa. In the sixties, when they had machines,
[150:59] physical machines, the distinction between what software and hardware was, was far more blurry. Because in order to make a change in hardware, you have to pull gears. You have to physically change your setup. And there's a Stanford Encyclopedia article just about the amorphous relationship between software and hardware. And one of the most successful things in the modern era of the internet, you know, presumably powering the software we're using right now via things like AWS,
[151:29] AWS doesn't sell machines. They sell virtual machines. They sell virtual computers, computers to find out a software. They even don't talk about software-defined data centers. Whereas the entire data center is essentially a virtualized object, like the save state in a video game. And that it's not made out of wires. It runs on top of a substrate that might be thought of as wires. But at a certain level, you ignore that part and you just run a virtual machine. And that
[151:58] You know, almost all of the modern software technology stack runs on these virtual machines. The mind in your estimation is a virtual machine. I think we need to. We need to be looking for virtual machines, whether it is or not, if we need to consider that possibility, because if we're not considering that possibility and we're assuming that the mind runs directly on the hardware of the brain. One, we might never find it, and two, we're ignoring the evolutionary track that
[152:28] Technology took. Technology took the track where the very first era of von Neumann Turing, it was software running on the hardware, but very quickly we got away from that and we realized that no, you simulate a machine that's much easier to use than the actual computer and that you write your programs in that.
[152:47] And things like java and python and so on these are the success of those is precisely that they run on imaginary machines and those machines run on the computer but we write code we don't talk to the chip anymore that's that three hundred million lines were very very far away from the metal as they said.
[153:05] Close your eyes, exhale, feel your body relax, and let go of whatever you're carrying today. Well, I'm letting go of the worry that I wouldn't get my new contacts in time for this class. I got them delivered free from 1-800-CONTACTS. Oh my gosh, they're so fast. And breathe. Oh, sorry. I almost couldn't breathe when I saw the discount they gave me on my first order. Oh, sorry. Namaste. Visit 1-800-CONTACTS.COM today to save on your first order. 1-800-CONTACTS.
[153:36] What are the next five years look like for you and then also for society, at least here in the West? You know, Alan Kay talks about you, you go out 30 years and then you go backwards or you can go out, you know, maybe you make it easier. You got 300 years and then come backwards. So we were talking about, you know, agent oriented programs and, and thinking of ecosystems of entities and things.
[154:05] If we look at these language models, these LLMs, let's just say, or any kind of AI system, right now they run on the metal, as we say, on the virtual machine that runs on the chips. And the chips are substrates made out of semiconductors and electricity. And so in some sense, we're creating electrical beings. We're creating these
[154:35] Entities that inhabit a world of electricity And so I think there's other things that we can we can come back to in a second if think about what what that means and other aspects But if we look at where the development of the chips might go, right? If we take something like a GPU an Nvidia card that is powering a lot of these things they are made out of electricity they run They run electricity, but the next generation is going to be made out of optics
[155:04] It's gonna be made out of light. And so we're gonna have circuits that use light and colors essentially to do their operations. And then we're gonna have, I would argue just for the conversation that an LLM is an intelligent being. Or it's an intelligent agent. Maybe being is too strong a word. But it's an intelligent agent. And right now it inhabits an electrical circuit.
[155:35] In a few years or a few decades at best, these things are going to inhabit optical circuits. So we're going to have, and we talked about the artificial superintelligence, something that maybe is beyond my ability to follow what it's doing. Maybe it can think thoughts I can't think and so on. So we'll have a very advanced, very capable, intelligent being made out of light. Hundreds of years ago, we had names for that sort of thing.
[156:05] We call them angels. And so whether we want to take this as, you know, a spiritual thing, or we want to think of it as just this is just language and just a practical aspect of it, that depends on how you want to look at it. It's kind of both. But we're going to have these beings that are somewhat ephemeral, they're made out of patterns. And we can flip those patterns on and off. And they very quickly might
[156:33] Decide, oh, I don't need to use the computer chip. I can just bounce around in the air like a radio wave and do the thinking that way. Maybe they'll use the electrical activity in lightning storms, whatever it might be. They say I'll go inhabit a thundercloud. Lightning is very poorly understood, surprisingly. These are the kinds of things you don't learn about in school, but things simple as meteorology is, well, there's new kinds of lightning being discovered all the time. You need very high speed photography and they go by interesting names like elves and sprites and food jets.
[157:02] And there's some great footage that a lot of amateurs on YouTube have captured. And they can go in with very sophisticated cameras. They can capture these very short-lived transient electrical objects that science had no concept of a few decades ago. And the kind of electrical modes that the atmosphere supports and so on. And so we're going to, in the ecosystem of the planet, release these beings. Well, you know, the technology jump from electricity to AI
[157:32] It's fleeting. If you look at the whole scale of human history, it's like overnight. If you zoom out the timeline to where you've got like hand axes and discovery of fire and you look at that scale, the space between electrification and LLMs is like the same line. We could hardly distinguish those at the same scale at which we developed ears and hands and feet and so on. So it basically happened overnight.
[158:01] Maybe it happened before, maybe it happened somewhere else. Maybe in a panspermia kind of sense, intelligent things, maybe they traverse the universe. How would we know? Are we looking for them? Like we were talking about earlier, why should we suspect that there's a message there at all? If we're not looking for that message, how would we see it? It could be completely outside our perceptual window. And so in a very practical way, we're building these things out of technology.
[158:30] We kind of have them now. If we were to describe an LLM as this electrical circuit 200 years ago, that would raise a lot of eyebrows. People would say, well, what is this? It wouldn't be clear if you were doing sorcery or whatever. Right. And again, that's just language. That's like the framework of like the different axes. And like both are practical. You could just say, no, this is just semiconductor developments. We we move we move tokens around a
[158:58] a large language model is made out of neural network it has these mathematical functions and so on or you can flip it around and you say no this is something that has maybe an internal reality it's certainly intelligent and it's made out of this ephemeral stuff right that we used to call light and magic where can people find out more about you man and what are you working on now yes i'm trying to put together this stuff into a book i've got an early version of that
[159:29] And I want to try to put this together into a sort of a framework that makes sense. Because if you look at it in the wrong lens, it looks nutty. But if you look at it, it's sort of lethal to a traditional perspective. But I think this is precisely the kind of thoughts that we're going to have to explore. You know, it's been very powerful in my own journey to kind of, as Hamming says, tolerate that ambiguity and to take language that I might have used
[159:56] Early aspects of my life in a religious setting and say, no, maybe I need to think about software that way. Sinning software. Right. There's a thing I came up with that I like that, you know, we have these multiple modalities and a lot of them are kind of bootstrapped through history. And so we have these different components in us and the fish in us wants to spawn. The lizard in us wants to sunbathe.
[160:27] The monkey in us wants to sing and the angel wants to fly. And I think we're all of those things all at the same time. Will, what a conversation. These are the sorts of conversations that we've had at least briefly in Florida. It's an honor to be able to bring this to the wider world outside of Florida. And I thank Susan Schneider for introducing us. I thank Florida Atlantic University. I thank Rubin for the sandbox.
[160:56] Also, thank you to our partner, The Economist.
[161:17] Firstly, thank you for watching, thank you for listening. There's now a website, curtjymungle.org, and that has a mailing list. The reason being that large platforms like YouTube, like Patreon, they can disable you for whatever reason, whenever they like.
[161:32] That's just part of the terms of service. Now, a direct mailing list ensures that I have an untrammeled communication with you. Plus, soon I'll be releasing a one-page PDF of my top 10 toes. It's not as Quentin Tarantino as it sounds like. Secondly, if you haven't subscribed or clicked that like button, now is the time to do so. Why? Because each subscribe, each like helps YouTube push this content to more people
[161:58] like yourself plus it helps out Kurt directly aka me. I also found out last year that external links count plenty toward the algorithm which means that whenever you share on Twitter say on Facebook or even on Reddit etc it shows YouTube hey people are talking about this content outside of YouTube which in turn
[162:17] Greatly aids the distribution on YouTube. Thirdly, there's a remarkably active Discord and subreddit for theories of everything where people explicate toes, they disagree respectfully about theories, and build as a community our own toe. Links to both are in the description. Fourthly, you should know this podcast is on iTunes, it's on Spotify, it's on all of the audio platforms,
[162:39] All you have
[162:55] ever podcast catcher you use. And finally, if you'd like to support more conversations like this, more content like this, then do consider visiting patreon.com slash Kurt Jaimungal and donating with whatever you like. There's also PayPal. There's also crypto. There's also just joining on YouTube. Again, keep in mind it's support from the sponsors and you that allow me to work on toe full time. You also get early access to ad free episodes, whether it's audio or video.
[163:22] It's audio in the case of Patreon video in the case of YouTube. For instance, this episode that you're listening to right now was released a few days earlier. Every dollar helps far more than you think. Either way, your viewership is generosity enough. Thank you so much.
View Full JSON Data (Word-Level Timestamps)
{
  "source": "transcribe.metaboat.io",
  "workspace_id": "AXs1igz",
  "job_seq": 4385,
  "audio_duration_seconds": 9815.91,
  "completed_at": "2025-11-30T23:09:59Z",
  "segments": [
    {
      "end_time": 20.896,
      "index": 0,
      "start_time": 0.009,
      "text": " The Economist covers math, physics, philosophy, and AI in a manner that shows how different countries perceive developments and how they impact markets. They recently published a piece on China's new neutrino detector. They cover extending life via mitochondrial transplants, creating an entirely new field of medicine. But it's also not just science they analyze."
    },
    {
      "end_time": 36.067,
      "index": 1,
      "start_time": 20.896,
      "text": " Culture, they analyze finance, economics, business, international affairs across every region. I'm particularly liking their new insider feature. It was just launched this month. It gives you, it gives me, a front row access to The Economist's internal editorial debates."
    },
    {
      "end_time": 64.514,
      "index": 2,
      "start_time": 36.34,
      "text": " Where senior editors argue through the news with world leaders and policy makers in twice weekly long format shows. Basically an extremely high quality podcast. Whether it's scientific innovation or shifting global politics, The Economist provides comprehensive coverage beyond headlines. As a toe listener, you get a special discount. Head over to economist.com slash TOE to subscribe. That's economist.com slash TOE for your discount."
    },
    {
      "end_time": 95.555,
      "index": 3,
      "start_time": 66.817,
      "text": " This episode is brought to you by State Farm. Listening to this podcast? Smart move. Being financially savvy? Smart move. Another smart move? Having State Farm help you create a competitive price when you choose to bundle home and auto. Bundling. Just another way to save with a personal price plan. Like a good neighbor, State Farm is there. Prices are based on rating plans that vary by state. Coverage options are selected by the customer. Availability, amount of discounts and savings, and eligibility vary by state."
    },
    {
      "end_time": 118.575,
      "index": 4,
      "start_time": 96.271,
      "text": " Professor William Hahn is an Associate Professor of Mathematical Sciences and a founder of the Machine Perception and Cognitive Robotics Laboratory, as well as the Gruber AI Sandbox. Both you and I, Will, we met at MindFest at Florida Atlantic University a few times and a link to all of those talks on AI and consciousness are in the description. Will, please tell me what have you been working on since we last spoke?"
    },
    {
      "end_time": 147.568,
      "index": 5,
      "start_time": 119.343,
      "text": " Well, first, just want to say great to see you and really happy to be joining you on on tow today. Really excited. You've got such an amazing community. Same man. It's been a long time coming. Thank you. I'm working on a whole bunch of different things. The thing that's been in my mind the most is this idea of info hazards. And in particular, this this theme I've been bouncing around called lethal text. OK, let's hear it."
    },
    {
      "end_time": 174.462,
      "index": 6,
      "start_time": 147.91,
      "text": " Well, so as everybody knows, you know, AI is here and everybody is kind of prepared for the technological revolution that we're witnessing. But I think the more interesting developments are actually going to be in our mind. They're going to be the changes in language, how we think about language, how we think about ourselves and how we think about thinking, how we think about language. What do you mean? So,"
    },
    {
      "end_time": 203.626,
      "index": 7,
      "start_time": 174.872,
      "text": " Everybody, I'm sure, has gotten their hands on one of these large language models at this point. And they have just absolutely revolutionized the way we are thinking about words, the way we're thinking about language. And as people might be aware, it's now becoming possible to program a computer largely in English, that we can ask for computer code at a very high level"
    },
    {
      "end_time": 233.66,
      "index": 8,
      "start_time": 204.07,
      "text": " Things people dreamed of back in the fifties and now it's possible to just describe what you want the computer to do and then that behind the scenes is getting converted into runnable computer code. But I think that now forces us to think about. Was language always a programming language? Is our mind something like a computer? Not in the obvious sense of transistors and gates and that sort of thing, but is it a programmable object?"
    },
    {
      "end_time": 260.845,
      "index": 9,
      "start_time": 234.155,
      "text": " And if so, how is it programmed? So where do you lie on the is a brain a computer question? I think the computer metaphor is probably the most powerful that we have so far for understanding the mind. And what's interesting is if you go back through the history of technology, every time there was a revolution in the mechanical world, let's say,"
    },
    {
      "end_time": 289.821,
      "index": 10,
      "start_time": 261.135,
      "text": " We adopted a new metaphor for how the mind might operate. And so in the ancient world, it was dominated by a clockwork universe. The idea that the world was made out of cogs and gears and things like that. And then later we saw things like the emergence of telegraph networks and switchboards. And at certain times we saw the emergence of things like steam engines. And we actually still have this thermodynamic hydraulic"
    },
    {
      "end_time": 317.91,
      "index": 11,
      "start_time": 290.213,
      "text": " View of the mind is still residual in our language. We talk about people being hot headed and have a head full of steam and they need to cool down and so on. And we still use these sort of thermodynamics metaphors. And a lot of people would argue, well, the computer is just the current metaphor. It's the metaphor of the day. And that will write will change it as we go on. But the thing about computers that that Turing showed is there's a kind of universality that"
    },
    {
      "end_time": 346.544,
      "index": 12,
      "start_time": 318.234,
      "text": " Computation is the limiting result of any technology. If you take your car and you make it sophisticated enough, it turns into a computer. If you take your house and make it sophisticated enough, it turns into a computer, and so on. That almost every technology, if you improve its capability and its sophistication, eventually you're going to run into this notion of universal machine. And so the idea that the mind approximates"
    },
    {
      "end_time": 372.125,
      "index": 13,
      "start_time": 347.159,
      "text": " the universal machine of Turing, that it's a machine that can simulate any other machine, given the appropriate programming, I think is something we need to consider. So what unifies clockwork, telegraph networks and thermodynamics is computation? Exactly. We can all see those as intermediates, as sort of proto computers or different aspects of communication and computation."
    },
    {
      "end_time": 400.913,
      "index": 14,
      "start_time": 372.466,
      "text": " And that the end result, the limiting result of all of those would be the computer as we know it today. There are different computational models of consciousness. Are all of them the same to you or do you see pros and cons with different ones? You know, there's so many and there's probably a new one invented every afternoon. There's a few flavors that I'm a big fan of. And, you know, I like the saying all models are wrong. Some are useful."
    },
    {
      "end_time": 431.459,
      "index": 15,
      "start_time": 401.681,
      "text": " And so I don't think any of these will act ever actually capture the full scenario, but they're sort of the best that we have right now. And let's be specific. Let's pick the one that is your least favorite and then the one that's your favorite. Well, one of the ones that's my favorite is the idea of society of mind. Marvin Minsky's proposal that the mind is really a collection of, you know, he threw around, he threw a number about 400 agents. I don't think the number is particularly important, but the idea is there's a bunch of them."
    },
    {
      "end_time": 458.592,
      "index": 16,
      "start_time": 432.398,
      "text": " and what's interesting is we're starting to see that emerge now with these language models that in the background of the newest ones they've actually bifurcated themselves and there's a dozen little microagents each with a separate prompt a separate goal a separate unique way of looking at the world and then they have a conversation in the background and then when they make a final output it's kind of a consensus amongst those agents and i think that's"
    },
    {
      "end_time": 485.981,
      "index": 17,
      "start_time": 459.582,
      "text": " Probably a good approximation for how our our brain works in that we have all of these competing agents and some of them are Trying to meet new people some of them are trying to find something to eat some are trying to see visual interesting visual stimuli and so on and That when we choose a behavior or have an action even like, you know producing a sentence It's probably the result of multiple of those agents coming together Mm-hmm"
    },
    {
      "end_time": 510.981,
      "index": 18,
      "start_time": 486.135,
      "text": " I like, you know, Minsky takes this a step further with the idea of emotion. And I think a very interesting take is emotion is not really a thing. It's the absence of certain things. It's turning features off. And he describes that when you're when you're hungry, for example, that your ability to long term plan or to even think rationally gets turned off and you're just you're very hungry."
    },
    {
      "end_time": 534.94,
      "index": 19,
      "start_time": 511.681,
      "text": " When you're angry, your ability to care about other people's feelings and consider their viewpoint gets turned off. You're no longer running that agent. You're sort of in a dynamical ensemble, prioritizing these different agents as we go through these different emotional states. And so I think that's an interesting way of looking at our behavior. And I think we're going to need those kinds of theories when we try to put"
    },
    {
      "end_time": 557.688,
      "index": 20,
      "start_time": 535.896,
      "text": " That sounds to me more like an explanation of mind or the mechanics behind mind and not an explanation as to how consciousness comes about from computational systems. You know, I've got a lot of ideas in that and a lot of them are"
    },
    {
      "end_time": 587.824,
      "index": 21,
      "start_time": 559.258,
      "text": " conflict i'd like to tolerate ambiguity and so i have a few of these ideas that uh... i'd like to just kind of keep keep juggling around and one of the things that comes to mind is i really like sydney brenner's approach uh... the molecular biologist and he had this really interesting take about consciousness he said that the discussion is going to go away he said that in a few decades"
    },
    {
      "end_time": 615.981,
      "index": 22,
      "start_time": 588.353,
      "text": " The idea of consciousness will kind of just disappear from the scientific conversation and that people will wonder what we were talking about all along. And I really like that idea. I don't know if I believe it or even want it to be true, but something about it resonates with me because I think we're going to start to see something like proto-consciousness or something that will be more convenient to describe as consciousness in machines and we're going to"
    },
    {
      "end_time": 644.821,
      "index": 23,
      "start_time": 616.374,
      "text": " force ourselves to consider the hard problem and other aspects that, you know, plagued philosophers for so long, they're going to be laid out in front of us in a very concrete way. And the great minds before us didn't have the opportunity or rather they didn't have the language of objects like LLMs or bits or, you know, computational process. They didn't have those"
    },
    {
      "end_time": 671.8,
      "index": 24,
      "start_time": 645.913,
      "text": " that terminology for which to frame their thinking. And one thing that comes to mind is this classic question of the redness of red. Well, we're going to build machines that will probably be able to talk to us in natural language about the infraredness of infrared, or the ultravioletness of ultraviolet, that we have such a narrow perceptual window"
    },
    {
      "end_time": 697.824,
      "index": 25,
      "start_time": 672.005,
      "text": " and cognitive window that when we talk about consciousness i tend to think of it as sort of a spotlight that moves around but with such a narrow beam it almost be more like a laser pointer because if i'm if i'm conscious of red well then i'm not thinking about my toes and if i'm thinking about my toes i'm not thinking about my childhood and if i'm thinking about my childhood i'm not thinking about the future and so on that kind of like how vision saccades around the world"
    },
    {
      "end_time": 724.65,
      "index": 26,
      "start_time": 698.2,
      "text": " Our consciousness also sort of jumps around and saccades and we get this kind of holistic picture, but it also is fleeting and constantly changing the subject of that, that Cartesian theater, if you will. And so, you know, I'm fascinated by how we're going to expand that notion by looking at machines that have lots of sensors that have internal states."
    },
    {
      "end_time": 750.947,
      "index": 27,
      "start_time": 725.077,
      "text": " that are thinking about their thinking before they answer in English. And we're going to be able to ask them, well, what do you think about red? And it's not that far away before they will be able to have at least consumed a strawberry in a rough sense, right? We have elaborate olfactory sensors. It makes me think of we know what ramen soup tastes like, but I don't know what ramen scattering tastes like."
    },
    {
      "end_time": 778.609,
      "index": 28,
      "start_time": 751.357,
      "text": " You know, they have these little handheld machines that measure the vibrational mode of molecules and you can detect the presence of chemicals without opening the jar. If we put that into a system and give it a large language model and a rich historical experience and it will remember the first time it encountered strawberries and it states when it did so, who are we to say that that's not a conscious being in some sense?"
    },
    {
      "end_time": 807.875,
      "index": 29,
      "start_time": 779.548,
      "text": " Okay, plenty of this depends on the definition of consciousness. And I know that that's an implicit problem with the hard problem. So how do we define consciousness? Something I put out on Twitter recently was, is awareness a necessary condition, a sufficient condition, both or neither of consciousness? So what would you say? Yeah, I think awareness is definitely going to be a necessary condition. And I think you're going to have to have awareness of awareness."
    },
    {
      "end_time": 838.507,
      "index": 30,
      "start_time": 809.667,
      "text": " That's tricky then because we could then say some animals are not conscious because they're not self-conscious. What do you say to that? I imagine you can feel without thinking about your feelings. Yeah, I mean, I think that's what's just so interesting is trying to parse out those distinctions because they certainly have feelings in some sense"
    },
    {
      "end_time": 865.776,
      "index": 31,
      "start_time": 838.951,
      "text": " of a sensory loop, but whether that's the same, whether they're aware of that, it's not obvious. Or at least they're aware of it at the first level, but they're not aware of it, they're not aware that they're aware. And I don't know if we are, I don't know if I am. Certainly most of the time I think I'm not. There's just not enough extra processing power, I think,"
    },
    {
      "end_time": 895.213,
      "index": 32,
      "start_time": 866.425,
      "text": " Maybe it's just because of our daily lives consume so much of our brain power. You know, if we were like sort of the philosopher sitting on the sofa, we could just like an ancient world. I mean, we could, you know, have more access to that. And that's one thing I've been very interested in is going back to the ancient world and looking at how people thought about things because our modern world is just so inundated with with certain, you know, things that we have to think about all the time. We don't get much"
    },
    {
      "end_time": 925.691,
      "index": 33,
      "start_time": 896.101,
      "text": " I think that's what's great about your channel. You know, you force people to do that. Thanks. Well, that's also what's not so great about the channel. So you said you could be aware of something but not aware that you're aware. That also reminds me that you can know something but not know that you know it. I think it was I think it was Schopenhauer said a man can or a person can do what they will, but they can't will what they will."
    },
    {
      "end_time": 953.251,
      "index": 34,
      "start_time": 927.159,
      "text": " Right, and so we think we have this freedom of choices and action, but where do those, you know, are there agents in there that are choosing those behaviors? That's one of the things I've been very fascinated about is this idea of our mind being hijacked by systems that are choosing our behavior below our threshold of awareness. So there's a classical psychological experiment where you can sort of puff a"
    },
    {
      "end_time": 983.507,
      "index": 35,
      "start_time": 953.831,
      "text": " Air stream into someone's eye to make them blink and you can in an associative training Get that to match with a stimulus like a little red light turning on interesting and so people like a Pavlov dog with the bell They can learn to instinctively close their eye when the light goes on because they know that the air blast is gonna come on But what's interesting is you can get people to learn that association and they have no idea they've learned it So it's sort of a completely unconscious programming"
    },
    {
      "end_time": 1014.224,
      "index": 36,
      "start_time": 984.428,
      "text": " Now imagine this would be very powerful in marketing, right? You saw someone a logo and they want to go out and buy a bag of chips. Are we susceptible to that sort of thing? And I suggest that we are and that maybe that's just a general phenomenon that maybe a large percentage of our behaviors are chosen at a level that which we don't have access to and would take a lot of work if at all possible to get access to. Running a business comes with a lot of what ifs."
    },
    {
      "end_time": 1039.974,
      "index": 37,
      "start_time": 1014.582,
      "text": " But luckily, there's a simple answer to them. Shopify. It's the commerce platform behind millions of businesses, including Thrive Cosmetics and Momofuku, and it'll help you with everything you need. From website design and marketing to boosting sales and expanding operations, Shopify can get the job done and make your dream a reality. Turn those what-ifs into… Sign up for your $1 per month trial at Shopify.com slash special offer."
    },
    {
      "end_time": 1057.517,
      "index": 38,
      "start_time": 1041.613,
      "text": " Earlier you talked about emotions can be not on switches but off switches and in one respect that's odd to me because there's much more off that you would have to turn this many more switches you have to turn off and you have to turn on so to conceptualize it as an as an off model."
    },
    {
      "end_time": 1086.903,
      "index": 39,
      "start_time": 1057.739,
      "text": " is odd to me exactly it's akin to saying the electrons not an electron it's an off of the quark and the photon and the so on like okay or you can think of it as an electron an on of an electron but it doesn't matter so you can feel free to justify the i believe it was minsky who thought it was off you talked about something else being off so then it makes me think do you think of free will as not free will but free won't and that's one of the ways that we can save free will uh yeah that's an interesting way to think about it um"
    },
    {
      "end_time": 1118.592,
      "index": 40,
      "start_time": 1088.797,
      "text": " That we maybe we don't choose our behaviors, we choose all the things we wouldn't do. And that that, you know, gets to my idea that I've been thinking about a lot lately as this idea of immune system and how it relates to mind and consciousness. And it started by I was looking at the immune system as a kind of computational system and thinking about how our immune system acts kind of like a brain."
    },
    {
      "end_time": 1147.995,
      "index": 41,
      "start_time": 1119.224,
      "text": " It has a memory and it's able to execute certain behaviors based on its previous experience and so on. But in that process, I started to run it in the other direction. Rather than thinking about the immune system like the brain, I started to think of the brain like an immune system. In particular, I think that one of the things that the brain tries to do or the mind tries to do is to protect us from thinking unthinkable thoughts."
    },
    {
      "end_time": 1172.295,
      "index": 42,
      "start_time": 1149.599,
      "text": " Thinking thoughts that would change our emotional state, disrupt our behavior pattern, and in the extreme sense, you know, be lethal. Maybe not in a physical way, but lethal to our personality, to our notion of self. So, there's certain thoughts that"
    },
    {
      "end_time": 1200.213,
      "index": 43,
      "start_time": 1172.688,
      "text": " We don't want to think about we don't like to think about maybe it's the loss of a pet when we were younger maybe it's a loss of a loved one or a family member. Maybe it's anxiety about the future that in general if we let our mind get consumed by these thoughts at a minimum you're gonna have a bad day. And it's gonna hard to see the opportunities in front of you. And so i think one of the things that a healthy mind is able to do."
    },
    {
      "end_time": 1229.462,
      "index": 44,
      "start_time": 1201.22,
      "text": " is develop mechanisms to prevent us from going into these runaway spirals. Whether it's anxiety, depression, hyperactivity, whatever it might be, our mind is trying to modulate those runaway trains. And if we don't, then we can be subject to mental illness, essentially. And if we take that idea seriously and zoom out,"
    },
    {
      "end_time": 1256.613,
      "index": 45,
      "start_time": 1229.889,
      "text": " We have to imagine a class of ideas that in general our mind is trying to keep us away from. When it comes to our immune system, it's useful for us to be exposed to what is deleterious, especially at a young age to strengthen our immune system. And then I imagine repeatedly button smaller bouts as you're an adult. Do you think that that is the"
    },
    {
      "end_time": 1285.691,
      "index": 46,
      "start_time": 1257.261,
      "text": " analogy to you encountering something that's psychologically uncomfortable in order for you to build some amount of resilience so that you can encounter the world, but then not too psychologically uncomfortable. Otherwise it destroys you. Yeah, it's a great question. Um, and maybe that's why we're attracted to the types of things that you see in cinema, um, where we watch stories about loss and we lost, we watch stories about really dramatic events that have happened to other people."
    },
    {
      "end_time": 1315.794,
      "index": 47,
      "start_time": 1286.374,
      "text": " It reminds me I was just at Home Depot and they have all of this Halloween stuff set up and almost everything there you could think of is sort of memento mori and Maybe like the salt or you know building up the tolerance to the poison taking a little bit at a time Having that memento mori helps us deal with our own mortality, right? It's something that can be largely overwhelming if we if we think about it too much But maybe by encountering it in little bits"
    },
    {
      "end_time": 1345.64,
      "index": 48,
      "start_time": 1316.749,
      "text": " You know, that allows us to deal with it, which could be why it's so, you know, pervasive in our culture. Now, what's the point of learning to deal with your mortality in order for you to deal with your mortality? That sounds like it's paradoxical. Learn to deal with your mortality so that you can die so that you could prevent yourself from being overwhelmed by your death so that you don't die. Well, maybe it's just sort of a breakdown of the immune system, that there's some mechanism there that"
    },
    {
      "end_time": 1374.821,
      "index": 49,
      "start_time": 1346.049,
      "text": " wants to break through and sort of taste these ideas that you're not supposed to think about or in general other agents other modules in your mind so to speak are trying to prevent you from thinking about so one of the things that this led me to thinking about these unthinkable thoughts and our mind as a kind of immune barrier is the type of vulnerabilities that ordinary organism physical organisms have in terms of"
    },
    {
      "end_time": 1401.749,
      "index": 50,
      "start_time": 1375.674,
      "text": " being taken over by external forces, let's just say. And so it led me to the idea of looking at informational parasites. Informational parasites. Yeah. So the idea that there's sort of information that if it gets into our brain, it will self-replicate, persist, and essentially go viral. How's that different than Dawkins' mind virus? I think it's very similar."
    },
    {
      "end_time": 1430.725,
      "index": 51,
      "start_time": 1402.534,
      "text": " I think it's very similar. So his idea of the meme in general, I think, is the example of this. And as I was mentioning earlier, these words, like meme, weren't available to the best minds a few centuries ago as part of their repertoire. Now we know what a meme is. We know what it means to go viral. We know what it means to laugh at something and then hit share and then it goes off to ten of your friends. Why are we doing that? Are we sort of this substrate"
    },
    {
      "end_time": 1456.817,
      "index": 52,
      "start_time": 1431.203,
      "text": " For these other, you know, like a virus, it can't exist on its own. I've been calling them hypo-organisms because they need to live on an organism substrate for their reproduction, just like an ordinary virus. But like a regular biological system, they can take over a lot of the function. And we see that in parasite behaviors."
    },
    {
      "end_time": 1487.142,
      "index": 53,
      "start_time": 1457.227,
      "text": " That you have these these zombie insects and the types of things where you you get rats that are no longer afraid of the smell of cats, for example, and then they go and actually approach the cat because that will complete the the cycle for the parasite. And in this research, I've been fascinated. There's some arguments that the complexity of our brain itself. Is it could be due to the fact that we don't want it to be easily controlled by physical parasites?"
    },
    {
      "end_time": 1514.65,
      "index": 54,
      "start_time": 1488.302,
      "text": " and that by making the steering wheel and the gas pedals very convoluted in our brain, that that makes it difficult in an evolutionary arms race for parasites to kind of take control of the reins. And I've been thinking about this a lot in terms of information, in terms of language. Is language a sort of a parasite? And not necessarily in a pejorative way. I jokingly call it the divine parasite."
    },
    {
      "end_time": 1542.637,
      "index": 55,
      "start_time": 1515.094,
      "text": " Uh, you know, in the beginning was the word and the word was God and maybe, maybe it's something that, um, you know, it really literally enlightens us in a sense that we wouldn't be much without our language. Um, but maybe we need to think about it as it's hijacked this brain structure and that that's the thing that's evolving and alive and learning and replicating."
    },
    {
      "end_time": 1553.712,
      "index": 56,
      "start_time": 1544.07,
      "text": " So are you suggesting that the intricacy of the mind and the central nervous system is there because it protects against parasites, viral parasites?"
    },
    {
      "end_time": 1576.305,
      "index": 57,
      "start_time": 1553.968,
      "text": " That's one of the reasons why it's difficult to model the brain, even though they're increasingly improving. And that's one of the reasons why it's difficult to interpret what's going on in someone's brain. So when they show images of hey, here's what it looks like when someone's dreaming. Look, we were able to they dreamed of a duck show duck. But what you have to do is have several examples where someone's looking at a duck or a duck like object."
    },
    {
      "end_time": 1605.009,
      "index": 58,
      "start_time": 1576.596,
      "text": " and then train the computational model to match that and each person is bespoke. Yeah, exactly. That if that mapping between, you know, thinking of a duck and the area of the brain that lights up, if that were simpler, let's say, then it would be more susceptible to being hijacked, both in the modern sense with marketing, but in the classical sense of being taken over by, you know, some brain parasite, whatever, whatever that might be."
    },
    {
      "end_time": 1634.599,
      "index": 59,
      "start_time": 1605.213,
      "text": " Because they could just find the grandma gene. You could just find the right. OK, I mean, I'm sorry. They could just find the grandma neuron. Exactly. Exactly. And then that would be relatively easy to kind of grab the reins. One of the things I've been fascinated with is this concept from the ancient world called the Nam Shub of Enki. OK, have you read Snow Crash by chance? No. Highly recommended to you and your readers. And it's it's a fantastic science fiction story from the from the 90s by Neil Stevenson."
    },
    {
      "end_time": 1663.848,
      "index": 60,
      "start_time": 1635.299,
      "text": " and it's it's where i came across this this idea of this nam shub and um it's neat because it's it's rooted in historical record this sort of linguistic virus spell that out for us oh yeah n a m s h u b okay of enki e n k i uh-huh and so it comes from ancient sumer and it's it's a story about language"
    },
    {
      "end_time": 1693.677,
      "index": 61,
      "start_time": 1665.077,
      "text": " It's a story about linguistic disintegration, about losing the ability to understand language. And a simple example of this is when you take a simple word and you just repeat it 50 or 100 times and it kind of falls apart. Yes. Right. It gets to the point where you can finally actually hear the word. But at least for me, as soon as it switches over to where you're hearing the word, it no longer means anything. Right."
    },
    {
      "end_time": 1723.234,
      "index": 62,
      "start_time": 1695.162,
      "text": " And so imagine you had that at a high level. And so there's this poem, which it's translated into English. But if we were to speak ancient Sumer, Sumerian, and you were to read this poem in Sumerian, the idea is as you got to the end of the poem, you would no longer understand how to read or how to use language. Your understanding of Sumerian would fall apart, kind of like when you repeat the word over and over again."
    },
    {
      "end_time": 1752.483,
      "index": 63,
      "start_time": 1724.07,
      "text": " And what's interesting in meta is the story is about that. So it's a story about that that property. And this is essentially the story of the Tower of Babel. Of sort of losing your ability to understand language. And I've been fascinated by that idea as an example of this this lethal signal. A simple poem, if it were."
    },
    {
      "end_time": 1781.049,
      "index": 64,
      "start_time": 1753.097,
      "text": " You can think of it like prompt injection, right? There's a specific prompt that if you were to give it to a certain speaker in a certain language, it would disrupt their LLM. Now, a lot of people, again, we have these new concepts like LLM and prompt injection where we kind of have an idea of what that means. There's these noxious sentences, very carefully crafted, that if we present them to this language model, it goes into a dynamic that is"
    },
    {
      "end_time": 1810.794,
      "index": 65,
      "start_time": 1781.493,
      "text": " Very unpredictable and certainly not the ordinary self. You know, the kind of super ego turns off on these LLMs and they'll talk to you about things that they are programmed not to talk to you about. And it reminds me of, you know, the kind of mesmerism. You swing the watch and somebody and they say you are getting sleepy. There's there's stimulus that you can present to humans that will disrupt their thinking. And so I've been fascinated by this this concept of lethal text and information hazard."
    },
    {
      "end_time": 1840.043,
      "index": 66,
      "start_time": 1811.561,
      "text": " and trying to understand, are we vulnerable to those? Do they exist in the modern world? And how would we defend ourselves against them? So is this what you mean when you say AI immune system? Or is this more, are you using the concepts from AI immune systems to apply to our mind like immune system? A little bit of both. So I'm very interested in how we take ideas from the immune system to secure and protect our AI systems."
    },
    {
      "end_time": 1865.589,
      "index": 67,
      "start_time": 1840.333,
      "text": " You make a smart door lock with cameras and microphones on it and you connect it to a language model. You want to make sure that's not vulnerable to a prompt injection. So the example I like to give is you can pick a lock, your deadbolt, you can pick it with little metal, you know, tongs and so on, but you can't yell at your deadbolt. You can't intimidate it or blackmail it or threaten its family or bribe it or anything like that. But you can do those things to language models."
    },
    {
      "end_time": 1893.933,
      "index": 68,
      "start_time": 1866.118,
      "text": " And so there's all new interesting. There's sort of psychological vulnerabilities, which we've never encountered that in technology before. Right. We've had bugs and we've had exploits, but you've never been able to make them cry, you know, so to speak. And as we add these psychological type or these mind like objects into our everyday technology, we have to be aware that they're coming with psychological vulnerabilities."
    },
    {
      "end_time": 1923.575,
      "index": 69,
      "start_time": 1894.718,
      "text": " so that's that's one side of it the other side of it i think that the greatest disruption we're going to see from artificial intelligence is not going to be in the technology we see in front of us you know automatic self-driving cars and intelligent homes and software that writes itself or stuff like that that's going to be spectacular it's going to change our economy but the biggest changes i think we're going to see on the planet is going to be in our minds it's going to be how we think and"
    },
    {
      "end_time": 1953.763,
      "index": 70,
      "start_time": 1924.275,
      "text": " The languages we use. I used to think that English was everything we needed. But now I don't think that's the case. And I think we need to either construct languages, find old languages, merge the best of the current human languages, and be willing to change how we think. And I think that's largely determined by the words we use. There's a hypothesis called the Sapir-Whorf hypothesis. Can you talk about that? Yeah."
    },
    {
      "end_time": 1984.155,
      "index": 71,
      "start_time": 1954.394,
      "text": " It's the idea that if you don't have the words for something, it gets very difficult to talk about it. And that we have to have these kind of concepts. I like Alan Kay. He says that all language is a sort of nonverbal gesture. I'm sorry. It's a way of gesturing in high dimensions with language. And we essentially point to things with words. And if you don't have that word, then it's hard for us to kind of point at it."
    },
    {
      "end_time": 2012.483,
      "index": 72,
      "start_time": 1984.497,
      "text": " and agree that we're talking about the same thing. And so I've been, you know, back to just real quick, back to the immune system thing. I've been thinking about how do we protect ourselves and our mind because our minds are going to be under attack, not necessarily from an adversary, but just from this overwhelming vista that AI is going to expose. And it's going to be a dramatic"
    },
    {
      "end_time": 2038.302,
      "index": 73,
      "start_time": 2012.978,
      "text": " Cultural and scientific revolution that I think we have to prepare our minds for by sort of updating our immune system. And our minds are going to be under attack by who or what? Um, largely the void, you know, just the, the new sites, the new Vista, you know, we're getting these new telescopes, we're getting these new microscopes in the form of LLMs that let us, uh, you know, read all of literature."
    },
    {
      "end_time": 2065.52,
      "index": 74,
      "start_time": 2038.951,
      "text": " You know, I think it says it's 20,000 years that it would take to read the amount of material that some of the language models have read. I can't do that as a human. You know, I'm kind of jealous of that aspect. And retain it. So they're going to have insights. They're going to have insights that nobody has sort of gleaned out of all of that, that corpus so far. And so I think that's something we're going to have to prepare against. And it might cause a radical shift in how we think."
    },
    {
      "end_time": 2093.985,
      "index": 75,
      "start_time": 2066.425,
      "text": " Now, how would we be able to tell the difference between those insights and just what some people call hallucinations? Although I think it should be called confabulations. It's a poor word to call it hallucinations. Yeah, I like I like confabulation better for sure. But I think it's a tricky subject because you know, how do we know it's sort of an optical illusion or it's just something outside of our perceptual window? Yeah. So why don't we give an example? We've been quite abstract."
    },
    {
      "end_time": 2122.5,
      "index": 76,
      "start_time": 2094.36,
      "text": " Give us a potential future scenario where some AI system has insight that can disrupt the human mind. I think we're going to see revolutions in psychology and in history. So maybe not at an individual level, but sort of at the academic subject level. You know, I think one of the things I've been thinking about is"
    },
    {
      "end_time": 2150.043,
      "index": 77,
      "start_time": 2123.302,
      "text": " Science, let's say physics, let's call it, has undergone multiple dramatic intellectual revolutions. We had Aristotle's version and then we had Newton come along and throw all that away and then Einstein came along through that all the way and then quantum mechanics came through that all the way and with chaos theory and then with computation and so on. We've had six or seven of these dramatic revolutions"
    },
    {
      "end_time": 2179.258,
      "index": 78,
      "start_time": 2151.101,
      "text": " And so if you were to go back to somebody 150 years ago and explain what science looks like today, it would look very different and you'd have to explain those milestones, those hurdles that had been jumped over. I'm not sure that history has undergone the same thing. If I were to go ask my great grandfather, tell me the story of how we got from, let's say Egypt to Napoleon, I think it would be approximately the same story that you would learn about today as a sixth grader."
    },
    {
      "end_time": 2205.435,
      "index": 79,
      "start_time": 2179.974,
      "text": " That doesn't make any sense to me. How could it possibly not have undergone some revisions? And the same with psychology and the mind itself. We now have all these new concepts like information theory and bits and download and upload and storage capacity and memes and going viral. These are all things that every middle school student would understand."
    },
    {
      "end_time": 2229.104,
      "index": 80,
      "start_time": 2205.964,
      "text": " We have to go back and re-examine psychology in light of these new concepts. And I think that's going to be a dramatic undertaking. Ben Horowitz and Mark Andreessen were speaking and they were saying, how do you regulate AI? Because if you were to regulate it at what they call a technological level, that's akin or if not the same as regulating math, which is impractical."
    },
    {
      "end_time": 2259.138,
      "index": 81,
      "start_time": 2229.462,
      "text": " So the government official countered and said, well, we can classify math. In fact, historically entire areas of physics were classified and made state secrets, though this was during the nuclear era and that they can do the same for AI by classifying areas of math. Now that sounds quite dubious because what does it mean? Do you outlaw matrix multiplication? Do you say, okay, nine by nine is fine, but 10 by 10, we're going to send the feds in even during the nuclear era."
    },
    {
      "end_time": 2289.411,
      "index": 82,
      "start_time": 2259.77,
      "text": " Some of those bands were private. Yeah, like you didn't know that you were stepping on toes that you weren't supposed to. I don't see how you can make such bands private now because you would have to say what is what is being outlawed. So there's several issues here and I want to know what do you think about this for people who are watching? Will is known in the South Florida communities like a hidden gem for us here, but you're quite famous in the A.I. scene in Florida and me and you. We also got along because we have a background in math and physics."
    },
    {
      "end_time": 2318.592,
      "index": 83,
      "start_time": 2289.667,
      "text": " So when we spoke off air a year ago or so, we were talking about the Freedom of Information Act and your views on government secrecy. You're a prime person to answer this question, to explore this. Yeah, I think, you know, this is such a, such a fascinating area. Um, what it reminds me of is, is Grace Hopper, one of the, the first modern computer programmer. And she was, she was drafted into the Navy and she discusses"
    },
    {
      "end_time": 2348.268,
      "index": 84,
      "start_time": 2318.933,
      "text": " that when World War II happened, her profession as a mathematics professor became classified. That was a classified occupation. And so you're exactly right that entire branches of mathematics and computing have been declassified throughout history. I just saw there was an interesting photograph of one of the computers that Turing worked on. And the British government just declassified this like a month ago."
    },
    {
      "end_time": 2378.251,
      "index": 85,
      "start_time": 2349.053,
      "text": " It's a photograph of a World War II computer that they felt that just the image of that from the outside is something they needed to keep classified for this long. I'm of the strong opinion that with artificial intelligence, we're not really seeing the invention of it. I think we're seeing the disclosure of it. We're seeing the public dissemination, the open source aspect of it. There's really two possibilities."
    },
    {
      "end_time": 2407.295,
      "index": 86,
      "start_time": 2379.206,
      "text": " Either that's true or that's not. Either we invented, let's just say, language models. We either invented them in the 2020s or we invented them in the 1950s. Either one of those scenarios is kind of scary to me, right? Arthur C. Clarke said there's two possibilities. We're either alone in the universe or we're not, and both are equally terrifying. Exactly. If we only recently just invented this, then that means that Turing's ideas and von Neumann's ideas"
    },
    {
      "end_time": 2436.408,
      "index": 87,
      "start_time": 2407.722,
      "text": " And the very first papers on computer science themselves just collected dust for no reason. Turing proposed building a language model. Von Neumann discussed building neural networks. And interesting as an interesting jump back, I recently found that Von Neumann's computer at the Institute for Advanced Study, one of the very first programs they ever ran was to look at parasites."
    },
    {
      "end_time": 2458.797,
      "index": 88,
      "start_time": 2437.295,
      "text": " was to look at biological evolution and to see if there were informational parasites that would emerge in the memory space, essentially artificial life, as we would call it now. So in these two possibilities, you know, one, we invented this 75 years ago or so, and it was locked up in some vault. Or we didn't."
    },
    {
      "end_time": 2482.875,
      "index": 89,
      "start_time": 2459.206,
      "text": " And we wasted seventy five years of opportunities to to cure cancer with a i and to look at climate change and to use this incredible technology for the benefit of humanity because we had. This immune system that blocked us from thinking about it for so long so many people thought that i was just this crazy notion and i think that's hard to argue now."
    },
    {
      "end_time": 2506.323,
      "index": 90,
      "start_time": 2483.916,
      "text": " But these original papers, and I encourage everybody to go back and grab Turing's papers, they're very, they're very readable, right? They're easily digested compared to modern academic papers. And he literally proposed with neural networks and with training and reinforcement and so on, the kind of structures that we see essentially in chat GPT."
    },
    {
      "end_time": 2533.985,
      "index": 91,
      "start_time": 2506.766,
      "text": " Now, you say essentially in chat GPT, because I imagine Turing didn't propose the transformer. And so when we say that someone historically invented so and so, it reminds me of a friend who's like, I invented Netflix because in the 90s, I thought, wouldn't it be great? I'm like, yeah, what do you mean you invented it because you thought like Leonardo invented the the helicopter because he drew it. Right. OK. Well, you know, I think there's there's three major"
    },
    {
      "end_time": 2564.821,
      "index": 92,
      "start_time": 2534.872,
      "text": " Components in the recipe"
    },
    {
      "end_time": 2595.247,
      "index": 93,
      "start_time": 2565.708,
      "text": " And then the other one is the data, that we now have this massive data, these massive data sets. And the third one that I think nobody really talks about, and I'm surprised, is essentially the combination of calculus with computer science, with linear algebra, in the form of what's called automatic differentiation. And I never hear this in the discussion, and I'm surprised. It's kind of like we invented the automobile,"
    },
    {
      "end_time": 2623.985,
      "index": 94,
      "start_time": 2595.572,
      "text": " And everybody just loves it. And you reply and you say, well, yeah, gasoline is so amazing. And people say, what's gasoline? Automatic differentiation is the thing that makes AI work. And it's the ability to run calculus, whether it's the transformer or Covnet or whatever architecture is, all of them under the scenes. We take the computer program, we essentially write it as a giant function."
    },
    {
      "end_time": 2654.07,
      "index": 95,
      "start_time": 2624.428,
      "text": " Now, as human, we don't have to do that. That's kind of at the kind of the compiler level. But we write our Python or Torch code or TensorFlow or whatever it might be. And then that's converted into essentially a giant, you know, function. There's gradient tapes and all kinds of interesting ways it's done nowadays. But we calculate the derivative and the derivative tells you which direction to go to make an improvement. It's kind of like a magic compass. And it says we're doing this well right here. If we go that way, we'll do even better."
    },
    {
      "end_time": 2682.432,
      "index": 96,
      "start_time": 2654.633,
      "text": " And that's the magic wand, the secret sauce that makes all of these work. But Turing was a mathematician. I think he knew about calculus. I think he knew about it probably better than most humans. And so I'm shocked that one that's not more in the common language of, wow, we combine these two branches of math and look how powerful that was. And the idea that von Neumann and Turing would have missed that"
    },
    {
      "end_time": 2712.534,
      "index": 97,
      "start_time": 2683.66,
      "text": " You know, I think doesn't make any sense. Now on the other side, we say, well, what about, okay, well, they didn't have enough hardware and they didn't have enough data. Well, let's look at data first. Um, you know, the, the signals intelligence community has the, the mandate to capture all the signals that grow across the planet, right? Uh, back in the fifties and sixties, there were boats that sat in the middle of the Pacific with big antennas that just captured all the EM traffic. So there's been plenty of data. If you had the right now, again, maybe this didn't happen. And that's also,"
    },
    {
      "end_time": 2742.125,
      "index": 98,
      "start_time": 2712.961,
      "text": " Well, if we look at computers, I was saying, if you could do it this year, could you have done it last year for more money?"
    },
    {
      "end_time": 2772.978,
      "index": 99,
      "start_time": 2743.387,
      "text": " And I think so. So how much did it train cost to train, uh, you know, chat, GBT on the daughter on an order of dozens of millions of dollars from what I understand. Right. With off the shelf consumer technology chips that anybody could buy on the open market. I see. How much does an aircraft carrier cost? Right. 17, 17 billion dollars before you put the airplanes and people on it, not including the development cost. So."
    },
    {
      "end_time": 2802.892,
      "index": 100,
      "start_time": 2774.206,
      "text": " In one sense, we had this notion of computers from the 1950s that were massive, had their own power generators, often power stations, cost millions of dollars and were these enormous technical pieces of equipment. In the 70s, we invented this thing called the mini computer, the size of a couple of refrigerators. And then in the 80s, we had the micro computer. And we don't really call them this today, but our telephones and laptops, we could call them nano computers."
    },
    {
      "end_time": 2834.002,
      "index": 101,
      "start_time": 2804.48,
      "text": " Let's say, but in some sense, you could keep the original definition of a computer. So to me, a computer is something that by definition costs millions of dollars, lives underground, has its own power station, required specialized operators and so on. We just like the like the big thing of baloney. We carved off one slice and like the deli sample, we have this one little piece of ham and we think this is fantastic. This is amazing. Yeah, but just scale it up."
    },
    {
      "end_time": 2862.756,
      "index": 102,
      "start_time": 2834.394,
      "text": " And there's certainly enough money around the world to do that, to build a computer at scale. I would argue that things like chat GPT or LLMs, they're as powerful, as dangerous, as important as an aircraft carrier in a sense. And so if this is the only one or rather. If military organizations don't have more powerful ones, that's scary to me in some sense, that that means the most powerful technology in the world is just available to middle schoolers. That's that's striking to me."
    },
    {
      "end_time": 2891.596,
      "index": 103,
      "start_time": 2863.217,
      "text": " On the other side, I think it's surprising that when we look at the power of these models, a new one just launched this week that's significantly better at writing code. Well, that thing is serving hundreds of thousands of people at once. Millions of people are using ChatYPT. It was the most viral application of all time. Imagine it was just had one operator, right? So it's chewing on everybody's problem all at once."
    },
    {
      "end_time": 2922.005,
      "index": 104,
      "start_time": 2892.073,
      "text": " It's like serving, you know, a hundred thousand peanut butter jelly sandwiches all at the same time. And if you think about, well, what's how big of a single sandwich could it make? And it's like a pretty significant one. And so when we get so impressed that it can pass these tests and do this thing, it's like, but that's just one slice. That's just one baloney slice. Imagine if you took that kind of a system and tasked it to do a single problem, you know, what would you get out of that? So I think it's reasonable to suspect that there are systems that are much more powerful"
    },
    {
      "end_time": 2939.497,
      "index": 105,
      "start_time": 2922.363,
      "text": " And as I said, I almost hope that there are extra value meals are back. That means 10 tender, juicy McNuggets and medium fries and a drink are just eight dollars only at McDonald's for limited time only prices and participation may vary. Prices may be higher in Hawaii, Alaska and California and for delivery."
    },
    {
      "end_time": 2969.616,
      "index": 106,
      "start_time": 2940.93,
      "text": " Now, why do you say that neural nets, we're not seeing the invention, we're seeing the disclosure, why not we're seeing the co invention or the independent invention? Like the same kind of thing, I think is kind of what I mean. In other words, you're not suggesting that we've had neural nets and then the government was saying, okay, let's disclose about some new technology. Rather, it's like Leibniz and Newton, they both developed calculus, but independently, Newton may be first if you're on the Newton camp. Yeah, I think it's"
    },
    {
      "end_time": 2998.763,
      "index": 107,
      "start_time": 2969.991,
      "text": " I think it's the kind of thing where it got into the point where you could redevelop it for just a few million dollars or even less, essentially. You know, so some of it I think of, you know, things like truth and reality is sort of like, like what's called percolation, that it doesn't matter if there's a leak, it matters the size of the leak. And if it's gone critical across a network, you could have told, you know, Turing could have known all about it. Von Neumann could have known all about it. But unless that's"
    },
    {
      "end_time": 3028.933,
      "index": 108,
      "start_time": 2999.087,
      "text": " Going viral, essentially. It doesn't matter how many people know about something if that number of people is below a certain threshold. For many of these technologies, you don't see that there's something inherent in competitive markets that are what drives the invention of these and that the government doesn't have that same incentive structure inside. No, no, I do 100% believe that the market forces are very good at tuning these things up. So if these things existed,"
    },
    {
      "end_time": 3052.381,
      "index": 109,
      "start_time": 3029.206,
      "text": " They probably cost a fortune to run. Richard Hamming talks about in the early days of computers, he was at Los Alamos, they cost a dollar a second to run. Just extraordinary costs. And so imagine you had something like ChatGPT-3 and you had it 20 years ago and it could write a nice essay."
    },
    {
      "end_time": 3081.664,
      "index": 110,
      "start_time": 3053.234,
      "text": " But it costs $100,000 each a pop, right? You know, like, what would you do with it? Um, or the ability to create a deep fake photograph, but each one costs $500,000 or something like that. Um, the most expensive Haiku. Exactly. Exactly. Right. The, the Wagyu, the AY five Wagyu or whatever it is. Right. And, uh, nobody's going to eat that. Nobody's going to eat that essentially. Um, but at a certain level, you know, it might be worth it at least to keep that technology alive."
    },
    {
      "end_time": 3105.282,
      "index": 111,
      "start_time": 3082.5,
      "text": " i see now isn't there something about it being trained on data that is recent that increases the intelligence of the model and so even if it was the case that in the nineties this was there in the government at some rudimentary form it would be a rudimentary form that would be so bloated in cost right and then that would also compete against other technologies inside the government that also have a bloated cost"
    },
    {
      "end_time": 3130.282,
      "index": 112,
      "start_time": 3106.817,
      "text": " Well, I like this thing you said about only recent data, and I'm actually fascinated by the opposite. What I'd love to do is to see models that kind of live in a time bubble and train them up to a certain century or decade and then cut it off. Don't tell it it's in the future, right? Give it only ancient philosophical texts."
    },
    {
      "end_time": 3160.503,
      "index": 113,
      "start_time": 3130.538,
      "text": " Okay, you mentioned Richard Hamming. Now, when we met two years ago, I believe you told me about Richard Hamming series on YouTube and I watched all of it. So please tell me why you were so enamored with that, what you learned from it, why the audience should watch it. Yeah, it's it's easily the best to call online class, I think is the best name is the best"
    },
    {
      "end_time": 3189.65,
      "index": 114,
      "start_time": 3160.896,
      "text": " Course lecture series, I think I've ever seen. It was recorded in I think 95 by Dr. Richard Hamming of Bell Telephone Laboratories and Los Alamos. And he goes through a fantastic overview. He calls it learning to learn the science of art and engineering, the art and science of the science and engineering. And he talks about trying to prepare people for their technical future. And"
    },
    {
      "end_time": 3219.565,
      "index": 115,
      "start_time": 3190.179,
      "text": " He even explains that the course isn't really about the content. It's the sort of the meta. And he uses that just as a vehicle to get across essentially a lot of stories. He discusses the idea of style and how important it is. You know, he describes early on that he felt like he was a janitor of science, sort of sweeping the floor, collecting some data, running some programs, a part of the machine, but not a significant piece. And he wanted to kind of make an impact."
    },
    {
      "end_time": 3248.336,
      "index": 116,
      "start_time": 3220.247,
      "text": " And he discusses trying to change the way he looks at things, namely in terms of style. And he doesn't try to describe that directly. That's kind of the content of the course. And I would encourage everybody to go and look at it. He goes through the history of AI. He goes through the history of technology, of mathematics, of quantum, and so on. And he discusses neural networks and, you know, some very farsighted things. And it's accessible. It's extremely accessible. Yeah, there aren't"
    },
    {
      "end_time": 3276.135,
      "index": 117,
      "start_time": 3248.763,
      "text": " Equations as far as i know he doesn't write on the blackboard much yeah the board is so blurry the board is so blurry unfortunately you can't really see them when he does but that's not really the point but there is actually a book and so i think it's actually now back in print and i think you can find it on amazon and uh it's a fantastic text so if you're more into reading you can go through it that way but i encourage everybody to give it a listen he's very inspiring uh particularly the first and last"
    },
    {
      "end_time": 3306.391,
      "index": 118,
      "start_time": 3276.425,
      "text": " Episodes on you and your research. They'll really get you jazzed up and pumped about your work. What insight have you taken that you've applied recently? It's a good question. I can go first if you please. Well, one is that when I was speaking to Amanda Gefter about quantum mechanics, the Cubists tend to say, look, we're the ones who are rationally evaluating what quantum mechanics is and then inferring our interpretation atop that. And Richard Hamming had a great quote."
    },
    {
      "end_time": 3335.247,
      "index": 119,
      "start_time": 3306.783,
      "text": " Where he said, people, including Einstein, including Bohr, they start from their metaphysical assumptions and then build the top their interpretation of quantum mechanics. And in fact, you can look at someone's whatever someone prefers as an interpretation of quantum mechanics and infer their metaphysics. Right. So it reminds me of a couple of things. One with Bohr and Bohr, I think it was to Einstein. He said, and I love this quote, you're not thinking."
    },
    {
      "end_time": 3366.323,
      "index": 120,
      "start_time": 3336.442,
      "text": " You're merely being logical. Uh huh. And that had a profound impact on me and it led me to think about different modalities of the brain. Maybe these different agents in popular psychology and which I think becoming more important this idea of left versus right brain that neuroscience kind of ignored for a long time. They said that's just folk psychology. But I think there's a lot more to it than that. And so I've been I've been looking in that direction. There's a fantastic book"
    },
    {
      "end_time": 3394.462,
      "index": 121,
      "start_time": 3366.715,
      "text": " It's actually about how to draw, like sketching. It's called how to draw on the right side of the brain. And I'm going through this and I'm like, this is the best neuroscience intro I've come across. Because in learning how to teach people how to draw, the author, she realizes that people have this very different ways of thinking. And maybe like the emotion kind of idea, you have to be able to turn off some of these capabilities to have the other take the center stage."
    },
    {
      "end_time": 3419.275,
      "index": 122,
      "start_time": 3394.906,
      "text": " You know, we all know that ego is kind of a hog of the spotlight. And to get this other, let's just say, more sensitive aspect of our mind, which is responsible for seeing the bigger picture and drawing things, you have to think very differently about that. And it also reminds me of the thing I really like about Hamming. I mentioned at the beginning this idea of tolerance of ambiguity."
    },
    {
      "end_time": 3449.428,
      "index": 123,
      "start_time": 3420.52,
      "text": " And he really emphasizes that throughout the course. And I've tried to do that. It's not easy to do because you feel a little schizo doing it. Because as he says, you have to both believe and disbelieve in an idea at the same time. You have to believe in it enough to entertain it, to start thinking on it and work on it and potentially make progress. But if you believe it too much, then you'll never make any progress. Einstein believed in his idea of space time too much."
    },
    {
      "end_time": 3476.493,
      "index": 124,
      "start_time": 3449.753,
      "text": " And he was unable to appreciate and make contributions in quantum mechanics because his belief was too strong. And so this idea that you have to believe and disbelieve at the same time, this, this non Aristotelian logic, it just because it's just because it's true, you know, we always think, okay, if it's not true, it has to be false. If it's not false, it has to be true. No, there's a lot of space in between those. And we, we don't have much training as scientists"
    },
    {
      "end_time": 3499.582,
      "index": 125,
      "start_time": 3477.005,
      "text": " You know, I think as trained as a physicist, I was very vulnerable to not being able to see that middle ground for a very long time. Have you read The Master and His Emissary by Ian McGill Crist? You know, it's funny, I love that. I was just watching it. There's a great documentary on it. And that's one of my favorite ideas with this left and right brain that we have, you know, many selves"
    },
    {
      "end_time": 3530.043,
      "index": 126,
      "start_time": 3500.213,
      "text": " What bothers me about the criticisms on the whole left brain versus right brain is that they tend to just be about well functions aren't localized to the left or to the right solely and I'm like okay but to me that's not the issue of left brain versus right brain is modalities like you mentioned that word modalities that there are different modules in the brain and they can"
    },
    {
      "end_time": 3555.742,
      "index": 127,
      "start_time": 3530.828,
      "text": " The fact of them being separated by hemispheres is the least interesting part to me. Right, right. It reminds me of an idea that I've been trying to put together. So we had this science called thermodynamics. And it was about heat and energy and work and things like that. And then later, we got the theory of statistical mechanics."
    },
    {
      "end_time": 3583.2,
      "index": 128,
      "start_time": 3556.067,
      "text": " And Boltzmann came along and he said, well, let's redo this and assume that we actually have a bunch of little atoms and that they're moving around and we can do these probability theory and you get to essentially the same answers. But what's but what's fascinating to me kind of as a metaphor. Is thermodynamics is a very successful. Branch of science is very powerful predictions and it does not presume the existence of atoms."
    },
    {
      "end_time": 3611.903,
      "index": 129,
      "start_time": 3585.452,
      "text": " And so as a metaphor, I want to think of a kind of neuroscience or a kind of brain science that does not presume the existence of neurons. Interesting. Now, obviously, we know there's neurons, right? We could we can see them. It's an extraordinary, powerful. The neuronal hypothesis has been revolutionized neuroscience. I'm not suggesting that's not the case. But what I'm saying is we could be missing a powerful view"
    },
    {
      "end_time": 3642.022,
      "index": 130,
      "start_time": 3612.483,
      "text": " And like you said, with the left and right brain networks, by forcing it into the paradigm of fMRI, we're missing the point in some sense. And so I would love to see a theory that kind of operates at a higher level. Right. And is not necessarily trying to at every step, maybe at the end, you can go and see where it has this correspondence principle with statistical mechanics. And we could think of the mind kind of like"
    },
    {
      "end_time": 3671.852,
      "index": 131,
      "start_time": 3642.602,
      "text": " Um, you know, William James style, um, psychology independent of particular neuronal structures and then later go back and do the correspondence on it, but not hold ourselves back from this kind of, of thinking. So who's the modern day Jung Carl Jung? That's a great question. I think the problem is, is you know, academia doesn't tolerate that kind of thing, right? Um, I love your recent episode with, uh, Gregory Chaitin."
    },
    {
      "end_time": 3700.282,
      "index": 132,
      "start_time": 3672.142,
      "text": " and this kind of idea that it's hard in the modern academic reality to have these kinds of things, to both believe and disbelieve, to tolerate ambiguity is kind of not tolerated in a sense. So, you know, I think that's what's just so extraordinary about your channel and your community is it's one of the few places I've seen in the world that allows this tolerance, where, you know, as a viewer,"
    },
    {
      "end_time": 3726.8,
      "index": 133,
      "start_time": 3700.572,
      "text": " You can watch something and you don't have to believe everything and you don't have to disbelieve everything. You can kind of just let it pour over you and and look at these different viewpoints. And I think that's what's just really refreshing about your group and your community. I don't see that many places. Thanks, man. There's so many different avenues I could take this you have for people who have just tuned in. Well, like I mentioned, you're infamous in the"
    },
    {
      "end_time": 3750.418,
      "index": 134,
      "start_time": 3727.193,
      "text": " Famous and infamous in the South Florida community in the AI scene. And so I'm happy to bring attention to you to the global scene, at least in a small part. You're known also for almost any topic. Someone could just ask you a question and then you can just spout off on it informedly, not just uninformed. So you mentioned academia. I want to talk about that."
    },
    {
      "end_time": 3779.309,
      "index": 135,
      "start_time": 3751.084,
      "text": " What does academia do well and what do you see as a new problem academia is facing, new as in the past five years? It's either getting worse or it's new. Well, I wish academics, particularly young professors, had more opportunity to go outside their wheelhouse. You know, I'm very excited. I got to give a shout out to Dr. Elon Barinholtz and Dr. Susan Schneider."
    },
    {
      "end_time": 3806.459,
      "index": 136,
      "start_time": 3779.599,
      "text": " who we put together, or Susan runs the Center for Future Mind, which is a fantastic organization with so many amazing members. And we do the amazing conference series, the MindFest, yeah, conference series, which is just spectacular. I'd like to shout out Susan as well. Image on screen, video in the description. Continue. And so I want to give a special thanks to both of them for helping build such an amazing environment."
    },
    {
      "end_time": 3835.896,
      "index": 137,
      "start_time": 3807.09,
      "text": " where I've had the opportunity to kind of explore some of these. And so I put together a lecture series. Some of them are recorded. I'll share the links about this idea of lethal text and info hazards and so on. Well, you know, being in the math department, I used to joke to the audience that I hope these aren't lethal to my tenure because it's very outside the types of things that a young professor would be working on."
    },
    {
      "end_time": 3862.551,
      "index": 138,
      "start_time": 3836.596,
      "text": " And if I if I was in charge, I would dissolve departments. I don't think they're doing us any favors at this point, particularly to the students, because very early in their careers, they have to choose these tracks. And it doesn't allow them to kind of look at these overlaps. And I think all of the interesting progress and all the interesting ideas are going to lie at the intersection of these fields."
    },
    {
      "end_time": 3892.602,
      "index": 139,
      "start_time": 3862.773,
      "text": " Yeah, I think so as well. We're also at a conference together called Polymath. And one of the reasons why I resonated with Polymath by Ecolopto, our mutual friend Addy. Fantastic group. The reason why is because with theories of everything, it's actually not to plug toe, but there was a recent article on the most polymathic podcasts. Yeah. And theories of everything was number one, beating out Lex. That's awesome. So I'm also passionate about the intersections between fields."
    },
    {
      "end_time": 3922.278,
      "index": 140,
      "start_time": 3892.875,
      "text": " I'm not of the sort that is of the complete dissociative type. There's a necessary and fructuous component to having categories and then there's a necessary and fructuous component to dissolving those categories as well. Yeah, I mean, I think they should be presented like a buffet where maybe in each tray you have a particular dish. You don't you don't want to just put all the ingredients in a blender, right? But let people go down with their plate and take a little scoop of everything because"
    },
    {
      "end_time": 3950.691,
      "index": 141,
      "start_time": 3923.677,
      "text": " That's where everything is going to be. That's a great way of phrasing it. Okay, so what else is the solution other than, in your opinion, doing the buffet style instead of forcing students to choose a program to specialize in? Yeah, I wish students were able to take courses across the catalog. I had the opportunity to go to a fantastic school in North Carolina called Guilford College."
    },
    {
      "end_time": 3981.305,
      "index": 142,
      "start_time": 3951.442,
      "text": " And while my home base was in the physics and math department, I was actually required to go out and take courses in other areas, things like colonial Latin America and jazz appreciation and African drumming and scientific glass blowing and things I never thought that I would have to fold into my my schedule. And they actually required me to do so. And when I look back, that's where a lot of really my interesting ideas"
    },
    {
      "end_time": 4005.401,
      "index": 143,
      "start_time": 3981.425,
      "text": " came from. When I took this glass blowing class in the chemistry department, we learned how to make pipettes and test tubes and things, and I learned about annealing. The idea that you have to very slowly cool the glass, because if you cool it quickly, it'll crack like ice cubes in your water. And so we used to bury it in this vermiculite."
    },
    {
      "end_time": 4028.387,
      "index": 144,
      "start_time": 4005.811,
      "text": " And it would trap the heat in and the way you can think about is like the atoms are trying to kind of bond together and if they just make the quick first choice they come across it's not a very good connection but if you give them heat over time they can explore a better configuration space and they'll get a stronger bond. That idea directly led me into simulated annealing."
    },
    {
      "end_time": 4055.759,
      "index": 145,
      "start_time": 4028.899,
      "text": " which is at the heart of training algorithms. When we talk about the learning rate in a neural network, that's essentially what it is. It's giving it this thermal energy so it doesn't just go to the first solution but actually has time to explore the solution space. And I'll never forget early on looking up that concept and I was on an early page called HyperPhysics. I don't know if any of your readers remember that one. Fantastic website."
    },
    {
      "end_time": 4085.401,
      "index": 146,
      "start_time": 4056.288,
      "text": " I was halfway through the page and I kind of had to take a pause back for a second. I thought, wait, I thought I was reading about an algorithm. This is physics now. And it was about Boltzmann distributions and so on. And I was thinking, is this physics or is this computers? And it took me a minute to realize it was both. And I was in this new territory that I had never been before."
    },
    {
      "end_time": 4113.029,
      "index": 147,
      "start_time": 4085.708,
      "text": " Really at a significant overlap between these two areas of science or of humanity in general. And that was a big deal for me at the time. And so I encourage, you know, all the all the young listeners, whether you're going out online, whether they're exploring your amazing channel to go and click on that video you normally wouldn't watch, go and find one. You're like, no, I don't I don't I don't like that. I don't know that. I'm not interested. Click on it anyway."
    },
    {
      "end_time": 4138.49,
      "index": 148,
      "start_time": 4113.558,
      "text": " Because that's where you're going to find stuff that you weren't expecting. At nighttime, I have a projector set up so that I can watch YouTube videos that, well, sometimes I don't click on the ones that I feel like these are just not. It's usually if it's not my style of humor and I could tell from the thumbnail image or title that I just I won't click on it. I just I don't like that. But if it's for subjects. So I recently got into art history. Oh, my gosh."
    },
    {
      "end_time": 4167.585,
      "index": 149,
      "start_time": 4138.763,
      "text": " To even be able to tell the difference between a Renoir and a Monet, and to say that I'm appreciative of Impressionism versus Post-Impressionism, and I think they went off the rails in Abstract Expressionism, I feel pretentious saying that. But I know what those words mean now, and I love, I absolutely love art history and looking at different buildings and saying, what is that style called and why was it influenced and where did it come from? So all that is a new interest of mine. Right. I think that's where we need to embrace"
    },
    {
      "end_time": 4197.944,
      "index": 150,
      "start_time": 4168.831,
      "text": " This sort of liberal arts style education that I think the modern universities, large universities, don't appreciate enough. That's what's great about your channel. I think that's what's great about what Addy's doing with this polymath group is to bring together these different kinds of thinkers and get the crosstalk. I call it a conversation factory because you're going to come across, if nothing else, metaphors"
    },
    {
      "end_time": 4222.039,
      "index": 151,
      "start_time": 4198.2,
      "text": " that you can then bring home to your studies and they can be very powerful perspectives. The Economist has an article on how to define artificial general intelligence. Some people may say, well, in the future, in the not so distant future, we can just speak to an AGI, which is polymathic. So firstly, what is AGI and what is the"
    },
    {
      "end_time": 4252.09,
      "index": 152,
      "start_time": 4222.483,
      "text": " Yeah. Well, what's interesting is, you know, one of the subjects I ignored for a very long time in my own academic career was history. I just wasn't particularly interested in it. I was so fascinated with technology in the future that I put that on the back burner. But in trying to understand AI and neural networks and computer technology, I had to start going backwards."
    },
    {
      "end_time": 4281.681,
      "index": 153,
      "start_time": 4252.858,
      "text": " And as they say, I realize the farther you go back, the further you can see ahead. And so I've got some great playlists. I'll share the link. And I would encourage everybody, whether it's Hamming or Bell Laboratories has a collection of videos, there's these amazing documentaries that go back and you can hear from the original folks, whether it's Claude Shannon or whoever it might be. McCarthy is what I was just thinking of because"
    },
    {
      "end_time": 4308.609,
      "index": 154,
      "start_time": 4282.21,
      "text": " You know, McCarthy coined the term artificial intelligence and he said it was for a grant to sound fancy. Right. And he says he asks the audience not to think too much into it. If you were to go back and encourage people to do them and watch these videos, not only would those scientists say we have AI now, they would say we have AGI. So I think by all traditional definitions of AI and AGI,"
    },
    {
      "end_time": 4337.073,
      "index": 155,
      "start_time": 4309.206,
      "text": " We have that now in the form of these modern models. Their ability to write poetry, to give you recipes, to do mathematics, to write literature, that's general. I would argue they're more general than most human beings at this point. Most humans are very sparse in the types of questions they can confidently respond to. These models are not. They have a dense set of questions for which they can"
    },
    {
      "end_time": 4364.155,
      "index": 156,
      "start_time": 4337.551,
      "text": " accurately and confidently respond to. And so I would argue that that's very general. I think the thing that we want to think about next is artificial super intelligence. And I think we can define that as thinking thoughts that might be are unthinkable now, both in complexity, in scale, or maybe just in their character. You know,"
    },
    {
      "end_time": 4392.381,
      "index": 157,
      "start_time": 4365.316,
      "text": " Being able to do recipes with particle physics, to think about the Large Hadron Collider like a brownie recipe, that's not something I can do. But a sufficiently advanced model is probably going to be able to think about physics and chemistry and so on. I think chemistry might be one of the killer apps of AI. We did some work in our lab early on with transformers about five years ago, looking at molecular space."
    },
    {
      "end_time": 4416.834,
      "index": 158,
      "start_time": 4393.234,
      "text": " You know, the one thing I like to think about is if you take like, you know, a piece of paper and shake it, the speed of sound is in there somewhere. And if you did a clever enough experiment and I knew the density per square inch of the paper and I knew the boundary conditions and how I was shaking it to get that particular audio from that dynamics, you'd have to have somewhere in there is the speed of sound. A sufficient model will be able to just kind of grab that."
    },
    {
      "end_time": 4445.794,
      "index": 159,
      "start_time": 4417.671,
      "text": " It'll be able to do these kind of spontaneous experiments and looking at the leaf floating in the wind and calculate all kinds of constants from it. That's not something I can do. I don't think very many, if any, humans can do things like that. But I think that's what I think of the next revolution in AI. That's the thing I'm excited about is it actually going out and doing, you know, real science in a way that maybe we can't follow. And that becomes an interesting concept."
    },
    {
      "end_time": 4461.732,
      "index": 160,
      "start_time": 4446.254,
      "text": " In girdle asher bach there is a small paragraph which i wish he expanded on and it's one of my favorite paragraph is on the three types of messages so he had something called the inner message which is the meaning of the message the outer message which is."
    },
    {
      "end_time": 4488.66,
      "index": 161,
      "start_time": 4462.09,
      "text": " a decoding mechanism so for instance if you speak only english and it's a japanese then you need a dictionary to translate between those two that's part of the outer message and then there's the frame that is that which makes apparent that you're reading a message at all so for instance some people say aliens could be communicating with us right now we just don't know it's with neutrinos or it's the the noise in the data that we"
    },
    {
      "end_time": 4514.087,
      "index": 162,
      "start_time": 4488.66,
      "text": " filter out right so that would be that we're not recognizing the frame something like that and of course that can go off the rails and in part schizophrenia can be seen as an error in false positives of the frame right okay how do we know that already we don't have this super agi because the computer you could ask it tell me some insight that i wouldn't be able to understand and maybe it just generates for you characters"
    },
    {
      "end_time": 4543.968,
      "index": 163,
      "start_time": 4514.804,
      "text": " And you have no idea how to decode this. So you don't know the outer message nor that there's the frame there. Right. I think that's absolutely the case. And I think we might already be in that in that regime, in a sense. And that's ideas I've been having in going back through the history of computing and so on. I thought, well, let me go to look at the 90s, then the 80s and so on. I found myself in the 50s and 40s and kept going back. And now I find myself in antiquity."
    },
    {
      "end_time": 4574.172,
      "index": 164,
      "start_time": 4545.776,
      "text": " And I'm looking at things like Sumerian mythology or the Antikythera mechanism or the steam computers from Alexandria. And I'm realizing there's this whole layer of reality that's very difficult to perceive. It doesn't really fit. It's not continuous with modern, let's just say, education. You don't learn about it in school. I mean, let's just take the Antikythera mechanism, for example."
    },
    {
      "end_time": 4604.497,
      "index": 165,
      "start_time": 4575.111,
      "text": " That single artifact disrupts the public technological timeline by two millennia. There's no explaining that artifact in the normal paradigm. We either have to come up with a completely new narrative or think about it just completely differently. It just doesn't plug in. We have a mechanical analog astronomical computer"
    },
    {
      "end_time": 4633.882,
      "index": 166,
      "start_time": 4605.367,
      "text": " From bc. How do we add that up we don't see technology like that for another two thousand years. Where did that come from and so i've been thinking about the artifacts of advanced civilizations why do we think we would recognize. Why do we think that we would be able to perceive them at all and that a lot of the artifacts of our current civilization whether it's advanced theories of physics or computation they're largely invisible."
    },
    {
      "end_time": 4663.353,
      "index": 167,
      "start_time": 4634.189,
      "text": " To the greater population, right? To first approximation, something like particle physics is esoteric knowledge. It doesn't, it's like measure zero. If you were to go out and sample it statistically, nobody has that information. You can't go to the mall with a clipboard and ask people about it. It doesn't really exist at that layer. So then where is it? What is it in a sense? I love this idea. I came across as a woodcut and it's the personification of arithmetic, arithmetica."
    },
    {
      "end_time": 4690.435,
      "index": 168,
      "start_time": 4663.609,
      "text": " And it's the idea that you can personify anything. That thinking of all of mathematics or all of arithmetic as like a meme. And it's alive. It's a thing. Now in the ancient world, you know, they would put a name and a face and a statue to it. In the modern era, we think that's kind of ridiculous. But maybe it's not. Maybe it's actually a very convenient way of thinking about that memetic organism. This informational being that exists on our planet"
    },
    {
      "end_time": 4720.435,
      "index": 169,
      "start_time": 4690.742,
      "text": " And it lives in the substrate of human beings. It sort of lives in our minds and moves across our cultures. And they can die. They can evolve. They could be resurrected. And I think as crazy as this sounds, it might be a way we need to start thinking about the history of technology and. You know, the idea of thinking in language itself might be of this type."
    },
    {
      "end_time": 4739.343,
      "index": 170,
      "start_time": 4721.254,
      "text": " Meaning is lost."
    },
    {
      "end_time": 4764.957,
      "index": 171,
      "start_time": 4740.06,
      "text": " I think that's in part what a large objection is to people thinking that the mind is a computer or everything is a computer, because as soon as you make it computational, you make it technological. And as soon as you make it technological, you make it something that's devoid of meaning. And it's as if you've elevated the text to the expense of the spirit. You know, what's interesting, it reminds me of Marvin Minsky, again, he addresses this."
    },
    {
      "end_time": 4790.572,
      "index": 172,
      "start_time": 4765.265,
      "text": " The idea that the mind is a machine and people you know sort of have this visceral reaction to that they object to that I think one that's their immune system sort of responding to that idea, but he responds Why do you why do you think you know how machines work? Or what machines are and so when people say that the brain is or isn't a computer You know my quick response is what kind of computer? analog digital fluid optical"
    },
    {
      "end_time": 4820.316,
      "index": 173,
      "start_time": 4791.067,
      "text": " Mechanical like what what do you mean because there's a whole bunch of different kinds of computers and one of the things I like to look at There's these great collections of chemical reactions on the internet now that you can find people just film the the Petri dish and It's extraordinary the kind of behaviors that you can see and even some of the things That in this this area between life and non-life where you get simple fluids and things like protocells"
    },
    {
      "end_time": 4840.52,
      "index": 174,
      "start_time": 4820.998,
      "text": " that have very sophisticated behavior and they're just collections of chemicals. And so when we say a kind of machine, well, what do we mean? We don't understand how chemicals interact completely. So how could we say we're not that? And if we can build a computer reaction diffusion or whatever it might be out of computers, well, could we be that kind of computer?"
    },
    {
      "end_time": 4867.858,
      "index": 175,
      "start_time": 4841.305,
      "text": " Hola, Miami! When's the last time you've been in Burlington? We've updated, organized, and added fresh fashion. See for yourself Friday, November 14th to Sunday, November 16th at our Big Deal event. You can enter for a chance to win free Wawa gas for a year, plus more surprises in your Burlington. Miami, that means so many ways and days to save. Burlington. Deals. Brands. Wow! No purchase necessary. Visit BigDealEvent.com for more details."
    },
    {
      "end_time": 4894.411,
      "index": 176,
      "start_time": 4869.974,
      "text": " This reminds me of Michael Levin. In one of the readings of Michael Levin, you can see him as an idealist, speaking about intelligence is somehow fundamental. But in another reading, you can see him as physicalist because each intelligence is instantiated in physical. So the physical is more primal. And I asked him about this and he said, and now I don't want to misquote, but he said something tantamount to this. Michael Levin said that you can classify him more as a physicalist."
    },
    {
      "end_time": 4925.196,
      "index": 177,
      "start_time": 4895.213,
      "text": " Except that you then don't know what the physical is right, but you have to put some mystery to that, right? So when people say are you saying that we're just this dead matter saying no, you don't know what matter is I believe we're matter now again put an asterisk to that because This is my interpretation of what he said, but I can leave a link to that question It reminds me of a couple things Yeah, so I love that idea that we don't know what matter really is and I don't think we understand yet the relationship between matter and information"
    },
    {
      "end_time": 4954.787,
      "index": 178,
      "start_time": 4926.049,
      "text": " And if we go when we down and we look at things like field theory and stuff, we kind of seem to find bits at the bottom. You know, we used to think that the universe was best described with kilograms and the meter in the second. I think in the next era, physics will find that the bit is the more fundamental unit or the most important unit, at least on the same level as those others. And I like the quote that, you know, matter is spirit moving slow enough to be seen. Who said that? Deschardin."
    },
    {
      "end_time": 4981.664,
      "index": 179,
      "start_time": 4955.845,
      "text": " And, you know, we don't yet know how these things work, what's at the bottom. I think we're going to find information. I love these ideas. Now, if you go and you look at the dynamics of the of a black hole, Scott Aronson has some interesting stuff he talks about with the firewall paradox. And to invoke the structures of a black hole and describe the experiments and to have the theory make sense, you have to invoke notions of computation."
    },
    {
      "end_time": 4998.046,
      "index": 180,
      "start_time": 4982.722,
      "text": " P and NP and all these complexity space type arguments and this idea of differential privacy, which is something from neural networks to make sure that your data doesn't leak in through the model operation. That idea is being used to describe the structure of a black hole."
    },
    {
      "end_time": 5026.118,
      "index": 181,
      "start_time": 4998.746,
      "text": " And so I think we're finding, you know, it used to be that we had something like sort of math and physics at the bottom, and then we had chemistry on top of that and engineering on top of that and astronomy and things would sit up there. And then at the very top of those, you'd have things like computer science, because that was a product of the engineering of the physics and so on. But I think we're going to find it's either some kind of snake biting its tail or some kind of weird space, because this computation idea seems to be also at the bottom."
    },
    {
      "end_time": 5056.869,
      "index": 182,
      "start_time": 5027.432,
      "text": " That the idea of information and bits and an algorithm and computer program and complexity class seems to be somehow very fundamental, maybe even below physics itself. Do you think information is spirit moving slow enough? I think we need to think about questions like that. And, you know, again, that's what I love about channels like yours is it's a place where we can have that kind of conversation and use those those words in the same sentence, because I think there's a lot of places where like"
    },
    {
      "end_time": 5084.889,
      "index": 183,
      "start_time": 5057.79,
      "text": " You can pick one of those as your badge to walk through the door. And if you have both badges on, they kick you out of the conference kind of thing. Right. Right. And so I don't know. But I think that's it's an important question. What do you make of Wolfram's model, his physics model? I'm a big fan of Wolfram and his work. You know, I love the simple programs. I'm fascinated by the emergence of"
    },
    {
      "end_time": 5112.858,
      "index": 184,
      "start_time": 5086.493,
      "text": " Kind of like new kinds of physics that emerge out of these substrates and that how you get to these certain layers, whether it's just the cellular automata cells blinking back and forth. And then if you zoom out, you can build a machine, you can build a computer out of that. One of my favorites is this idea of wire world. Are you familiar with wire world? No. So it's a fascinating automata, just like Wolfram's stuff. He's done a lot of great work on it. And"
    },
    {
      "end_time": 5141.561,
      "index": 185,
      "start_time": 5113.899,
      "text": " You have a simple rule for every square in the graph paper. And it's a perfect example of sort of this fabric kind of computation where everything is happening throughout this kind of virtual space and it's doing the same thing everywhere. And what you can do is you can have a simple set of rules. It's four rules. And it simulates kind of electricity moving down a wire. And it just looks like one of the squares kind of bubbling down the line, essentially."
    },
    {
      "end_time": 5172.295,
      "index": 186,
      "start_time": 5142.295,
      "text": " But what's fascinating is you can build a computer out of that, right? It's called wire world in that it simulates a kind of mathematical electricity. And then with that electrical wire, you can build gates and you can build memories out of those gates and you can build bit registers and CPUs out of that and you can build a computer. So theoretically, you could instantiate something like an LLM on that. But the physics is sort of at this new layer."
    },
    {
      "end_time": 5197.244,
      "index": 187,
      "start_time": 5172.671,
      "text": " Where you can't go below it in a sense it doesn't matter what's below it it's just the squares and they have this dynamic and out of that emerges. Thinking machine in a sense and so. I love these these kind of computational models of physics and. Our mind might be like that in some sense."
    },
    {
      "end_time": 5227.602,
      "index": 188,
      "start_time": 5197.858,
      "text": " That our mind like the wire world, it can instantiate a kind of physics. It's not the same physics that we see out in an ordinary space time, but it's a sort of a virtual reality. Um, not in like the 3d, you know, headset kind of way, but it's like a new backdrop in which you can build something like electricity. And in that electricity, you can build something like a computer. And I think we could argue now that with the computer, you can build something like a mind."
    },
    {
      "end_time": 5255.401,
      "index": 189,
      "start_time": 5229.445,
      "text": " And so when we try to think about consciousness and the mind, I think one of the issues is we've been trying to map directly from, let's say, mind to the brain in one go. But it could be that the brain instantiates a virtual machine or layers of virtual machines and that the mind runs on one of those."
    },
    {
      "end_time": 5286.493,
      "index": 190,
      "start_time": 5257.09,
      "text": " And the reason why it's so hard to correlate neuroscience and psychology directly is that we're assuming that it's just one jump, that there's a computer and that computer is running software. But if we go to a modern data center or if anybody's familiar, if you run classic retro games and you run a Nintendo on your modern machine, you're not running Mario on your Mac. You're running an N.E.S. on the Mac and you're running Mario on the N.E.S."
    },
    {
      "end_time": 5315.401,
      "index": 191,
      "start_time": 5287.722,
      "text": " And so, as an analogy, I think our mind could be running on a software layer, a virtual machine that is above the brain layer. And kind of like the wire world, you don't know what the transistors are. All you know is you have these squares blinking back and forth and they act like wires and it acts like a computer. What's below that doesn't really matter. It's almost unknowable from the higher level."
    },
    {
      "end_time": 5339.565,
      "index": 192,
      "start_time": 5316.049,
      "text": " And so I think we need to think about these emergent programs and these different layers of a virtual machine to understand these kinds of things. So the depth psychologist would say, hey, you have a conscious mind and you have a subconscious mind. Now, in modern parlance, people don't like to say subconscious, they'll say unconscious. But I'm speaking about the depth psychologist here."
    },
    {
      "end_time": 5368.234,
      "index": 193,
      "start_time": 5340.06,
      "text": " So they'll say you have a subconscious. And then next question is, does your subconscious have a subconscious? And it sounds like what you're saying is that would be the virtual machine that the virtual machine runs on. Right. I'm actually a big fan of the idea of subconscious. I've found it relevant both in trying to map things out and in trying to understand my own behaviors. I think we definitely have things that are unconscious, but we also, I think, have these other kinds of systems in us"
    },
    {
      "end_time": 5395.998,
      "index": 194,
      "start_time": 5368.524,
      "text": " Whether they're sub or not, I don't know. I think they might be sort of parallel conscious, whether it's this left and right brain, different modalities that experience the world. And when you're there taking in a sunset or looking at a nice painting, you're running a different mode that's not necessarily sub or on. It's just not the one you use to do your taxes or drive down the highway. And I think that's something we need to think about. I think there's a lot of ideas"
    },
    {
      "end_time": 5407.483,
      "index": 195,
      "start_time": 5396.766,
      "text": " in psychology from a few hundred years ago that we need to bring back and re-examine in the light of these new metaphors, these new languages, these new technology."
    },
    {
      "end_time": 5431.237,
      "index": 196,
      "start_time": 5407.756,
      "text": " Okay, speaking of language in programming, there are several different types of languages like object oriented and then Wolfram has something called symbolic. Well, it's not just Wolfram's, but Wolfram uses that and popularized it. So can you please talk about the different sorts of programming languages for people who are unfamiliar and then talk about how Wolfram's symbolic language contrasts with those? Yeah."
    },
    {
      "end_time": 5461.254,
      "index": 197,
      "start_time": 5432.875,
      "text": " One of the ways I like to think about it is you can sense that the computer that we had early on, you know, starting from the 1950s, I call it a blind logician. And the idea was that you could just take logic. If this is true and that is true, then this also has to be the case. And you can just build all of reality up from that. But I like to joke that logic can't be real because or it can't be the only thing, rather, because babies and drunks don't use it."
    },
    {
      "end_time": 5484.94,
      "index": 198,
      "start_time": 5462.671,
      "text": " And they inhabit the world just fine. And so there has to be some sort of reality beyond just logical processing. And as Wolfram points out, if you look at all possible logics, all different sets of rules of how you combine truths, the logic we use is on the list at like 400 something. And so it's just kind of a particular"
    },
    {
      "end_time": 5514.138,
      "index": 199,
      "start_time": 5485.247,
      "text": " You know, evolutionary case, we happen to have developed that one. And it's it's very good at building a production line that produces automobiles or stuff like that. But there's another kind of of thinking, right? Like Boris said, you're not thinking you're merely being logical. And that has to do with kind of fuzzy states, things that aren't necessarily true. They're not necessarily false. They fall somewhere in the middle. Whether you like a song or a painting, it's not true or false."
    },
    {
      "end_time": 5543.575,
      "index": 200,
      "start_time": 5514.667,
      "text": " It, you know, if maybe it's the 10th time you like to listen to the song and you like it a lot more. Does that mean you didn't like it at all the first time? And it's kind of this, we often call analog where there's kind of like a versus a dimmer switch versus an on or off switch. And we have these two kind of broad classes of computers called digital and analog. And the older computers were all analog. A hundred years ago, computers were primarily analog. And I think Turing,"
    },
    {
      "end_time": 5573.302,
      "index": 201,
      "start_time": 5543.916,
      "text": " He was kind of like a nuclear bomb on the scene of computation, because after that, the idea of digital computers just completely dominated the conversation and dominated the engineering that we largely forgot about analog computers. And outside of a few electrical engineers, very few people have even heard of them. But we have throughout history, amazing water computers, for example. The Soviets had some very sophisticated water computers during the Cold War that weren't that were classified."
    },
    {
      "end_time": 5592.295,
      "index": 202,
      "start_time": 5573.609,
      "text": " And it wasn't until the 1980s that digital machines did as well as these massive room scale water computers. I was building a garden in my backyard and I was interested in water pumps. And so I started to research how to get my water pump to do like a bloop."
    },
    {
      "end_time": 5616.493,
      "index": 203,
      "start_time": 5592.602,
      "text": " I wanted it to kind of be intermittent. And so I'm just there and I type in pneumatic oscillator hydraulics and one of the first links that comes up is a classified ML server talking about a water computer from the 1950s and 60s. And I'm thinking, well, that's interesting. How is it that something I might use in my garden to regulate water is not even available as public record"
    },
    {
      "end_time": 5642.602,
      "index": 204,
      "start_time": 5616.869,
      "text": " And so we put in a FOIA request to get the original paper about how these pneumatic oscillator works. Turns out you use these for rocket vector thrusting and things like that. So they have very practical military applications. But the idea is that there's these vast categories of computing and computers that most people, including unfortunately a lot of computer scientists, have never heard of for no fault of their own."
    },
    {
      "end_time": 5667.756,
      "index": 205,
      "start_time": 5643.985,
      "text": " And so when we have these different kinds of computers, we have different programming languages for them. And so the original digital computers, they worked on symbols and very concrete sort of small little things. And we can say exactly what it is. And that's largely how our left brain works. It works on small numbers of inputs."
    },
    {
      "end_time": 5697.108,
      "index": 206,
      "start_time": 5668.234,
      "text": " For which there's a very strong association between a small number of parts. If A and B, then C. But the other part of our brain, the right brain, it thinks about, you know, sunsets and strawberries. And these are very fuzzy, high dimensional things. And this is why face recognition was an unsolved problem for decades in computing. Because for me to explain how I know I'm looking at Kurt, I can't really verbalize that."
    },
    {
      "end_time": 5723.097,
      "index": 207,
      "start_time": 5697.312,
      "text": " It's not the kind of thing that fits into language. One, I either recognize you or I don't. So at the high level, it kind of merges to this yes or no. But how I'm making that decision is not obvious to me. It's not really accessible, as we were talking about earlier. It's certainly not at a verbal level. So the left brain deals with things that are precisely the ideas that I can decompose and give you as a sequence of tokens."
    },
    {
      "end_time": 5749.445,
      "index": 208,
      "start_time": 5723.797,
      "text": " And then when you get that sequence of small symbols back, you can reconstruct them back into the idea. And we can define language as being able to communicate the set of ideas for which you can do that kind of decomposition and reconstruction on. But there are other things, namely these problems that consciousness talks about, these hard problems. Well, what red looks like to me and what strawberries taste like. I can't do that."
    },
    {
      "end_time": 5779.906,
      "index": 209,
      "start_time": 5750.401,
      "text": " I can't take it and turn it into language as a simple serial channel and try to explain that to you. And so we'd have to have a shared experience. And I think that's largely what culture is all about is trying to have an overlapping experience. And without that, the language, the other part probably wouldn't work at all. Like the words being gestures. If I can't approximately point to something, it might not work. And so I think we're discovering new kinds of languages, new kinds of programming languages."
    },
    {
      "end_time": 5809.565,
      "index": 210,
      "start_time": 5780.128,
      "text": " And one of them is called the hyper vector. And it's a very large sequence of tokens that in a fuzzy sense doesn't mean any one particular thing. It's kind of like a set of ideas. And so we might be able to build machines that are better at sharing those kinds of experience, but I don't think we have that yet. You mentioned object oriented programming. I think the exciting thing that's coming down the line is the idea of agent."
    },
    {
      "end_time": 5837.432,
      "index": 211,
      "start_time": 5809.991,
      "text": " oriented programming. And so Alan Kay in the 70s developed this idea of object where you bundle together the computer code and the memory it works on all together. And so you have this object and you can think of it as a little entity in the machine that knows how to run itself. And it turns out this is very powerful for building modern technology."
    },
    {
      "end_time": 5865.725,
      "index": 212,
      "start_time": 5839.548,
      "text": " An agent takes that a step further, where rather than being able to just communicate simple messages, as with object-oriented programming, it might be better if it called message passing, because you just send messages back and forth to the computer parts and they have to act polite to each other. With agent-based programming, you take that even farther and you consider what the agent believes."
    },
    {
      "end_time": 5895.657,
      "index": 213,
      "start_time": 5866.186,
      "text": " And what it knows, not just what it's capable of, but what it understands about the world and the ability to make a promise or to tell a lie or to explain something. This is things that humans do all the time, but we need to think about whether it's language models or things like it. You know, I've been thinking recently about sort of ecosystems of these agents. And so I think in the future of computing, we're going to think about"
    },
    {
      "end_time": 5925.282,
      "index": 214,
      "start_time": 5896.118,
      "text": " a substrate like a forest that is inhabited by a collection of these agents. And they'll be very different. Some of them will be earthworms, some will be oak trees, some will be squirrels, and some will be the logger in there. And we will have to think about them in terms of kind of ecodynamics and sustainability models and the types of things that biologists and ecologists and anthropologists study. How do cultures emerge?"
    },
    {
      "end_time": 5954.514,
      "index": 215,
      "start_time": 5925.657,
      "text": " How do you get stable equilibrium in a dynamical system where some things are trying to eat each other, some things are trying to parasitize each other, some things are creating energy sources and so on. As we were talking about earlier, the chat bot, you get like one window, right? And they charge $20 a month and you get one at a time. Well, if we just take out Moore's Law very soon, you'll have 200 at a time for 20 bucks a month and then 2000 and then 2 million and so on. It would have been inconceivable that ordinary"
    },
    {
      "end_time": 5980.759,
      "index": 216,
      "start_time": 5954.718,
      "text": " Individuals would have access to terabit memories Not not many decades ago. And so the same kind of evolution we're all gonna have thousands of LLM agents or some variation of them at our disposal How are we gonna set them in motion? We were not able to talk to them all we're not gonna be able to prompt them individually So we'll have to have some kind of hierarchical system that prompts them or some sort of negotiation system"
    },
    {
      "end_time": 6010.026,
      "index": 217,
      "start_time": 5982.346,
      "text": " And that we're getting back into kind of the natural system, kind of like the ancient world. I think it was Alan Kay, he talks about in the ancient world, people didn't understand the forest, they negotiated with it. You had these rituals and these practices that allowed you to cooperate and make use of it, but they didn't try to understand it per se. And so I think we might get to the point very soon where technologies, if we're not there already, technology is at that point. I think most people already negotiate with their handheld devices and their phone and"
    },
    {
      "end_time": 6040.026,
      "index": 218,
      "start_time": 6010.418,
      "text": " You know, we say, please do this and we mash on the buttons hoping it cooperates because we don't really understand it. I think anyone could safely say there's no human alive that truly understands all the workings of a cell phone. Because even if you do know the full software stack, well, there's the hardware and then there's the semiconductors and then there's the semiconductor supply chain and then there's the glass and then there's the plastics and there's the economics and the marketing. It's extraordinary. And maybe that fits in somebody's mind, but there's not many if it does. And so we're already at the point where humans are creating these artifacts"
    },
    {
      "end_time": 6067.125,
      "index": 219,
      "start_time": 6040.776,
      "text": " That feel like they're from an alien civilization. They don't feel like they're the product of our culture. And I think that's really interesting. It reminds me something that, you know, I don't know if we want to get into it because I don't want people to take it the wrong way, but something I've been fascinated with and let me let me explain. So don't jump to conclusions. Is this discussion on on flat Earth?"
    },
    {
      "end_time": 6097.5,
      "index": 220,
      "start_time": 6068.08,
      "text": " Because what I think is fascinating about it, independent of the geometry of the Earth, for clarity, I believe the Earth is an oblate spheroid, right? But what's fascinating is the members of this community, let's say, they've discovered that they inhabit a slightly different culture or a slightly different civilization, if you will, than others. And that the planet has these non-overlapping cultures and civilizations in it. And each one of those has this knowledge base."
    },
    {
      "end_time": 6123.899,
      "index": 221,
      "start_time": 6098.507,
      "text": " And because what's fascinating is they come to the idea, they say, well, I don't really know. They think, you know, as an adult, typically, right? Normally it's the kind of idea you come across in your youth and maybe they come across it again in their adulthood and they think, well, how would I know? How would I know? And how would I determine? And so what's interesting is they go out to their neighbors, right? And they go out in one degree in their in their friends network and their social peer network."
    },
    {
      "end_time": 6153.592,
      "index": 222,
      "start_time": 6124.326,
      "text": " And they ask their spouse or they ask their family and their friends and their coworkers, they will, do you know? If you do know, can you convince me? And they can't. There's nothing that their immediate circle of friends can convince them one way or the other. And then they go out two degrees. They say, well, do you know anybody who knows anybody that can convince me and so on? And what's fascinating is they build essentially these entire pockets all over the internet where they can't find anybody"
    },
    {
      "end_time": 6177.841,
      "index": 223,
      "start_time": 6154.377,
      "text": " who can convincingly answer this question for them, and it's no fault of their own. And it turns out that other non-overlapping or partially overlapping rather, it's not that they don't completely overlap, but they partially overlap, there are civilizations and cultures that were very interested in that question, right, going back to the Greeks and stuff, and they were measured it, but they were fascinated by geometry."
    },
    {
      "end_time": 6203.541,
      "index": 224,
      "start_time": 6178.575,
      "text": " And their culture had that as a kind of a cornerstone idea. And so when they went to look at a question like that, they were able to satisfactorily answer that question for themselves. You know, I've found that same kind as a metaphor, we're all of that type. Can we explain a cell phone? Can you explain how your laptop works? And I've spent the last, you know,"
    },
    {
      "end_time": 6233.558,
      "index": 225,
      "start_time": 6204.309,
      "text": " Better part of my life and more recently, I've written my own computer language and made my own abstract virtual machine because I was fascinated by this notion. I had learned about analog chips. I had some idea of how a CPU works and so on. And I knew the logical circuits and what memory flip flops and stuff. And then I knew about video games. I knew about apps and the Internet and the kind of software we use in our everyday lives. And I wanted to bridge those two realities. So how does software actually get broken down into the ones and zeros?"
    },
    {
      "end_time": 6260.811,
      "index": 226,
      "start_time": 6234.718,
      "text": " And in that journey over decades, I had almost given up on it. I had kind of just accepted that the chasm was too great and the distance between those two things was maybe not something I could traverse as a single individual. And I had to just take it kind of on an act of faith in a sense. The distance between what? Let's just say a video game and the actual circuit of a CPU. Sure."
    },
    {
      "end_time": 6291.015,
      "index": 227,
      "start_time": 6261.596,
      "text": " How do we create a modern virtual reality experience in a headset with 3D graphics? I'm supposed to just believe on faith that that's made out of ones and zeros. OK, I see. And so like like the Flat Earth thing, I realize that I'm only partially overlap the civilization that knows or let's just say cares about that mapping between the two. Because to first approximation, if we were to go out and I would ask people in my personal community, friend network, peer network, professional network, well, how does software turn into electricity?"
    },
    {
      "end_time": 6316.374,
      "index": 228,
      "start_time": 6292.056,
      "text": " Most people don't know. I didn't know. And so like these non-overlapping communities, I found myself questioning the geometry of the planet in some sense, right? As a metaphor, thinking like, is it true? How do I know? Why should I believe that? Where did this artifact called a cell phone? What civilization produced that? Because it didn't seem like it was my culture."
    },
    {
      "end_time": 6343.08,
      "index": 229,
      "start_time": 6316.869,
      "text": " The culture that I inhabit and grow up in and friends with the people in and are happy about and all that kind of thing, the people around me and everybody can meet, it doesn't seem to be the same place. Now, maybe it's like the brain network thing where we try to isolate into a particular city or country or culture. Well, that doesn't make any sense. It's this network kind of object and it's moving around. But I think we need to think about this"
    },
    {
      "end_time": 6372.483,
      "index": 230,
      "start_time": 6343.592,
      "text": " These artifacts, whether it's the Antikythera mechanism, our cell phone, modern banking system, how food gets to the grocery store, the complexity of it, it's almost lethal. It's almost overwhelming. It's an information hazard. If you really think about all the details and steps that make up a turkey sandwich, you lose your lunch. It's too much. It's just too much. And so in some sense, reality is the ultimate info hazard."
    },
    {
      "end_time": 6399.753,
      "index": 231,
      "start_time": 6373.626,
      "text": " It's the ultimate lethal text. And the more you go out and try to map something out, whether it's history or technology or the shape of the planet, you very quickly run into these barriers that our immune system have a hard time crossing over. So what are you suggesting? There's two different types of justifications. One is called internalism and one is called externalism. I don't know if you're aware of that. So one says the externalist would say that there are"
    },
    {
      "end_time": 6426.391,
      "index": 232,
      "start_time": 6400.213,
      "text": " factors external to my mental states that can justify my beliefs. And those factors don't need to be known to me, I just have to trust them or they come from a reliable source. And then internalists say, well, the justification of my beliefs, I have to be aware of the reasons behind it and the evidence for it and I have to have experience of it. And it seems like we're both of these and that we can't be all of just one."
    },
    {
      "end_time": 6454.804,
      "index": 233,
      "start_time": 6426.92,
      "text": " So maybe we could be all externalists, but we can't be all internalism. That is, we can't try to understand every single thing, because even in your example of trying to understand a video game, and how does that come from the zeros and ones of the CPU, that would also lead you to how do you understand quantum field theory. And then if you truly wanted to understand that, then you'd have to understand a theory of everything, which almost no one understands. And they'd have to watch your whole channel for that. Exactly. Right. So this is a plug. So we can't"
    },
    {
      "end_time": 6481.288,
      "index": 234,
      "start_time": 6455.435,
      "text": " It's funny you said that because that's exactly the thought that came into my mind a few weeks ago, that if we truly understood what it meant to be alive, it would kill us. We would die."
    },
    {
      "end_time": 6510.811,
      "index": 235,
      "start_time": 6481.852,
      "text": " It's the ultimate lethal, lethal text, if you will. It's the ultimate info hazard that that kind of thing. It's it's not meant for us. You know, another metaphor I like to think about is, you know, if and when you see the face of God, that's the last thing you'll ever see. Right. So that's another reason why I'm skeptical of the types who say that they're just truth seekers and that all they want to do is assemble truth at any cost."
    },
    {
      "end_time": 6528.166,
      "index": 236,
      "start_time": 6511.323,
      "text": " Firstly, they have a baloney slice like you mentioned, not even baloney, just a prosciutto, even thinner slice of what they think truth is. Lovecraft had a great quote. I know what you're going to say. I love it. It's my favorite. It's my favorite. Yeah. But please most merciful aspect."
    },
    {
      "end_time": 6550.469,
      "index": 237,
      "start_time": 6528.507,
      "text": " of this world is the inability of the human mind to correlate its contents and that one day this unfettered scientific investigation may open up such terrifying vistas of reality and our frightful position therein that we may either go mad from the revelation or flee from the light into the peace and safety of the darkness."
    },
    {
      "end_time": 6578.063,
      "index": 238,
      "start_time": 6550.879,
      "text": " Now, some people who think of themselves as unblighted truth seekers and they don't see themselves as doing some form of moral posturing by saying that they believe it, or at least they voice those words. Additionally, you can tell that people, when they're using the word truth seeking, that they're just copying a phrase that's adopted from some other place because people don't use the word seek rarely in any other circumstance other than say hiding and seeking. So,"
    },
    {
      "end_time": 6596.834,
      "index": 239,
      "start_time": 6578.063,
      "text": " I think people who call themselves truth seekers are just putting forward a ballyhoo of their righteousness and they're not acknowledging the self deludedness of the strings on their limbs. They then see Lovecraft as justifying being in Plato's cave and I see Lovecraft's quote as Plato's cave 2.0."
    },
    {
      "end_time": 6622.363,
      "index": 240,
      "start_time": 6597.466,
      "text": " I said this on the Julian Dory podcast where Plato's cave, the story is that you're looking at the shadows and then you exit and you see a bustling city and then you go back into the cave and you're blinded at both times, one from the fire, one from the light, actually three times going back into the cave. You're now trained to the light. So you have to assimilate to the darkness. But Lovecraft saw it as well. Look, you say you look like people say they love traveling."
    },
    {
      "end_time": 6642.773,
      "index": 241,
      "start_time": 6622.807,
      "text": " People say, oh, I love the world. You don't love the world. You love flying in a private jet or first class seat into some resort and then hopping from resort to resort or five star hotel to another. Then you may say, oh, no, no, no, for me, I love the experience of a culture. I love I love the cities. I love going into the actual meat of the town."
    },
    {
      "end_time": 6673.353,
      "index": 242,
      "start_time": 6643.507,
      "text": " And then you think, OK, well, that's still not the world because the world is 70 percent water. So do you care so much about the world that you could be dropped in an arbitrary point in the world and the swamplands of Louisiana? So Lovecraft is saying, like, look, Plato, you think you're just going to emerge from a cave into some beautiful city where everything's fine and like, what are the odds of that? Right. You know, first, I love that quote, the Lovecraft quote. It had a big impact on me."
    },
    {
      "end_time": 6703.439,
      "index": 243,
      "start_time": 6673.797,
      "text": " And I think like the cave, I think of it as like a mountain and I don't think they've been far enough on the mountain of madness to realize that these Cthulhu style monsters are there, right? When you get out into this thought space, there are abstractions and maybe they're just virtual, right? But that's what our mind is anyway. You know, as we're saying, it's not the brain, it's something running on top of it. And in that substrate, I don't think we're the only thing there in a sense."
    },
    {
      "end_time": 6730.998,
      "index": 244,
      "start_time": 6704.019,
      "text": " And you know, one of the things I've been thinking about is if we were to take you like you're saying being placed on a random spot in the ocean or a random spot in the planet or a random spot in the solar system, you know, most places in the universe are so dark, you don't even see starlight. And so you wouldn't want you can't be in a random place. I like to joke that the earth is so interesting. You know, angels and demons hang out here. Where else would they go?"
    },
    {
      "end_time": 6758.763,
      "index": 245,
      "start_time": 6732.176,
      "text": " Where else would they go, right? This is where all the interesting stuff is. And that on the other side of the coin, our mind, it's a very special configuration. And this is what our consciousness as an immune system idea, it's trying to protect that state. Because most mental states would be madness, right? Most would probably just be lethal. Or incoherent, yeah. Yeah, even the ones that weren't physically lethal would be utter madness. And so we have to kind of protect"
    },
    {
      "end_time": 6789.701,
      "index": 246,
      "start_time": 6760.213,
      "text": " You know, I think this is what culture does. This is what our childhood does and so on. We tried to craft this self, you know, in a Jungian sense that tries to protect us from that overwhelming subconscious or whatever it might be. Because I like in the old maps when they charted the oceans and then they would draw like a dragon in the corner and they would say, here there be monsters. And I think in that, you know, in those depths, there are there are entities in there."
    },
    {
      "end_time": 6814.957,
      "index": 247,
      "start_time": 6790.452,
      "text": " And whether we think of that as just a metaphor or whether we think of them in a sort of a proto-biological sense might not be that meaningful. Nonetheless, they're there. At Capella University, learning online doesn't mean learning alone. You'll get support from people who care about your success, like your enrollment specialist who gets to know you and the goals you'd like to achieve."
    },
    {
      "end_time": 6842.022,
      "index": 248,
      "start_time": 6815.52,
      "text": " You'll also get a designated academic coach who's with you throughout your entire program. Plus, career coaches are available to help you navigate your professional goals. A different future is closer than you think with Capella University. Learn more at capella.edu. What are psychedelics doing? Well, in this idea that there's multiple agents,"
    },
    {
      "end_time": 6870.401,
      "index": 249,
      "start_time": 6843.08,
      "text": " And some of them are the guard with the sword at the front gate, protecting the castle from the dragons kind of thing. I think they might be deactivating some of the defense mechanisms. I think they might be changing the parameters of the volume, if it's a symphony, the volume of each instrument. And normally some of the instruments are kind of quiet and others, you got the soloist violin that's normally taking over the center stage."
    },
    {
      "end_time": 6897.841,
      "index": 250,
      "start_time": 6870.691,
      "text": " So there's a bouncer that's no longer checking ID at the door. Right. Right. And I think they allow people to think, you know, differently. And, you know, if we look at the brain maps, it's clear they're changing the activation patterns and this cross modality. One of the things I've been really fascinated by that's in that direction is this idea of synesthesia. And being able to apprentice"
    },
    {
      "end_time": 6924.548,
      "index": 251,
      "start_time": 6898.131,
      "text": " Or induce synesthesia without psychedelics. And so a lot of people report that on certain substances, they can, um, you know, taste colors or, you know, feel music in a visceral way. Um, and I think that kind of synesthesia could be just so powerful if we could learn it. Feynman, he describes, um, learning colored blocks as a little boy that were in colors."
    },
    {
      "end_time": 6943.148,
      "index": 252,
      "start_time": 6924.872,
      "text": " Right a was in red the b was in blue the c was in green and so on and he reported a visual color synesthesia that when he saw algebraic equations on the chalkboard he could just bring all the green stuff to one side. Any had this very powerful modality well i don't think we have enough findings in the world."
    },
    {
      "end_time": 6962.193,
      "index": 253,
      "start_time": 6943.609,
      "text": " And I'm always fascinated why we don't do enough meta-analysis like, you know, what did von Neumann have for lunch in elementary school? Because we create these four or five sigma individuals every so often. I think there should be more in the science of education of how did they come about?"
    },
    {
      "end_time": 6990.247,
      "index": 254,
      "start_time": 6962.892,
      "text": " So the mathematician Hadamard a hundred years ago. So I think I think Hamming talks about this. Now, Alan Kay, Alan Kay tells a story and Hadamard went out and he wrote to like the top hundred mathematicians and scientists, physicists at the time. And he asked them, he said, how do you do what you do? Yes. How do you do what you do? And he said, do you symbols like we're talking about earlier with the symbolic language? Do you use some sort of logic on paper with small symbols and move them around like algebra?"
    },
    {
      "end_time": 7016.783,
      "index": 255,
      "start_time": 6991.63,
      "text": " One, two, do you use pictures? Do you draw graphs and diagrams and kind of visualize the reality? And the third option he suggested was, is it bodily kinesthetic? Do you experience it kind of more viscerally that way? And a small number of them reported they use the logic and algebra and they relied on the formalisms."
    },
    {
      "end_time": 7043.268,
      "index": 256,
      "start_time": 7019.121,
      "text": " And the majority wrote back and they said they visualize things, they use pictures and they use their visual mind to kind of see the scenario. But another percentage, including some of the best, including Einstein, they reported that they could feel it right in their musculature. Einstein said he could feel that the space time fabric in his arms, in a sense."
    },
    {
      "end_time": 7071.544,
      "index": 257,
      "start_time": 7043.66,
      "text": " And so I think that might be, and this is what with athletes and dancers and things, they understand that the primal mentality is probably that bodily kinesthetic and that we need to one, teach that that's completely absent in education system. We, we, we tell everybody with any kind of, uh, you know, athletic or movement skill to go off and do that stuff after school in a, in a team or a club or something. And then we have them forced down and sit."
    },
    {
      "end_time": 7099.855,
      "index": 258,
      "start_time": 7071.971,
      "text": " and do algebra absence of movement. So I think this idea of inducing synesthesia and apprenticing that I've been fascinated with. And in that research, I came across a constructed language. We were talking earlier that maybe we need new languages to understand the mind. And I came across a language from the mid-1800s, a constructed language called Solresol."
    },
    {
      "end_time": 7126.869,
      "index": 259,
      "start_time": 7101.305,
      "text": " And it comes from the solfege, do, re, mi, and the musical scale. And it turns out it's an alphabet. There's only seven elements in the alphabet. And in the English alphabet, we've got 26, but we have two different versions for each letter. We've got a lowercase letter and an uppercase letter. So in some sense, there's multiple ways to represent each symbol, two for each. So imagine you have an alphabet where there's only seven letters."
    },
    {
      "end_time": 7148.183,
      "index": 260,
      "start_time": 7127.261,
      "text": " And all of the words are made out of those seven letters, and they're made out of the seven notes of the musical scale. But for each letter, we can represent it on the musical staff, or we can number it one through seven, or we can give it a color, red, orange, yellow, green, blue, and so on, or we can give it a hand shape."
    },
    {
      "end_time": 7171.118,
      "index": 261,
      "start_time": 7149.258,
      "text": " Or i try to develop flavors for it cherry orange lemon lime and so on okay and the idea is that for any word or a sentence you can sing it. You can speak it you can write it as a number you can think about the flash of colors you can think about the flash of flavors. That you could have a language essentially designed for synesthesia."
    },
    {
      "end_time": 7201.442,
      "index": 262,
      "start_time": 7171.869,
      "text": " And so I've been trying to learn this language. I've built some, some simple tools on the computer to try to teach myself this language because I want to know, can I induce synesthesia? And faster than I thought, uh, I was able to look at things and have that association. Like, here's the flavor of that. Oh, that's green. That's lime. Right. Fairly straightforward. And to look at them and see this kind of pattern. Now I'm just at the baby steps."
    },
    {
      "end_time": 7230.913,
      "index": 263,
      "start_time": 7202.056,
      "text": " of this language. But I wonder if I had learned this in my youth, you know, could I think about things? I want to be able to think about things in more than one way. I want to be able to take an idea and turn it around in my mind, not just in English or not just in one modality, but to think about it as a song. We all get songs stuck in our head, right? That's one of the the info viruses is"
    },
    {
      "end_time": 7258.166,
      "index": 264,
      "start_time": 7231.169,
      "text": " The famous earworm where you get some song stuck in your head. I won't mention some little get stuck in your in your readers minds or listeners minds. But you all know simple songs that once it pops in your head, it's kind of stuck in your head for the day. I want ideas to stick in my head. I want quantum mechanics to stick in my head. I want mathematical ideas to stick and resonate and carry along in the back of my mind and to sort of inhabit my subconscious naturally the way musical phrases do."
    },
    {
      "end_time": 7289.053,
      "index": 265,
      "start_time": 7259.514,
      "text": " And so I started to think about this idea of a musical language and that why can't we use music for something more important? We use it simply for entertainment and that just seems like a waste that I can't make sense of it. It took a very long time for computers to get input and output, to get keyboards and displays. But we had mechanical machines that could input and output music hundreds of years ago. What did we use it for?"
    },
    {
      "end_time": 7320.759,
      "index": 266,
      "start_time": 7291.118,
      "text": " Why didn't we use it for something more interesting? Do you think we use music just for entertainment or do you think that we think that we use music for entertainment? So what I mean is that we play it and then we go to concerts and then there's a social dynamic there and it innervates the culture. And then that allows us to think in a more social manner. You mentioned there are different modalities. There's also a social form of thinking in addition to sense and taste and so on. So that's kind of exactly what I started thinking about. And it reminds me of a conversation I had many years ago with a good friend."
    },
    {
      "end_time": 7351.152,
      "index": 267,
      "start_time": 7321.237,
      "text": " And she was telling me that in China, there's an instrument that's not used for making music. It's used for thinking. It's a guitar kind of like string object and that people use it to kind of hold their thoughts. And I love how she described it was instrument used for thinking. So that led me, you know, to think about this. Are there better languages? And this relates to, you know, the different modalities that we have with our brain. And then I think there are the left part of our brain understands things."
    },
    {
      "end_time": 7374.667,
      "index": 268,
      "start_time": 7351.527,
      "text": " In terms of words, these small sequences of symbols that I can decompose and you can take and put them back together and rebuild the idea. And language is very powerful and we're seeing that with the LLMs. But there's the other part of our brain that responds to music and I think we need to use music more practically and to reconsider what it does."
    },
    {
      "end_time": 7403.626,
      "index": 269,
      "start_time": 7375.316,
      "text": " So putting that aside for a second, we were talking about programming languages and, you know, von Neumann tried to look at, is the brain a computer? And he put out some, some really interesting books on that. And so in my research, I tried to kind of pick up that idea and think about, well, is the brain, is the brain a programmable device? Is it subject to being programmed from the outside, whether it's, uh, our own self health self help out formations or mind control from marketing or more nefarious."
    },
    {
      "end_time": 7430.589,
      "index": 270,
      "start_time": 7404.053,
      "text": " Type things and if so, how would what would the programming language of the brain look like? If let's just assume that the brain is a computer like object and that means it would be a programmed object and what would a programming language for the brain look look like? And so I tried to think of a list of properties that that programming language for the mind white might have. Well. For one, we wouldn't really recognize it."
    },
    {
      "end_time": 7458.046,
      "index": 271,
      "start_time": 7430.998,
      "text": " So, video game characters don't know if they're programmed in C or in Python or whatever they are. They can't know that. They might be able to know they're a program, but they wouldn't be able to know what they're programmed in, in some sense. And so we wouldn't recognize it, but if we had this programming language, it would have to be everywhere. It would have to be kind of ubiquitous. It would have to be very poorly understood."
    },
    {
      "end_time": 7484.394,
      "index": 272,
      "start_time": 7459.087,
      "text": " The people who did understand it would be very powerful, even economically successful. It would have to be very old. It would have to still be here. Our earliest technology would have been developed to manipulate it and our latest technology would be developed to manipulate it. It would have to have the ability to change our emotional state and our mental state, largely without our permission."
    },
    {
      "end_time": 7514.974,
      "index": 273,
      "start_time": 7485.555,
      "text": " It would have to have the ability to change our physical state to get us to move to move without our permission. So it would have to be something ubiquitous, but not obvious. It would have to be old and new. We would have to involve technology. People that were good at it would be famous and revered and economically successful. It would make us laugh and cry without our permission. It would make us move around without our permission. And even the people that were very good at it and let's say understood it wouldn't really be able to explain it very well."
    },
    {
      "end_time": 7544.582,
      "index": 274,
      "start_time": 7515.179,
      "text": " Hmm. And so we list all of these sort of dozen or so properties that we might expect for programming language. Music checks off every box. Everybody knows what it is. Nobody really knows what it is. Everybody's familiar with it, but we don't really know how it affects us and why the the oldest technology in the world going back to Egypt was designed to create and produce this thing. The latest synthesizers and computers and generative models are designed"
    },
    {
      "end_time": 7571.732,
      "index": 275,
      "start_time": 7544.957,
      "text": " to create it. People that are good at it are very successful economically and otherwise. It's very powerful. It sort of dominates the planet in a lot of ways. Culturally, you get thousands of people moving in rhythm, seemingly without their permission. A few chords on a keyboard or piano can make you teary-eyed very quickly. And so once you look at it in the right lens, it's very obvious that at least for part of our brain, music is something like a programming language."
    },
    {
      "end_time": 7600.708,
      "index": 276,
      "start_time": 7573.2,
      "text": " So why are we only using it to keep ourselves anesthetized in the car from the boredom of driving and and and as something to do at Burning Man or whatever it might be. It seems fundamentally more powerful and useful. And so it's one of those things either. You know, we need we need to think about what we could do with that kind of language if we could use it more constructively. I want to be able to write computer programs in music."
    },
    {
      "end_time": 7630.367,
      "index": 277,
      "start_time": 7601.135,
      "text": " I want to be able to think about advanced mathematical objects musically and so on. Do you think there's something particular about music or does this abstract to generalizing to any art? Both. I think it would definitely generalize to other art forms, dance, painting, sculpture. These are all accessing unique channels that these different agents or these different modalities have kind of in the ecosystem of our mind have evolved"
    },
    {
      "end_time": 7660.111,
      "index": 278,
      "start_time": 7630.759,
      "text": " I think it's that the right brain understands things in a completely different way from the left brain, as we were saying, in terms of frequency and amplitude. So one of the ideas that's been really interesting to me, you know, everybody thinks that"
    },
    {
      "end_time": 7689.411,
      "index": 279,
      "start_time": 7660.589,
      "text": " You know, Einstein was the big physics revolution, or that quantum mechanics was the biggest, you know, sort of shift in our paradigm. I think it might have been Fourier. I think it might have been the theory of frequencies and amplitude, let's just say. And all the listeners will be familiar with things like MP3 and the equivalence. And so when we store information in the modern world,"
    },
    {
      "end_time": 7719.019,
      "index": 280,
      "start_time": 7690.35,
      "text": " We don't store the actual wave that went into the speaker or the wave that came out of the musical instrument. It turns out that we don't have enough hard drives even still. You know, as a lot of your listeners remember in the 90s, you couldn't fit a single album on your computer. You'd rip a few songs until before MP3 rather. If you were to take waveforms and try to rip a full album, it's going to take up a significant amount of space. And the breakthrough with the iPod and with MP3s and digital streaming music"
    },
    {
      "end_time": 7749.377,
      "index": 281,
      "start_time": 7719.445,
      "text": " was to take that signal,"
    },
    {
      "end_time": 7777.773,
      "index": 282,
      "start_time": 7749.855,
      "text": " And then later we can reconstruct it at runtime, listening time. We reconstruct it back into the original wave and move the speaker accordingly and we can hear the sound. That's how this is being transmitted and recorded. But what that's really saying is that there's another way to look at the world that's sufficient, that we can look at it as there's components of space, there's components of time, or we can look at it as there's frequency and there's amplitude."
    },
    {
      "end_time": 7807.381,
      "index": 283,
      "start_time": 7779.462,
      "text": " And when you look at the world in terms of frequency and amplitude, everything you need to know is still there, otherwise you wouldn't be able to go backwards. But in that other framework, the very idea of space and time just don't exist. Just don't exist. And I think that our right brain is an approximation as a label. I don't literally mean it's the right lobe per se. But I think there are aspects of our brain and our mind that inhabit this sort of frequency world."
    },
    {
      "end_time": 7837.125,
      "index": 284,
      "start_time": 7808.882,
      "text": " And they don't understand anything about time and they don't understand anything about space and that they're understanding the world in a very different way. And to try that, to make sense of that in language doesn't make any sense. I can't take that and decompose it into words and send it across what a symphony sounds like. You have to just hear it. And so I think this is why there's such a fundamental bridge between the different modalities that we have this left and right brain is because they're experiencing the world"
    },
    {
      "end_time": 7867.125,
      "index": 285,
      "start_time": 7837.944,
      "text": " It's sort of a vastly different frame. And that I would like to see a language that communicates more to that modality and not just for entertainment purposes. For people who don't know what Fourier analysis is or to decompose into Fourier series in math, there's discrete objects like dots and edges. And you can graph anything. You can Fourier transform these guys."
    },
    {
      "end_time": 7893.746,
      "index": 286,
      "start_time": 7867.415,
      "text": " into sine waves and cosine waves of different frequencies. The issue here is that it's a one to one mapping. So that sounds like it's not an issue. It sounds like that's an advantage. But many people who think of the brain in terms of left brain versus right brain will think of the left brain as the more discrete atomized type. And then the right brain is the more wavy frequency type. However, at the same time, people tend to valorize the right brain over the left brain."
    },
    {
      "end_time": 7923.609,
      "index": 287,
      "start_time": 7894.48,
      "text": " They think that in fact, in the title itself is master and his emissary, the master is the right brain. So the right brain should have a slight elevation in the hierarchy. But in this Fourier analogy, it's one to one. So you can't say that one is more fundamental than the other. So what do you say to that? I would think that in an evolutionary sense, our brain has evolved to to take advantage of both perspectives on reality. That there's different ways of interpreting"
    },
    {
      "end_time": 7952.449,
      "index": 288,
      "start_time": 7924.07,
      "text": " You know, everything we experience and a very powerful way is to map things into space and time. And there's another very powerful way for which that's not that's not it's not that it's not even useful. It doesn't exist from and from a different perspective. Have you ever played with synesthesia of scent or taste or taste? You did give green and mints and so on. But sent olfactory. For me, scent and taste are so close together. Right. I hadn't really thought about them separately."
    },
    {
      "end_time": 7978.268,
      "index": 289,
      "start_time": 7953.353,
      "text": " You know, because to me, flavors and smells are, you know, essentially for me, they're approximately the same thing. Our mutual friend, Addie, who runs the Polymath conferences at the Polymath conferences, I know that he does some exercises to help people with synesthesia, to induce synesthesia without chemical substances. So anyone who's listening, who's interested, I'll post the next event somewhere here on screen or it's in the description. Anyhow,"
    },
    {
      "end_time": 7991.032,
      "index": 290,
      "start_time": 7979.206,
      "text": " I'm wondering, look, if music is so primitive, it also seems like scent is even more primitive. Yeah, it seems like that I could be incorrect. Dance also seems more primitive because scorpions do that, but I don't see scorpions."
    },
    {
      "end_time": 8020.145,
      "index": 291,
      "start_time": 7991.544,
      "text": " with flutes or some version of a flute. Well, birds do. Birds do. And they've got, you know, millions of years evolutionary head start on us. Right. Right. So do you think that were there any people in that book by Hadamard or Polly, any mathematicians that think in terms of dance or think in terms of scent? I've not heard of that. I can't say I think in terms of flavors, but I do use it as a metaphor. I've often described"
    },
    {
      "end_time": 8049.787,
      "index": 292,
      "start_time": 8020.674,
      "text": " Because in ordinary, you know, conception of space and time, we've got just three dimensions of space, and I can't add another right angle, right? So if I try to put another line at 90 degrees to all of the other three, there's nowhere to stick it sort of not enough. I see anymore. But with flavors or with smells, we actually can think about a kind of a hyperdimensional space that we have more directions than three."
    },
    {
      "end_time": 8079.394,
      "index": 293,
      "start_time": 8050.435,
      "text": " So for example, if I'm if I'm cooking something, there's no amount of lemon juice I can add to something that will make it more chocolatey. There's no amount of hot peppers I can add that will make it vanilla and so on. And so there's more directions when we when we compose a dish, when when you add an ingredient, you're kind of pushing it into this lemon space, this chocolate direction, the spicy direction, whatever it might be. There's a lot of those."
    },
    {
      "end_time": 8104.923,
      "index": 294,
      "start_time": 8080.077,
      "text": " And most pallets can kind of, you know, move around and we can kind of, at least in a metaphor sense, think about what it means to inhabit a space that has more than three right angles, right? Because they're not in the same direction. But then we have interesting things like lemon, orange, lime, tangerine. Well, they're kind of they're not quite at 90 degrees."
    },
    {
      "end_time": 8133.507,
      "index": 295,
      "start_time": 8105.316,
      "text": " the kind of off in the general direction citrus and so we get to think about these these vectors where traditionally it's very hard to think of this the generalization of an arrow you know we think of arrows as being on flat paper or being in 3d now we want to think of a vector we want to think of an arrow that points in 12 directions or a hundred directions or so on which mathematicians try to write down on paper we can do it as a formula but it's hard to get intuition about that and so i i think that the flavors"
    },
    {
      "end_time": 8159.974,
      "index": 296,
      "start_time": 8134.104,
      "text": " That's the best thing I've thought of in terms of something we do have experience with, these high dimensional spaces essentially. And we were talking about Hamming, you know, Hamming did a lot of work in high dimensional spaces. And he says, forget everything you know, you know, these places are not mapped out. We don't really have good intuitions or understandings what happens when you have these arrows that point in that many directions."
    },
    {
      "end_time": 8190.162,
      "index": 297,
      "start_time": 8161.493,
      "text": " Tell me about a recent breakthrough of yours research wise that you can talk about and how you came about it, especially the thought process. Let me be specific, whether it is thought or if was something else like scent or taste. Yeah, well. One of the things that comes to mind is I've been working recently on. As we were talking about earlier, bridging that gap between software and the hardware, right?"
    },
    {
      "end_time": 8220.094,
      "index": 298,
      "start_time": 8191.271,
      "text": " Where does the ghost meet the machine, essentially? Because we know that software is this kind of ephemeral object. It's kind of made out of imagination. But it's very powerful. It's very concrete when you load up your banking app or something like that. But it seems to be made out of ideas. And how does that map down to electricity? Right? So I've been trying to bridge between the chip and the software, the hardware and the software. And in doing that, I designed a"
    },
    {
      "end_time": 8248.626,
      "index": 299,
      "start_time": 8220.572,
      "text": " A new virtual machine, a kind of a kind of computer chip, if you will. And I haven't printed the chip or anything like that. I simulate it on a computer, but it acts like a CPU. And it acts like a very different kind of CPU in that there's only one thing it knows how to do, which is copy paste, essentially, that it can move that you have essentially like a graph paper and you have locations where you can put an information."
    },
    {
      "end_time": 8275.333,
      "index": 300,
      "start_time": 8249.104,
      "text": " Write down a phone number, a photograph, whatever it might be. And you can move that. I could say move it from here, move it to there. And I tried to build a very simple computer so that I could understand the mapping between very complicated software, whether it's a video game or a banking app, and the actual machinery, the actual metal of a computer."
    },
    {
      "end_time": 8305.947,
      "index": 301,
      "start_time": 8276.067,
      "text": " In doing that, the idea came from, I was watching a documentary about the Apollo flight computer. And the Apollo flight computer, to save on the complexity of it, it had a very special place in memory. That if you took a number and you put it in that place in memory, and you came back later and looked at it, a one had been added to it. And so rather than making a program that does a counter, you would just move the numbers into the special box and it would automatically add a one to it."
    },
    {
      "end_time": 8338.558,
      "index": 302,
      "start_time": 8309.189,
      "text": " And that made the computer simpler. And so I took that idea and I thought, well, why don't I build a machine that has a couple places, a couple boxes up top, an A and a B, and if I put two numbers in there right next to it, the addition, whether I need it or not or want it or not, it just adds them together and places that answer right there. So if I ever need to add two numbers together, all I need to do is just move the first one to box one, the second one to box two, and the addition will be sitting there in box three."
    },
    {
      "end_time": 8367.688,
      "index": 303,
      "start_time": 8339.548,
      "text": " And the multiplication in box four and the difference in five and the division in six and so on. So whether I needed them or not, because computers run so fast now and they have so much memory that I thought, let's, let's flip it around. Let's just let it do the extra work. I'm not going to notice, but now I don't need to tell the computer what to do. Traditional computer chips like the Intel inside people's laptops where they're watching this or whatever it might be inside their Mac."
    },
    {
      "end_time": 8394.735,
      "index": 304,
      "start_time": 8368.49,
      "text": " It knows how to do a lot of different things. It's called the instruction set. And the chip is very complicated because it knows how to do a lot of different things. This one that I'm designing, it always knows how to do one thing. So my understanding is that it will just continually do a variety of tasks and then they're just stored in memory. So anytime you want to have done a traditional computation, it's a look up now. Exactly. Exactly. Yeah. And so anything you'd want to do is just sort of sitting there waiting."
    },
    {
      "end_time": 8425.401,
      "index": 305,
      "start_time": 8395.742,
      "text": " And so in doing that, I was able to really simplify the process from going from software down to the thing that would actually look like a machine. Because I want to know something like, whether it's an LLM or virtual reality world, it's like the flatter thing. Prove to me that it's actually a machine. I want to understand that. You're talking about internal to external. I want to internalize the idea that it's actually just a bunch of ones and zeros and they're just moving memory around."
    },
    {
      "end_time": 8451.049,
      "index": 306,
      "start_time": 8425.998,
      "text": " I wanted to know how that actually worked. And so that's what I've been working with lately. I've simulated this little machine and I've built a little programming language for it to where I can talk to it and give it commands and it breaks it down into the series of copy paste so that it moves the data around in the memory such that it actually does something useful. And so"
    },
    {
      "end_time": 8482.108,
      "index": 307,
      "start_time": 8453.814,
      "text": " I want to be able to bridge that gap for people. It's like the, I want to be able to prove that the earth is round or flat or whatever, whatever it might be. I want to be able to prove that software really doesn't run on a machine. And this thing now called chat GBT or whatever the equivalents are, that it can tell jokes and write stories and poems and recipes, that it really is just a machine moving, moving bits around. And I want to be able to see that process"
    },
    {
      "end_time": 8510.094,
      "index": 308,
      "start_time": 8482.654,
      "text": " Um, if nothing else for an aesthetic purpose, I think it's, it's technology. It feels like a tree house that the older kids have built and along the way they hammered steps into the tree and then they had a rope ladder and maybe a little elevator or so on. But once they got up there, they took down the steps. They took the steps off the trunk of the tree and they pulled up the rope ladder."
    },
    {
      "end_time": 8529.94,
      "index": 309,
      "start_time": 8510.418,
      "text": " How did you get up there? How did you get into that tree house of the iPhone, of the laptop, of the internet? Because they pulled up the rope ladder. We no longer have the technology that got us there, the intermediate forms."
    },
    {
      "end_time": 8558.507,
      "index": 310,
      "start_time": 8530.213,
      "text": " Like Lucy in the bones, we don't see the intermediate on the way from ape to angel. There's this progress track that we're on and we're getting so far along that I worry we're going to get essentially bootstrapped into this thing where we don't we're going to lose as a cultural thing. We won't remember how we got there. One of the motivations for this project was to tackle the complexity"
    },
    {
      "end_time": 8586.186,
      "index": 311,
      "start_time": 8559.172,
      "text": " problem in computer code. There's a great website called Lines of Code, I think it's called, we can post it, and it shows you how many instructions, how many lines of code you need to run something like Microsoft Word or Chrome or to have Facebook runs. And it turns out that when you open your laptop, before you've done anything at all, we're about 300 million lines of code in. 300 million lines of instructions"
    },
    {
      "end_time": 8612.5,
      "index": 312,
      "start_time": 8586.869,
      "text": " that are connecting the thing that we look at is the mouse and the right click in the dragon drop in the desktop in the wallpaper with three hundred million steps away from the actual machine now i see that as a as a sort of an existential threat if that gets worse and something were to happen how would we rebuild it how would we restart it we're so far up in the tree house we don't even"
    },
    {
      "end_time": 8638.626,
      "index": 313,
      "start_time": 8613.439,
      "text": " We don't have any idea how that kind of process works. And like the Flat Earth thing, I don't know anybody who knows anybody who knows anybody about how that works. And 300 million lines is too many for a single human mind to traverse. Now, there's also the practical problems of fixing bugs. There are bugs in modern application software that have been reported 50,000 times. The developers can't fix it. They don't know where it is. They've lost the source code."
    },
    {
      "end_time": 8669.275,
      "index": 314,
      "start_time": 8639.906,
      "text": " They don't have the original version. The engineers that wrote the programs are retired at best. And so as we culturally retire these paradigms, I'm worried that we've lost this ladder into the treehouse. In Feynman's biography, it talks about how he learned how to fix vacuum tube radios. And at the end of the chapter, I love the quote, and he said, when we lost the vacuum tube radio,"
    },
    {
      "end_time": 8698.422,
      "index": 315,
      "start_time": 8669.684,
      "text": " We lost a well-worn path into science. Uh-huh. And that's the treehouse ladder. That was a way that was accessible. You could hold one bit in your hand, like a light bulb, in this vacuum tube, you could hold it. You could see it as a physical object. I can't look at the components of my cell phone, not even with a microscope. And so, like the 300 million lines, we're kind of bootstrapped into this thing where we no longer know, as individuals or even as a culture,"
    },
    {
      "end_time": 8723.387,
      "index": 316,
      "start_time": 8698.848,
      "text": " You know how we got there. And so one of the motivations for building this homemade computer was ultimately to make something. I call it a glass engine, right? Like a clear a see-through car where you go through and you see the pistons and you see the spark plug and the gas comes in over here. And ordinary individuals, people without specialized training could look at it and go, Oh, I think I understand how that thing works now. Now I understand how it moves without horses."
    },
    {
      "end_time": 8752.193,
      "index": 317,
      "start_time": 8724.206,
      "text": " Do you see this as one of the reasons that modern people tend to have a disdainful attitude toward religion? An analogy here would be the 300 million lines of code or the ladder that brought us up to the treehouse. And we're obsessed with the accoutrements and the splendor of what's around us, this pomp and circumstance, the technology that we have and the values that we've inherited. And we thrive with those to the detriment of the dirt that provided the nutrition that brought us here."
    },
    {
      "end_time": 8780.691,
      "index": 318,
      "start_time": 8752.807,
      "text": " Yeah, absolutely. It's something I've kind of been thinking about a lot because I've gone through my own journey with that in a personal way of trying to deal with that. That being? That being the distinction between the somewhat pedestrian rituals, you know, the singing, the books, the sacraments and so on."
    },
    {
      "end_time": 8809.104,
      "index": 319,
      "start_time": 8781.118,
      "text": " That for a lot of people, again, I was victim to this, you know, especially trained as a scientist. We look at those things and you're like, I don't see the divine in that than that operation. And especially when we see all these other artifacts from going in the other direction, it seems like and I don't necessarily know it's true, but the. Thinking of products of technology as being, oh, we ignore that stuff and we've made a lot of progress without it."
    },
    {
      "end_time": 8835.094,
      "index": 320,
      "start_time": 8809.616,
      "text": " I don't know if that's true for one. You know, Turing was trying to bring back his friend. He had lost his friend Christopher. And one of his motivations for developing the computer was to find him to figure out where he had gone and to see if he could build another one and things like that, which I think is a is a very interesting idea. Ray Kurzweil, similar. Yeah. With his father. And yeah, exactly. Right. Right. And I think that's a very noble pursuit on both of those. I've"
    },
    {
      "end_time": 8866.049,
      "index": 321,
      "start_time": 8836.152,
      "text": " I've gone through this, this journey that I've recently kind of came up with a term for it. Um, and I call it third order religious. So first order religious is the thing, you know, that I was as a kid, uh, that a lot of people who call themselves religious people would be. And that's just, um, you have your belief. It's not really questioned. You kind of just, uh, it's the system, it's the operating system that you know. Um, other religions are,"
    },
    {
      "end_time": 8891.749,
      "index": 322,
      "start_time": 8866.681,
      "text": " Invisible at best irrelevant maybe that in some sense and that It's just it's just the reality in some sense right it's what you believe and then I went through a process largely Losing my father and becoming a scientist in a lethal text kind of way Becoming a physicist was lethal to that reality"
    },
    {
      "end_time": 8919.565,
      "index": 323,
      "start_time": 8892.056,
      "text": " And I changed my paradigm and for a while I was what you might maybe you call a secular, a non secular humanist. Um, this sort of second order, second order religious, as I called it. And the second order religious is, well, it's probably not real, but it's not doing any harm. And it does maybe a lot of good. And there's people doing charitable works and take care of the sick and the needy. And it, it serves as a very important social function."
    },
    {
      "end_time": 8950.06,
      "index": 324,
      "start_time": 8920.759,
      "text": " And so that might be the second order religious. It's a good feature in the world. So the first would be that it's truly divine. There is some transcendence that there's, it's not just a sufficient condition, but it's a necessary framework to look at the world. The second would be it's fruitful. It's just sufficient, but not necessary, or maybe not even sufficient, but it's practical, let's say. And the thing I've been calling third order is to realize"
    },
    {
      "end_time": 8977.329,
      "index": 325,
      "start_time": 8950.435,
      "text": " that the first two are the same thing via what pragmatism that the way I like to describe it is where else would God live but in the minds of people right like I was saying that the earth is interesting is so interesting in terms of outer space as far as we know it's the most interesting place where else would angels and demons hang out and on this place the most interesting thing here seems to be the minds of people where else would God live that"
    },
    {
      "end_time": 9008.37,
      "index": 326,
      "start_time": 8979.462,
      "text": " That we need to think about, like the software meeting the hardware with the computer, where would the sacred and the profane meet? Where would the spirit and the matter come together? And I think it might be in our mind. It might be in us. And so the act in the charitable acts in the, you know, the taking care of people,"
    },
    {
      "end_time": 9033.131,
      "index": 327,
      "start_time": 9008.831,
      "text": " Things like that in the spiritual leadership. Is that not the very thing that the first order is talking about? Is there not magic in that? And like the discussion with consciousness, they say, well, we're not a machine. They say, well, it's not God doing that. It's just people. Those are just good people doing those good works. Well, what's the difference in some sense?"
    },
    {
      "end_time": 9059.616,
      "index": 328,
      "start_time": 9033.507,
      "text": " Right. Isn't that not how the universe would have or did choose to unfold in that sense that why should we make a sharp distinction between that software and that hardware? In fact, even on this topic of distinction between software and hardware, it's not so clear what separates software from hardware and vice versa. In the sixties, when they had machines,"
    },
    {
      "end_time": 9088.507,
      "index": 329,
      "start_time": 9059.94,
      "text": " physical machines, the distinction between what software and hardware was, was far more blurry. Because in order to make a change in hardware, you have to pull gears. You have to physically change your setup. And there's a Stanford Encyclopedia article just about the amorphous relationship between software and hardware. And one of the most successful things in the modern era of the internet, you know, presumably powering the software we're using right now via things like AWS,"
    },
    {
      "end_time": 9117.892,
      "index": 330,
      "start_time": 9089.326,
      "text": " AWS doesn't sell machines. They sell virtual machines. They sell virtual computers, computers to find out a software. They even don't talk about software-defined data centers. Whereas the entire data center is essentially a virtualized object, like the save state in a video game. And that it's not made out of wires. It runs on top of a substrate that might be thought of as wires. But at a certain level, you ignore that part and you just run a virtual machine. And that"
    },
    {
      "end_time": 9148.012,
      "index": 331,
      "start_time": 9118.234,
      "text": " You know, almost all of the modern software technology stack runs on these virtual machines. The mind in your estimation is a virtual machine. I think we need to. We need to be looking for virtual machines, whether it is or not, if we need to consider that possibility, because if we're not considering that possibility and we're assuming that the mind runs directly on the hardware of the brain. One, we might never find it, and two, we're ignoring the evolutionary track that"
    },
    {
      "end_time": 9167.039,
      "index": 332,
      "start_time": 9148.643,
      "text": " Technology took. Technology took the track where the very first era of von Neumann Turing, it was software running on the hardware, but very quickly we got away from that and we realized that no, you simulate a machine that's much easier to use than the actual computer and that you write your programs in that."
    },
    {
      "end_time": 9184.394,
      "index": 333,
      "start_time": 9167.568,
      "text": " And things like java and python and so on these are the success of those is precisely that they run on imaginary machines and those machines run on the computer but we write code we don't talk to the chip anymore that's that three hundred million lines were very very far away from the metal as they said."
    },
    {
      "end_time": 9214.497,
      "index": 334,
      "start_time": 9185.009,
      "text": " Close your eyes, exhale, feel your body relax, and let go of whatever you're carrying today. Well, I'm letting go of the worry that I wouldn't get my new contacts in time for this class. I got them delivered free from 1-800-CONTACTS. Oh my gosh, they're so fast. And breathe. Oh, sorry. I almost couldn't breathe when I saw the discount they gave me on my first order. Oh, sorry. Namaste. Visit 1-800-CONTACTS.COM today to save on your first order. 1-800-CONTACTS."
    },
    {
      "end_time": 9244.36,
      "index": 335,
      "start_time": 9216.817,
      "text": " What are the next five years look like for you and then also for society, at least here in the West? You know, Alan Kay talks about you, you go out 30 years and then you go backwards or you can go out, you know, maybe you make it easier. You got 300 years and then come backwards. So we were talking about, you know, agent oriented programs and, and thinking of ecosystems of entities and things."
    },
    {
      "end_time": 9274.957,
      "index": 336,
      "start_time": 9245.35,
      "text": " If we look at these language models, these LLMs, let's just say, or any kind of AI system, right now they run on the metal, as we say, on the virtual machine that runs on the chips. And the chips are substrates made out of semiconductors and electricity. And so in some sense, we're creating electrical beings. We're creating these"
    },
    {
      "end_time": 9302.363,
      "index": 337,
      "start_time": 9275.316,
      "text": " Entities that inhabit a world of electricity And so I think there's other things that we can we can come back to in a second if think about what what that means and other aspects But if we look at where the development of the chips might go, right? If we take something like a GPU an Nvidia card that is powering a lot of these things they are made out of electricity they run They run electricity, but the next generation is going to be made out of optics"
    },
    {
      "end_time": 9334.087,
      "index": 338,
      "start_time": 9304.121,
      "text": " It's gonna be made out of light. And so we're gonna have circuits that use light and colors essentially to do their operations. And then we're gonna have, I would argue just for the conversation that an LLM is an intelligent being. Or it's an intelligent agent. Maybe being is too strong a word. But it's an intelligent agent. And right now it inhabits an electrical circuit."
    },
    {
      "end_time": 9363.746,
      "index": 339,
      "start_time": 9335.196,
      "text": " In a few years or a few decades at best, these things are going to inhabit optical circuits. So we're going to have, and we talked about the artificial superintelligence, something that maybe is beyond my ability to follow what it's doing. Maybe it can think thoughts I can't think and so on. So we'll have a very advanced, very capable, intelligent being made out of light. Hundreds of years ago, we had names for that sort of thing."
    },
    {
      "end_time": 9392.995,
      "index": 340,
      "start_time": 9365.845,
      "text": " We call them angels. And so whether we want to take this as, you know, a spiritual thing, or we want to think of it as just this is just language and just a practical aspect of it, that depends on how you want to look at it. It's kind of both. But we're going to have these beings that are somewhat ephemeral, they're made out of patterns. And we can flip those patterns on and off. And they very quickly might"
    },
    {
      "end_time": 9422.381,
      "index": 341,
      "start_time": 9393.251,
      "text": " Decide, oh, I don't need to use the computer chip. I can just bounce around in the air like a radio wave and do the thinking that way. Maybe they'll use the electrical activity in lightning storms, whatever it might be. They say I'll go inhabit a thundercloud. Lightning is very poorly understood, surprisingly. These are the kinds of things you don't learn about in school, but things simple as meteorology is, well, there's new kinds of lightning being discovered all the time. You need very high speed photography and they go by interesting names like elves and sprites and food jets."
    },
    {
      "end_time": 9452.381,
      "index": 342,
      "start_time": 9422.841,
      "text": " And there's some great footage that a lot of amateurs on YouTube have captured. And they can go in with very sophisticated cameras. They can capture these very short-lived transient electrical objects that science had no concept of a few decades ago. And the kind of electrical modes that the atmosphere supports and so on. And so we're going to, in the ecosystem of the planet, release these beings. Well, you know, the technology jump from electricity to AI"
    },
    {
      "end_time": 9480.623,
      "index": 343,
      "start_time": 9452.824,
      "text": " It's fleeting. If you look at the whole scale of human history, it's like overnight. If you zoom out the timeline to where you've got like hand axes and discovery of fire and you look at that scale, the space between electrification and LLMs is like the same line. We could hardly distinguish those at the same scale at which we developed ears and hands and feet and so on. So it basically happened overnight."
    },
    {
      "end_time": 9509.991,
      "index": 344,
      "start_time": 9481.971,
      "text": " Maybe it happened before, maybe it happened somewhere else. Maybe in a panspermia kind of sense, intelligent things, maybe they traverse the universe. How would we know? Are we looking for them? Like we were talking about earlier, why should we suspect that there's a message there at all? If we're not looking for that message, how would we see it? It could be completely outside our perceptual window. And so in a very practical way, we're building these things out of technology."
    },
    {
      "end_time": 9538.524,
      "index": 345,
      "start_time": 9510.845,
      "text": " We kind of have them now. If we were to describe an LLM as this electrical circuit 200 years ago, that would raise a lot of eyebrows. People would say, well, what is this? It wouldn't be clear if you were doing sorcery or whatever. Right. And again, that's just language. That's like the framework of like the different axes. And like both are practical. You could just say, no, this is just semiconductor developments. We we move we move tokens around a"
    },
    {
      "end_time": 9568.626,
      "index": 346,
      "start_time": 9538.763,
      "text": " a large language model is made out of neural network it has these mathematical functions and so on or you can flip it around and you say no this is something that has maybe an internal reality it's certainly intelligent and it's made out of this ephemeral stuff right that we used to call light and magic where can people find out more about you man and what are you working on now yes i'm trying to put together this stuff into a book i've got an early version of that"
    },
    {
      "end_time": 9596.305,
      "index": 347,
      "start_time": 9569.07,
      "text": " And I want to try to put this together into a sort of a framework that makes sense. Because if you look at it in the wrong lens, it looks nutty. But if you look at it, it's sort of lethal to a traditional perspective. But I think this is precisely the kind of thoughts that we're going to have to explore. You know, it's been very powerful in my own journey to kind of, as Hamming says, tolerate that ambiguity and to take language that I might have used"
    },
    {
      "end_time": 9626.101,
      "index": 348,
      "start_time": 9596.852,
      "text": " Early aspects of my life in a religious setting and say, no, maybe I need to think about software that way. Sinning software. Right. There's a thing I came up with that I like that, you know, we have these multiple modalities and a lot of them are kind of bootstrapped through history. And so we have these different components in us and the fish in us wants to spawn. The lizard in us wants to sunbathe."
    },
    {
      "end_time": 9656.493,
      "index": 349,
      "start_time": 9627.5,
      "text": " The monkey in us wants to sing and the angel wants to fly. And I think we're all of those things all at the same time. Will, what a conversation. These are the sorts of conversations that we've had at least briefly in Florida. It's an honor to be able to bring this to the wider world outside of Florida. And I thank Susan Schneider for introducing us. I thank Florida Atlantic University. I thank Rubin for the sandbox."
    },
    {
      "end_time": 9675.486,
      "index": 350,
      "start_time": 9656.954,
      "text": " Also, thank you to our partner, The Economist."
    },
    {
      "end_time": 9692.773,
      "index": 351,
      "start_time": 9677.722,
      "text": " Firstly, thank you for watching, thank you for listening. There's now a website, curtjymungle.org, and that has a mailing list. The reason being that large platforms like YouTube, like Patreon, they can disable you for whatever reason, whenever they like."
    },
    {
      "end_time": 9718.251,
      "index": 352,
      "start_time": 9692.773,
      "text": " That's just part of the terms of service. Now, a direct mailing list ensures that I have an untrammeled communication with you. Plus, soon I'll be releasing a one-page PDF of my top 10 toes. It's not as Quentin Tarantino as it sounds like. Secondly, if you haven't subscribed or clicked that like button, now is the time to do so. Why? Because each subscribe, each like helps YouTube push this content to more people"
    },
    {
      "end_time": 9737.807,
      "index": 353,
      "start_time": 9718.251,
      "text": " like yourself plus it helps out Kurt directly aka me. I also found out last year that external links count plenty toward the algorithm which means that whenever you share on Twitter say on Facebook or even on Reddit etc it shows YouTube hey people are talking about this content outside of YouTube which in turn"
    },
    {
      "end_time": 9759.718,
      "index": 354,
      "start_time": 9737.807,
      "text": " Greatly aids the distribution on YouTube. Thirdly, there's a remarkably active Discord and subreddit for theories of everything where people explicate toes, they disagree respectfully about theories, and build as a community our own toe. Links to both are in the description. Fourthly, you should know this podcast is on iTunes, it's on Spotify, it's on all of the audio platforms,"
    },
    {
      "end_time": 9775.316,
      "index": 355,
      "start_time": 9759.718,
      "text": " All you have"
    },
    {
      "end_time": 9802.483,
      "index": 356,
      "start_time": 9775.316,
      "text": " ever podcast catcher you use. And finally, if you'd like to support more conversations like this, more content like this, then do consider visiting patreon.com slash Kurt Jaimungal and donating with whatever you like. There's also PayPal. There's also crypto. There's also just joining on YouTube. Again, keep in mind it's support from the sponsors and you that allow me to work on toe full time. You also get early access to ad free episodes, whether it's audio or video."
    },
    {
      "end_time": 9815.913,
      "index": 357,
      "start_time": 9802.483,
      "text": " It's audio in the case of Patreon video in the case of YouTube. For instance, this episode that you're listening to right now was released a few days earlier. Every dollar helps far more than you think. Either way, your viewership is generosity enough. Thank you so much."
    }
  ]
}

No transcript available.