Audio Player
Starting at:
Jacob Barandes: The Mathematical Accident That Changes Everything
July 1, 2025
•
2:12:20
•
undefined
Audio:
Download MP3
ℹ️ Timestamps visible: Timestamps may be inaccurate if the MP3 has dynamically injected ads. Hide timestamps.
Transcript
Enhanced with Timestamps
314 sentences
21,445 words
Method: api-polled
Transcription time: 130m 25s
The Economist covers math, physics, philosophy, and AI in a manner that shows how different countries perceive developments and how they impact markets. They recently published a piece on China's new neutrino detector. They cover extending life via mitochondrial transplants, creating an entirely new field of medicine. But it's also not just science they analyze.
Culture, they analyze finance, economics, business, international affairs across every region. I'm particularly liking their new insider feature. It was just launched this month. It gives you, it gives me, a front row access to The Economist's internal editorial debates.
Where senior editors argue through the news with world leaders and policy makers in twice weekly long format shows. Basically an extremely high quality podcast. Whether it's scientific innovation or shifting global politics, The Economist provides comprehensive coverage beyond headlines. As a total listener, you get a special discount. Head over to economist.com slash TOE to subscribe. That's economist.com slash TOE for your discount.
Harvard's Jacob Arendes exposes the hidden assumption that has blinded us for nearly a century. One day while preparing to teach quantum mechanics, Jacob made a startling discovery. Quantum theory and classical probability are separated by a single unnoticed presumption, Markovianity.
Drop it and the gap between them vanishes entirely. Even more startling, this mathematical accident bypasses the so-called local realism constraint of Bell's theorem and dissolves the measurement problem.
All without magic. This discussion ranges from black holes that reign to the mathematical beauty of indivisible processes culminating in a meditation on legacy, kindness, and why the next revolution in physics demands philosophers and physicists working as one. Jacob, welcome back. It's always a pleasure to talk with you, Kurt.
It's always a pleasure to have you, to host you. Thank you so much. Lovely being here in Toronto. It's a lovely city. And if you haven't been to Toronto, you should come visit. It's great. Is Toronto real here? How about that? Is Toronto non-locally real or locally real? Firstly, let's focus on this term real. Has the 2022 Nobel Prize disproved so-called local realism? If you read the press release,
from the 2022 Nobel Prize in Physics that was given to Aspeh, Clauser, and Zeilinger for their work testing experimentally violations of a generalized set of equalities that began with the Bell inequality and evolved into things like the CHSH inequality. If you read the press release for that Nobel Prize,
It says that what they accomplished was proving that there cannot be hidden variables. That's not strictly correct. It's certainly not what Bell argued. There is a somewhat narrower claim about what they demonstrated with their experimental work. And that was to show that local realism is false.
So we have to talk about what local realism means. Local realism is the statement that objects localized in space have definite properties, have in some real sense, they possess some kind of definite way that they are that is independent of measurements and that somehow interact
With measuring devices to yield results, maybe the measuring devices passively reveal those pre-existing properties, maybe there's a more subtle interplay, but the objects have something like real definite properties localized where they are in space.
Just to be specific, you said real definite properties. Can we just drop real from that? Can we just say that the particles have definite properties? Sure, sure. I was using real there more for emphasis. Real, definite, just to make very, yeah. The question about what do we mean something distinct by real from definite? I mean, you could try to parse those. I don't have a definition of what real means.
in a metaphysical or physical sense that doesn't involve words that essentially mean the same thing as real. To say something is real is to say that it exists. But what does exist mean? To say that it is real, really there. I mean, it's, so this is again, one of those, you know, we've had conversations before about how some very primordial primitive notions can be very difficult to define rigorously in a way that isn't logically circular.
So for these kinds of notions, and these include things like reality and existence, they include things like if you really try to pin it down exactly what we mean by probability, exactly what we mean by consciousness, you know, they're all of these very difficult questions in metaphysics.
We think we're talking about something when we talk about them, but they are very difficult to define. Free will is another good example, very difficult things to define. So we'll have to take for granted for now, because we can't solve every problem in philosophy today, that we have some prior notion of what it means for things to be real, that they exist. So we assume, according to local realism, that objects localized in space in some sense have real
or definite or pre-existing properties or a way that they are, an ontology, a physical state of being that is separate from what we see when we measure those objects. There could be some subtle interplay between that state of being of the object and measurement, but it can't just be that
That they have no state of being except through some kind of measurement process according to local realism, if that's the view that one takes. I know Tim Maudlin quipped about people's obsession with saying that there's no realism, but yet they like locality. He would say, oh, it's not real, but thank God it's local.
Right, yeah. And I think that the author Adam Becker, who wrote a book, What is Real, about the historical development of quantum theory, I think he also put it really neatly. He said, without realism, there's nothing to be local about. So the arguments that people have made is, and this term local realism, I should say that not everybody who works in
philosophy and foundations of physics, foundations of quantum mechanics, particularly likes that term local realism. But of course, one one view is maybe we can detach the two pieces and save locality, but give up realism. Or maybe we have to do is hang on to realism and give up locality. I have to say I'm sympathetic, strongly sympathetic to those who would say that without the realism part, there's nothing to be local about. I mean,
Presumably, in some sense, you and I exist. If I'm not going to be solipsistic, then if I accept that I exist, I'm going to want to accept that you also exist, that others exist. I appreciate that. Yes. Yes, you're very welcome. You're very welcome. It's your finest quality. Thank you. Thank you. And if science is to make any sense at all,
If even the textbook version of quantum theory doesn't make any sense at all, then measurement outcomes have to exist in some sense. If there are no measurement outcomes at all in any sense, according to anybody, measurement outcomes, we can talk about different interpretations of quantum theory and what it means to have measurement outcomes. Many people who are watching this will know that, you know, on the
The many worlds theory, there are many measurement outcomes. There are also relational or perspectival interpretations or theories for quantum theory in which measurement outcomes are relational or depend on one's perspective. But if there are no measurement outcomes of any kind in any sense, if those just don't exist, then it's a completely self undermining picture of reality. That is,
That sort of picture of reality undoes itself. It means that without measurement outcomes, we can't even talk about how we do science or how we gather empirical knowledge of the world. And without empirical knowledge of the world, there's no way to to account for what we see. There's no way to ground our physical theories. So I think some kind of realism about something is unavoidable if science
narrowly or our physical experience more broadly is to be coherent. And if you think that there is realism about people and realism about measuring devices or measurement outcomes at least, then you can ask the question of where the line is. Why only measurement outcomes? Is there something special about measurement outcomes? Is there something special about people?
What about our individual cells? Do our cells get to have realism also? The cells that make up our bodies? The, you know, sub components that make up our measuring devices? And if you want to claim that our macroscopic, macroscopic meaning that the big world, the world that people walk around in exists in some sense,
And you want to argue that this world is emergent in some way from some deeper level of reality, some deeper physical substrate, then it's very hard to avoid some commitment to the reality of that physical substrate. I mean, you can't have emergence without a substrate out of which the emergence is supposed to happen unless you can provide a rigorous argument for how we're supposed to do that. And I have not seen such a rigorous argument.
So it seems hard to deny some kind of realism to something going on in nature even at a fairly low level. Exactly where we have to stop if we have to stop at all is an interesting question. So I just don't know how to make sense of the idea of giving up realism. I don't even know what that means. I don't think it's coherent. I think people sometimes will say it and then they'll move on without maybe following the consequences of giving up realism
to their logical conclusions. I think when you do that, you run into some pretty deep problems of self undermining. So the question is, does Bell's theorem rule out local realism to begin with? And this is where we can start to talk about some of the implicit assumptions, some explicit, some implicit assumptions that lead to Bell's results. You will sometimes see writings of prominent physicists, sometimes in the popular press, sometimes in articles
in scientific journals that are intended for people to see, in which they sometimes wax poetic about how quantum theory has transformed our view of reality, how pre 20th century physics was very different from the physics of the 20th century and beyond. And what we've learned from quantum theory is that nature is subtle and mysterious. I grant all those things, nature is subtle and mysterious.
but that we have to give up things like realism, that what it's taught us is that we can't be realists about nature, that we have to view all of physics in a purely operational or instrumentalist sense. It's merely about the operations we can perform. Things are defined in terms of the operations we can do to measure them or interact with them or work with them, and that scientific theories are only instrumentalist in the sense that they're just models or mathematical vehicles for relating
preparations of measurement setups to the outcomes of measurements. I don't view this as some kind of progress of science. It's a particular philosophical metaphysical viewpoint toward what scientific theories are supposed to be like. And I object and reject the idea that this is somehow the lesson that modern physics, including quantum theory, has taught us. It's true that
on the assumption that quantum theory is a good, successful physical theory as abundant experimental evidence strongly suggests that our understanding our picture of reality does need to be modified compared with the physics prior to the beginning of the 20th century. But that just means
that there's work to be done, work to be done by philosophers and by physicists to try to understand that world rather than give up and embrace instrumentalism or operationalism. I think that instrumentalism and operationalism are perfectly fine practical approaches to making use of our physical theories. And until we find an acceptable picture of what's going on, I think
They're perfectly reasonable, temporary places to be, but I don't think they're the end goal. So how do we avoid speculation then if we're not going to ground ourselves with what's operational or measurable? So I have an aversion to speculation. This is something that we've talked about. I think that
The success of quantum theory, quantum theory is a very intricate theory. It's got a list of axioms, which we've talked about. It makes a huge number of very non-trivial predictions that have been confirmed to incredible accuracy in experiments over many decades. Oh, and I should qualify what I said as not just speculation, because speculation could just be idea generation, which is what one should do in a meeting or in a room with yourself ideating.
I mean to say more wild generation of theories and then speculation, a top speculation, a top speculation. Yeah. So it's a great point. Yes. Idea generation is great, but what I don't typically like is wild speculation that doesn't eventually ground itself in some kind of rigorous scrutinizing. Fortunately, quantum theory is such a rich, intricate theory that it places a lot of constraints on the kinds of world pictures that you might try to write down.
Now, of course, when you try to create any physical theory or try to put together any world picture of the theory, you're going to be guided by some extra empirical criteria as well. You don't want to multiply assumptions beyond what's necessary in some vague sense. That's Occam's razor. There's, you know, given the choice between different kinds of world pictures or physical theories or what have you. All else equal, you'll want to use pictures that
are more perspicuous, clearer, simpler. There's a kind of elegance that we're often looking for. But above all, you want to meet certain criteria that I think are just deal breakers. One is your world picture has to be consistent with the empirical predictions of the physical theory. It's got to get the experimental predictions right. We call that empirical adequacy. That is
an absolute must for any world picture or interpretation or formulation that you're looking for. You want this interpretation or picture not to yield ambiguous statements about things that in principle may be in practice difficult, but in principle you could go out and look at. Ideally, you want to understand how things like our macroscopic everyday world, at least in schematic terms,
can be seen to arise from the world picture that you're proposing. So as a counterexample, the Copenhagen interpretation just takes for granted as a classical world. And going back, I mean, many people have said this more eloquently than I have, including Hugh Everett, who gave rise to the Many Worlds interpretation, all the way back to his doctoral work in 56 and 57,
He complained that the Copenhagen interpretation made it impossible to understand how you could, there's any way to understand how the classical world emerged from a deeper level of reality because it simply took the classical world for granted and I agree with that critique. So understanding at least in schematic terms how our macroscopic everyday reality is supposed to emerge from that world picture. And finally, you should avoid the need for a very long list.
of epicyclical additional speculative metaphysical hypothesis and ad hoc assumptions that should have gone forever. I think these are deal breaking conditions and given the success and intricacy of quantum theory and its predictions and given those criteria, most things you would propose just don't work. They don't meet those criteria. And so you might worry as I spent a lot of time worrying
that maybe we don't have a case of under determination, that quantum theory under determines its possible realist interpretations, but that quantum theory over determines them, that there simply aren't any sensible, realist oriented formulations or interpretations, world pictures, things the world could be like, such that
The theory to describe and make predictions about the world is quantum theory. That was a concern that I had for a very long time. There are other interpretive approaches to quantum theory. We've talked about these and many people who are watching this probably have heard of these or know something about them.
The Copenhagen interpretation we already mentioned,
There's the strict textbook, don't ask questions, shut up and calculate approach that just goes directly from Dirac and von Neumann's axioms. There's the de Broglie-Bohm pilot wave theory or Bohmian mechanics. There's the Everettian many worlds type picture and
Arguably there's more than just one some people who work on this would say there's only one but but People will formalize this story somewhat axiomatically differently. So arguably there's more than one such picture and there's more I mean, there's a whole There's this handsome guy who came up with Indivisible stochastic processes. I don't recall his name though Yeah, yeah. Yeah, I know that I know that guy. I think I do I think I know that guy and
What motivated me to work on, and we're talking about this indivisible stochastic approach, was I didn't think any of the previously existing approaches met those requirements. And we can go through and talk about why I don't think they meet those requirements.
There's a sense in which the textbook approach and Copenhagen meet the empirical adequacy requirement by construction. They're just phrased, they're just constructed around, you know, the measurements, which they've just taken to be, you know, to be primitive axiomatic features of their descriptions. And so they're, of course, they're going to be empirically adequate, you know, for most everyday purposes. But
They do lead to some ambiguities and then we run into the ambiguity problem.
is an example of where you run into some ambiguity. You have two observers, one inside of a sealed box, one outside of the box, and then there's this question, do both observers agree that the one in the box conducted a measurement and we should apply the measurement axioms, or did not conduct a measurement and should be modeled using the non-measurement axioms? And this is just an ambiguity that shows up in these circumstances. Now, when other physical theories break down, like general relativity breaks down at singularities,
Newtonian mechanics has places where it has singularities. Maybe we'll talk about some of those. Autromagnetism has singularities. We just accept that these physical theories are incomplete in some sense. They're effective descriptions. It's not the end of the world. It's interesting that there was so much resistance in the history of the development of quantum theory to accepting that quantum theory also can have some limitations according to the textbook or Copenhagen approaches, which are subtly different.
Speaking about the Copenhagen interpretation, are there modern physicists who adopt that view? Just a moment. Don't go anywhere. Hey, I see you inching away.
Don't be like the economy, instead read the economist. I thought all the economist was was something that CEOs read to stay up to date on world trends. And that's true, but that's not only true. What I found more than useful for myself personally is their coverage of math, physics, philosophy, and AI, especially how something is perceived by other countries and how it may impact markets.
For instance the economist had an interview with some of the people behind deep seek the week deep seek was launched no one else had that another example is the economist has this fantastic article on the recent dark energy data which surpasses even scientific americans coverage in my opinion they also have the charts of everything like the chart version of this channel it's something which is a pleasure to scroll through and learn from.
Links to all of these will be in the description of course. Now the economist commitment to rigorous journalism means that you get a clear picture of the world's most significant developments. I am personally interested in the more scientific ones like this one on extending life via mitochondrial transplants which creates actually a new field of medicine.
Something that would make michael levin proud the economist also covers culture finance and economics business international affairs britain europe middle east africa china asia americas and of course the u.s.a. whether it's the latest in scientific innovation or the shifting landscape of global politics the condoms provide comprehensive coverage and it goes far beyond just headlines.
Look, if you're passionate about expanding your knowledge and gaining a new understanding, a deeper one of the forces that shape our world, then I highly recommend subscribing to The Economist. I subscribe to them and it's an investment into my, into your intellectual growth. It's one that you won't regret. As a listener of this podcast, you'll get a special 20% off discount. Now you can enjoy The Economist and all it has to offer.
Speaking about the Copenhagen interpretation, are there modern physicists who adopt that view?
I give a survey out to incoming graduate students and I ask them their views on quantum mechanics. Is the measurement problem a serious problem? What's their preferred interpretation? The last time I gave out this interview was for the students coming into the physics PhD program in 2024.
I got all of them to answer it, and about half of them put either the orthodox or textbook approach or the Copenhagen approach, and then the other half picked various other approaches. A pretty big chunk regarded the measurement problem as either a major or minor ongoing problem, so it's very interesting to get a snapshot of graduate students. When it comes to practicing physicists, senior physicists, it depends on whom you ask. People have a lot of different views. In 2019, Harvard
hosted Anton Zeilinger, who is the Zeilinger who shared the Nobel Prize in 2022 with Alana Spey and John Clouser for his work testing and finding experimentally violations by quantum theory of certain inequalities that are related to the Bell inequality.
Harvard has an annual Lee Historical Lecture when we invite a physicist who has been witness to many important and great events in the historical development of physics and who's contributed to them, talks about their life, their contributions, what they've seen, and their broader views at this point in their career. In 2019, Harvard invited Anton Zeilinger to be the historical lecturer.
There this I believe was recorded and if there is a recording Kurt, I can send you a link to it and people can watch it and it's it's amazing disease. I linger talk about his work and his career. So that that would be a really interesting thing to share toward the end of that lecture. I'm talking like an hour and nine minutes in something like that. He talks about his own interpretational views about quantum theory.
And he very explicitly embraces the Copenhagen interpretation. We have a classical reality. All statements about measurement preparations and results and measuring devices and people are all phrased in classical language. And the role of the quantum state is that it is a mathematical tool
for relating our classical measurement preparations, classical in the sense that the measurement preparations are prepared by classical measuring devices to study quantum things. The quantum state encodes and represents mathematically those classical devices that prepare our measurements and represents predictions about the results that show up on those classical devices. And the collapse of the quantum state
is not some physical process but is merely a change in representation because classical observers or classical devices are updating their information and that there's therefore no measurement problem at all. So these sorts of views exist. I'm not painting straw men when I talk about people adhering to the Copenhagen approach, including people who know a lot about quantum mechanics and have
You're done incredibly important work in their careers on quantum mechanics. I have the utmost respect for it for people, you know, like, certainly Anton's Islander. I mean, he's a Nobel Prize winner. And, you know, he's done absolutely central work in our understanding of quantum foundations. But this is a point at which very respectfully, I and many others disagree.
Um, Bohmian mechanics has proved to be very difficult to generalize beyond systems of fixed numbers of finitely many non relativistic particles. There have been attempts to generalize them. There are amazing people thinking and working on these things. And we've talked about some, some of them, Shelley Goldstein, Ward Strava, um, and many others. I mean, I, I, I could list everybody, uh, over the years, Detlef Dürr, Nino Zanghi, Roddy Tomolka,
I want to leave anybody out but a lot of people have worked on these approaches and trying to generalize to the role of the fully relativistic case try to generalize to be able to accommodate quantum field theories in particular for me on a field theories interacting field theories the kinds of field theories that we see in the center model has proved to be very very difficult and if bohemian mechanics can't achieve
an ability to describe those real-world models that work so well. The standard model is the most well-tested physical theory that we've ever had. Then these Bohm-type theories simply don't achieve empirical adequacy. And this is something that David Wallace, who's a strong proponent of the Everett many-worlds approach, has argued in a paper and in a series of talks that are centered around why the sky is blue, Rayleigh scattering,
Rayleigh scattering is the reason why this guy is blue. This is a relativistic problem, and it's one that Bohmian mechanics seems to have a lot of difficulty handling. And his argument is if it can't handle a question like why this guy is blue, then this is a clear sign of empirical inadequacy. Now that could be fixed up. It's possible that people will develop Bohmian mechanics to a point at which we'll be able to accommodate modern realistic field theories.
But until we reach that point, the theory doesn't achieve empirical adequacy. And my problems with the Everett approach are, you know, and people have a lot of views about this, a lot of work is still being done on this.
but I'm just still not convinced that there's any way to get probability out of this deterministic picture. We have all these branches, and on the branches we have lots of copies of observers. Some are rational by some definition, some are irrational, but there's no connection between whether they're rational or irrational and what happens to them because in the many-worlds ontology everything happens. So we can't somehow argue that observers ought to be rational and ought in some subjective decision-theoretic way to assign probabilities according to any given rule.
There have been a lot of arguments trying to get that off the ground, going back to the work by David Deutsch in 1999 and then David Wallace in his 2012 book. The proofs are very intricate. They get longer and longer. But I think you can't ultimately overcome this problem. And there's more work. I mean, Simon Saunders is trying to bring back branch counting using core screening and appeals to analogies with statistical mechanics. And there are other approaches also, but none of them appear to achieve the aim of getting probability to show up.
um arguably all the arguments if you carefully look at them are circular or involve a very long list of speculative metaphysical hypothesis when you look at the fine print and if you can't get probabilities out then again you're not achieving the empirical adequacy requirements and i know there's some people who might say something like well you know can't we just impose a measure on all the branches just impose a probability measure and declare them to be probabilities the problem is that imposing a measure is something you would do in the axioms
You'd have to add an axiom, but in modern approaches to Everettian quantum theory, the branches to which you would presumably be imposing these probabilities are emergent. They're approximate. They're not fundamental in the axioms. And so, yes, they can arise. You can get branches. Axioms describing fundamental ingredients can produce contingent. Contingent means not necessary, you know, but things that could show up.
tables, chairs, in this case branches, these can show up later on, but you can't assign properties from the axioms to emergent, contingent, derivable things. If I have a theory of chemistry, I can assign properties to my atoms. I cannot, after chairs emerge, axiomatically assign properties to chairs and declare chairs must all be yellow, for example.
Right. And if you if the branches are supposed to be immersion things, then we cannot assign them a measure or probability, a probability measure after the fact. In our axioms, we have to somehow get the probabilities out without assuming probabilities at the beginning. And then there's just no deductive argument that's going to get you to the probabilities. Anyway, this is this is a long range debate that people have been having. People are arguing about this still, but I'm just not convinced we can ultimately get this to work. This problem of probability, I think, is really a fundamental obstruction. And then separately, the effort approach
to get these arguments off the ground in the first place entail lots of additional assumptions beyond the core assumptions that you just have a Hilbert space in the state vector. I mean even some very basic ones like it seems intuitive that when a branch has a zero in front of it because when you expand
The universal wave function or state vector as branches, they've got numbers in front of them. These are the numbers that you want to somehow argue should be squared to get probabilities. Prior to assigning that probabilistic understanding of those numbers, it seems intuitive that if any of them have a zero in front of them, then they don't exist.
But even that's actually not totally obvious. Yeah, we talked about this. Yeah, we talked about this. Why would a zero in front of something? Yeah, there's a way to think about the evolving wave function as a system of classical harmonic oscillators just by changing a representation. This is work by Strochi and Heslot, Strochi in the 60s and Heslot in the 80s.
And from that standpoint, having a zero in front is just like having an oscillator that's not oscillating, but that doesn't mean the oscillator doesn't exist. So there's a lot of these extra assumptions you have to carefully add. I don't know how to justify all of these assumptions. There are just too many of them. It's not that I have a problem with having any metaphysical assumptions. We need some metaphysics to get off, you know, to get out of bed every morning. But once you have that many, each one reduces the credence, the credibility, my belief in the success of the picture.
So I actually think that the constraints we have from the empirical success of quantum theory and just this short list of deal-breaking conditions put so many constraints on candidate world pictures, interpretations, formulations, theories that are supposed to stand in and give us the world picture we need for quantum theory that almost anything that you guess is going to be wrong. You'll be able to show that it runs afoul of one of these conditions.
So I actually think this is exactly the kind of circumstance in which we can make progress by maybe some initial speculating, but then carefully checking that things work together. And this is what led me to the work that I'm currently working on. I think that this approach, I'm working on this indivisible sarcastic approach meets those requirements. Now, I don't know for a fact this is the unique approach that will work. For me, this is just an existence proof of proof of principle.
And maybe some of the ideas that went into this indivisible approach will inspire other approaches that will also do a better job of meeting those conditions. So I think progress actually can be made here. I think we are exactly the kind of situation in which we have the kinds of constraints on us that can lead to progress.
If it turns out that this indivisible stochastic approach is not unique, well, then we're back to having an under-determination problem. But under-determination of scientific theories or interpretations given data, I guess under-determination of theory given data and under-determination of interpretation given theory, these are old problems. These are problems that go back to the beginning of science. And if we can just revert back to those problems, I would still feel that we've made some progress.
So when we first spoke, we talked extensively about indivisible stochastic processes, and I will place a link on screen and in the description of part one, part two, part three with Jacob. And in the first part, if I recall correctly, you described a cliff, two cliffs, and it was as if they had merged and there was no longer a gap between them. Can you tell me about that moment when you were developing indivisible stochastic the framework?
What that looked like? What time of day was it? Where were you? What did you feel? What were you thinking? Well, I was sitting at my desk and I was typing on my computer and I was I was trying to so I was I needed to teach a class and we talked a little bit about this to students who I was not assuming had any prior exposure to quantum theory, but also complex numbers, linear algebra. I wasn't assuming they'd seen any of these ingredients.
But they had seen some probability. And so I felt like I could talk about the theory of stochastic processes. So let me give a little bit of historical background that I don't think we've talked about before. Please. So when I was in college, I spent a summer at Fermilab, which is an experimental physics laboratory in the United States in Illinois. I learned a couple of important things from this experience.
one was had a drive on highways because there were a lot of highways like we would pull out of where we were sleeping, you know, the place the rental places where we were we were all staying, you'd pull right out onto a four lane highway. Okay, so it was a real chance to get a lot of driving experience. That was one thing I learned. Another thing was the sky is really huge in Illinois, like, you know, as someone who spent a lot of my time growing up in New York City, and then in
The suburbs of New York City, lots of trees. You don't see a lot of the sky all the time. Where we were staying in Illinois, the sky was enormous. That was a really extraordinary thing. I also learned that I was not destined to be an experimental particle physicist. So that was an important thing to learn. Wasn't particularly good with my hands. Ultimately, I think I never managed to use a soldering iron.
um but you know i would go to meetings and we talk about getting the experiments you know what was the latest going with experiments and i just it it it just wasn't what i felt most interested in i had enormous respect for people who did that work it was incredibly interesting and what they were able to make matter and energy do was extraordinary it just didn't have the right i just have the right connection to it i found myself thinking a lot more about theoretical and philosophical questions
So I learned that also and the other thing was I decided to learn linear algebra. I wanted to get ahead and so I found a curriculum that was being taught at my college curriculum and I saw the book they were using, I found some homework exercises and I had a summer and I was away at Fermilab so I decided to spend the evenings learning linear algebra. When I finished doing all the homeworks, I went to a professor
Dave Bayer, really nice guy, really amazing guy, mathematician. And I told him I had done all this work and I was wondering if he would grade it for me, if I could get some kind of letter grade. I figured after all this work, maybe I can get a letter grade and put it on my transcript. He said, okay, but only if I did a final exam, a take-home exam. I said, okay.
So he gave me a take-home exam and I did the exam and I did okay. I did okay on the exam. But when he sent it back to me, I was a little bit disappointed in my final grade and I felt a little bad because I put so much work into the course. And so I asked him, you know, okay, so I got this final grade. That's fine. You know, but I'm wondering, is there anything I can do to boost the grade? Could I do like an extra project or something like that? He says, actually, yeah, you can do an extra project if you want maybe to boost your grade. This project is on stochastic processes.
I had never heard of stochastic processes before. Back in high school, I had played around with probabilistic simulations for various things, but I'd never done anything like a formal study of probabilistic theories. So this was my first opportunity to see this, and I think what's interesting about this is if I had done better on this exam, I never would have had this encounter, right? So, you know, this is, I think, a general lesson. Sometimes you have an experience and you feel like it's bad news,
And it turns out actually might be really good news. Here I'm quoting Kurt Vonnegut. And those of you who don't know, Kurt Vonnegut has this famous lecture he used to give on good news and bad news. And we never know what the good news or bad news is at the time. Sometimes we only find out the answer much later. And he's got a lecture on YouTube people can go watch. It's very interesting lecture.
This episode is brought to you by State Farm. Listening to this podcast? Smart move. Being financially savvy? Smart move. Another smart move? Having State Farm help you create a competitive price when you choose to bundle home and auto. Bundling. Just another way to save with a personal price plan. Like a good neighbor, State Farm is there. Prices are based on rating plans that vary by state. Coverage options are selected by the customer. Availability, amount of discounts and savings, and eligibility vary by state.
so the time i thought it was very bad news that i hadn't done so well this exam in the end it gave me an opportunity to learn the rudiments of the subject and this is an old story i mean max born tells a story in his autobiographical memoir about when heisenberg was visiting from munich to gertigen
with Max Born and Heisenberg eventually defended his doctoral dissertation and he was asked a question that he couldn't answer. This is Born retelling the story. It's in my life recollections of Nobel laureate which is Max Born's autobiographical memoir and he tells the story about how Heisenberg could not get this one question. It was proposed to him by Wilhelm Wien who was an experimental physicist and Wien was quite upset that Heisenberg couldn't get the answer and wanted to fail him
And his other two committee members said that they couldn't fail him. He was the best theorist they'd ever seen. And so they agreed to give him the lowest passing grade. And Heisenberg was just mortified. He felt so depressed after he got this. He barely passed his final exam for his doctoral work. And he went and he sort of sulked for a long time. But then he thought about this question that Wilhelm Wien had asked him. And it turned out the question was closely related to the uncertainty principle.
And so all this time he spent worrying about this question he couldn't answer may have helped inspire him to come up with the principle that is the most famous thing attached to the Heisenberg principle. So again, you never know whether something you think is a failure is ultimately going to end up being the thing that is important for your career. So I learned about stochastic matrices in a very rudimentary way. I considered some very simple stochastic systems that I was given to do for this final project.
I learned about their connection, you know, long time behavior of stochastic processes and how this is related to their eigenvalues. But these were all very new terms to me because I had only just learned linear algebra that summer. Fast forward a number of years to the end of my doctoral dissertation in which I'm writing simulations, numerical simulations to handle systems of these intricate systems of black holes that show up in certain low energy solutions to quantum gravity.
How many years at this point is there in between?
eight years, nine years, something like that. I have to be more precise. I don't know exactly when I started doing the numerical simulation, so it's a little hard to say. So how much of it did you recall? Is it just a semblance, like the gist of it, or are you recalling precise formulas? I remember the gist of it, but I had scanned. I had photocopied all my notes. And so I went looking for my old notes for this project that I did. And so I had an opportunity to
to see it again. Interesting. But now this is so many years later. It's after I had done an undergraduate degree in physics and math. It's after I had studied a lot of theoretical physics and philosophy. It's the end of graduate school. I mean, I was coming at it from a completely different vantage point. And it looked very rudimentary to me now, given, you know, all the work that I had done in the years since. But I was so fascinated by this. Because going back to that time, I mean, I saw these stochastic matrices, this sort of theory of stochastic processes,
Before I had learned quantum mechanics, before I really knew anything concrete about quantum mechanics and seeing it again, after all these years of having thought about having taught quantum mechanics to students as a teaching assistant, you know, having taken so many more quantum mechanics courses, having used quantum mechanics so much in all my other work, I was struck
by some of the formal similarities between the theory of stochastic processes and quantum theory. These are both theories that involve probabilities. They're both theories that involve processes in which the outcomes are indeterministic and are described using some kind of probability. They're both theories in which we encode those probabilities in vectors, in vector spaces. Stochastic processes, it's probability vectors. Quantum theory, it's
State vectors or wave functions or somewhat more generally density matrices. Time evolution is given by square matrices for a stochastic process. They're stochastic matrices. These are matrices whose entries are non-negative in the column sum to one. If we think about multiplication as being multiplication with the matrixes on the left and the probability vectors on the right. And in quantum theory,
It's unitary matrices, unitary operators that carry out the evolution. For the theory of stochastic processes, some of the things we might want to ask about are random variables, functions on a sample space. The random variables are the things we could observe. They're the observables. And in quantum theory, observables are represented by operators or matrices, self-adjoint operators or matrices. We call them observables also. So there are all these formal resemblances.
And so now fast forward to me trying to prepare for this class, trying to teach to students who, like me, didn't know linear algebra at the time, didn't know very much about complex numbers, didn't know about quantum theory, but knew something about probability. And I thought, well, maybe I can adjust the formalism of the classical theory of stochastic processes.
And maybe I can adjust the formalism of quantum theory to make them look a little more similar. Maybe I can figure out some kind of mapping between them or change how I write them to make them look more similar. And the goal was very clear. My goal was to bring the two theories as close together as possible and then be able to tell the students, OK, students, here's what you need to jump the gap. And by bringing the two theories close together, the hope was that I could make that gap
a little bit less mysterious, a little bit less arcane, a little bit less extravagant. Maybe I could boil it down to some relatively simple, transparent change. Maybe a generalization, maybe dropping an assumption, maybe modifying an assumption. Something simpler than just listing all the Dirac, Feynman axioms out of the blue like we often do. And the surprising thing was that the gap disappeared.
And suddenly I had one mathematical formalism for both the theory of stochastic processes and for quantum theory. And I was very confused how this had happened. It took me a little while to realize that I had implicitly given up the Markov assumption. The assumption that for the stochastic process, what comes next according to the process is determined solely by the system's present state or configuration. That's the Markov assumption.
I had allowed the probabilistic development of the system to depend on past details, details that were not mediated solely by what was going on at the present. And once I realized I dropped this, immediately what I did was check the literature and see, surely someone else has tried to model quantum theory using a non-Markovian stochastic process of some kind. And the answer was there was almost nothing in literature about this. Previous efforts to replace quantum theory with something like a stochastic theory
Which go back to the work of Fritz Bopp in the 1940s, who, by the way, is mentioned in Hugh Everett's correspondences, his 1957 letter to Bryce DeWitt, his extended unpublished dissertation from 1956. He talks about Bopp's stochastic theory, says actually he thinks it's a fine theory if it can be fully developed. His objection is not.
to indeterminism. He doesn't prefer determinism over indeterminism. Everett says he just wants a theory that does one thing and not the direct line of an axioms, which seem to be deterministic in some situations and indeterministic in others. He's very clear about this, and I recommend, and you can put a link to his full 137 page unpublished dissertation. It's available online. People can read about this. The link will be on screen. So this will be interesting for people to look at. But then work by Imre Fenyes in the 50s and Edward Nelson in the 60s through the 80s. But they had assumed that the dynamics should be Markov.
This Markov assumption was an ingrained assumption that many people had. Now, at least as far back as 2011, here I'm pointing to some work by Shelly Goldstein, Tosk, Norsen and Zanghi. They have an article in Scholarpedia on Bell's theorem, which you can also link to. They note that Bell implicitly assumed Markovianity in deriving his theorem.
There's a much more recent draft article by Tim Maudlin called The Great Rift in Physics, Relativity and Quantum Theory, in which he also highlights this Markovian assumption that's implicitly made in Bell's Theorem. This is especially clear in the 1990 formulation of Bell's Theorem, La Nouvelle Cuisine's name in that paper, you can look at that as well.
relies crucially on situating his so-called screening local beables in a space-time region of finite thickness. It has to be finite thickness so it doesn't intrude on the on the light cone of the other thing. And if you have a non-Markovian set of laws, you can jump over those regions.
through the laws, but in a manner that stays within the light cones, respects light cone structure, so provides a way around some of Bell's conclusions while respecting the so-called relativistic causal structure of space-time. But what I think was lacking was a concrete realization of this loophole. Loophole may not be quite the right word because
You know, Bell has premises. Some of them were explicit, some of them were implicit. Those premises lead to Bell's theorem. Here, we're denying one of the premises. That's not quite a loophole as much as showing the theorem is doing its job, right? The theorem says with these premises, you get this result, and I'm denying one of those premises. So that doesn't mean the theorem is broken. In fact, it's showing the theorem is doing its job as a no-go theorem, highlighting what the premises are, although arguably by not making this Markov assumption explicit, there was a loophole. You could argue that's a loophole in some sense.
But what we lacked was a concrete realization of a comprehensive formulation of quantum theory that was built on non-Markovian laws and I had inadvertently stumbled into such a theory. The particular kind of non-Markovianity involved is called indivisibility. That term was introduced and we've talked about this before in the quantum information literature as far back as 2006 and then specifically in the context of
Classical looking stochastic processes in a review article in 2020 is the pre print 2021 is when it was published by Simon Mills and Kevin Modi. Right. It's recent. Very, very, very recent. Right. We're talking just a year and a half or so before I had independently arrived at this. Also to be technical, is it being non Markovian or is it just not being Markovian? Right. So this is a subtle distinction. An indivisible stochastic process is one in which
the laws
the laws. That is, there's a failure of the laws to divide in time. Now, that's a form of non-Markovianity. It's a particular form of non-Markovianity and it's a particularly unstructured form of non-Markovianity. So what this means is that you can fill in the story if you want with a detailed set of probabilities for all the possible trajectories that could be taking place behind the scenes.
The laws of the individual process don't appear to fix just one choice of such non-Markovian description. My colleague Alex Meehan, who's a professor of philosophy at University of Wisconsin-Madison, who may be also someone you might talk to, very interesting philosopher of physics, super great, big fan, he suggested that we use the term realizer for a given non-Markovian process, a specific
realization a specific process that assigns probabilities to lots of intervening events. And an indivisible process is not one such realizer. It's an equivalence class. It represents a whole collection of different realizers different specific non Markovian processes that all agree
on the rudimentary laws that define the indivisible process. So the indivisible process identifies a couple of basic laws that fail to divide and doesn't fix all of these additional things that you might want to impose. And all those additional things, if you impose them, give you a specific realization or realizer. Sorry, what's a realization? Right. So let me be, this was sort of an overview, but let me now be a little more precise. So one thing you could ask about such a process is, well, okay, behind the scenes,
Behind the scenes, if I imagine this process is truly unfolding and I run an indivisible process, let's say 10,000 times, can't I, if I imagine being able to see behind the scenes, can't I just count up all the trajectories that do this and do that?
And then just by adding them up and dividing by the total number of trajectories, start assigning fractions, probabilities in some frequent sense to lots of statements that are not specified by the limited laws I gave you. Well, the answer is you could. You can do that. What you'll find is that there's not a unique such choice of frequency ratios to write down. The laws of the indivisible process are very rudimentary. They tell you how to predict
What the probabilities will be starting at certain conditioning times to later times. The later times are adjustable. There's no assumption that time is fundamentally discrete here, but that's kind of all the laws give you. They don't give you detailed information about the probabilities to assign to the detailed trajectories that are going on behind the scenes. If you impose
What all those probabilities should be, all those extra probabilities behind the scenes, all of them, completely specify them, which is an infinite amount of information and very unwieldy and not practical. But if you could somehow imagine imposing all of them and fixing absolutely every probabilistic detail, you would have one realizer. But nothing fixes that particular set of choices. You could have assigned different frequencies, different probabilities to all those those behind the scenes details.
give a different set of probabilistic statements for all those things consistent with the same indivisible laws that we started with and that would be another realizer and you can argue that there may be many many many realizers
But because all the empirical predictions of the theory come out of the rudimentary indivisible laws, all these extra details do not appear to have any empirical content. And an indivisible theory simply doesn't specify what they are. It leaves them undetermined. And so an indivisible process represents a whole class of possible realizers.
So the difference between an indivisible process and a non-Markovian process is that a non-Markovian process is one such realization where you've assigned probabilities to every possible statement, every trajectory, every detail. An indivisible process is less sharply defined. You define some features and those features are sharply defined. But what's not empirically significant is left unfixed. So an indivisible process in a way represents a whole class of non-Markovian processes.
And the nice thing about this is, from the point of view of someone who isn't even thinking about quantum theory maybe, maybe you're a statistician, maybe you're a statistical modeler, you might have thought, well, I'd like to model non-Markovian systems. I'd like to model systems in which the more you know about the past, the more you can say about the future.
But if your system is arbitrarily non-Markovian, if there's no bound on how much previous information will determine what happens in the future, you might think that you'd need to specify an infinite amount of lawful information, an infinite amount of information about the laws of your model in order to make any predictions at all. It might seem that fully non-Markovian processes are just too impractical to use. These invisible processes give you a way to handle that problem.
with a limited set of laws, you can make predictions with these models, you can make empirical predictions with these models, even though the models are inherently non-Markovian, you don't have to specify an infinite amount of information. You might have worried if I only specify a small amount of information with the laws, will this theory be able to make any empirical predictions at all? And the answer is well, as I've shown, it's equivalent to quantum theory,
And quantum theory certainly makes a lot of empirical predictions. So you might have thought what you had to do was make a Markov approximation. Just take all that past information, truncate it somewhere at some order, or truncate it all the way down to just the present state. We know when we do that we're making approximations, but maybe we thought that's all we can do because otherwise the problem is too intractable. An indivisible process gives you another way to make non-Markovian processes tractable without making all those approximations.
The cliffs, let's speak about cliffs, the cliffs between being a theoretical physicist or quantum physicist and being in finance, it's actually not that large. And you know, many people, I'm sure, have made that jump. And have gone both directions too, yes. Okay. Now, given that you have a new mathematical tool, indivisible stochastic processes that are a subset of non-Markovian that doesn't require infinite amount of information, and
Markovian and non-Markovian processes are useful in finance. Do you imagine that your indivisible stochastic approach not only will aid quantum theory, quantum foundations potentially, but finance? Yeah, I mean, I came at this out of an interest in trying to make sense of the fundamental nature of the physical world and make sense of quantum theory. To answer this question, can we find a world picture that
underlies quantum theory. But I would argue that good foundational work in science and in philosophy can and should have practical implications for other fields. On the one hand, having this indivisible picture might give us finally a world picture underlying quantum theory.
But you can read this correspondence in the other direction. Right. If you have some thorny system in which you have to worry about memory effects or other forms of non-Markovianity and didn't know what to do and don't want to make various kinds of approximations, this might give you a new set of tools for studying those kinds of processes, whether you're working in finance or you're working in biostatistics or you're working in neuroscience or you're working in machine learning. I mean, indivisible processes are new.
They only entered the research literature in the way that I'm describing them for what we would normally call something like a classical looking stochastic process in 2020, 2021. And that paper didn't really explore what you could do with them. Ford Blue Cruise hands-free highway driving takes the work out of being behind the wheel, allowing you to relax and reconnect while also staying in control.
Enjoy the drive in Blue Cruise enabled vehicles like the F-150, Explorer and Mustang Mach-E. Available feature on equipped vehicles. Terms apply. Does not replace safe driving. See Ford.com slash Blue Cruise for more details.
Now we have this tool and the question is, what can we use it for? And I think that's a really exciting thing to have a brand new tool. It's like having a blank page that we can write on, right? I mean, it's five years old. So attention is all you need. It was 2017. Chad GPT came out five years later. Who knows what's going to happen this year? Who knows what's going to happen going forward? That's right. But, you know, I would be very excited to see these methods find use in other areas.
uh... finance biostatistics neuroscience you name it i mean all these areas i think yet we don't know where where where these where these things could be useful i'm excited to see where they could be
Hi everyone, hope you're enjoying today's episode. If you're hungry for deeper dives into physics, AI, consciousness, philosophy, along with my personal reflections, you'll find it all on my sub stack. Subscribers get first access to new episodes, new posts as well, behind the scenes insights, and the chance to be a part of a thriving community of like-minded pilgrimers.
By joining you'll directly be supporting my work and helping keep these conversations at the cutting edge. So click the link on screen here, hit subscribe and let's keep pushing the boundaries of knowledge together. Thank you and enjoy the show. Just so you know, if you're listening, it's C-U-R-T-J-A-I-M-U-N-G-A-L dot org, KurtGymongle dot org. Okay, so this came from you tearing apart your curriculum and thinking, how can I attack this course in a new manner to make it
More elementary for people to understand for first year graduate students, or maybe this was undergrad. This was first year undergraduate students who were taking this class. OK, I want to speak about first year graduate students. So what's an example of something that's been that you've consistently found is difficult for first year graduates to understand, but you found some clever analogy or some interesting Hello World example that makes it finally click for them?
So I've taught a number of courses aimed at first-year graduate students in physics. I taught Jackson's classical electrodynamics for six years and I've taught graduate level general relativity for over a decade. So there are a lot of examples of things, I mean there's many I could list, where just through
Experience repetition teaching over and over again hearing people's questions and and Having lots of opportunities to refine my approach. I think I found some things that that are helpful to talk about I think one example I like is talking about black holes So I teach general relativity and we get to black holes I set aside half of a full class where I don't do any lecturing and
I just stand in front and ask students to ask me all their questions about black holes. Like an opportunity to talk about the physics of black holes, the metaphysics of black holes, whatever they want to ask. Because black holes are incredible. They're mysterious, they're exotic. For a lot of young people, hearing about black holes is the kind of thing that triggers their interest in science, maybe even in physics. And so to finally be in the class where we've mathematically formulated what black holes are,
We have the tools now at our disposal to start answering technical detailed questions about black holes is a really exciting moment. And I don't want to run through it too quickly. I want to give students the opportunity to dwell and really ask questions about it. And so I don't know that I have exactly like a trick that I do, except the trick being this sort of methodology, this methodology of just opening up space during during a period of time during class to just talk about things, to field all their questions, no matter how silly they may seem.
Tell me about some of the most common questions. Well, so one question students often have is, if there's so much time dilation near the edge of a black hole, how does anything actually fall into a black hole? I mean, you draw these space-time diagrams that show the trajectories of infalling objects
spaces in one direction, time in another direction, and you draw these pictures and it kind of looks like the trajectories never quite reach the event horizon, the black hole, they never quite fall in. And this is really mysterious to a lot of students. And so it's an opportunity for us to talk about coordinate transformations, coordinate representations in general relativity. How will we derive the solution for the simplest kinds of black holes or some more complicated ones? We're using coordinate systems that are particularly good for
Solving the basic equations of general relativity, the Einstein field equation, in order to write down the correct formula for the shape of space-time. But it may not be the best coordinate system to understand the experience of observers moving around in space-time. As we talk about how you can change coordinate systems, there's no canonical preferred default coordinate choice in general relativity.
You can change your coordinate systems. And it turns out the kinds of coordinate systems that we often use when we first start talking about black holes are not the best kinds of coordinate systems to understand what the experience is of probes or observers who fall into black holes. There are better coordinate systems. And even if you want to say, well, I want a coordinate system that for which the clicking, the ticking of a wristwatch
you know, has its sensible meaning for observers very far away. So suppose you have an observer very far away who drops in a probe to fall into the black hole. And you can ask, what kinds of coordinate systems can I write down that far away from the black hole tick in time at the same rate as the far away observer's wristwatch? You'll find there's not a unique coordinate system you can write down.
The coordinate systems we will sometimes write down when we're first trying to solve the answer field equation do have the property that for observers far away, the notion of time for that coordinate system coincides with the ticking of the wristwatch. But these coordinate systems can be very badly behaved near the edge of the black hole. There are other coordinate systems you can write down that are just as legitimate that likewise agree with the ticking of the wristwatch outside far away from the black hole, but that allow us to see what happens to things that fall into the black hole.
An example is Gholstrand-Ponlew coordinates. But there are other coordinate systems you can write down. People can learn about this. Gholstrand-Ponlew coordinates have a beautiful name. They're called global rain coordinates because they're based on free-falling trajectories like raindrops falling down the black hole. I think the image of a black hole floating in the silence of empty space with raindrops quietly falling on it is such a beautiful poetic image.
But, you know, so there are so showing students that there are other coordinate systems you can write down and that you shouldn't take any one particular coordinate system to be completely serious as the only way to understand what's going on in a picture of space time. That's the kind of thing that I find can be very elucidating to students who are confused about what goes on with black holes. So that would be an example of something I would point to as something that can be very illuminating for students who are seeing this for the first time. What's the difference between being coordinate independent and being generally covariant? Well,
The general and general relativity refers to, well, when Einstein introduced that term, my understanding, and this is now an historical question, so this needs to be fact-checked, but my understanding was that Einstein was in part motivated by desire to understand how to incorporate gravity into special relativity, but was also in part trying to understand how to be able to handle relativity in much more general coordinate systems than the
the Cartesian-Minkowski coordinate systems that one uses in special relativity, these rigid straight-line rectilinear coordinate systems. He wanted to be able to talk about the kinds of coordinate systems that might be adapted to observers that were in various kinds of acceleration or freefall, or just be able to talk about the theory with a more general set of coordinate representations. Here, these coordinate systems are being put on four-dimensional spacetime.
so space points in three different orthogonal directions you have to use your imagination and imagine the fourth dimension for time and space time can be curvy in some intrinsic sense that doesn't require the existence of an extra dimension for the curvature to happen and we want to describe all of the points the events the things that can happen at certain points in space and at certain times we want to be able to describe them numerically and so we put down a coordinate system like graph paper but you could imagine different kinds of
coordinate system different different kinds of graph paper and if you want to be very general about this you want to be able to handle general coordinate systems that's the general in general activity general activity is able to handle arbitrary coordinate systems general coordinate systems and then you want the basic rules of the theory to maintain the same
Meaning to have a sensible consistent meaning as we imagine transforming between coordinate systems, we want them to be covariant. The word is covariant for having a certain kind of consistency as we go between coordinate systems. Not invariant. We're not saying that things look exactly the same in every coordinate system.
Covariant is a bit of a weaker statement. It just means that there's a certain kind of technical formal meaning of the ingredients of the theory, the laws of the theory, the mathematical objects we use to represent things in the theory. We want them to maintain their integrity in some sensible way as we imagine changing coordinate systems. And general relativity has this feature that the theory retains its structural form as we imagine changing coordinate systems in a very general way. And so general covariance is
is related to our ability to change coordinate systems, but it's a statement of the rules or laws of general relativity that when we do change the general coordinate systems, they maintain a certain kind of conceptual integrity.
Your PhD supervisor was Neema, Neema Arkani Hamed, correct? I worked with Neema Arkani Hamed for the first few years of my PhD and then Neema took a job at the Institute for Advanced Studies at Princeton and I transitioned from working on particle phenomenology, which was primarily what Neema worked on,
I want to know what something you learned from nema that stuck with you to this day. I think anyone who talks to nema for five minutes learns a lot of things. So there's a number of things I learned from nema one is
I learned a lot about tennis. We played tennis, which was great. He was a little better than me. So he always ultimately won every match we played, which was very frustrating. I mean, I learned effective field theory from Nima. So effective field theory is a particular paradigm for how we think about quantum field theory is not as necessarily fundamental exact descriptions of nature.
but as theories that provide us with progressively more precise approximations that allow us to make progressively more accurate kinds of predictions of the things that we see. And thinking about quantum field theory in terms of effective field theories, it means we don't take our theories necessarily too seriously as strict statements about what's going on in nature and that our theories serve us.
rather than us serving our theories. We can adjust the features of our theories to provide a way to describe different regimes. And, you know, the larger theory of effective field theory goes back to very important, you know, physicists people like Steve Weinberg and Howard Georgi and
And various people who played very important holes in the development of one there i'm leaving lots of people out of the effective field was about by a lot of people but nema was a very strong component of thinking in terms of effective field during that had a big impression on me when i took quantum field theory with nema i'd seen quantum field three before i took it again with nema because i figured i would learn a lot from him and i did.
um and his approach to quantum field theory was heavily based on thinking in terms of effective field theory and you know um in understanding the relationship between particles and fields through representation theory which was also really very revelatory for me another very important thing i learned from nema was that i really wanted to be a philosopher of science philosopher of physics rather than a theoretical physicist
Because some of the things that Nima said about the foundations of quantum mechanics I found very mysterious and some of the questions that he raised partly inspired my shift in thinking, which wasn't so much a shift as much as a return to the kinds of philosophical thinking I'd always really wanted to engage in. In a lot of ways, physics in my undergraduate years and in graduate school was an extremely enriching
worthwhile, exciting, mysterious, wonderful detour that gave me, I think, a lot of skills and tools to address the kinds of questions I was really most interested in at the intersection of philosophy and physics. And some of the conversations and things I learned from Nima inspired me to go in those directions. So I'm very appreciative of my getting to know him. And I think anyone who spends a lot of time with him, you just learn a lot from talking to him.
I mentioned he had a view on decoherence and he had some proof about how decoherence solves the measurement problem or an argument, but it didn't quite work out and you wrestled with it for days or weeks maybe. Yeah, so Nima taught a course early in my time in graduate school. I don't know if I should say this, but it was a...
The course was called Physics 283B, it was called Quantum Mechanics in Space Time. And so it was an upper level advanced graduate course. And everyone who went in to take the course was going to brace themselves. We're all bracing ourselves for what we expected to be very difficult homework assignments and exams.
And every week Nima would say, I'm working on your homework assignment, you know, it'll be ready soon and it's going to be difficult so just stay tuned. And he kept saying that every week, kind of like the Dread Pirate Roberts from The Princess Bride saying that, you know, to Wesley, you know, good working with you, I'm most likely to kill you in the morning. He said that every day for five years.
So and I think Nemo will appreciate the Princess Bride reference because he also like making Princess Bride references. He once accidentally drew a picture of someone with six fingers and said too much Princess Bride.
but so every week he would say he would get us a homework assignment and then the last day he said it's been great working with you and we all left him we never got a single homework or exam the whole course we all get A's it was the it was the best course I learned so much from the course it was mostly about quantum field theory and curved space-time which is a very intricate really interesting subject wait you didn't even have to do an exam? no nothing we all just got A's so I learned a lot and I got an A with no homework of any kind it was fantastic
But of course, while you were there in class, we were all working very hard to understand what was going on, so it was a very enriching class. But he began the class by talking about quantum foundations. And the motivation, and I think this is a very important motivation for people to think about it, and this continues today, is that he was trying to talk about quantum theory in the cosmological context. How quantum theory should be connected up with our best theories about the universe as a whole.
And when you're trying to understand the universe as a whole, you only have as far as we know, or at least we have access to one observable universe. There are no external observers as far as we know who can do measurements on the universe.
And so you begin to run into some rather important fundamental questions about quantum theory. And Hugh Everett talked about these questions in the published version of his dissertation in 1957. He specifically talked about cosmology and how difficult it was to talk about quantum theory in the context of cosmology when you don't seem to have external observers anymore. So these kinds of questions have been going on for many, many decades. And I first began to see some of these concerns in this class that Nima was teaching. And Nima argued in that first class
that there was a way to make sense of quantum theory in many real-world scenarios, maybe not necessarily in the full cosmological situation, but in many scenarios, by deriving everything from decoherence. The way he put it is, you need to posit the eigenvalue-eigenstate link, which just connects a thing called eigenvectors in the Hilbert space with numerical values called eigenvalues, the things that we should see in experiment when we measure things,
unitary evolution so the idea that a quantum state evolves according to a smooth linear kind of rule essentially the Schrodinger equation in the simplest cases and the probabilistic predictions of quantum theory the Born rule that results should occur with certain probabilities when we measure them and he claimed in that lecture that you could derive the second two things solely from the first thing as long as you
put the right kinds of measuring devices into the story and understood how decoherence worked. And some of this was inspired by a lecture that Sydney Coleman, who was a quantum field theory professor at Harvard, gave in 1994, which is on YouTube. It's called Quantum Mechanics in Your Face, and there's also a transcribed version on the archive. I've seen it. He's linked to both of those. Yeah, I'll place it on screen. That's right.
you
I should say that I've spoken to Nima since then, and he doesn't remember having said exactly those things. He said he doesn't have those views and doesn't remember having them at the time. My notes were very accurate, so I definitely took those notes. So it may be that he didn't tell the whole story. It may be that I misunderstood what he was saying. It may be that he briefly had one set of views and did another. I don't want to attribute anything to Nima on this count. But at the time, that's what I took from this lecture.
And i spent a long time trying to understand how you can get the second to postulates from the first one and ultimately i decided that you just couldn't do it and this isn't the first to have this problem in lots of people when they sat down to really try to understand the things fit together have found themselves in a similar circumstance.
So these kinds of thoughts inspired me, in part, to want to understand quantum foundations better. Now there were other things that happened while I was in undergrad and grad school that pushed me in this direction, but that was definitely one of the things that inspired me in that direction. So Sidney Coleman had a bravado and a confidence when he was giving his lecture. So is the statement from NEMA that he gave in the lesson the same as Sidney's?
I don't know if you recall Coleman's lecture, but if you did, what was the critique?
Well, Coleman's lecture was based on, I mean, I have the utmost respect for Sidney Coleman's work in quantum field theory, which was extraordinary. And some of the most important quantum field theory people who lived talked about Sidney Coleman being the person who taught them more about quantum field theory than anything. I mean, Steven Weinberg, for example, who passed away just a couple of years ago, Nobel Prize winning quantum field theorist who helped construct the standard model,
He was in Harvard and at an event to honor Sidney Coleman back in 2005, I'm pretty sure I remember Steven Weinberg saying that he learned more about quantum field theory from Sidney Coleman than anybody else. And anyone who knows Steven Weinberg's textbooks on quantum field theory will realize what an amazing statement that is. But Sidney Coleman's lecture on quantum mechanics was, it was
This is the season for all your holiday favorites, like a very Jonas Christmas movie and Home Alone on Disney+.
And Hulu has National Lampoon's Christmas Vacation. We're all in for a very big Christmas treat. All of these and more streaming this holiday season. And right now, save big with our special Black Friday offer. Bundle Disney Plus and Hulu for just $4.99 a month for one year. Savings compared to current regular monthly price. Ends 12-1. Offer for ad-supported Disney Plus Hulu bundle only. Then $12.99 a month or then current regular monthly price. 18-plus terms apply.
His view of quantum mechanics was just quantum mechanics even said it's quantum mechanics comma stupid as if anyone who thinks differently is stupid. The tone he takes in lecture is very dismissive toward philosophers now i don't know. I didn't know sydney colman personally i never got a chance to meet him i heard wonderful things about him.
so i can only go based on what's the lecture but that dismissive attitude toward philosophers as a physicist can do all of this themselves and philosophers don't have anything meaningful to contribute is not i think a good message to be sending to young people i don't think it fosters the kind of interdisciplinary dialogue that can be very fruitful for all of these disciplines
Um, and you know, he says clearly in the lecture that he attributes his views to the picture of quantum theory that comes from Hugh Everett. So he takes a point of view on quantum theory that is at least in some way inspired by Everett, although he doesn't specifically commit, I think, to a full many worlds picture and lecture, although my memory could be slightly mistaken. But he appeals to various arguments to get the probabilities out of quantum quantum theory that are no longer widely considered definitive.
So he has various arguments involving infinite lists of experiments, and in some notion of doing an experiment infinitely many times, you get exact results, but of course you can't really do infinite measurements. That's why a lot of these arguments have fallen out of favor.
He also makes some statements about, he uses the GHZ theorem, which is a somewhat more modern, non-probabilistic version of Bell's theorem that's related to non-locality, to make certain strong arguments about what's possible. I think he also does something that I think requires a little more attention. So, on the one hand, you can talk about probability theory.
On the other hand, you can talk about kinematics. Kinematics is the way that we mathematically represent the configurations of a system, the states of a system, the trajectories of a system, the way we describe how it is and what it looks like. And then there's the dynamics. Dynamics are the rules for how configurations or states change. Those are the dynamical rules, the rules that tell us how you go from initial states to later states and so forth. F equals MA is a dynamical rule. The Maxwell equations are dynamical rules.
Whereas the kinematics of Newtonian mechanics is the statement that there are bodies in space and we represent their locations using coordinate systems. That's kinematics. And of course, probability is probability. Now, there's a view that what quantum theory did was transform probability kinematics and dynamics. They're all different. They're all non-classical. They're all something totally new. To the point at which I think some people conflate all of these things and just say all of it is quantum.
And I think we'll go farther and say that if you think any of them is not quantum, you're saying that none of them are quantum. I think that's too strong of you. For example, in the indivisible stochastic approach, probability theory is ordinary probability theory. We're using good old-fashioned ordinary probability theory, which, in talking to statisticians, they seem to really like. The fear among, I think, some statisticians is that quantum theory doesn't use ordinary probability theory, and so it's not something amenable to some of the techniques that statisticians like to use.
In the indivisible approach, we're using ordinary probability theory. If you want to call it classical probability theory, it's classical ordinary probability theory. All the probabilities that show up are just of the usual kind. The kinematics, the configurations of things, are in some sense kind of classical. Systems just have arrangements, configurations.
Maybe in physical space, if you think physical space is the right way to think about things. If you're modeling a system of particles, this is arrangements of particles in physical space. If you're talking about fields, it's patterns of field intensities in space. These are the kinds of configurations that we would describe classically, for the most part.
What we're altering is the dynamics. The dynamics is no longer going to be a Markovian deterministic differential equation or set of differential equations. The dynamics will now take the form of these non-Markovian probabilistic kinds of laws. So that's what's new. The laws are now different. And I think in Cindy Coleman's lecture, he can place all these things. He says that if you think about any of these things in a non-quantum way,
Then you're just being too classical. You're just thinking everything is classical. And I think if you read the transcript or watch the lecture, you'll get that impression. So I guess my feeling is, with enormous respect, of course, to Sydney Coleman, I don't think that lecture answers the questions of what's going on in quantum foundations. And I think that for at least some time, I think it gave people the impression that these problems were all solved. They were all just a mistake.
of people working in philosophy. There's one point in the lecture when Coleman even looks very frustrated. He's like, I can't understand why all these people, they draw all these diagrams and they get so confused. I don't understand how they could be so confused about such a simple point. And it's kind of very condescending tone toward people who work in philosophy that I just don't think is helpful. I don't think any of us need that kind of attitude. We need to bring people together.
Did these disciplines work much better when we understand the work that we do and we bring our work together? You get a kind of cross-pollination that lays the seeds for future discovery. And I should say that from people I've spoken to who knew Sidney Coleman, he was not anti-philosophical. He was very interested in a lot of this stuff. So the best I can say is maybe that somehow didn't come across in this lecture. And for whatever reason, that was the case. But I think that that's worth noting.
Why did you leave string theory? I was drawn to these foundational questions at the intersection of philosophy and physics. I was just fascinated by the problems that happen trying to make sense of quantum theory. I was dissatisfied with the interpretations and formulations that were available. And I just, I got hooked.
You get hooked on something and you just want to probe it and understand and make sense of it. And I just found myself much more drawn to those kinds of questions. I'm particularly drawn to the kinds of questions that philosophers of physics will say is the kind of work that they do.
We tend to be interested in the mathematical and structural features of our best, most successful physical theories, some of which are fundamental or candidate fundamental theories, some of which are somewhat more prosaic theories that describe everyday physics. We want to know what it is that physicists or more generally scientists are doing when they do science. We want to think about what is the success of these theories tell us about the structure of what's going on in reality?
You can't do anything without some metaphysical posits at the very least that our experimental devices exist, right? I mean, there's some very basic metaphysical things that we assume to get things working.
That we can take evidence of the past and use it to say something about the future. There's no way to justify that. I mean, back to David Hume, you know, hundreds of years ago, who pointed out that any attempt to justify that by using past experience is a circular argument, because if you say that induction is successful, we should believe in induction because it's worked so well in the past, then you're using induction to support induction.
And there are a lot of people who have written about this. I know that you had John Norton on your podcast as well, and he's written a whole book on how to make sense of induction in his book, The Material Theory of Induction. So these are very difficult problems. You need something to get off the ground before you can begin to even do science. And philosophers of physics, philosophers of science are interested in those kinds of questions also. We're interested in what
our best physical theories have to say about traditional questions in philosophy and in metaphysics. That's what I call physical philosophy. And at least some of us are interested in taking the methods and tools that one develops in analytic philosophy and philosophy of science and applying them to make progress on outstanding questions in physics. That's what I call philosophical physics as opposed to theoretical physics or mathematical physics or experimental physics or applied physics or computational physics.
Trying to make sense of quantum theory, I view very much as a form of philosophical physics. We have a physical theory, quantum theory. There are places where it is either ambiguous or other attempts to make sense of it run into problems of empirical adequacy or one of the other problems that we've talked about earlier. This is a physics problem and it may be that the ideal set of tools to address it
are the kinds of tools that Einstein was using when he interrogated the meaning of inertial reference frames, an interrogation that led to enormous consequences. This whole development of relativity comes out of him trying to develop a more rigorous understanding of inertial reference frames. The tools being? Tools of rigorous scrutiny, careful argumentation from as clear definitions and as clear, clearly stated premises as we can formulate,
Looking for implicit assumptions that might not have been noticed, looking for connections, questioning standard assumptions, looking under rocks, metaphorically speaking, for interesting things that may be looking under them. Can you give an example of that, the looking under the rock? Sure, yeah. So, I mean, in a sense, that's what Einstein was doing when he was probing the meaning of an inertial reference frame. I think one could very well have had an attitude back in the early aughts
not the 2000 odds but the 1900 odds that physics was about the atomic theory and it was about electromagnetism and it was about thermodynamics and here Einstein wasn't trying to build new models of that kind he was asking about the scenery like inertial reference frames inertial reference frames that's background stuff that's scenery that's not the protagonist of physics but he
Uncovered that rock and out came relativity. So I mean that's I think a fantastic example of how looking under rocks can lead to new insights We also look for connections between theories connections that other people haven't noticed I mean this project came out of me trying to build a connection between the theory of stochastic processes and and quantum theory What kind of work is that? It's not the kind of work I think that we usually associate with theoretical physics where you're building models with any given paradigm or
mathematical physics where you're trying to take statements that physicists have made and prove them rigorously turn them into theorems or apply mathematics to physical problems or develop new areas of mathematics inspired by what's going on in physics you know it's not experimental physics it's its own kind of thing
Definitions premises building very very careful arguments uncovering hidden assumptions, you know looking under rocks building connections between things analyzing the Conceptual and mathematical structure of our best theories understanding their moving parts, you know spending time doing that is is really exciting and Sometimes this leads to surprises but scrutinizing I mean that's Scrutiny is
A particular methodology of doing things, right? We're not necessarily doing experiments. We're not just building models, which is, of course, you know, building models is a very important and very difficult and challenging thing to do and obviously central to how we formulate physics. But taking things we already have and really trying to pin down all the details, trying to make sure everything fits together, there are no gaps and no logical problems. Trying to pin all that down is just a different approach. It requires a different set of tools.
different inclinations. I mean, there are different people who like doing different things who have different talents, different tendencies, different inclinations. Some people like doing one kind of work. This is the kind of work I like doing. And arguably, it is born fruit for science. Last time we talked, we had a lovely discussion with Emily Adlam. And during that time, we listed
Many important contributions have been made to physics that have come from taking that philosophical lens and applying it to our best physical theories, from EPR and entanglements to decoherence to quantum advantage, Bell's theorem, the no cloning theorem, the no signaling theorem, and arguably later work that is connected with things like quantum teleportation and quantum cryptography and quantum information.
I think there's a real track record of this being incredibly useful to science and worthwhile for people to work on and also for people to fund. So I have a question about the interpretations of quantum mechanics. There's plenty of hubbub about interpretation of quantum mechanics, but if it's already understood that the greater theory, the more fundamental theory will be a theory of quantum gravity,
Furthermore, that the only or the most well-developed UV complete non-perturbative approach is string theory, then why isn't there more work done on the quote-unquote interpretations of string theory? Yeah, so I would recommend that people look up the work of Nick Huggett, for example, a philosopher of physics who's given a lot of attention to trying to understand the metaphysics and philosophical questions surrounding string theory. I did some work with some of my colleagues
Some preliminary work on string theory. We just had a lot of other things we were working on. We got pulled away from this. I think partly the reason there's been less philosophical work on string theory is because it's just newer than things like relativity and quantum mechanics. You know, relativity goes back over a hundred years. Quantum theory goes back over a hundred years. So there's been a lot more time for people to think about these theories. String theory is of much more recent vintage.
I think one issue is that string theory is still very speculative. We don't know that string theory is the confirmed best theory of quantum gravity. And I think that there's some reluctance to try to spend too much time trying to understand the metaphysical underpinnings of a theory that isn't substantially verified at this point. We don't have any real empirical confirmation of string theory at this point.
I said before that philosophers of physics like to understand the mathematical structure and features and implicit assumptions and everything for our best most successful physical theories and by this I mean theories that have proved the test of time that have been empirically verified because the work that we do for those theories we feel will stand the test of time whereas if you're working on it on trying to understand the philosophical underpinnings of a speculative theory that might not last
Well, then your work on that might also not last. Now, of course, one could take the view that philosophical work, foundational work on string theory may help move quantum gravity forward. And I think that maybe partly what inspires people to think about these questions, but I would recommend that you interview some of the people who work on the philosophy of string theory. I think Nick Huggett would be an excellent person for you to talk with.
I think you might get some insight and you could ask him what motivates him to work on this theory. I think the other main reason why fewer people in philosophy and foundations of physics work on string theory is that string theory is mathematically very complicated. I worked in string theory during graduate school and there are very beautiful features of string theory. I mean, you work on it and you see beautiful connections.
Changes how you think about quantum field theory in really profound ways. I learned a lot about quantum field theory from learning string theory. But it is a very mathematically intricate theory and I think that presents an obstacle for a larger fraction of people working in philosophy of physics to work on it. Now the people I know working in philosophy of physics are very mathematically sophisticated.
um, but there's an investment in time that one has to, has to, has to make in order to be able to work on, on, on string theory, a bigger investment in time, I think, than, than maybe the case for other theories people can work on. And so I think that's been a hindrance to more people working on it. But there are people who have decided to invest that time and they've worked on it. And, you know, it's interesting to know, you know, to think about what, what they've been able to see. I think one of the difficulties is that because string theory is in many ways still a very partial theory, it's not yet quite ripe enough
to be able to start making strong statements about the metaphysics. We have only a very sort of superficial understanding of exactly what the theory entails. And that makes it difficult to ask deep foundational questions about it at this stage of development. What did you learn about QFT from string theory that isn't string contingent? That isn't string contingent. That's a good question. I mean, we
So one thing I learned about about quantum field theories from string theory is how to think about gauge theories. I'm a little worried that if I get in the weeds here, this is going to become technical very quickly. The audience loves the technicality. Don't worry. OK, well, so in string theory, one models the kinds of particles that transmit forces using certain kinds of strings. We use open strings to model gauge theories and we use closed strings to model gravitons.
The actual force carriers correspond to particular quantized excitations of these strings. And one question you could ask is, well, if I have a particular quantized excited mode of a particular kind of a string, and this string is supposed to describe some kind of force carrier, well, I've got the particles.
How do I understand where the field comes from and the structure of the field? Why should these fields have certain features? Why should gauge fields exhibit gauge invariance? Why should the gravitational field exhibit diffeomorphism invariance and the equivalence principle? Why should it treat inertial and gravitational mass as being similar kinds of things in the first place?
You know, in string theory, because you're working in a so-called first quantized formalism most of the time, you're working with individual strings, which manifest as individual particles, rather than in the so-called second quantized formalism that's called string field theory, which is its own discipline, and there are people who work in string field theory. But a lot of the time, you're working in the first quantized string particles as sort of individual excitations of these strings. Understanding how you get all the intricate, rich structures that show up in quantum field theory from these strings
ports right over to thinking about the relationship between, not in string theory, the particles that correspond to fields and the fields that they're related with. So, for example, photons are associated with the electromagnetic field. The Higgs boson is associated with the Higgs field. The electron is associated with what's called the electron field, which is a fermionic field. It's a very interesting kind of thing. Quarks have their own fields.
Deutrino's have their fields. There's fields associated with all these particles. And understanding the relationship between a field and its corresponding particles is a little bit subtle. One way to think about it is the field is a sort of prior idea and that you can argue using some elementary quantum mechanics thinking of fields as connected systems of harmonic oscillators that quantum mechanics or harmonic oscillators can only be excited in quantized amounts. These fields can only be excited in quantized energetic amounts.
And each such quantized excitation, each quantized energetic excitation corresponds to one more quantum, one more particle of that field showing up. This is the sense in which, say, the Higgs boson is one quantized excitation of the underlying Higgs field. But you may also ask the opposite question. If I imagine starting with some statement about the properties of particles, let's suppose I've got a particle with certain features.
I've got a particle that's got this intrinsic inertial mass. It's got this intrinsic charge. It's got this intrinsic spinniness or spin or angular momentum. Can I predict what kind of field it will correspond to? And can I even, in some sense, model the field as some appropriately defined quantum state involving these particles, as some coherent state of these particles? And if I do that, what kind of field do I get? What features does the field have?
and what I took from string theory which I guess you could have learned just in quantum field theory but for me it took learning string theory to see this connection was that the properties of these particles again things like their mass and their charge and their spin and this sort of these are the features these particles can reveal to you the structure of the fields they correspond to interesting for example the fact that photons have zero intrinsic inertial mass
and have one unit h-bar of intrinsic spin and have no charge. That you can use to show that the field that emerges from photons is going to look something like the electromagnetic field, and in particular, the masslessness of the photon and its spin being one is connected with gauge invariance in this electromagnetic field.
So that's the sort of connection and again you could understand this connection without string theory if you pick up Steven Weinberg's books on quantum field theory he also explores this connection although in a way that when I first learned it from Steven Weinberg's book I didn't find as intuitively clear as I did from string theory.
that that would be an example right and you know string theory is generated a number of other spin-offs that people working in quantum gravity spent a lot of their time thinking about things like holography you know and you know to whatever extent that you think that those ideas are worthwhile they're certainly very interesting and arguably they stand on their own separately from string theory at least some of them
I should have been asking about the interpretations of quantum field theory as well. Who are some people I should be speaking to? Interpretations of quantum field theory. There's a number of people who work in an area who might be worth speaking to. Michael Miller, who's particularly convenient because he's at the University of Toronto. You might talk to- Right, we talked about him yesterday? We did, yes. You might talk to Doreen Fraser, who's at the University of Waterloo. So also not someone who's very far away.
You might
Primarily with algebraic quantum field theory. So they'd both be interesting people to talk to about how we think about quantum field theory. So I have a lot of people I would recommend. Okay. Now that I've accidentally inadvertently tease the audience about interpretations of QFT, why don't you outline some of them? Why don't you outline two of them? Right, right. So quantum field theories live within the umbrella of quantum theory. So you have the same kinds of axioms. You have quantum states.
In some sense, although depending on how you formulate a quantum field theory, you might prefer to work with what are called c star algebras. We've talked about that rather than Hilbert spaces, but but the similar conceptual basis for thinking about quantum states and some kind of evolution law and observables being represented by an algebra of an algebra means a collection of mathematical symbols that are the observables.
and you still have to use the Born rule to calculate things probabilistically, or at least compute measurement averages of things. So the basic rules still apply. Some people make a terminological distinction between quantum theory, which is the more general idea, and quantum mechanics, which is specifically about particles. Some people use the word quantum mechanics to mean all of quantum theory, so you have to be very careful what they mean. When I say quantum mechanics, I usually mean quantum theory applied to models of systems of particles,
I use quantum theory to refer to the more general framework of which quantum mechanics is an example and quantum field theory is an example and string theory is an example. These are all phrased within this larger formalism of quantum theory. So some of the foundational philosophical metaphysical interpretation questions
that one considers in quantum theory are still present in quantum field theory. Quantum field theory doesn't let you get around the measurement problem. Most of the time in quantum field theory you're practically speaking if you're doing quantum field theory for practical purposes.
for particle experiments you're mostly imagining some collection of particles coming in in the far past which for particles experiments is not really very far right and then you consider some other collection of particles in the far future again quote unquote for future
And you want to compute the, roughly speaking, the probability to go from one to the other. This is usually phrased in technical terms, in terms of what are called scattering cross-sections and decay rates. You take these probabilities, you convert them into the kinds of quantities you would actually measure in a particle oscillator, but they're still based on the Born rule. And you're still using the Born rule to calculate those probabilistic predictions. And usually you're doing only one measurement and you're calling it quits.
So you don't usually see the collapse anymore in the formalism. You don't collapse the quantum state and then take the collapse quantum state and do something else on it. So the measurement problem is a little more implicit in the formalism for the most part. We call by the way the array, the set of all of the
Scattering amplitudes the complex numbers that you you then compute scattering cross-sections into carries that if we call that that array of all of them That data set of all of them. We call that the s matrix And and so a lot of the time in quantum field theory you're trying to understand the s matrix and compute You know the entries in this s matrix or trying to study its analytic mathematical properties or whatever
So the standard problems are still there, even if maybe they're a little more suppressed, given the kinds of things we usually work with in quantum field theory. Students are often surprised when they do quantum field theory that they're not using the Schrodinger equation very much anymore. So a lot of those older problems, like I said, are just less manifest. But in addition to all those problems, there are new problems that show up. Quantum field theories are phrased in a manifestly special relativistic language.
And there are new kinds of problems that show up there. In particular, if you do want to think about doing multiple measurements on a quantum field theory, well then you can't have one measurement be in the infinite past and one measurement in the infinite future because if you want to do another measurement, you can't do something after the infinite future. You have to actually take seriously that things happen in finite amounts of time. And now you're talking about doing measurements ostensibly in some kind of space-time picture.
You're thinking about your measurements being events in some sense localized in space and in time in a relativistic context. And so now you have to be very careful that you don't get paradoxes and violations and
There's a whole set of papers where people are trying to make sure they understand how measurements work in this sense of quantum field theory. And so this is a whole collection of things that people might want to look at. After we talk, I can send you some references that you can put in the chat. But that's a source of real serious discussion. Another set of questions is there are different ways to formulate quantum field theories. I mentioned algebraic approaches.
things that I mentioned a couple people who work on algebraic approaches to quantum field theory. Then there's what some people call Lagrangian quantum field theory, which is also closely related to effective field theory. We talked about earlier thinking about our quantum field theories as progressive approximations where we're really just interested in computing S matrix elements for the most part. And understanding the connection between these different formulations of quantum field theory is an outstanding question.
At present, we don't have an algebraic quantum field.
An algebraic quantum field theory version of the kinds of quantum fields that we use in the standard model. The standard model is our most successful scientific theory. That's the standard model that has the quarks and leptons and gluons and photons and the Higgs boson that we think gives us our best, most quantitatively precise description of fundamental physics. That's phrased in the language of effective and Lagrangian field theory.
which is not for the most part mathematically rigorous and for which it's very difficult to answer some of these foundational questions I mentioned algebraic quantum field theory is much more mathematically rigorous and we have more resources mathematical theoretical resources to probe some of these foundational questions but because we don't know how to formulate the standard model in that rigorous algebraic language
This limits our ability to address some of these foundational questions for the kinds of realistic, interacting field theories that we work on. And so one area in the foundations of quantum field theory is to try to bring these two pictures together. Try to see to what extent we can understand how we use quantum field theory in practice, but in a somewhat more rigorous way that's more amenable to addressing foundational questions. One other question you can ask is
What is quantum field theory saying is actually real, real in the physical or metaphysical sense? We're talking about reality. Are we saying that fields are physical real things, that every point in space there's like a physical intensity or directional or more complicated entity that's really there, and that there are real patterns in these fields across space-time, or are we saying something else?
Prior to having some kind of realist approach to quantum theory, it would have been very difficult to even ask that kind of a question. But even once you think you have maybe a realist-oriented approach to quantum theory, like the kind I've advocated, or like, for example, Bohmians who are trying to do quantum field theory are trying to advocate, or Everettians or whatever, you then have this further question, what do I take to be the ontology? What should the real thing be? And so one set of debates was, should we think about quantum field theories more in terms of particles or more in terms of fields?
Some philosophers argued that thinking in terms of particles was untenable for a whole variety of reasons. Others have argued that thinking in terms of fields is also untenable. If you talk to practicing theoretical particle physicists, you'll hear a variety of answers in that question as well. You'll even hear from some top people working in quantum field theory that we don't even understand exactly what quantum field theory is in some fundamental sense. So that's just scratching the surface.
We could then go farther. What happens when you put quantum fields not on flat, special relativity type space-time, Kowski space-time? What happens when you put quantum field theories on a curved space-time? Even fixing, freezing gravity, not letting gravity be dynamical, freezing space-time is in particular shape. What happens to quantum field theory when the space-time is no longer flat?
What happens when you're accelerating in space-time and you have things like the unruh effect and you see the appearance of particles that show up? I can recommend to people who are interested in learning more about that particular problem and learning more about sea straw to break formulations of quantum field theory to read a Remarkable review puts part review paper and also part philosophy paper by Rob Clifton and Hans Halverson called our Rindler there's an N in there Rindler our Rindler quanta real and
um... and in addition to addressing that question which they do in the later parts of the paper the beginning of the paper is a really nice introduction to the cistern algebraic formulation of quantum theories generally which they use to study this problem and then you know within algebraic quantum field theory you run into all these deep questions about unitary and equivalence of different representations of quantum field theories
I mean, there's just so many interesting problems in the foundations of quantum field theory. And I know that people who work in the field are listening to this and are probably upset that I'm leaving something out. There are just too many things to mention. But I'm only leaving them out because of lack of time and because they're not occurring to me in real time. I mean, no disrespect at all, please. So I have a two-part question. Between measurements, are particles popping in and out of existence? Now, I know we've spoken about that on part one or part two, but I still want you to go over it.
Half of my question. My second half is in many of the approaches of quantum gravity, we sum over different space times. So between measurements is space time also fluctuating. Particle counts fluctuating and space time fluctuating between measurements. What does it even mean for space time to fluctuate?
So, in non-relativistic quantum theory, we're usually interested in systems of fixed numbers of finitely many non-relativistic particles, and in that case the particle number doesn't fluctuate.
And if you model this sort of thing in the indivisible stochastic approach, you get arrangements of particles. Those arrangements of particles are like snapshots. Those snapshots can look very different as time goes by. They're probabilistic. But you would have a conserved number of particles. In a relativistic context, the number of particles is not generally conserved.
Now, there are conservation laws you have to worry about. For example, electric charge is conserved, and that means that if you have charged particles, then if particles appear, antiparticles should appear so that the charge is conserved, or something like that. You have to be mindful of those conservation laws, but there's nothing in principle that stops particles from appearing or disappearing. Usually in the context of relativistic quantum theory, we're usually thinking about something like a quantum field theory. That's usually the most natural way to handle relativistic quantum theory.
There are first quantized approaches to relativistic quantum theory. That's another thing I picked up from string theory because we usually do a lot of string theory working with the first quantized formalism thinking in terms of specific numbers of strings. Although I should say that the number of strings can change because strings can break and attach. But we're thinking in terms of strings rather than fields made of strings. You can apply that relativistic first quantized formalism to particles and you can model
Particles with no intrinsic spin, you can model particles with various kinds of spin in a formalism that's very reminiscent of what one does in string theory but applied to just point particles. So that's another interesting thing. But usually when we're thinking about relativistic systems, it's often easier to use quantum field theory. And in quantum field theory, particles, as we've talked about, are kind of emergent entities.
You can excite the fields in different amounts, so when you excite them, you have different numbers of particles. And because the fields can be excited in different patterns and the excitation patterns can change with time, particle number in general is not conserved. So particles in that sense are emerging as fluctuations of the field as functions of time. So in the case of particles fluctuating in and out of existence, in some sense that's allowed in the relativistic case. Now in quantum gravity,
Here we're entering the realm of speculation. We don't have a fully realized theory of quantum gravity by any stretch. Arguably there has been some progress made in handling questions in quantum gravity by various techniques. One technique used to handle difficult problems in quantum gravity is functional integral techniques.
We use the path integral or partition functions, various things that capture quantum features of what we think is the right way to think about gravity, but not directly using the usual tools of Hilbert spaces and operators.
There are even some circumstances in which things that might be very harder or very difficult to see in a Hilbert space oriented approach become easier to calculate or see in a functional integral type approach, even to the extent that there may be some situations in which the functional integral approach takes you to places you can't get to from the Hilbert space approach, which may reveal some very important things about whether quantum gravity is really meant to be based on Hilbert spaces at all.
Personally, I'm suspicious that quantum gravity is ultimately going to be phrased in terms of Hilbert spaces for a whole variety of reasons, one of which is that Hilbert spaces seem to be really well adapted to the case where you have an external time parameter. There are ways to do quantum theory with Hilbert spaces without an external time parameter. The Page-Wooders formalism, which I'd rather not get into in detail here,
But it's a bit difficult to work with Hilbert spaces when you don't have an external time parameter and in general relativity you don't have an external time parameter. So there are a lot of reasons why you might be suspicious that Hilbert space is the right ingredients and so we use these sort of functional integral techniques to make certain kinds of predictions to calculate things to answer certain kinds of problems and in these functional integrals you can think of them as you take whole spacetimes
You assign whole space times a complex number and amplitude and then you sum these complex numbers associated with different space times and then you do various squaring of the answers to calculate things. The metaphysical status of these kinds of operations is very murky. I don't have an intuitive grasp of what it means.
to add together two spacetimes. Of course, I don't really have a grasp of what it means to add together two particle states. In the indivisible approach, we don't really have superpositions in a literal sense. Our use of superpositions in the Hilbert space mathematics is just a way to encode the indivisibility of what's going on in the process. The particle really is in just one place or the other. So arguably, if you wanted to think about quantum gravity in an indivisible stochastic sense,
You wouldn't really have true superpositions of different spacetimes. There might just be one spacetime or something that spacetime emerges from, some other kind of more fundamental substrate out of which spacetime emerges. And our use of sums of complex numbers over spacetime is no more telling us what's going on metaphysically than would be the case in the use of the path integral formulation of a quantum mechanical system of particles. But this is all very speculative.
I don't feel like I have enough of a grip on what's really going on in quantum gravity to be able to give anything like a concrete metaphysical picture of what I think is going on. I don't think we were just at that stage yet in development of quantum gravity. So what does it look like for an indivisible stochastic process to pop in and out of existence? How do you model creation and annihilation of particles in your approach? So one thing is
To take your configurations not to just be arrangements of a fine number of particles, but to broaden what you mean by your configurations. Now your configurations are not just arrangements, but also any number of particles in those arrangements. Configurations with no particles, configurations with one particle, configurations with two particles, but in all kinds of various arrangements. When you do this in the Hilbert space sense,
This is called the second quantized formalism. The Hilbert spaces you use are called Fox spaces. So one could model it that way. Another way to model it is not to treat particles as fundamental but to work with fields. And fields don't pop in and out of existence in the usual sense. The fields are just there and they can be activated in various patterns and some of those patterns we regard as emergent particles.
So rather than seeing particles coming in and out of existence, we replace particles with a more fundamental substrate that is not winking in and out of existence. Now, I should say there are some really interesting directions where people have considered third quantize theories or higher order quantize theories in which they imagine what if quantum fields can pop in and out of existence, more profound sense. People who are interested might want to
You're a master of physics, of philosophy, and of history. You may even be... I think you're assuming way too much about me, Kurt, but I appreciate the compliment.
You may even be a part of that history. So let's imagine 10, 20, 50 years from now, there's a history book, there's a chapter on Jacob in this history of physics book. What do you want it to say? That I was a really nice person to people I cared about and to people like everybody that I was that I tried to make the world a better place that
kindness was important to me that that I created spaces for the people I care about to feel safe and nurtured and and loved. I mean, that's the thing that immediately jumps out at me. I mean, what what more could anyone want to aspire to? I mean, of course, we all fall short of I fall short of that all the time. But that's my hope is that I get better at that. And and that's
I mean, I don't have history books talk about those kinds of things. I hope any book that talked about me would talk about that. In terms of contributions to scholarship, I would hope that the projects I'm working on end up panning out. Anything we work on could ultimately not succeed. I'm not claiming to have a theory of everything. My hope is to address what I think are some important problems at the heart of
deep and foundational questions in physics. I hope that my work ends up succeeding and that the history books say that they succeeded, or at the very least inspired people to go in new directions that they might not have gone in otherwise. You know, I hope that, well, I mean, I hope they talk about my amazing family. My family is amazing and I love them and I hope
I don't know. It's a hard question to answer. I don't know. Jacob, thank you for spending so much time with me. It's always a delight, Kurt. Every time I come to Toronto, I'll always come and we'll talk more. And you have to come visit me in Boston again. It's a deal. Take care, man. You're a real gem, you know that? I'm a gem. Talk about master. Like, you are a master of what you do.
Hi there, Kurt here. If you'd like more content from Theories of Everything and the very best listening experience,
Then be sure to check out my sub stack at curtjymungle.org. Some of the top perks are that every week you get brand new episodes ahead of time. You also get bonus written content exclusively for our members. That's C-U-R-T-J-A-I-M-U-N-G-A-L.org. You can also just search my name and the word sub stack on Google. Since I started that sub stack,
It's somehow already became number two in the science category. Now, Substack for those who are unfamiliar is like a newsletter, one that's beautifully formatted. There's zero spam. This is the best place to follow the content of this channel that isn't anywhere else. It's not on YouTube. It's not on Patreon.
It's exclusive to the Substack. It's free. There are ways for you to support me on Substack if you want, and you'll get special bonuses if you do. Several people ask me like, hey, Kurt, you've spoken to so many people in the field of theoretical physics, of philosophy, of consciousness. What are your thoughts, man? Well, while I remain impartial in interviews, this Substack is a way to peer into my present deliberations on these topics.
And it's the perfect way to support me directly, curtjaymungle.org or search curtjaymungle sub stack on Google. Oh, and I've received several messages, emails and comments from professors and researchers saying that they recommend theories of everything to their students. That's fantastic. If you're a professor or a lecturer or what have you, and there's a particular standout episode,
that students can benefit from or your friends, please do share. And of course, a huge thank you to our advertising sponsor, The Economist. Visit economist.com slash toe to get a massive discount on their annual subscription. I subscribe to The Economist and you'll love it as well.
Toe is actually the only podcast that they currently partner with. So it's a huge honor for me. And for you, you're getting an exclusive discount. That's economist.com slash toe. And finally,
You should know this podcast is on iTunes, it's on Spotify, it's on all the audio platforms. All you have to do is type in theories of everything and you'll find it. I know my last name is complicated, so maybe you don't want to type in Jymungle, but you can type in theories of everything and you'll find it.
Personally, I gain from rewatching lectures and podcasts. I also read in the comment that toll listeners also gain from replaying. So how about instead you relisten on one of those platforms like iTunes, Spotify, Google podcasts, whatever podcast catcher you use. I'm there with you. Thank you for listening.
▶ View Full JSON Data (Word-Level Timestamps)
{
"source": "transcribe.metaboat.io",
"workspace_id": "AXs1igz",
"job_seq": 2097,
"audio_duration_seconds": 7824.87,
"completed_at": "2025-11-30T21:21:32Z",
"segments": [
{
"end_time": 20.896,
"index": 0,
"start_time": 0.009,
"text": " The Economist covers math, physics, philosophy, and AI in a manner that shows how different countries perceive developments and how they impact markets. They recently published a piece on China's new neutrino detector. They cover extending life via mitochondrial transplants, creating an entirely new field of medicine. But it's also not just science they analyze."
},
{
"end_time": 36.067,
"index": 1,
"start_time": 20.896,
"text": " Culture, they analyze finance, economics, business, international affairs across every region. I'm particularly liking their new insider feature. It was just launched this month. It gives you, it gives me, a front row access to The Economist's internal editorial debates."
},
{
"end_time": 64.514,
"index": 2,
"start_time": 36.34,
"text": " Where senior editors argue through the news with world leaders and policy makers in twice weekly long format shows. Basically an extremely high quality podcast. Whether it's scientific innovation or shifting global politics, The Economist provides comprehensive coverage beyond headlines. As a total listener, you get a special discount. Head over to economist.com slash TOE to subscribe. That's economist.com slash TOE for your discount."
},
{
"end_time": 92.108,
"index": 3,
"start_time": 66.237,
"text": " Harvard's Jacob Arendes exposes the hidden assumption that has blinded us for nearly a century. One day while preparing to teach quantum mechanics, Jacob made a startling discovery. Quantum theory and classical probability are separated by a single unnoticed presumption, Markovianity."
},
{
"end_time": 106.561,
"index": 4,
"start_time": 92.329,
"text": " Drop it and the gap between them vanishes entirely. Even more startling, this mathematical accident bypasses the so-called local realism constraint of Bell's theorem and dissolves the measurement problem."
},
{
"end_time": 131.578,
"index": 5,
"start_time": 107.125,
"text": " All without magic. This discussion ranges from black holes that reign to the mathematical beauty of indivisible processes culminating in a meditation on legacy, kindness, and why the next revolution in physics demands philosophers and physicists working as one. Jacob, welcome back. It's always a pleasure to talk with you, Kurt."
},
{
"end_time": 159.036,
"index": 6,
"start_time": 132.278,
"text": " It's always a pleasure to have you, to host you. Thank you so much. Lovely being here in Toronto. It's a lovely city. And if you haven't been to Toronto, you should come visit. It's great. Is Toronto real here? How about that? Is Toronto non-locally real or locally real? Firstly, let's focus on this term real. Has the 2022 Nobel Prize disproved so-called local realism? If you read the press release,"
},
{
"end_time": 185.401,
"index": 7,
"start_time": 159.343,
"text": " from the 2022 Nobel Prize in Physics that was given to Aspeh, Clauser, and Zeilinger for their work testing experimentally violations of a generalized set of equalities that began with the Bell inequality and evolved into things like the CHSH inequality. If you read the press release for that Nobel Prize,"
},
{
"end_time": 214.377,
"index": 8,
"start_time": 186.288,
"text": " It says that what they accomplished was proving that there cannot be hidden variables. That's not strictly correct. It's certainly not what Bell argued. There is a somewhat narrower claim about what they demonstrated with their experimental work. And that was to show that local realism is false."
},
{
"end_time": 242.5,
"index": 9,
"start_time": 214.804,
"text": " So we have to talk about what local realism means. Local realism is the statement that objects localized in space have definite properties, have in some real sense, they possess some kind of definite way that they are that is independent of measurements and that somehow interact"
},
{
"end_time": 260.384,
"index": 10,
"start_time": 242.892,
"text": " With measuring devices to yield results, maybe the measuring devices passively reveal those pre-existing properties, maybe there's a more subtle interplay, but the objects have something like real definite properties localized where they are in space."
},
{
"end_time": 290.452,
"index": 11,
"start_time": 260.589,
"text": " Just to be specific, you said real definite properties. Can we just drop real from that? Can we just say that the particles have definite properties? Sure, sure. I was using real there more for emphasis. Real, definite, just to make very, yeah. The question about what do we mean something distinct by real from definite? I mean, you could try to parse those. I don't have a definition of what real means."
},
{
"end_time": 321.408,
"index": 12,
"start_time": 291.578,
"text": " in a metaphysical or physical sense that doesn't involve words that essentially mean the same thing as real. To say something is real is to say that it exists. But what does exist mean? To say that it is real, really there. I mean, it's, so this is again, one of those, you know, we've had conversations before about how some very primordial primitive notions can be very difficult to define rigorously in a way that isn't logically circular."
},
{
"end_time": 344.343,
"index": 13,
"start_time": 322.159,
"text": " So for these kinds of notions, and these include things like reality and existence, they include things like if you really try to pin it down exactly what we mean by probability, exactly what we mean by consciousness, you know, they're all of these very difficult questions in metaphysics."
},
{
"end_time": 373.814,
"index": 14,
"start_time": 344.787,
"text": " We think we're talking about something when we talk about them, but they are very difficult to define. Free will is another good example, very difficult things to define. So we'll have to take for granted for now, because we can't solve every problem in philosophy today, that we have some prior notion of what it means for things to be real, that they exist. So we assume, according to local realism, that objects localized in space in some sense have real"
},
{
"end_time": 399.343,
"index": 15,
"start_time": 374.104,
"text": " or definite or pre-existing properties or a way that they are, an ontology, a physical state of being that is separate from what we see when we measure those objects. There could be some subtle interplay between that state of being of the object and measurement, but it can't just be that"
},
{
"end_time": 419.138,
"index": 16,
"start_time": 399.582,
"text": " That they have no state of being except through some kind of measurement process according to local realism, if that's the view that one takes. I know Tim Maudlin quipped about people's obsession with saying that there's no realism, but yet they like locality. He would say, oh, it's not real, but thank God it's local."
},
{
"end_time": 446.681,
"index": 17,
"start_time": 419.804,
"text": " Right, yeah. And I think that the author Adam Becker, who wrote a book, What is Real, about the historical development of quantum theory, I think he also put it really neatly. He said, without realism, there's nothing to be local about. So the arguments that people have made is, and this term local realism, I should say that not everybody who works in"
},
{
"end_time": 475.657,
"index": 18,
"start_time": 447.278,
"text": " philosophy and foundations of physics, foundations of quantum mechanics, particularly likes that term local realism. But of course, one one view is maybe we can detach the two pieces and save locality, but give up realism. Or maybe we have to do is hang on to realism and give up locality. I have to say I'm sympathetic, strongly sympathetic to those who would say that without the realism part, there's nothing to be local about. I mean,"
},
{
"end_time": 506.8,
"index": 19,
"start_time": 477.705,
"text": " Presumably, in some sense, you and I exist. If I'm not going to be solipsistic, then if I accept that I exist, I'm going to want to accept that you also exist, that others exist. I appreciate that. Yes. Yes, you're very welcome. You're very welcome. It's your finest quality. Thank you. Thank you. And if science is to make any sense at all,"
},
{
"end_time": 535.555,
"index": 20,
"start_time": 508.37,
"text": " If even the textbook version of quantum theory doesn't make any sense at all, then measurement outcomes have to exist in some sense. If there are no measurement outcomes at all in any sense, according to anybody, measurement outcomes, we can talk about different interpretations of quantum theory and what it means to have measurement outcomes. Many people who are watching this will know that, you know, on the"
},
{
"end_time": 561.186,
"index": 21,
"start_time": 535.811,
"text": " The many worlds theory, there are many measurement outcomes. There are also relational or perspectival interpretations or theories for quantum theory in which measurement outcomes are relational or depend on one's perspective. But if there are no measurement outcomes of any kind in any sense, if those just don't exist, then it's a completely self undermining picture of reality. That is,"
},
{
"end_time": 591.425,
"index": 22,
"start_time": 563.968,
"text": " That sort of picture of reality undoes itself. It means that without measurement outcomes, we can't even talk about how we do science or how we gather empirical knowledge of the world. And without empirical knowledge of the world, there's no way to to account for what we see. There's no way to ground our physical theories. So I think some kind of realism about something is unavoidable if science"
},
{
"end_time": 616.664,
"index": 23,
"start_time": 591.954,
"text": " narrowly or our physical experience more broadly is to be coherent. And if you think that there is realism about people and realism about measuring devices or measurement outcomes at least, then you can ask the question of where the line is. Why only measurement outcomes? Is there something special about measurement outcomes? Is there something special about people?"
},
{
"end_time": 641.203,
"index": 24,
"start_time": 617.056,
"text": " What about our individual cells? Do our cells get to have realism also? The cells that make up our bodies? The, you know, sub components that make up our measuring devices? And if you want to claim that our macroscopic, macroscopic meaning that the big world, the world that people walk around in exists in some sense,"
},
{
"end_time": 671.954,
"index": 25,
"start_time": 642.978,
"text": " And you want to argue that this world is emergent in some way from some deeper level of reality, some deeper physical substrate, then it's very hard to avoid some commitment to the reality of that physical substrate. I mean, you can't have emergence without a substrate out of which the emergence is supposed to happen unless you can provide a rigorous argument for how we're supposed to do that. And I have not seen such a rigorous argument."
},
{
"end_time": 701.783,
"index": 26,
"start_time": 672.841,
"text": " So it seems hard to deny some kind of realism to something going on in nature even at a fairly low level. Exactly where we have to stop if we have to stop at all is an interesting question. So I just don't know how to make sense of the idea of giving up realism. I don't even know what that means. I don't think it's coherent. I think people sometimes will say it and then they'll move on without maybe following the consequences of giving up realism"
},
{
"end_time": 732.21,
"index": 27,
"start_time": 702.312,
"text": " to their logical conclusions. I think when you do that, you run into some pretty deep problems of self undermining. So the question is, does Bell's theorem rule out local realism to begin with? And this is where we can start to talk about some of the implicit assumptions, some explicit, some implicit assumptions that lead to Bell's results. You will sometimes see writings of prominent physicists, sometimes in the popular press, sometimes in articles"
},
{
"end_time": 757.807,
"index": 28,
"start_time": 732.517,
"text": " in scientific journals that are intended for people to see, in which they sometimes wax poetic about how quantum theory has transformed our view of reality, how pre 20th century physics was very different from the physics of the 20th century and beyond. And what we've learned from quantum theory is that nature is subtle and mysterious. I grant all those things, nature is subtle and mysterious."
},
{
"end_time": 787.108,
"index": 29,
"start_time": 758.507,
"text": " but that we have to give up things like realism, that what it's taught us is that we can't be realists about nature, that we have to view all of physics in a purely operational or instrumentalist sense. It's merely about the operations we can perform. Things are defined in terms of the operations we can do to measure them or interact with them or work with them, and that scientific theories are only instrumentalist in the sense that they're just models or mathematical vehicles for relating"
},
{
"end_time": 815.367,
"index": 30,
"start_time": 787.637,
"text": " preparations of measurement setups to the outcomes of measurements. I don't view this as some kind of progress of science. It's a particular philosophical metaphysical viewpoint toward what scientific theories are supposed to be like. And I object and reject the idea that this is somehow the lesson that modern physics, including quantum theory, has taught us. It's true that"
},
{
"end_time": 839.718,
"index": 31,
"start_time": 817.005,
"text": " on the assumption that quantum theory is a good, successful physical theory as abundant experimental evidence strongly suggests that our understanding our picture of reality does need to be modified compared with the physics prior to the beginning of the 20th century. But that just means"
},
{
"end_time": 863.968,
"index": 32,
"start_time": 839.923,
"text": " that there's work to be done, work to be done by philosophers and by physicists to try to understand that world rather than give up and embrace instrumentalism or operationalism. I think that instrumentalism and operationalism are perfectly fine practical approaches to making use of our physical theories. And until we find an acceptable picture of what's going on, I think"
},
{
"end_time": 885.35,
"index": 33,
"start_time": 864.804,
"text": " They're perfectly reasonable, temporary places to be, but I don't think they're the end goal. So how do we avoid speculation then if we're not going to ground ourselves with what's operational or measurable? So I have an aversion to speculation. This is something that we've talked about. I think that"
},
{
"end_time": 915.265,
"index": 34,
"start_time": 886.954,
"text": " The success of quantum theory, quantum theory is a very intricate theory. It's got a list of axioms, which we've talked about. It makes a huge number of very non-trivial predictions that have been confirmed to incredible accuracy in experiments over many decades. Oh, and I should qualify what I said as not just speculation, because speculation could just be idea generation, which is what one should do in a meeting or in a room with yourself ideating."
},
{
"end_time": 945.282,
"index": 35,
"start_time": 915.742,
"text": " I mean to say more wild generation of theories and then speculation, a top speculation, a top speculation. Yeah. So it's a great point. Yes. Idea generation is great, but what I don't typically like is wild speculation that doesn't eventually ground itself in some kind of rigorous scrutinizing. Fortunately, quantum theory is such a rich, intricate theory that it places a lot of constraints on the kinds of world pictures that you might try to write down."
},
{
"end_time": 974.701,
"index": 36,
"start_time": 945.742,
"text": " Now, of course, when you try to create any physical theory or try to put together any world picture of the theory, you're going to be guided by some extra empirical criteria as well. You don't want to multiply assumptions beyond what's necessary in some vague sense. That's Occam's razor. There's, you know, given the choice between different kinds of world pictures or physical theories or what have you. All else equal, you'll want to use pictures that"
},
{
"end_time": 1002.449,
"index": 37,
"start_time": 975.367,
"text": " are more perspicuous, clearer, simpler. There's a kind of elegance that we're often looking for. But above all, you want to meet certain criteria that I think are just deal breakers. One is your world picture has to be consistent with the empirical predictions of the physical theory. It's got to get the experimental predictions right. We call that empirical adequacy. That is"
},
{
"end_time": 1031.715,
"index": 38,
"start_time": 1002.841,
"text": " an absolute must for any world picture or interpretation or formulation that you're looking for. You want this interpretation or picture not to yield ambiguous statements about things that in principle may be in practice difficult, but in principle you could go out and look at. Ideally, you want to understand how things like our macroscopic everyday world, at least in schematic terms,"
},
{
"end_time": 1057.381,
"index": 39,
"start_time": 1032.944,
"text": " can be seen to arise from the world picture that you're proposing. So as a counterexample, the Copenhagen interpretation just takes for granted as a classical world. And going back, I mean, many people have said this more eloquently than I have, including Hugh Everett, who gave rise to the Many Worlds interpretation, all the way back to his doctoral work in 56 and 57,"
},
{
"end_time": 1083.319,
"index": 40,
"start_time": 1057.824,
"text": " He complained that the Copenhagen interpretation made it impossible to understand how you could, there's any way to understand how the classical world emerged from a deeper level of reality because it simply took the classical world for granted and I agree with that critique. So understanding at least in schematic terms how our macroscopic everyday reality is supposed to emerge from that world picture. And finally, you should avoid the need for a very long list."
},
{
"end_time": 1109.189,
"index": 41,
"start_time": 1083.814,
"text": " of epicyclical additional speculative metaphysical hypothesis and ad hoc assumptions that should have gone forever. I think these are deal breaking conditions and given the success and intricacy of quantum theory and its predictions and given those criteria, most things you would propose just don't work. They don't meet those criteria. And so you might worry as I spent a lot of time worrying"
},
{
"end_time": 1135.538,
"index": 42,
"start_time": 1109.94,
"text": " that maybe we don't have a case of under determination, that quantum theory under determines its possible realist interpretations, but that quantum theory over determines them, that there simply aren't any sensible, realist oriented formulations or interpretations, world pictures, things the world could be like, such that"
},
{
"end_time": 1151.63,
"index": 43,
"start_time": 1136.084,
"text": " The theory to describe and make predictions about the world is quantum theory. That was a concern that I had for a very long time. There are other interpretive approaches to quantum theory. We've talked about these and many people who are watching this probably have heard of these or know something about them."
},
{
"end_time": 1182.568,
"index": 44,
"start_time": 1152.841,
"text": " The Copenhagen interpretation we already mentioned,"
},
{
"end_time": 1199.531,
"index": 45,
"start_time": 1182.944,
"text": " There's the strict textbook, don't ask questions, shut up and calculate approach that just goes directly from Dirac and von Neumann's axioms. There's the de Broglie-Bohm pilot wave theory or Bohmian mechanics. There's the Everettian many worlds type picture and"
},
{
"end_time": 1227.398,
"index": 46,
"start_time": 1199.923,
"text": " Arguably there's more than just one some people who work on this would say there's only one but but People will formalize this story somewhat axiomatically differently. So arguably there's more than one such picture and there's more I mean, there's a whole There's this handsome guy who came up with Indivisible stochastic processes. I don't recall his name though Yeah, yeah. Yeah, I know that I know that guy. I think I do I think I know that guy and"
},
{
"end_time": 1251.613,
"index": 47,
"start_time": 1227.841,
"text": " What motivated me to work on, and we're talking about this indivisible stochastic approach, was I didn't think any of the previously existing approaches met those requirements. And we can go through and talk about why I don't think they meet those requirements."
},
{
"end_time": 1275.247,
"index": 48,
"start_time": 1252.073,
"text": " There's a sense in which the textbook approach and Copenhagen meet the empirical adequacy requirement by construction. They're just phrased, they're just constructed around, you know, the measurements, which they've just taken to be, you know, to be primitive axiomatic features of their descriptions. And so they're, of course, they're going to be empirically adequate, you know, for most everyday purposes. But"
},
{
"end_time": 1284.838,
"index": 49,
"start_time": 1276.118,
"text": " They do lead to some ambiguities and then we run into the ambiguity problem."
},
{
"end_time": 1312.602,
"index": 50,
"start_time": 1285.282,
"text": " is an example of where you run into some ambiguity. You have two observers, one inside of a sealed box, one outside of the box, and then there's this question, do both observers agree that the one in the box conducted a measurement and we should apply the measurement axioms, or did not conduct a measurement and should be modeled using the non-measurement axioms? And this is just an ambiguity that shows up in these circumstances. Now, when other physical theories break down, like general relativity breaks down at singularities,"
},
{
"end_time": 1339.462,
"index": 51,
"start_time": 1312.995,
"text": " Newtonian mechanics has places where it has singularities. Maybe we'll talk about some of those. Autromagnetism has singularities. We just accept that these physical theories are incomplete in some sense. They're effective descriptions. It's not the end of the world. It's interesting that there was so much resistance in the history of the development of quantum theory to accepting that quantum theory also can have some limitations according to the textbook or Copenhagen approaches, which are subtly different."
},
{
"end_time": 1350.179,
"index": 52,
"start_time": 1340.128,
"text": " Speaking about the Copenhagen interpretation, are there modern physicists who adopt that view? Just a moment. Don't go anywhere. Hey, I see you inching away."
},
{
"end_time": 1373.916,
"index": 53,
"start_time": 1350.674,
"text": " Don't be like the economy, instead read the economist. I thought all the economist was was something that CEOs read to stay up to date on world trends. And that's true, but that's not only true. What I found more than useful for myself personally is their coverage of math, physics, philosophy, and AI, especially how something is perceived by other countries and how it may impact markets."
},
{
"end_time": 1397.927,
"index": 54,
"start_time": 1373.916,
"text": " For instance the economist had an interview with some of the people behind deep seek the week deep seek was launched no one else had that another example is the economist has this fantastic article on the recent dark energy data which surpasses even scientific americans coverage in my opinion they also have the charts of everything like the chart version of this channel it's something which is a pleasure to scroll through and learn from."
},
{
"end_time": 1415.794,
"index": 55,
"start_time": 1397.927,
"text": " Links to all of these will be in the description of course. Now the economist commitment to rigorous journalism means that you get a clear picture of the world's most significant developments. I am personally interested in the more scientific ones like this one on extending life via mitochondrial transplants which creates actually a new field of medicine."
},
{
"end_time": 1440.094,
"index": 56,
"start_time": 1415.794,
"text": " Something that would make michael levin proud the economist also covers culture finance and economics business international affairs britain europe middle east africa china asia americas and of course the u.s.a. whether it's the latest in scientific innovation or the shifting landscape of global politics the condoms provide comprehensive coverage and it goes far beyond just headlines."
},
{
"end_time": 1464.787,
"index": 57,
"start_time": 1440.094,
"text": " Look, if you're passionate about expanding your knowledge and gaining a new understanding, a deeper one of the forces that shape our world, then I highly recommend subscribing to The Economist. I subscribe to them and it's an investment into my, into your intellectual growth. It's one that you won't regret. As a listener of this podcast, you'll get a special 20% off discount. Now you can enjoy The Economist and all it has to offer."
},
{
"end_time": 1488.251,
"index": 58,
"start_time": 1465.026,
"text": " Speaking about the Copenhagen interpretation, are there modern physicists who adopt that view?"
},
{
"end_time": 1504.838,
"index": 59,
"start_time": 1489.309,
"text": " I give a survey out to incoming graduate students and I ask them their views on quantum mechanics. Is the measurement problem a serious problem? What's their preferred interpretation? The last time I gave out this interview was for the students coming into the physics PhD program in 2024."
},
{
"end_time": 1533.968,
"index": 60,
"start_time": 1505.23,
"text": " I got all of them to answer it, and about half of them put either the orthodox or textbook approach or the Copenhagen approach, and then the other half picked various other approaches. A pretty big chunk regarded the measurement problem as either a major or minor ongoing problem, so it's very interesting to get a snapshot of graduate students. When it comes to practicing physicists, senior physicists, it depends on whom you ask. People have a lot of different views. In 2019, Harvard"
},
{
"end_time": 1561.101,
"index": 61,
"start_time": 1535.35,
"text": " hosted Anton Zeilinger, who is the Zeilinger who shared the Nobel Prize in 2022 with Alana Spey and John Clouser for his work testing and finding experimentally violations by quantum theory of certain inequalities that are related to the Bell inequality."
},
{
"end_time": 1589.804,
"index": 62,
"start_time": 1563.046,
"text": " Harvard has an annual Lee Historical Lecture when we invite a physicist who has been witness to many important and great events in the historical development of physics and who's contributed to them, talks about their life, their contributions, what they've seen, and their broader views at this point in their career. In 2019, Harvard invited Anton Zeilinger to be the historical lecturer."
},
{
"end_time": 1617.551,
"index": 63,
"start_time": 1590.452,
"text": " There this I believe was recorded and if there is a recording Kurt, I can send you a link to it and people can watch it and it's it's amazing disease. I linger talk about his work and his career. So that that would be a really interesting thing to share toward the end of that lecture. I'm talking like an hour and nine minutes in something like that. He talks about his own interpretational views about quantum theory."
},
{
"end_time": 1638.865,
"index": 64,
"start_time": 1618.336,
"text": " And he very explicitly embraces the Copenhagen interpretation. We have a classical reality. All statements about measurement preparations and results and measuring devices and people are all phrased in classical language. And the role of the quantum state is that it is a mathematical tool"
},
{
"end_time": 1666.169,
"index": 65,
"start_time": 1639.565,
"text": " for relating our classical measurement preparations, classical in the sense that the measurement preparations are prepared by classical measuring devices to study quantum things. The quantum state encodes and represents mathematically those classical devices that prepare our measurements and represents predictions about the results that show up on those classical devices. And the collapse of the quantum state"
},
{
"end_time": 1696.527,
"index": 66,
"start_time": 1666.664,
"text": " is not some physical process but is merely a change in representation because classical observers or classical devices are updating their information and that there's therefore no measurement problem at all. So these sorts of views exist. I'm not painting straw men when I talk about people adhering to the Copenhagen approach, including people who know a lot about quantum mechanics and have"
},
{
"end_time": 1715.538,
"index": 67,
"start_time": 1696.817,
"text": " You're done incredibly important work in their careers on quantum mechanics. I have the utmost respect for it for people, you know, like, certainly Anton's Islander. I mean, he's a Nobel Prize winner. And, you know, he's done absolutely central work in our understanding of quantum foundations. But this is a point at which very respectfully, I and many others disagree."
},
{
"end_time": 1741.988,
"index": 68,
"start_time": 1716.817,
"text": " Um, Bohmian mechanics has proved to be very difficult to generalize beyond systems of fixed numbers of finitely many non relativistic particles. There have been attempts to generalize them. There are amazing people thinking and working on these things. And we've talked about some, some of them, Shelley Goldstein, Ward Strava, um, and many others. I mean, I, I, I could list everybody, uh, over the years, Detlef Dürr, Nino Zanghi, Roddy Tomolka,"
},
{
"end_time": 1765.043,
"index": 69,
"start_time": 1741.988,
"text": " I want to leave anybody out but a lot of people have worked on these approaches and trying to generalize to the role of the fully relativistic case try to generalize to be able to accommodate quantum field theories in particular for me on a field theories interacting field theories the kinds of field theories that we see in the center model has proved to be very very difficult and if bohemian mechanics can't achieve"
},
{
"end_time": 1792.125,
"index": 70,
"start_time": 1765.64,
"text": " an ability to describe those real-world models that work so well. The standard model is the most well-tested physical theory that we've ever had. Then these Bohm-type theories simply don't achieve empirical adequacy. And this is something that David Wallace, who's a strong proponent of the Everett many-worlds approach, has argued in a paper and in a series of talks that are centered around why the sky is blue, Rayleigh scattering,"
},
{
"end_time": 1819.377,
"index": 71,
"start_time": 1792.398,
"text": " Rayleigh scattering is the reason why this guy is blue. This is a relativistic problem, and it's one that Bohmian mechanics seems to have a lot of difficulty handling. And his argument is if it can't handle a question like why this guy is blue, then this is a clear sign of empirical inadequacy. Now that could be fixed up. It's possible that people will develop Bohmian mechanics to a point at which we'll be able to accommodate modern realistic field theories."
},
{
"end_time": 1832.568,
"index": 72,
"start_time": 1819.735,
"text": " But until we reach that point, the theory doesn't achieve empirical adequacy. And my problems with the Everett approach are, you know, and people have a lot of views about this, a lot of work is still being done on this."
},
{
"end_time": 1862.79,
"index": 73,
"start_time": 1833.268,
"text": " but I'm just still not convinced that there's any way to get probability out of this deterministic picture. We have all these branches, and on the branches we have lots of copies of observers. Some are rational by some definition, some are irrational, but there's no connection between whether they're rational or irrational and what happens to them because in the many-worlds ontology everything happens. So we can't somehow argue that observers ought to be rational and ought in some subjective decision-theoretic way to assign probabilities according to any given rule."
},
{
"end_time": 1891.817,
"index": 74,
"start_time": 1863.166,
"text": " There have been a lot of arguments trying to get that off the ground, going back to the work by David Deutsch in 1999 and then David Wallace in his 2012 book. The proofs are very intricate. They get longer and longer. But I think you can't ultimately overcome this problem. And there's more work. I mean, Simon Saunders is trying to bring back branch counting using core screening and appeals to analogies with statistical mechanics. And there are other approaches also, but none of them appear to achieve the aim of getting probability to show up."
},
{
"end_time": 1919.565,
"index": 75,
"start_time": 1892.159,
"text": " um arguably all the arguments if you carefully look at them are circular or involve a very long list of speculative metaphysical hypothesis when you look at the fine print and if you can't get probabilities out then again you're not achieving the empirical adequacy requirements and i know there's some people who might say something like well you know can't we just impose a measure on all the branches just impose a probability measure and declare them to be probabilities the problem is that imposing a measure is something you would do in the axioms"
},
{
"end_time": 1946.493,
"index": 76,
"start_time": 1920.145,
"text": " You'd have to add an axiom, but in modern approaches to Everettian quantum theory, the branches to which you would presumably be imposing these probabilities are emergent. They're approximate. They're not fundamental in the axioms. And so, yes, they can arise. You can get branches. Axioms describing fundamental ingredients can produce contingent. Contingent means not necessary, you know, but things that could show up."
},
{
"end_time": 1971.937,
"index": 77,
"start_time": 1946.869,
"text": " tables, chairs, in this case branches, these can show up later on, but you can't assign properties from the axioms to emergent, contingent, derivable things. If I have a theory of chemistry, I can assign properties to my atoms. I cannot, after chairs emerge, axiomatically assign properties to chairs and declare chairs must all be yellow, for example."
},
{
"end_time": 2001.596,
"index": 78,
"start_time": 1972.261,
"text": " Right. And if you if the branches are supposed to be immersion things, then we cannot assign them a measure or probability, a probability measure after the fact. In our axioms, we have to somehow get the probabilities out without assuming probabilities at the beginning. And then there's just no deductive argument that's going to get you to the probabilities. Anyway, this is this is a long range debate that people have been having. People are arguing about this still, but I'm just not convinced we can ultimately get this to work. This problem of probability, I think, is really a fundamental obstruction. And then separately, the effort approach"
},
{
"end_time": 2025.043,
"index": 79,
"start_time": 2002.722,
"text": " to get these arguments off the ground in the first place entail lots of additional assumptions beyond the core assumptions that you just have a Hilbert space in the state vector. I mean even some very basic ones like it seems intuitive that when a branch has a zero in front of it because when you expand"
},
{
"end_time": 2045.128,
"index": 80,
"start_time": 2025.503,
"text": " The universal wave function or state vector as branches, they've got numbers in front of them. These are the numbers that you want to somehow argue should be squared to get probabilities. Prior to assigning that probabilistic understanding of those numbers, it seems intuitive that if any of them have a zero in front of them, then they don't exist."
},
{
"end_time": 2062.773,
"index": 81,
"start_time": 2045.759,
"text": " But even that's actually not totally obvious. Yeah, we talked about this. Yeah, we talked about this. Why would a zero in front of something? Yeah, there's a way to think about the evolving wave function as a system of classical harmonic oscillators just by changing a representation. This is work by Strochi and Heslot, Strochi in the 60s and Heslot in the 80s."
},
{
"end_time": 2090.981,
"index": 82,
"start_time": 2063.08,
"text": " And from that standpoint, having a zero in front is just like having an oscillator that's not oscillating, but that doesn't mean the oscillator doesn't exist. So there's a lot of these extra assumptions you have to carefully add. I don't know how to justify all of these assumptions. There are just too many of them. It's not that I have a problem with having any metaphysical assumptions. We need some metaphysics to get off, you know, to get out of bed every morning. But once you have that many, each one reduces the credence, the credibility, my belief in the success of the picture."
},
{
"end_time": 2119.872,
"index": 83,
"start_time": 2091.374,
"text": " So I actually think that the constraints we have from the empirical success of quantum theory and just this short list of deal-breaking conditions put so many constraints on candidate world pictures, interpretations, formulations, theories that are supposed to stand in and give us the world picture we need for quantum theory that almost anything that you guess is going to be wrong. You'll be able to show that it runs afoul of one of these conditions."
},
{
"end_time": 2144.48,
"index": 84,
"start_time": 2120.111,
"text": " So I actually think this is exactly the kind of circumstance in which we can make progress by maybe some initial speculating, but then carefully checking that things work together. And this is what led me to the work that I'm currently working on. I think that this approach, I'm working on this indivisible sarcastic approach meets those requirements. Now, I don't know for a fact this is the unique approach that will work. For me, this is just an existence proof of proof of principle."
},
{
"end_time": 2164.906,
"index": 85,
"start_time": 2144.872,
"text": " And maybe some of the ideas that went into this indivisible approach will inspire other approaches that will also do a better job of meeting those conditions. So I think progress actually can be made here. I think we are exactly the kind of situation in which we have the kinds of constraints on us that can lead to progress."
},
{
"end_time": 2190.435,
"index": 86,
"start_time": 2165.316,
"text": " If it turns out that this indivisible stochastic approach is not unique, well, then we're back to having an under-determination problem. But under-determination of scientific theories or interpretations given data, I guess under-determination of theory given data and under-determination of interpretation given theory, these are old problems. These are problems that go back to the beginning of science. And if we can just revert back to those problems, I would still feel that we've made some progress."
},
{
"end_time": 2215.998,
"index": 87,
"start_time": 2191.459,
"text": " So when we first spoke, we talked extensively about indivisible stochastic processes, and I will place a link on screen and in the description of part one, part two, part three with Jacob. And in the first part, if I recall correctly, you described a cliff, two cliffs, and it was as if they had merged and there was no longer a gap between them. Can you tell me about that moment when you were developing indivisible stochastic the framework?"
},
{
"end_time": 2245.486,
"index": 88,
"start_time": 2217.108,
"text": " What that looked like? What time of day was it? Where were you? What did you feel? What were you thinking? Well, I was sitting at my desk and I was typing on my computer and I was I was trying to so I was I needed to teach a class and we talked a little bit about this to students who I was not assuming had any prior exposure to quantum theory, but also complex numbers, linear algebra. I wasn't assuming they'd seen any of these ingredients."
},
{
"end_time": 2275.247,
"index": 89,
"start_time": 2245.776,
"text": " But they had seen some probability. And so I felt like I could talk about the theory of stochastic processes. So let me give a little bit of historical background that I don't think we've talked about before. Please. So when I was in college, I spent a summer at Fermilab, which is an experimental physics laboratory in the United States in Illinois. I learned a couple of important things from this experience."
},
{
"end_time": 2305.538,
"index": 90,
"start_time": 2276.596,
"text": " one was had a drive on highways because there were a lot of highways like we would pull out of where we were sleeping, you know, the place the rental places where we were we were all staying, you'd pull right out onto a four lane highway. Okay, so it was a real chance to get a lot of driving experience. That was one thing I learned. Another thing was the sky is really huge in Illinois, like, you know, as someone who spent a lot of my time growing up in New York City, and then in"
},
{
"end_time": 2332.858,
"index": 91,
"start_time": 2305.862,
"text": " The suburbs of New York City, lots of trees. You don't see a lot of the sky all the time. Where we were staying in Illinois, the sky was enormous. That was a really extraordinary thing. I also learned that I was not destined to be an experimental particle physicist. So that was an important thing to learn. Wasn't particularly good with my hands. Ultimately, I think I never managed to use a soldering iron."
},
{
"end_time": 2358.217,
"index": 92,
"start_time": 2333.968,
"text": " um but you know i would go to meetings and we talk about getting the experiments you know what was the latest going with experiments and i just it it it just wasn't what i felt most interested in i had enormous respect for people who did that work it was incredibly interesting and what they were able to make matter and energy do was extraordinary it just didn't have the right i just have the right connection to it i found myself thinking a lot more about theoretical and philosophical questions"
},
{
"end_time": 2388.507,
"index": 93,
"start_time": 2358.575,
"text": " So I learned that also and the other thing was I decided to learn linear algebra. I wanted to get ahead and so I found a curriculum that was being taught at my college curriculum and I saw the book they were using, I found some homework exercises and I had a summer and I was away at Fermilab so I decided to spend the evenings learning linear algebra. When I finished doing all the homeworks, I went to a professor"
},
{
"end_time": 2409.565,
"index": 94,
"start_time": 2388.66,
"text": " Dave Bayer, really nice guy, really amazing guy, mathematician. And I told him I had done all this work and I was wondering if he would grade it for me, if I could get some kind of letter grade. I figured after all this work, maybe I can get a letter grade and put it on my transcript. He said, okay, but only if I did a final exam, a take-home exam. I said, okay."
},
{
"end_time": 2437.671,
"index": 95,
"start_time": 2410.026,
"text": " So he gave me a take-home exam and I did the exam and I did okay. I did okay on the exam. But when he sent it back to me, I was a little bit disappointed in my final grade and I felt a little bad because I put so much work into the course. And so I asked him, you know, okay, so I got this final grade. That's fine. You know, but I'm wondering, is there anything I can do to boost the grade? Could I do like an extra project or something like that? He says, actually, yeah, you can do an extra project if you want maybe to boost your grade. This project is on stochastic processes."
},
{
"end_time": 2467.039,
"index": 96,
"start_time": 2438.865,
"text": " I had never heard of stochastic processes before. Back in high school, I had played around with probabilistic simulations for various things, but I'd never done anything like a formal study of probabilistic theories. So this was my first opportunity to see this, and I think what's interesting about this is if I had done better on this exam, I never would have had this encounter, right? So, you know, this is, I think, a general lesson. Sometimes you have an experience and you feel like it's bad news,"
},
{
"end_time": 2483.063,
"index": 97,
"start_time": 2467.363,
"text": " And it turns out actually might be really good news. Here I'm quoting Kurt Vonnegut. And those of you who don't know, Kurt Vonnegut has this famous lecture he used to give on good news and bad news. And we never know what the good news or bad news is at the time. Sometimes we only find out the answer much later. And he's got a lecture on YouTube people can go watch. It's very interesting lecture."
},
{
"end_time": 2512.739,
"index": 98,
"start_time": 2483.968,
"text": " This episode is brought to you by State Farm. Listening to this podcast? Smart move. Being financially savvy? Smart move. Another smart move? Having State Farm help you create a competitive price when you choose to bundle home and auto. Bundling. Just another way to save with a personal price plan. Like a good neighbor, State Farm is there. Prices are based on rating plans that vary by state. Coverage options are selected by the customer. Availability, amount of discounts and savings, and eligibility vary by state."
},
{
"end_time": 2530.913,
"index": 99,
"start_time": 2513.592,
"text": " so the time i thought it was very bad news that i hadn't done so well this exam in the end it gave me an opportunity to learn the rudiments of the subject and this is an old story i mean max born tells a story in his autobiographical memoir about when heisenberg was visiting from munich to gertigen"
},
{
"end_time": 2558.66,
"index": 100,
"start_time": 2531.442,
"text": " with Max Born and Heisenberg eventually defended his doctoral dissertation and he was asked a question that he couldn't answer. This is Born retelling the story. It's in my life recollections of Nobel laureate which is Max Born's autobiographical memoir and he tells the story about how Heisenberg could not get this one question. It was proposed to him by Wilhelm Wien who was an experimental physicist and Wien was quite upset that Heisenberg couldn't get the answer and wanted to fail him"
},
{
"end_time": 2587.056,
"index": 101,
"start_time": 2559.872,
"text": " And his other two committee members said that they couldn't fail him. He was the best theorist they'd ever seen. And so they agreed to give him the lowest passing grade. And Heisenberg was just mortified. He felt so depressed after he got this. He barely passed his final exam for his doctoral work. And he went and he sort of sulked for a long time. But then he thought about this question that Wilhelm Wien had asked him. And it turned out the question was closely related to the uncertainty principle."
},
{
"end_time": 2611.578,
"index": 102,
"start_time": 2587.551,
"text": " And so all this time he spent worrying about this question he couldn't answer may have helped inspire him to come up with the principle that is the most famous thing attached to the Heisenberg principle. So again, you never know whether something you think is a failure is ultimately going to end up being the thing that is important for your career. So I learned about stochastic matrices in a very rudimentary way. I considered some very simple stochastic systems that I was given to do for this final project."
},
{
"end_time": 2636.613,
"index": 103,
"start_time": 2611.834,
"text": " I learned about their connection, you know, long time behavior of stochastic processes and how this is related to their eigenvalues. But these were all very new terms to me because I had only just learned linear algebra that summer. Fast forward a number of years to the end of my doctoral dissertation in which I'm writing simulations, numerical simulations to handle systems of these intricate systems of black holes that show up in certain low energy solutions to quantum gravity."
},
{
"end_time": 2655.606,
"index": 104,
"start_time": 2637.602,
"text": " How many years at this point is there in between?"
},
{
"end_time": 2686.101,
"index": 105,
"start_time": 2659.65,
"text": " eight years, nine years, something like that. I have to be more precise. I don't know exactly when I started doing the numerical simulation, so it's a little hard to say. So how much of it did you recall? Is it just a semblance, like the gist of it, or are you recalling precise formulas? I remember the gist of it, but I had scanned. I had photocopied all my notes. And so I went looking for my old notes for this project that I did. And so I had an opportunity to"
},
{
"end_time": 2715.589,
"index": 106,
"start_time": 2687.193,
"text": " to see it again. Interesting. But now this is so many years later. It's after I had done an undergraduate degree in physics and math. It's after I had studied a lot of theoretical physics and philosophy. It's the end of graduate school. I mean, I was coming at it from a completely different vantage point. And it looked very rudimentary to me now, given, you know, all the work that I had done in the years since. But I was so fascinated by this. Because going back to that time, I mean, I saw these stochastic matrices, this sort of theory of stochastic processes,"
},
{
"end_time": 2737.807,
"index": 107,
"start_time": 2715.981,
"text": " Before I had learned quantum mechanics, before I really knew anything concrete about quantum mechanics and seeing it again, after all these years of having thought about having taught quantum mechanics to students as a teaching assistant, you know, having taken so many more quantum mechanics courses, having used quantum mechanics so much in all my other work, I was struck"
},
{
"end_time": 2765.128,
"index": 108,
"start_time": 2738.217,
"text": " by some of the formal similarities between the theory of stochastic processes and quantum theory. These are both theories that involve probabilities. They're both theories that involve processes in which the outcomes are indeterministic and are described using some kind of probability. They're both theories in which we encode those probabilities in vectors, in vector spaces. Stochastic processes, it's probability vectors. Quantum theory, it's"
},
{
"end_time": 2788.49,
"index": 109,
"start_time": 2765.418,
"text": " State vectors or wave functions or somewhat more generally density matrices. Time evolution is given by square matrices for a stochastic process. They're stochastic matrices. These are matrices whose entries are non-negative in the column sum to one. If we think about multiplication as being multiplication with the matrixes on the left and the probability vectors on the right. And in quantum theory,"
},
{
"end_time": 2811.51,
"index": 110,
"start_time": 2788.746,
"text": " It's unitary matrices, unitary operators that carry out the evolution. For the theory of stochastic processes, some of the things we might want to ask about are random variables, functions on a sample space. The random variables are the things we could observe. They're the observables. And in quantum theory, observables are represented by operators or matrices, self-adjoint operators or matrices. We call them observables also. So there are all these formal resemblances."
},
{
"end_time": 2835.145,
"index": 111,
"start_time": 2811.92,
"text": " And so now fast forward to me trying to prepare for this class, trying to teach to students who, like me, didn't know linear algebra at the time, didn't know very much about complex numbers, didn't know about quantum theory, but knew something about probability. And I thought, well, maybe I can adjust the formalism of the classical theory of stochastic processes."
},
{
"end_time": 2864.258,
"index": 112,
"start_time": 2835.879,
"text": " And maybe I can adjust the formalism of quantum theory to make them look a little more similar. Maybe I can figure out some kind of mapping between them or change how I write them to make them look more similar. And the goal was very clear. My goal was to bring the two theories as close together as possible and then be able to tell the students, OK, students, here's what you need to jump the gap. And by bringing the two theories close together, the hope was that I could make that gap"
},
{
"end_time": 2892.824,
"index": 113,
"start_time": 2864.974,
"text": " a little bit less mysterious, a little bit less arcane, a little bit less extravagant. Maybe I could boil it down to some relatively simple, transparent change. Maybe a generalization, maybe dropping an assumption, maybe modifying an assumption. Something simpler than just listing all the Dirac, Feynman axioms out of the blue like we often do. And the surprising thing was that the gap disappeared."
},
{
"end_time": 2920.845,
"index": 114,
"start_time": 2893.251,
"text": " And suddenly I had one mathematical formalism for both the theory of stochastic processes and for quantum theory. And I was very confused how this had happened. It took me a little while to realize that I had implicitly given up the Markov assumption. The assumption that for the stochastic process, what comes next according to the process is determined solely by the system's present state or configuration. That's the Markov assumption."
},
{
"end_time": 2950.657,
"index": 115,
"start_time": 2921.067,
"text": " I had allowed the probabilistic development of the system to depend on past details, details that were not mediated solely by what was going on at the present. And once I realized I dropped this, immediately what I did was check the literature and see, surely someone else has tried to model quantum theory using a non-Markovian stochastic process of some kind. And the answer was there was almost nothing in literature about this. Previous efforts to replace quantum theory with something like a stochastic theory"
},
{
"end_time": 2973.422,
"index": 116,
"start_time": 2950.879,
"text": " Which go back to the work of Fritz Bopp in the 1940s, who, by the way, is mentioned in Hugh Everett's correspondences, his 1957 letter to Bryce DeWitt, his extended unpublished dissertation from 1956. He talks about Bopp's stochastic theory, says actually he thinks it's a fine theory if it can be fully developed. His objection is not."
},
{
"end_time": 3004.087,
"index": 117,
"start_time": 2974.172,
"text": " to indeterminism. He doesn't prefer determinism over indeterminism. Everett says he just wants a theory that does one thing and not the direct line of an axioms, which seem to be deterministic in some situations and indeterministic in others. He's very clear about this, and I recommend, and you can put a link to his full 137 page unpublished dissertation. It's available online. People can read about this. The link will be on screen. So this will be interesting for people to look at. But then work by Imre Fenyes in the 50s and Edward Nelson in the 60s through the 80s. But they had assumed that the dynamics should be Markov."
},
{
"end_time": 3034.428,
"index": 118,
"start_time": 3004.462,
"text": " This Markov assumption was an ingrained assumption that many people had. Now, at least as far back as 2011, here I'm pointing to some work by Shelly Goldstein, Tosk, Norsen and Zanghi. They have an article in Scholarpedia on Bell's theorem, which you can also link to. They note that Bell implicitly assumed Markovianity in deriving his theorem."
},
{
"end_time": 3064.616,
"index": 119,
"start_time": 3034.94,
"text": " There's a much more recent draft article by Tim Maudlin called The Great Rift in Physics, Relativity and Quantum Theory, in which he also highlights this Markovian assumption that's implicitly made in Bell's Theorem. This is especially clear in the 1990 formulation of Bell's Theorem, La Nouvelle Cuisine's name in that paper, you can look at that as well."
},
{
"end_time": 3083.933,
"index": 120,
"start_time": 3065.196,
"text": " relies crucially on situating his so-called screening local beables in a space-time region of finite thickness. It has to be finite thickness so it doesn't intrude on the on the light cone of the other thing. And if you have a non-Markovian set of laws, you can jump over those regions."
},
{
"end_time": 3111.22,
"index": 121,
"start_time": 3084.394,
"text": " through the laws, but in a manner that stays within the light cones, respects light cone structure, so provides a way around some of Bell's conclusions while respecting the so-called relativistic causal structure of space-time. But what I think was lacking was a concrete realization of this loophole. Loophole may not be quite the right word because"
},
{
"end_time": 3140.23,
"index": 122,
"start_time": 3111.834,
"text": " You know, Bell has premises. Some of them were explicit, some of them were implicit. Those premises lead to Bell's theorem. Here, we're denying one of the premises. That's not quite a loophole as much as showing the theorem is doing its job, right? The theorem says with these premises, you get this result, and I'm denying one of those premises. So that doesn't mean the theorem is broken. In fact, it's showing the theorem is doing its job as a no-go theorem, highlighting what the premises are, although arguably by not making this Markov assumption explicit, there was a loophole. You could argue that's a loophole in some sense."
},
{
"end_time": 3167.5,
"index": 123,
"start_time": 3140.725,
"text": " But what we lacked was a concrete realization of a comprehensive formulation of quantum theory that was built on non-Markovian laws and I had inadvertently stumbled into such a theory. The particular kind of non-Markovianity involved is called indivisibility. That term was introduced and we've talked about this before in the quantum information literature as far back as 2006 and then specifically in the context of"
},
{
"end_time": 3196.886,
"index": 124,
"start_time": 3167.961,
"text": " Classical looking stochastic processes in a review article in 2020 is the pre print 2021 is when it was published by Simon Mills and Kevin Modi. Right. It's recent. Very, very, very recent. Right. We're talking just a year and a half or so before I had independently arrived at this. Also to be technical, is it being non Markovian or is it just not being Markovian? Right. So this is a subtle distinction. An indivisible stochastic process is one in which"
},
{
"end_time": 3226.937,
"index": 125,
"start_time": 3197.381,
"text": " the laws"
},
{
"end_time": 3253.268,
"index": 126,
"start_time": 3227.398,
"text": " the laws. That is, there's a failure of the laws to divide in time. Now, that's a form of non-Markovianity. It's a particular form of non-Markovianity and it's a particularly unstructured form of non-Markovianity. So what this means is that you can fill in the story if you want with a detailed set of probabilities for all the possible trajectories that could be taking place behind the scenes."
},
{
"end_time": 3283.012,
"index": 127,
"start_time": 3253.968,
"text": " The laws of the individual process don't appear to fix just one choice of such non-Markovian description. My colleague Alex Meehan, who's a professor of philosophy at University of Wisconsin-Madison, who may be also someone you might talk to, very interesting philosopher of physics, super great, big fan, he suggested that we use the term realizer for a given non-Markovian process, a specific"
},
{
"end_time": 3303.558,
"index": 128,
"start_time": 3283.626,
"text": " realization a specific process that assigns probabilities to lots of intervening events. And an indivisible process is not one such realizer. It's an equivalence class. It represents a whole collection of different realizers different specific non Markovian processes that all agree"
},
{
"end_time": 3333.473,
"index": 129,
"start_time": 3303.899,
"text": " on the rudimentary laws that define the indivisible process. So the indivisible process identifies a couple of basic laws that fail to divide and doesn't fix all of these additional things that you might want to impose. And all those additional things, if you impose them, give you a specific realization or realizer. Sorry, what's a realization? Right. So let me be, this was sort of an overview, but let me now be a little more precise. So one thing you could ask about such a process is, well, okay, behind the scenes,"
},
{
"end_time": 3351.374,
"index": 130,
"start_time": 3334.087,
"text": " Behind the scenes, if I imagine this process is truly unfolding and I run an indivisible process, let's say 10,000 times, can't I, if I imagine being able to see behind the scenes, can't I just count up all the trajectories that do this and do that?"
},
{
"end_time": 3382.039,
"index": 131,
"start_time": 3352.056,
"text": " And then just by adding them up and dividing by the total number of trajectories, start assigning fractions, probabilities in some frequent sense to lots of statements that are not specified by the limited laws I gave you. Well, the answer is you could. You can do that. What you'll find is that there's not a unique such choice of frequency ratios to write down. The laws of the indivisible process are very rudimentary. They tell you how to predict"
},
{
"end_time": 3402.892,
"index": 132,
"start_time": 3382.534,
"text": " What the probabilities will be starting at certain conditioning times to later times. The later times are adjustable. There's no assumption that time is fundamentally discrete here, but that's kind of all the laws give you. They don't give you detailed information about the probabilities to assign to the detailed trajectories that are going on behind the scenes. If you impose"
},
{
"end_time": 3429.48,
"index": 133,
"start_time": 3403.387,
"text": " What all those probabilities should be, all those extra probabilities behind the scenes, all of them, completely specify them, which is an infinite amount of information and very unwieldy and not practical. But if you could somehow imagine imposing all of them and fixing absolutely every probabilistic detail, you would have one realizer. But nothing fixes that particular set of choices. You could have assigned different frequencies, different probabilities to all those those behind the scenes details."
},
{
"end_time": 3442.978,
"index": 134,
"start_time": 3429.718,
"text": " give a different set of probabilistic statements for all those things consistent with the same indivisible laws that we started with and that would be another realizer and you can argue that there may be many many many realizers"
},
{
"end_time": 3463.695,
"index": 135,
"start_time": 3443.404,
"text": " But because all the empirical predictions of the theory come out of the rudimentary indivisible laws, all these extra details do not appear to have any empirical content. And an indivisible theory simply doesn't specify what they are. It leaves them undetermined. And so an indivisible process represents a whole class of possible realizers."
},
{
"end_time": 3493.575,
"index": 136,
"start_time": 3463.933,
"text": " So the difference between an indivisible process and a non-Markovian process is that a non-Markovian process is one such realization where you've assigned probabilities to every possible statement, every trajectory, every detail. An indivisible process is less sharply defined. You define some features and those features are sharply defined. But what's not empirically significant is left unfixed. So an indivisible process in a way represents a whole class of non-Markovian processes."
},
{
"end_time": 3513.865,
"index": 137,
"start_time": 3493.933,
"text": " And the nice thing about this is, from the point of view of someone who isn't even thinking about quantum theory maybe, maybe you're a statistician, maybe you're a statistical modeler, you might have thought, well, I'd like to model non-Markovian systems. I'd like to model systems in which the more you know about the past, the more you can say about the future."
},
{
"end_time": 3543.916,
"index": 138,
"start_time": 3514.377,
"text": " But if your system is arbitrarily non-Markovian, if there's no bound on how much previous information will determine what happens in the future, you might think that you'd need to specify an infinite amount of lawful information, an infinite amount of information about the laws of your model in order to make any predictions at all. It might seem that fully non-Markovian processes are just too impractical to use. These invisible processes give you a way to handle that problem."
},
{
"end_time": 3572.244,
"index": 139,
"start_time": 3544.189,
"text": " with a limited set of laws, you can make predictions with these models, you can make empirical predictions with these models, even though the models are inherently non-Markovian, you don't have to specify an infinite amount of information. You might have worried if I only specify a small amount of information with the laws, will this theory be able to make any empirical predictions at all? And the answer is well, as I've shown, it's equivalent to quantum theory,"
},
{
"end_time": 3601.391,
"index": 140,
"start_time": 3573.387,
"text": " And quantum theory certainly makes a lot of empirical predictions. So you might have thought what you had to do was make a Markov approximation. Just take all that past information, truncate it somewhere at some order, or truncate it all the way down to just the present state. We know when we do that we're making approximations, but maybe we thought that's all we can do because otherwise the problem is too intractable. An indivisible process gives you another way to make non-Markovian processes tractable without making all those approximations."
},
{
"end_time": 3630.486,
"index": 141,
"start_time": 3603.148,
"text": " The cliffs, let's speak about cliffs, the cliffs between being a theoretical physicist or quantum physicist and being in finance, it's actually not that large. And you know, many people, I'm sure, have made that jump. And have gone both directions too, yes. Okay. Now, given that you have a new mathematical tool, indivisible stochastic processes that are a subset of non-Markovian that doesn't require infinite amount of information, and"
},
{
"end_time": 3660.06,
"index": 142,
"start_time": 3630.964,
"text": " Markovian and non-Markovian processes are useful in finance. Do you imagine that your indivisible stochastic approach not only will aid quantum theory, quantum foundations potentially, but finance? Yeah, I mean, I came at this out of an interest in trying to make sense of the fundamental nature of the physical world and make sense of quantum theory. To answer this question, can we find a world picture that"
},
{
"end_time": 3684.206,
"index": 143,
"start_time": 3660.299,
"text": " underlies quantum theory. But I would argue that good foundational work in science and in philosophy can and should have practical implications for other fields. On the one hand, having this indivisible picture might give us finally a world picture underlying quantum theory."
},
{
"end_time": 3714.121,
"index": 144,
"start_time": 3684.684,
"text": " But you can read this correspondence in the other direction. Right. If you have some thorny system in which you have to worry about memory effects or other forms of non-Markovianity and didn't know what to do and don't want to make various kinds of approximations, this might give you a new set of tools for studying those kinds of processes, whether you're working in finance or you're working in biostatistics or you're working in neuroscience or you're working in machine learning. I mean, indivisible processes are new."
},
{
"end_time": 3743.268,
"index": 145,
"start_time": 3714.616,
"text": " They only entered the research literature in the way that I'm describing them for what we would normally call something like a classical looking stochastic process in 2020, 2021. And that paper didn't really explore what you could do with them. Ford Blue Cruise hands-free highway driving takes the work out of being behind the wheel, allowing you to relax and reconnect while also staying in control."
},
{
"end_time": 3761.51,
"index": 146,
"start_time": 3744.411,
"text": " Enjoy the drive in Blue Cruise enabled vehicles like the F-150, Explorer and Mustang Mach-E. Available feature on equipped vehicles. Terms apply. Does not replace safe driving. See Ford.com slash Blue Cruise for more details."
},
{
"end_time": 3791.596,
"index": 147,
"start_time": 3762.005,
"text": " Now we have this tool and the question is, what can we use it for? And I think that's a really exciting thing to have a brand new tool. It's like having a blank page that we can write on, right? I mean, it's five years old. So attention is all you need. It was 2017. Chad GPT came out five years later. Who knows what's going to happen this year? Who knows what's going to happen going forward? That's right. But, you know, I would be very excited to see these methods find use in other areas."
},
{
"end_time": 3801.715,
"index": 148,
"start_time": 3792.142,
"text": " uh... finance biostatistics neuroscience you name it i mean all these areas i think yet we don't know where where where these where these things could be useful i'm excited to see where they could be"
},
{
"end_time": 3823.063,
"index": 149,
"start_time": 3802.176,
"text": " Hi everyone, hope you're enjoying today's episode. If you're hungry for deeper dives into physics, AI, consciousness, philosophy, along with my personal reflections, you'll find it all on my sub stack. Subscribers get first access to new episodes, new posts as well, behind the scenes insights, and the chance to be a part of a thriving community of like-minded pilgrimers."
},
{
"end_time": 3851.954,
"index": 150,
"start_time": 3823.063,
"text": " By joining you'll directly be supporting my work and helping keep these conversations at the cutting edge. So click the link on screen here, hit subscribe and let's keep pushing the boundaries of knowledge together. Thank you and enjoy the show. Just so you know, if you're listening, it's C-U-R-T-J-A-I-M-U-N-G-A-L dot org, KurtGymongle dot org. Okay, so this came from you tearing apart your curriculum and thinking, how can I attack this course in a new manner to make it"
},
{
"end_time": 3878.131,
"index": 151,
"start_time": 3852.841,
"text": " More elementary for people to understand for first year graduate students, or maybe this was undergrad. This was first year undergraduate students who were taking this class. OK, I want to speak about first year graduate students. So what's an example of something that's been that you've consistently found is difficult for first year graduates to understand, but you found some clever analogy or some interesting Hello World example that makes it finally click for them?"
},
{
"end_time": 3910.862,
"index": 152,
"start_time": 3883.814,
"text": " So I've taught a number of courses aimed at first-year graduate students in physics. I taught Jackson's classical electrodynamics for six years and I've taught graduate level general relativity for over a decade. So there are a lot of examples of things, I mean there's many I could list, where just through"
},
{
"end_time": 3935.828,
"index": 153,
"start_time": 3911.271,
"text": " Experience repetition teaching over and over again hearing people's questions and and Having lots of opportunities to refine my approach. I think I found some things that that are helpful to talk about I think one example I like is talking about black holes So I teach general relativity and we get to black holes I set aside half of a full class where I don't do any lecturing and"
},
{
"end_time": 3964.821,
"index": 154,
"start_time": 3936.357,
"text": " I just stand in front and ask students to ask me all their questions about black holes. Like an opportunity to talk about the physics of black holes, the metaphysics of black holes, whatever they want to ask. Because black holes are incredible. They're mysterious, they're exotic. For a lot of young people, hearing about black holes is the kind of thing that triggers their interest in science, maybe even in physics. And so to finally be in the class where we've mathematically formulated what black holes are,"
},
{
"end_time": 3992.756,
"index": 155,
"start_time": 3965.213,
"text": " We have the tools now at our disposal to start answering technical detailed questions about black holes is a really exciting moment. And I don't want to run through it too quickly. I want to give students the opportunity to dwell and really ask questions about it. And so I don't know that I have exactly like a trick that I do, except the trick being this sort of methodology, this methodology of just opening up space during during a period of time during class to just talk about things, to field all their questions, no matter how silly they may seem."
},
{
"end_time": 4012.602,
"index": 156,
"start_time": 3993.592,
"text": " Tell me about some of the most common questions. Well, so one question students often have is, if there's so much time dilation near the edge of a black hole, how does anything actually fall into a black hole? I mean, you draw these space-time diagrams that show the trajectories of infalling objects"
},
{
"end_time": 4040.333,
"index": 157,
"start_time": 4013.217,
"text": " spaces in one direction, time in another direction, and you draw these pictures and it kind of looks like the trajectories never quite reach the event horizon, the black hole, they never quite fall in. And this is really mysterious to a lot of students. And so it's an opportunity for us to talk about coordinate transformations, coordinate representations in general relativity. How will we derive the solution for the simplest kinds of black holes or some more complicated ones? We're using coordinate systems that are particularly good for"
},
{
"end_time": 4062.278,
"index": 158,
"start_time": 4040.657,
"text": " Solving the basic equations of general relativity, the Einstein field equation, in order to write down the correct formula for the shape of space-time. But it may not be the best coordinate system to understand the experience of observers moving around in space-time. As we talk about how you can change coordinate systems, there's no canonical preferred default coordinate choice in general relativity."
},
{
"end_time": 4088.797,
"index": 159,
"start_time": 4062.807,
"text": " You can change your coordinate systems. And it turns out the kinds of coordinate systems that we often use when we first start talking about black holes are not the best kinds of coordinate systems to understand what the experience is of probes or observers who fall into black holes. There are better coordinate systems. And even if you want to say, well, I want a coordinate system that for which the clicking, the ticking of a wristwatch"
},
{
"end_time": 4114.701,
"index": 160,
"start_time": 4089.104,
"text": " you know, has its sensible meaning for observers very far away. So suppose you have an observer very far away who drops in a probe to fall into the black hole. And you can ask, what kinds of coordinate systems can I write down that far away from the black hole tick in time at the same rate as the far away observer's wristwatch? You'll find there's not a unique coordinate system you can write down."
},
{
"end_time": 4144.343,
"index": 161,
"start_time": 4115.452,
"text": " The coordinate systems we will sometimes write down when we're first trying to solve the answer field equation do have the property that for observers far away, the notion of time for that coordinate system coincides with the ticking of the wristwatch. But these coordinate systems can be very badly behaved near the edge of the black hole. There are other coordinate systems you can write down that are just as legitimate that likewise agree with the ticking of the wristwatch outside far away from the black hole, but that allow us to see what happens to things that fall into the black hole."
},
{
"end_time": 4173.029,
"index": 162,
"start_time": 4144.906,
"text": " An example is Gholstrand-Ponlew coordinates. But there are other coordinate systems you can write down. People can learn about this. Gholstrand-Ponlew coordinates have a beautiful name. They're called global rain coordinates because they're based on free-falling trajectories like raindrops falling down the black hole. I think the image of a black hole floating in the silence of empty space with raindrops quietly falling on it is such a beautiful poetic image."
},
{
"end_time": 4202.176,
"index": 163,
"start_time": 4173.422,
"text": " But, you know, so there are so showing students that there are other coordinate systems you can write down and that you shouldn't take any one particular coordinate system to be completely serious as the only way to understand what's going on in a picture of space time. That's the kind of thing that I find can be very elucidating to students who are confused about what goes on with black holes. So that would be an example of something I would point to as something that can be very illuminating for students who are seeing this for the first time. What's the difference between being coordinate independent and being generally covariant? Well,"
},
{
"end_time": 4231.357,
"index": 164,
"start_time": 4202.739,
"text": " The general and general relativity refers to, well, when Einstein introduced that term, my understanding, and this is now an historical question, so this needs to be fact-checked, but my understanding was that Einstein was in part motivated by desire to understand how to incorporate gravity into special relativity, but was also in part trying to understand how to be able to handle relativity in much more general coordinate systems than the"
},
{
"end_time": 4257.892,
"index": 165,
"start_time": 4231.92,
"text": " the Cartesian-Minkowski coordinate systems that one uses in special relativity, these rigid straight-line rectilinear coordinate systems. He wanted to be able to talk about the kinds of coordinate systems that might be adapted to observers that were in various kinds of acceleration or freefall, or just be able to talk about the theory with a more general set of coordinate representations. Here, these coordinate systems are being put on four-dimensional spacetime."
},
{
"end_time": 4286.544,
"index": 166,
"start_time": 4257.892,
"text": " so space points in three different orthogonal directions you have to use your imagination and imagine the fourth dimension for time and space time can be curvy in some intrinsic sense that doesn't require the existence of an extra dimension for the curvature to happen and we want to describe all of the points the events the things that can happen at certain points in space and at certain times we want to be able to describe them numerically and so we put down a coordinate system like graph paper but you could imagine different kinds of"
},
{
"end_time": 4308.319,
"index": 167,
"start_time": 4286.732,
"text": " coordinate system different different kinds of graph paper and if you want to be very general about this you want to be able to handle general coordinate systems that's the general in general activity general activity is able to handle arbitrary coordinate systems general coordinate systems and then you want the basic rules of the theory to maintain the same"
},
{
"end_time": 4325.589,
"index": 168,
"start_time": 4308.695,
"text": " Meaning to have a sensible consistent meaning as we imagine transforming between coordinate systems, we want them to be covariant. The word is covariant for having a certain kind of consistency as we go between coordinate systems. Not invariant. We're not saying that things look exactly the same in every coordinate system."
},
{
"end_time": 4352.688,
"index": 169,
"start_time": 4325.589,
"text": " Covariant is a bit of a weaker statement. It just means that there's a certain kind of technical formal meaning of the ingredients of the theory, the laws of the theory, the mathematical objects we use to represent things in the theory. We want them to maintain their integrity in some sensible way as we imagine changing coordinate systems. And general relativity has this feature that the theory retains its structural form as we imagine changing coordinate systems in a very general way. And so general covariance is"
},
{
"end_time": 4364.77,
"index": 170,
"start_time": 4353.814,
"text": " is related to our ability to change coordinate systems, but it's a statement of the rules or laws of general relativity that when we do change the general coordinate systems, they maintain a certain kind of conceptual integrity."
},
{
"end_time": 4385.52,
"index": 171,
"start_time": 4366.63,
"text": " Your PhD supervisor was Neema, Neema Arkani Hamed, correct? I worked with Neema Arkani Hamed for the first few years of my PhD and then Neema took a job at the Institute for Advanced Studies at Princeton and I transitioned from working on particle phenomenology, which was primarily what Neema worked on,"
},
{
"end_time": 4412.278,
"index": 172,
"start_time": 4385.52,
"text": " I want to know what something you learned from nema that stuck with you to this day. I think anyone who talks to nema for five minutes learns a lot of things. So there's a number of things I learned from nema one is"
},
{
"end_time": 4435.811,
"index": 173,
"start_time": 4412.739,
"text": " I learned a lot about tennis. We played tennis, which was great. He was a little better than me. So he always ultimately won every match we played, which was very frustrating. I mean, I learned effective field theory from Nima. So effective field theory is a particular paradigm for how we think about quantum field theory is not as necessarily fundamental exact descriptions of nature."
},
{
"end_time": 4457.841,
"index": 174,
"start_time": 4436.152,
"text": " but as theories that provide us with progressively more precise approximations that allow us to make progressively more accurate kinds of predictions of the things that we see. And thinking about quantum field theory in terms of effective field theories, it means we don't take our theories necessarily too seriously as strict statements about what's going on in nature and that our theories serve us."
},
{
"end_time": 4473.712,
"index": 175,
"start_time": 4458.353,
"text": " rather than us serving our theories. We can adjust the features of our theories to provide a way to describe different regimes. And, you know, the larger theory of effective field theory goes back to very important, you know, physicists people like Steve Weinberg and Howard Georgi and"
},
{
"end_time": 4494.275,
"index": 176,
"start_time": 4473.712,
"text": " And various people who played very important holes in the development of one there i'm leaving lots of people out of the effective field was about by a lot of people but nema was a very strong component of thinking in terms of effective field during that had a big impression on me when i took quantum field theory with nema i'd seen quantum field three before i took it again with nema because i figured i would learn a lot from him and i did."
},
{
"end_time": 4518.746,
"index": 177,
"start_time": 4494.599,
"text": " um and his approach to quantum field theory was heavily based on thinking in terms of effective field theory and you know um in understanding the relationship between particles and fields through representation theory which was also really very revelatory for me another very important thing i learned from nema was that i really wanted to be a philosopher of science philosopher of physics rather than a theoretical physicist"
},
{
"end_time": 4546.374,
"index": 178,
"start_time": 4519.087,
"text": " Because some of the things that Nima said about the foundations of quantum mechanics I found very mysterious and some of the questions that he raised partly inspired my shift in thinking, which wasn't so much a shift as much as a return to the kinds of philosophical thinking I'd always really wanted to engage in. In a lot of ways, physics in my undergraduate years and in graduate school was an extremely enriching"
},
{
"end_time": 4575.998,
"index": 179,
"start_time": 4547.415,
"text": " worthwhile, exciting, mysterious, wonderful detour that gave me, I think, a lot of skills and tools to address the kinds of questions I was really most interested in at the intersection of philosophy and physics. And some of the conversations and things I learned from Nima inspired me to go in those directions. So I'm very appreciative of my getting to know him. And I think anyone who spends a lot of time with him, you just learn a lot from talking to him."
},
{
"end_time": 4596.391,
"index": 180,
"start_time": 4576.664,
"text": " I mentioned he had a view on decoherence and he had some proof about how decoherence solves the measurement problem or an argument, but it didn't quite work out and you wrestled with it for days or weeks maybe. Yeah, so Nima taught a course early in my time in graduate school. I don't know if I should say this, but it was a..."
},
{
"end_time": 4613.524,
"index": 181,
"start_time": 4596.783,
"text": " The course was called Physics 283B, it was called Quantum Mechanics in Space Time. And so it was an upper level advanced graduate course. And everyone who went in to take the course was going to brace themselves. We're all bracing ourselves for what we expected to be very difficult homework assignments and exams."
},
{
"end_time": 4634.497,
"index": 182,
"start_time": 4613.78,
"text": " And every week Nima would say, I'm working on your homework assignment, you know, it'll be ready soon and it's going to be difficult so just stay tuned. And he kept saying that every week, kind of like the Dread Pirate Roberts from The Princess Bride saying that, you know, to Wesley, you know, good working with you, I'm most likely to kill you in the morning. He said that every day for five years."
},
{
"end_time": 4645.026,
"index": 183,
"start_time": 4634.77,
"text": " So and I think Nemo will appreciate the Princess Bride reference because he also like making Princess Bride references. He once accidentally drew a picture of someone with six fingers and said too much Princess Bride."
},
{
"end_time": 4670.367,
"index": 184,
"start_time": 4646.34,
"text": " but so every week he would say he would get us a homework assignment and then the last day he said it's been great working with you and we all left him we never got a single homework or exam the whole course we all get A's it was the it was the best course I learned so much from the course it was mostly about quantum field theory and curved space-time which is a very intricate really interesting subject wait you didn't even have to do an exam? no nothing we all just got A's so I learned a lot and I got an A with no homework of any kind it was fantastic"
},
{
"end_time": 4698.831,
"index": 185,
"start_time": 4670.606,
"text": " But of course, while you were there in class, we were all working very hard to understand what was going on, so it was a very enriching class. But he began the class by talking about quantum foundations. And the motivation, and I think this is a very important motivation for people to think about it, and this continues today, is that he was trying to talk about quantum theory in the cosmological context. How quantum theory should be connected up with our best theories about the universe as a whole."
},
{
"end_time": 4710.077,
"index": 186,
"start_time": 4699.36,
"text": " And when you're trying to understand the universe as a whole, you only have as far as we know, or at least we have access to one observable universe. There are no external observers as far as we know who can do measurements on the universe."
},
{
"end_time": 4740.162,
"index": 187,
"start_time": 4710.486,
"text": " And so you begin to run into some rather important fundamental questions about quantum theory. And Hugh Everett talked about these questions in the published version of his dissertation in 1957. He specifically talked about cosmology and how difficult it was to talk about quantum theory in the context of cosmology when you don't seem to have external observers anymore. So these kinds of questions have been going on for many, many decades. And I first began to see some of these concerns in this class that Nima was teaching. And Nima argued in that first class"
},
{
"end_time": 4770.862,
"index": 188,
"start_time": 4741.476,
"text": " that there was a way to make sense of quantum theory in many real-world scenarios, maybe not necessarily in the full cosmological situation, but in many scenarios, by deriving everything from decoherence. The way he put it is, you need to posit the eigenvalue-eigenstate link, which just connects a thing called eigenvectors in the Hilbert space with numerical values called eigenvalues, the things that we should see in experiment when we measure things,"
},
{
"end_time": 4796.22,
"index": 189,
"start_time": 4771.271,
"text": " unitary evolution so the idea that a quantum state evolves according to a smooth linear kind of rule essentially the Schrodinger equation in the simplest cases and the probabilistic predictions of quantum theory the Born rule that results should occur with certain probabilities when we measure them and he claimed in that lecture that you could derive the second two things solely from the first thing as long as you"
},
{
"end_time": 4819.343,
"index": 190,
"start_time": 4796.8,
"text": " put the right kinds of measuring devices into the story and understood how decoherence worked. And some of this was inspired by a lecture that Sydney Coleman, who was a quantum field theory professor at Harvard, gave in 1994, which is on YouTube. It's called Quantum Mechanics in Your Face, and there's also a transcribed version on the archive. I've seen it. He's linked to both of those. Yeah, I'll place it on screen. That's right."
},
{
"end_time": 4833.507,
"index": 191,
"start_time": 4819.923,
"text": " you"
},
{
"end_time": 4860.452,
"index": 192,
"start_time": 4834.428,
"text": " I should say that I've spoken to Nima since then, and he doesn't remember having said exactly those things. He said he doesn't have those views and doesn't remember having them at the time. My notes were very accurate, so I definitely took those notes. So it may be that he didn't tell the whole story. It may be that I misunderstood what he was saying. It may be that he briefly had one set of views and did another. I don't want to attribute anything to Nima on this count. But at the time, that's what I took from this lecture."
},
{
"end_time": 4878.046,
"index": 193,
"start_time": 4860.452,
"text": " And i spent a long time trying to understand how you can get the second to postulates from the first one and ultimately i decided that you just couldn't do it and this isn't the first to have this problem in lots of people when they sat down to really try to understand the things fit together have found themselves in a similar circumstance."
},
{
"end_time": 4900.435,
"index": 194,
"start_time": 4878.37,
"text": " So these kinds of thoughts inspired me, in part, to want to understand quantum foundations better. Now there were other things that happened while I was in undergrad and grad school that pushed me in this direction, but that was definitely one of the things that inspired me in that direction. So Sidney Coleman had a bravado and a confidence when he was giving his lecture. So is the statement from NEMA that he gave in the lesson the same as Sidney's?"
},
{
"end_time": 4921.374,
"index": 195,
"start_time": 4900.964,
"text": " I don't know if you recall Coleman's lecture, but if you did, what was the critique?"
},
{
"end_time": 4950.845,
"index": 196,
"start_time": 4922.381,
"text": " Well, Coleman's lecture was based on, I mean, I have the utmost respect for Sidney Coleman's work in quantum field theory, which was extraordinary. And some of the most important quantum field theory people who lived talked about Sidney Coleman being the person who taught them more about quantum field theory than anything. I mean, Steven Weinberg, for example, who passed away just a couple of years ago, Nobel Prize winning quantum field theorist who helped construct the standard model,"
},
{
"end_time": 4977.432,
"index": 197,
"start_time": 4951.425,
"text": " He was in Harvard and at an event to honor Sidney Coleman back in 2005, I'm pretty sure I remember Steven Weinberg saying that he learned more about quantum field theory from Sidney Coleman than anybody else. And anyone who knows Steven Weinberg's textbooks on quantum field theory will realize what an amazing statement that is. But Sidney Coleman's lecture on quantum mechanics was, it was"
},
{
"end_time": 4994.565,
"index": 198,
"start_time": 4978.046,
"text": " This is the season for all your holiday favorites, like a very Jonas Christmas movie and Home Alone on Disney+."
},
{
"end_time": 5017.5,
"index": 199,
"start_time": 4996.118,
"text": " And Hulu has National Lampoon's Christmas Vacation. We're all in for a very big Christmas treat. All of these and more streaming this holiday season. And right now, save big with our special Black Friday offer. Bundle Disney Plus and Hulu for just $4.99 a month for one year. Savings compared to current regular monthly price. Ends 12-1. Offer for ad-supported Disney Plus Hulu bundle only. Then $12.99 a month or then current regular monthly price. 18-plus terms apply."
},
{
"end_time": 5036.852,
"index": 200,
"start_time": 5017.5,
"text": " His view of quantum mechanics was just quantum mechanics even said it's quantum mechanics comma stupid as if anyone who thinks differently is stupid. The tone he takes in lecture is very dismissive toward philosophers now i don't know. I didn't know sydney colman personally i never got a chance to meet him i heard wonderful things about him."
},
{
"end_time": 5057.381,
"index": 201,
"start_time": 5037.21,
"text": " so i can only go based on what's the lecture but that dismissive attitude toward philosophers as a physicist can do all of this themselves and philosophers don't have anything meaningful to contribute is not i think a good message to be sending to young people i don't think it fosters the kind of interdisciplinary dialogue that can be very fruitful for all of these disciplines"
},
{
"end_time": 5084.002,
"index": 202,
"start_time": 5057.773,
"text": " Um, and you know, he says clearly in the lecture that he attributes his views to the picture of quantum theory that comes from Hugh Everett. So he takes a point of view on quantum theory that is at least in some way inspired by Everett, although he doesn't specifically commit, I think, to a full many worlds picture and lecture, although my memory could be slightly mistaken. But he appeals to various arguments to get the probabilities out of quantum quantum theory that are no longer widely considered definitive."
},
{
"end_time": 5101.527,
"index": 203,
"start_time": 5084.428,
"text": " So he has various arguments involving infinite lists of experiments, and in some notion of doing an experiment infinitely many times, you get exact results, but of course you can't really do infinite measurements. That's why a lot of these arguments have fallen out of favor."
},
{
"end_time": 5125.725,
"index": 204,
"start_time": 5102.568,
"text": " He also makes some statements about, he uses the GHZ theorem, which is a somewhat more modern, non-probabilistic version of Bell's theorem that's related to non-locality, to make certain strong arguments about what's possible. I think he also does something that I think requires a little more attention. So, on the one hand, you can talk about probability theory."
},
{
"end_time": 5154.206,
"index": 205,
"start_time": 5126.067,
"text": " On the other hand, you can talk about kinematics. Kinematics is the way that we mathematically represent the configurations of a system, the states of a system, the trajectories of a system, the way we describe how it is and what it looks like. And then there's the dynamics. Dynamics are the rules for how configurations or states change. Those are the dynamical rules, the rules that tell us how you go from initial states to later states and so forth. F equals MA is a dynamical rule. The Maxwell equations are dynamical rules."
},
{
"end_time": 5181.203,
"index": 206,
"start_time": 5154.445,
"text": " Whereas the kinematics of Newtonian mechanics is the statement that there are bodies in space and we represent their locations using coordinate systems. That's kinematics. And of course, probability is probability. Now, there's a view that what quantum theory did was transform probability kinematics and dynamics. They're all different. They're all non-classical. They're all something totally new. To the point at which I think some people conflate all of these things and just say all of it is quantum."
},
{
"end_time": 5211.971,
"index": 207,
"start_time": 5183.2,
"text": " And I think we'll go farther and say that if you think any of them is not quantum, you're saying that none of them are quantum. I think that's too strong of you. For example, in the indivisible stochastic approach, probability theory is ordinary probability theory. We're using good old-fashioned ordinary probability theory, which, in talking to statisticians, they seem to really like. The fear among, I think, some statisticians is that quantum theory doesn't use ordinary probability theory, and so it's not something amenable to some of the techniques that statisticians like to use."
},
{
"end_time": 5232.466,
"index": 208,
"start_time": 5213.712,
"text": " In the indivisible approach, we're using ordinary probability theory. If you want to call it classical probability theory, it's classical ordinary probability theory. All the probabilities that show up are just of the usual kind. The kinematics, the configurations of things, are in some sense kind of classical. Systems just have arrangements, configurations."
},
{
"end_time": 5248.131,
"index": 209,
"start_time": 5232.773,
"text": " Maybe in physical space, if you think physical space is the right way to think about things. If you're modeling a system of particles, this is arrangements of particles in physical space. If you're talking about fields, it's patterns of field intensities in space. These are the kinds of configurations that we would describe classically, for the most part."
},
{
"end_time": 5272.585,
"index": 210,
"start_time": 5248.763,
"text": " What we're altering is the dynamics. The dynamics is no longer going to be a Markovian deterministic differential equation or set of differential equations. The dynamics will now take the form of these non-Markovian probabilistic kinds of laws. So that's what's new. The laws are now different. And I think in Cindy Coleman's lecture, he can place all these things. He says that if you think about any of these things in a non-quantum way,"
},
{
"end_time": 5301.664,
"index": 211,
"start_time": 5273.797,
"text": " Then you're just being too classical. You're just thinking everything is classical. And I think if you read the transcript or watch the lecture, you'll get that impression. So I guess my feeling is, with enormous respect, of course, to Sydney Coleman, I don't think that lecture answers the questions of what's going on in quantum foundations. And I think that for at least some time, I think it gave people the impression that these problems were all solved. They were all just a mistake."
},
{
"end_time": 5325.435,
"index": 212,
"start_time": 5302.039,
"text": " of people working in philosophy. There's one point in the lecture when Coleman even looks very frustrated. He's like, I can't understand why all these people, they draw all these diagrams and they get so confused. I don't understand how they could be so confused about such a simple point. And it's kind of very condescending tone toward people who work in philosophy that I just don't think is helpful. I don't think any of us need that kind of attitude. We need to bring people together."
},
{
"end_time": 5353.387,
"index": 213,
"start_time": 5325.708,
"text": " Did these disciplines work much better when we understand the work that we do and we bring our work together? You get a kind of cross-pollination that lays the seeds for future discovery. And I should say that from people I've spoken to who knew Sidney Coleman, he was not anti-philosophical. He was very interested in a lot of this stuff. So the best I can say is maybe that somehow didn't come across in this lecture. And for whatever reason, that was the case. But I think that that's worth noting."
},
{
"end_time": 5381.391,
"index": 214,
"start_time": 5355.384,
"text": " Why did you leave string theory? I was drawn to these foundational questions at the intersection of philosophy and physics. I was just fascinated by the problems that happen trying to make sense of quantum theory. I was dissatisfied with the interpretations and formulations that were available. And I just, I got hooked."
},
{
"end_time": 5398.66,
"index": 215,
"start_time": 5381.886,
"text": " You get hooked on something and you just want to probe it and understand and make sense of it. And I just found myself much more drawn to those kinds of questions. I'm particularly drawn to the kinds of questions that philosophers of physics will say is the kind of work that they do."
},
{
"end_time": 5425.794,
"index": 216,
"start_time": 5399.104,
"text": " We tend to be interested in the mathematical and structural features of our best, most successful physical theories, some of which are fundamental or candidate fundamental theories, some of which are somewhat more prosaic theories that describe everyday physics. We want to know what it is that physicists or more generally scientists are doing when they do science. We want to think about what is the success of these theories tell us about the structure of what's going on in reality?"
},
{
"end_time": 5437.671,
"index": 217,
"start_time": 5426.032,
"text": " You can't do anything without some metaphysical posits at the very least that our experimental devices exist, right? I mean, there's some very basic metaphysical things that we assume to get things working."
},
{
"end_time": 5464.275,
"index": 218,
"start_time": 5440.759,
"text": " That we can take evidence of the past and use it to say something about the future. There's no way to justify that. I mean, back to David Hume, you know, hundreds of years ago, who pointed out that any attempt to justify that by using past experience is a circular argument, because if you say that induction is successful, we should believe in induction because it's worked so well in the past, then you're using induction to support induction."
},
{
"end_time": 5488.49,
"index": 219,
"start_time": 5465.145,
"text": " And there are a lot of people who have written about this. I know that you had John Norton on your podcast as well, and he's written a whole book on how to make sense of induction in his book, The Material Theory of Induction. So these are very difficult problems. You need something to get off the ground before you can begin to even do science. And philosophers of physics, philosophers of science are interested in those kinds of questions also. We're interested in what"
},
{
"end_time": 5517.995,
"index": 220,
"start_time": 5490.094,
"text": " our best physical theories have to say about traditional questions in philosophy and in metaphysics. That's what I call physical philosophy. And at least some of us are interested in taking the methods and tools that one develops in analytic philosophy and philosophy of science and applying them to make progress on outstanding questions in physics. That's what I call philosophical physics as opposed to theoretical physics or mathematical physics or experimental physics or applied physics or computational physics."
},
{
"end_time": 5541.408,
"index": 221,
"start_time": 5518.916,
"text": " Trying to make sense of quantum theory, I view very much as a form of philosophical physics. We have a physical theory, quantum theory. There are places where it is either ambiguous or other attempts to make sense of it run into problems of empirical adequacy or one of the other problems that we've talked about earlier. This is a physics problem and it may be that the ideal set of tools to address it"
},
{
"end_time": 5569.326,
"index": 222,
"start_time": 5541.988,
"text": " are the kinds of tools that Einstein was using when he interrogated the meaning of inertial reference frames, an interrogation that led to enormous consequences. This whole development of relativity comes out of him trying to develop a more rigorous understanding of inertial reference frames. The tools being? Tools of rigorous scrutiny, careful argumentation from as clear definitions and as clear, clearly stated premises as we can formulate,"
},
{
"end_time": 5600.725,
"index": 223,
"start_time": 5570.913,
"text": " Looking for implicit assumptions that might not have been noticed, looking for connections, questioning standard assumptions, looking under rocks, metaphorically speaking, for interesting things that may be looking under them. Can you give an example of that, the looking under the rock? Sure, yeah. So, I mean, in a sense, that's what Einstein was doing when he was probing the meaning of an inertial reference frame. I think one could very well have had an attitude back in the early aughts"
},
{
"end_time": 5630.111,
"index": 224,
"start_time": 5600.964,
"text": " not the 2000 odds but the 1900 odds that physics was about the atomic theory and it was about electromagnetism and it was about thermodynamics and here Einstein wasn't trying to build new models of that kind he was asking about the scenery like inertial reference frames inertial reference frames that's background stuff that's scenery that's not the protagonist of physics but he"
},
{
"end_time": 5660.401,
"index": 225,
"start_time": 5630.64,
"text": " Uncovered that rock and out came relativity. So I mean that's I think a fantastic example of how looking under rocks can lead to new insights We also look for connections between theories connections that other people haven't noticed I mean this project came out of me trying to build a connection between the theory of stochastic processes and and quantum theory What kind of work is that? It's not the kind of work I think that we usually associate with theoretical physics where you're building models with any given paradigm or"
},
{
"end_time": 5677.517,
"index": 226,
"start_time": 5660.742,
"text": " mathematical physics where you're trying to take statements that physicists have made and prove them rigorously turn them into theorems or apply mathematics to physical problems or develop new areas of mathematics inspired by what's going on in physics you know it's not experimental physics it's its own kind of thing"
},
{
"end_time": 5708.609,
"index": 227,
"start_time": 5679.411,
"text": " Definitions premises building very very careful arguments uncovering hidden assumptions, you know looking under rocks building connections between things analyzing the Conceptual and mathematical structure of our best theories understanding their moving parts, you know spending time doing that is is really exciting and Sometimes this leads to surprises but scrutinizing I mean that's Scrutiny is"
},
{
"end_time": 5737.244,
"index": 228,
"start_time": 5708.968,
"text": " A particular methodology of doing things, right? We're not necessarily doing experiments. We're not just building models, which is, of course, you know, building models is a very important and very difficult and challenging thing to do and obviously central to how we formulate physics. But taking things we already have and really trying to pin down all the details, trying to make sure everything fits together, there are no gaps and no logical problems. Trying to pin all that down is just a different approach. It requires a different set of tools."
},
{
"end_time": 5762.858,
"index": 229,
"start_time": 5737.722,
"text": " different inclinations. I mean, there are different people who like doing different things who have different talents, different tendencies, different inclinations. Some people like doing one kind of work. This is the kind of work I like doing. And arguably, it is born fruit for science. Last time we talked, we had a lovely discussion with Emily Adlam. And during that time, we listed"
},
{
"end_time": 5791.8,
"index": 230,
"start_time": 5763.404,
"text": " Many important contributions have been made to physics that have come from taking that philosophical lens and applying it to our best physical theories, from EPR and entanglements to decoherence to quantum advantage, Bell's theorem, the no cloning theorem, the no signaling theorem, and arguably later work that is connected with things like quantum teleportation and quantum cryptography and quantum information."
},
{
"end_time": 5819.838,
"index": 231,
"start_time": 5792.176,
"text": " I think there's a real track record of this being incredibly useful to science and worthwhile for people to work on and also for people to fund. So I have a question about the interpretations of quantum mechanics. There's plenty of hubbub about interpretation of quantum mechanics, but if it's already understood that the greater theory, the more fundamental theory will be a theory of quantum gravity,"
},
{
"end_time": 5848.166,
"index": 232,
"start_time": 5820.401,
"text": " Furthermore, that the only or the most well-developed UV complete non-perturbative approach is string theory, then why isn't there more work done on the quote-unquote interpretations of string theory? Yeah, so I would recommend that people look up the work of Nick Huggett, for example, a philosopher of physics who's given a lot of attention to trying to understand the metaphysics and philosophical questions surrounding string theory. I did some work with some of my colleagues"
},
{
"end_time": 5875.452,
"index": 233,
"start_time": 5848.166,
"text": " Some preliminary work on string theory. We just had a lot of other things we were working on. We got pulled away from this. I think partly the reason there's been less philosophical work on string theory is because it's just newer than things like relativity and quantum mechanics. You know, relativity goes back over a hundred years. Quantum theory goes back over a hundred years. So there's been a lot more time for people to think about these theories. String theory is of much more recent vintage."
},
{
"end_time": 5904.07,
"index": 234,
"start_time": 5876.032,
"text": " I think one issue is that string theory is still very speculative. We don't know that string theory is the confirmed best theory of quantum gravity. And I think that there's some reluctance to try to spend too much time trying to understand the metaphysical underpinnings of a theory that isn't substantially verified at this point. We don't have any real empirical confirmation of string theory at this point."
},
{
"end_time": 5927.995,
"index": 235,
"start_time": 5904.957,
"text": " I said before that philosophers of physics like to understand the mathematical structure and features and implicit assumptions and everything for our best most successful physical theories and by this I mean theories that have proved the test of time that have been empirically verified because the work that we do for those theories we feel will stand the test of time whereas if you're working on it on trying to understand the philosophical underpinnings of a speculative theory that might not last"
},
{
"end_time": 5946.152,
"index": 236,
"start_time": 5928.353,
"text": " Well, then your work on that might also not last. Now, of course, one could take the view that philosophical work, foundational work on string theory may help move quantum gravity forward. And I think that maybe partly what inspires people to think about these questions, but I would recommend that you interview some of the people who work on the philosophy of string theory. I think Nick Huggett would be an excellent person for you to talk with."
},
{
"end_time": 5971.749,
"index": 237,
"start_time": 5946.152,
"text": " I think you might get some insight and you could ask him what motivates him to work on this theory. I think the other main reason why fewer people in philosophy and foundations of physics work on string theory is that string theory is mathematically very complicated. I worked in string theory during graduate school and there are very beautiful features of string theory. I mean, you work on it and you see beautiful connections."
},
{
"end_time": 5995.845,
"index": 238,
"start_time": 5972.142,
"text": " Changes how you think about quantum field theory in really profound ways. I learned a lot about quantum field theory from learning string theory. But it is a very mathematically intricate theory and I think that presents an obstacle for a larger fraction of people working in philosophy of physics to work on it. Now the people I know working in philosophy of physics are very mathematically sophisticated."
},
{
"end_time": 6025.913,
"index": 239,
"start_time": 5996.391,
"text": " um, but there's an investment in time that one has to, has to, has to make in order to be able to work on, on, on string theory, a bigger investment in time, I think, than, than maybe the case for other theories people can work on. And so I think that's been a hindrance to more people working on it. But there are people who have decided to invest that time and they've worked on it. And, you know, it's interesting to know, you know, to think about what, what they've been able to see. I think one of the difficulties is that because string theory is in many ways still a very partial theory, it's not yet quite ripe enough"
},
{
"end_time": 6051.288,
"index": 240,
"start_time": 6026.271,
"text": " to be able to start making strong statements about the metaphysics. We have only a very sort of superficial understanding of exactly what the theory entails. And that makes it difficult to ask deep foundational questions about it at this stage of development. What did you learn about QFT from string theory that isn't string contingent? That isn't string contingent. That's a good question. I mean, we"
},
{
"end_time": 6082.944,
"index": 241,
"start_time": 6053.217,
"text": " So one thing I learned about about quantum field theories from string theory is how to think about gauge theories. I'm a little worried that if I get in the weeds here, this is going to become technical very quickly. The audience loves the technicality. Don't worry. OK, well, so in string theory, one models the kinds of particles that transmit forces using certain kinds of strings. We use open strings to model gauge theories and we use closed strings to model gravitons."
},
{
"end_time": 6104.275,
"index": 242,
"start_time": 6083.234,
"text": " The actual force carriers correspond to particular quantized excitations of these strings. And one question you could ask is, well, if I have a particular quantized excited mode of a particular kind of a string, and this string is supposed to describe some kind of force carrier, well, I've got the particles."
},
{
"end_time": 6131.152,
"index": 243,
"start_time": 6104.804,
"text": " How do I understand where the field comes from and the structure of the field? Why should these fields have certain features? Why should gauge fields exhibit gauge invariance? Why should the gravitational field exhibit diffeomorphism invariance and the equivalence principle? Why should it treat inertial and gravitational mass as being similar kinds of things in the first place?"
},
{
"end_time": 6161.903,
"index": 244,
"start_time": 6132.483,
"text": " You know, in string theory, because you're working in a so-called first quantized formalism most of the time, you're working with individual strings, which manifest as individual particles, rather than in the so-called second quantized formalism that's called string field theory, which is its own discipline, and there are people who work in string field theory. But a lot of the time, you're working in the first quantized string particles as sort of individual excitations of these strings. Understanding how you get all the intricate, rich structures that show up in quantum field theory from these strings"
},
{
"end_time": 6189.633,
"index": 245,
"start_time": 6162.363,
"text": " ports right over to thinking about the relationship between, not in string theory, the particles that correspond to fields and the fields that they're related with. So, for example, photons are associated with the electromagnetic field. The Higgs boson is associated with the Higgs field. The electron is associated with what's called the electron field, which is a fermionic field. It's a very interesting kind of thing. Quarks have their own fields."
},
{
"end_time": 6218.37,
"index": 246,
"start_time": 6189.906,
"text": " Deutrino's have their fields. There's fields associated with all these particles. And understanding the relationship between a field and its corresponding particles is a little bit subtle. One way to think about it is the field is a sort of prior idea and that you can argue using some elementary quantum mechanics thinking of fields as connected systems of harmonic oscillators that quantum mechanics or harmonic oscillators can only be excited in quantized amounts. These fields can only be excited in quantized energetic amounts."
},
{
"end_time": 6239.923,
"index": 247,
"start_time": 6218.575,
"text": " And each such quantized excitation, each quantized energetic excitation corresponds to one more quantum, one more particle of that field showing up. This is the sense in which, say, the Higgs boson is one quantized excitation of the underlying Higgs field. But you may also ask the opposite question. If I imagine starting with some statement about the properties of particles, let's suppose I've got a particle with certain features."
},
{
"end_time": 6268.916,
"index": 248,
"start_time": 6240.418,
"text": " I've got a particle that's got this intrinsic inertial mass. It's got this intrinsic charge. It's got this intrinsic spinniness or spin or angular momentum. Can I predict what kind of field it will correspond to? And can I even, in some sense, model the field as some appropriately defined quantum state involving these particles, as some coherent state of these particles? And if I do that, what kind of field do I get? What features does the field have?"
},
{
"end_time": 6297.039,
"index": 249,
"start_time": 6269.258,
"text": " and what I took from string theory which I guess you could have learned just in quantum field theory but for me it took learning string theory to see this connection was that the properties of these particles again things like their mass and their charge and their spin and this sort of these are the features these particles can reveal to you the structure of the fields they correspond to interesting for example the fact that photons have zero intrinsic inertial mass"
},
{
"end_time": 6322.056,
"index": 250,
"start_time": 6298.046,
"text": " and have one unit h-bar of intrinsic spin and have no charge. That you can use to show that the field that emerges from photons is going to look something like the electromagnetic field, and in particular, the masslessness of the photon and its spin being one is connected with gauge invariance in this electromagnetic field."
},
{
"end_time": 6341.084,
"index": 251,
"start_time": 6322.517,
"text": " So that's the sort of connection and again you could understand this connection without string theory if you pick up Steven Weinberg's books on quantum field theory he also explores this connection although in a way that when I first learned it from Steven Weinberg's book I didn't find as intuitively clear as I did from string theory."
},
{
"end_time": 6368.831,
"index": 252,
"start_time": 6341.596,
"text": " that that would be an example right and you know string theory is generated a number of other spin-offs that people working in quantum gravity spent a lot of their time thinking about things like holography you know and you know to whatever extent that you think that those ideas are worthwhile they're certainly very interesting and arguably they stand on their own separately from string theory at least some of them"
},
{
"end_time": 6398.217,
"index": 253,
"start_time": 6370.196,
"text": " I should have been asking about the interpretations of quantum field theory as well. Who are some people I should be speaking to? Interpretations of quantum field theory. There's a number of people who work in an area who might be worth speaking to. Michael Miller, who's particularly convenient because he's at the University of Toronto. You might talk to- Right, we talked about him yesterday? We did, yes. You might talk to Doreen Fraser, who's at the University of Waterloo. So also not someone who's very far away."
},
{
"end_time": 6415.725,
"index": 254,
"start_time": 6398.814,
"text": " You might"
},
{
"end_time": 6445.435,
"index": 255,
"start_time": 6416.084,
"text": " Primarily with algebraic quantum field theory. So they'd both be interesting people to talk to about how we think about quantum field theory. So I have a lot of people I would recommend. Okay. Now that I've accidentally inadvertently tease the audience about interpretations of QFT, why don't you outline some of them? Why don't you outline two of them? Right, right. So quantum field theories live within the umbrella of quantum theory. So you have the same kinds of axioms. You have quantum states."
},
{
"end_time": 6471.305,
"index": 256,
"start_time": 6445.725,
"text": " In some sense, although depending on how you formulate a quantum field theory, you might prefer to work with what are called c star algebras. We've talked about that rather than Hilbert spaces, but but the similar conceptual basis for thinking about quantum states and some kind of evolution law and observables being represented by an algebra of an algebra means a collection of mathematical symbols that are the observables."
},
{
"end_time": 6498.268,
"index": 257,
"start_time": 6472.159,
"text": " and you still have to use the Born rule to calculate things probabilistically, or at least compute measurement averages of things. So the basic rules still apply. Some people make a terminological distinction between quantum theory, which is the more general idea, and quantum mechanics, which is specifically about particles. Some people use the word quantum mechanics to mean all of quantum theory, so you have to be very careful what they mean. When I say quantum mechanics, I usually mean quantum theory applied to models of systems of particles,"
},
{
"end_time": 6518.865,
"index": 258,
"start_time": 6498.643,
"text": " I use quantum theory to refer to the more general framework of which quantum mechanics is an example and quantum field theory is an example and string theory is an example. These are all phrased within this larger formalism of quantum theory. So some of the foundational philosophical metaphysical interpretation questions"
},
{
"end_time": 6533.49,
"index": 259,
"start_time": 6519.77,
"text": " that one considers in quantum theory are still present in quantum field theory. Quantum field theory doesn't let you get around the measurement problem. Most of the time in quantum field theory you're practically speaking if you're doing quantum field theory for practical purposes."
},
{
"end_time": 6549.991,
"index": 260,
"start_time": 6533.899,
"text": " for particle experiments you're mostly imagining some collection of particles coming in in the far past which for particles experiments is not really very far right and then you consider some other collection of particles in the far future again quote unquote for future"
},
{
"end_time": 6576.101,
"index": 261,
"start_time": 6549.991,
"text": " And you want to compute the, roughly speaking, the probability to go from one to the other. This is usually phrased in technical terms, in terms of what are called scattering cross-sections and decay rates. You take these probabilities, you convert them into the kinds of quantities you would actually measure in a particle oscillator, but they're still based on the Born rule. And you're still using the Born rule to calculate those probabilistic predictions. And usually you're doing only one measurement and you're calling it quits."
},
{
"end_time": 6594.121,
"index": 262,
"start_time": 6576.664,
"text": " So you don't usually see the collapse anymore in the formalism. You don't collapse the quantum state and then take the collapse quantum state and do something else on it. So the measurement problem is a little more implicit in the formalism for the most part. We call by the way the array, the set of all of the"
},
{
"end_time": 6620.35,
"index": 263,
"start_time": 6594.514,
"text": " Scattering amplitudes the complex numbers that you you then compute scattering cross-sections into carries that if we call that that array of all of them That data set of all of them. We call that the s matrix And and so a lot of the time in quantum field theory you're trying to understand the s matrix and compute You know the entries in this s matrix or trying to study its analytic mathematical properties or whatever"
},
{
"end_time": 6648.148,
"index": 264,
"start_time": 6620.776,
"text": " So the standard problems are still there, even if maybe they're a little more suppressed, given the kinds of things we usually work with in quantum field theory. Students are often surprised when they do quantum field theory that they're not using the Schrodinger equation very much anymore. So a lot of those older problems, like I said, are just less manifest. But in addition to all those problems, there are new problems that show up. Quantum field theories are phrased in a manifestly special relativistic language."
},
{
"end_time": 6677.722,
"index": 265,
"start_time": 6648.268,
"text": " And there are new kinds of problems that show up there. In particular, if you do want to think about doing multiple measurements on a quantum field theory, well then you can't have one measurement be in the infinite past and one measurement in the infinite future because if you want to do another measurement, you can't do something after the infinite future. You have to actually take seriously that things happen in finite amounts of time. And now you're talking about doing measurements ostensibly in some kind of space-time picture."
},
{
"end_time": 6692.09,
"index": 266,
"start_time": 6678.097,
"text": " You're thinking about your measurements being events in some sense localized in space and in time in a relativistic context. And so now you have to be very careful that you don't get paradoxes and violations and"
},
{
"end_time": 6719.36,
"index": 267,
"start_time": 6692.346,
"text": " There's a whole set of papers where people are trying to make sure they understand how measurements work in this sense of quantum field theory. And so this is a whole collection of things that people might want to look at. After we talk, I can send you some references that you can put in the chat. But that's a source of real serious discussion. Another set of questions is there are different ways to formulate quantum field theories. I mentioned algebraic approaches."
},
{
"end_time": 6746.834,
"index": 268,
"start_time": 6719.582,
"text": " things that I mentioned a couple people who work on algebraic approaches to quantum field theory. Then there's what some people call Lagrangian quantum field theory, which is also closely related to effective field theory. We talked about earlier thinking about our quantum field theories as progressive approximations where we're really just interested in computing S matrix elements for the most part. And understanding the connection between these different formulations of quantum field theory is an outstanding question."
},
{
"end_time": 6756.988,
"index": 269,
"start_time": 6747.722,
"text": " At present, we don't have an algebraic quantum field."
},
{
"end_time": 6783.524,
"index": 270,
"start_time": 6757.927,
"text": " An algebraic quantum field theory version of the kinds of quantum fields that we use in the standard model. The standard model is our most successful scientific theory. That's the standard model that has the quarks and leptons and gluons and photons and the Higgs boson that we think gives us our best, most quantitatively precise description of fundamental physics. That's phrased in the language of effective and Lagrangian field theory."
},
{
"end_time": 6807.619,
"index": 271,
"start_time": 6784.206,
"text": " which is not for the most part mathematically rigorous and for which it's very difficult to answer some of these foundational questions I mentioned algebraic quantum field theory is much more mathematically rigorous and we have more resources mathematical theoretical resources to probe some of these foundational questions but because we don't know how to formulate the standard model in that rigorous algebraic language"
},
{
"end_time": 6832.807,
"index": 272,
"start_time": 6808.114,
"text": " This limits our ability to address some of these foundational questions for the kinds of realistic, interacting field theories that we work on. And so one area in the foundations of quantum field theory is to try to bring these two pictures together. Try to see to what extent we can understand how we use quantum field theory in practice, but in a somewhat more rigorous way that's more amenable to addressing foundational questions. One other question you can ask is"
},
{
"end_time": 6859.275,
"index": 273,
"start_time": 6833.439,
"text": " What is quantum field theory saying is actually real, real in the physical or metaphysical sense? We're talking about reality. Are we saying that fields are physical real things, that every point in space there's like a physical intensity or directional or more complicated entity that's really there, and that there are real patterns in these fields across space-time, or are we saying something else?"
},
{
"end_time": 6888.49,
"index": 274,
"start_time": 6859.65,
"text": " Prior to having some kind of realist approach to quantum theory, it would have been very difficult to even ask that kind of a question. But even once you think you have maybe a realist-oriented approach to quantum theory, like the kind I've advocated, or like, for example, Bohmians who are trying to do quantum field theory are trying to advocate, or Everettians or whatever, you then have this further question, what do I take to be the ontology? What should the real thing be? And so one set of debates was, should we think about quantum field theories more in terms of particles or more in terms of fields?"
},
{
"end_time": 6916.783,
"index": 275,
"start_time": 6889.667,
"text": " Some philosophers argued that thinking in terms of particles was untenable for a whole variety of reasons. Others have argued that thinking in terms of fields is also untenable. If you talk to practicing theoretical particle physicists, you'll hear a variety of answers in that question as well. You'll even hear from some top people working in quantum field theory that we don't even understand exactly what quantum field theory is in some fundamental sense. So that's just scratching the surface."
},
{
"end_time": 6940.265,
"index": 276,
"start_time": 6917.108,
"text": " We could then go farther. What happens when you put quantum fields not on flat, special relativity type space-time, Kowski space-time? What happens when you put quantum field theories on a curved space-time? Even fixing, freezing gravity, not letting gravity be dynamical, freezing space-time is in particular shape. What happens to quantum field theory when the space-time is no longer flat?"
},
{
"end_time": 6970.265,
"index": 277,
"start_time": 6941.067,
"text": " What happens when you're accelerating in space-time and you have things like the unruh effect and you see the appearance of particles that show up? I can recommend to people who are interested in learning more about that particular problem and learning more about sea straw to break formulations of quantum field theory to read a Remarkable review puts part review paper and also part philosophy paper by Rob Clifton and Hans Halverson called our Rindler there's an N in there Rindler our Rindler quanta real and"
},
{
"end_time": 6994.087,
"index": 278,
"start_time": 6970.674,
"text": " um... and in addition to addressing that question which they do in the later parts of the paper the beginning of the paper is a really nice introduction to the cistern algebraic formulation of quantum theories generally which they use to study this problem and then you know within algebraic quantum field theory you run into all these deep questions about unitary and equivalence of different representations of quantum field theories"
},
{
"end_time": 7023.217,
"index": 279,
"start_time": 6994.667,
"text": " I mean, there's just so many interesting problems in the foundations of quantum field theory. And I know that people who work in the field are listening to this and are probably upset that I'm leaving something out. There are just too many things to mention. But I'm only leaving them out because of lack of time and because they're not occurring to me in real time. I mean, no disrespect at all, please. So I have a two-part question. Between measurements, are particles popping in and out of existence? Now, I know we've spoken about that on part one or part two, but I still want you to go over it."
},
{
"end_time": 7041.817,
"index": 280,
"start_time": 7023.729,
"text": " Half of my question. My second half is in many of the approaches of quantum gravity, we sum over different space times. So between measurements is space time also fluctuating. Particle counts fluctuating and space time fluctuating between measurements. What does it even mean for space time to fluctuate?"
},
{
"end_time": 7055.452,
"index": 281,
"start_time": 7042.995,
"text": " So, in non-relativistic quantum theory, we're usually interested in systems of fixed numbers of finitely many non-relativistic particles, and in that case the particle number doesn't fluctuate."
},
{
"end_time": 7076.954,
"index": 282,
"start_time": 7056.015,
"text": " And if you model this sort of thing in the indivisible stochastic approach, you get arrangements of particles. Those arrangements of particles are like snapshots. Those snapshots can look very different as time goes by. They're probabilistic. But you would have a conserved number of particles. In a relativistic context, the number of particles is not generally conserved."
},
{
"end_time": 7105.64,
"index": 283,
"start_time": 7077.278,
"text": " Now, there are conservation laws you have to worry about. For example, electric charge is conserved, and that means that if you have charged particles, then if particles appear, antiparticles should appear so that the charge is conserved, or something like that. You have to be mindful of those conservation laws, but there's nothing in principle that stops particles from appearing or disappearing. Usually in the context of relativistic quantum theory, we're usually thinking about something like a quantum field theory. That's usually the most natural way to handle relativistic quantum theory."
},
{
"end_time": 7133.319,
"index": 284,
"start_time": 7105.64,
"text": " There are first quantized approaches to relativistic quantum theory. That's another thing I picked up from string theory because we usually do a lot of string theory working with the first quantized formalism thinking in terms of specific numbers of strings. Although I should say that the number of strings can change because strings can break and attach. But we're thinking in terms of strings rather than fields made of strings. You can apply that relativistic first quantized formalism to particles and you can model"
},
{
"end_time": 7154.019,
"index": 285,
"start_time": 7133.899,
"text": " Particles with no intrinsic spin, you can model particles with various kinds of spin in a formalism that's very reminiscent of what one does in string theory but applied to just point particles. So that's another interesting thing. But usually when we're thinking about relativistic systems, it's often easier to use quantum field theory. And in quantum field theory, particles, as we've talked about, are kind of emergent entities."
},
{
"end_time": 7181.101,
"index": 286,
"start_time": 7154.514,
"text": " You can excite the fields in different amounts, so when you excite them, you have different numbers of particles. And because the fields can be excited in different patterns and the excitation patterns can change with time, particle number in general is not conserved. So particles in that sense are emerging as fluctuations of the field as functions of time. So in the case of particles fluctuating in and out of existence, in some sense that's allowed in the relativistic case. Now in quantum gravity,"
},
{
"end_time": 7207.875,
"index": 287,
"start_time": 7182.466,
"text": " Here we're entering the realm of speculation. We don't have a fully realized theory of quantum gravity by any stretch. Arguably there has been some progress made in handling questions in quantum gravity by various techniques. One technique used to handle difficult problems in quantum gravity is functional integral techniques."
},
{
"end_time": 7222.671,
"index": 288,
"start_time": 7208.097,
"text": " We use the path integral or partition functions, various things that capture quantum features of what we think is the right way to think about gravity, but not directly using the usual tools of Hilbert spaces and operators."
},
{
"end_time": 7249.582,
"index": 289,
"start_time": 7223.404,
"text": " There are even some circumstances in which things that might be very harder or very difficult to see in a Hilbert space oriented approach become easier to calculate or see in a functional integral type approach, even to the extent that there may be some situations in which the functional integral approach takes you to places you can't get to from the Hilbert space approach, which may reveal some very important things about whether quantum gravity is really meant to be based on Hilbert spaces at all."
},
{
"end_time": 7270.572,
"index": 290,
"start_time": 7250.299,
"text": " Personally, I'm suspicious that quantum gravity is ultimately going to be phrased in terms of Hilbert spaces for a whole variety of reasons, one of which is that Hilbert spaces seem to be really well adapted to the case where you have an external time parameter. There are ways to do quantum theory with Hilbert spaces without an external time parameter. The Page-Wooders formalism, which I'd rather not get into in detail here,"
},
{
"end_time": 7294.07,
"index": 291,
"start_time": 7270.947,
"text": " But it's a bit difficult to work with Hilbert spaces when you don't have an external time parameter and in general relativity you don't have an external time parameter. So there are a lot of reasons why you might be suspicious that Hilbert space is the right ingredients and so we use these sort of functional integral techniques to make certain kinds of predictions to calculate things to answer certain kinds of problems and in these functional integrals you can think of them as you take whole spacetimes"
},
{
"end_time": 7315.623,
"index": 292,
"start_time": 7294.462,
"text": " You assign whole space times a complex number and amplitude and then you sum these complex numbers associated with different space times and then you do various squaring of the answers to calculate things. The metaphysical status of these kinds of operations is very murky. I don't have an intuitive grasp of what it means."
},
{
"end_time": 7343.524,
"index": 293,
"start_time": 7316.698,
"text": " to add together two spacetimes. Of course, I don't really have a grasp of what it means to add together two particle states. In the indivisible approach, we don't really have superpositions in a literal sense. Our use of superpositions in the Hilbert space mathematics is just a way to encode the indivisibility of what's going on in the process. The particle really is in just one place or the other. So arguably, if you wanted to think about quantum gravity in an indivisible stochastic sense,"
},
{
"end_time": 7371.647,
"index": 294,
"start_time": 7343.848,
"text": " You wouldn't really have true superpositions of different spacetimes. There might just be one spacetime or something that spacetime emerges from, some other kind of more fundamental substrate out of which spacetime emerges. And our use of sums of complex numbers over spacetime is no more telling us what's going on metaphysically than would be the case in the use of the path integral formulation of a quantum mechanical system of particles. But this is all very speculative."
},
{
"end_time": 7396.664,
"index": 295,
"start_time": 7371.647,
"text": " I don't feel like I have enough of a grip on what's really going on in quantum gravity to be able to give anything like a concrete metaphysical picture of what I think is going on. I don't think we were just at that stage yet in development of quantum gravity. So what does it look like for an indivisible stochastic process to pop in and out of existence? How do you model creation and annihilation of particles in your approach? So one thing is"
},
{
"end_time": 7419.616,
"index": 296,
"start_time": 7396.988,
"text": " To take your configurations not to just be arrangements of a fine number of particles, but to broaden what you mean by your configurations. Now your configurations are not just arrangements, but also any number of particles in those arrangements. Configurations with no particles, configurations with one particle, configurations with two particles, but in all kinds of various arrangements. When you do this in the Hilbert space sense,"
},
{
"end_time": 7442.415,
"index": 297,
"start_time": 7419.957,
"text": " This is called the second quantized formalism. The Hilbert spaces you use are called Fox spaces. So one could model it that way. Another way to model it is not to treat particles as fundamental but to work with fields. And fields don't pop in and out of existence in the usual sense. The fields are just there and they can be activated in various patterns and some of those patterns we regard as emergent particles."
},
{
"end_time": 7468.183,
"index": 298,
"start_time": 7442.722,
"text": " So rather than seeing particles coming in and out of existence, we replace particles with a more fundamental substrate that is not winking in and out of existence. Now, I should say there are some really interesting directions where people have considered third quantize theories or higher order quantize theories in which they imagine what if quantum fields can pop in and out of existence, more profound sense. People who are interested might want to"
},
{
"end_time": 7498.234,
"index": 299,
"start_time": 7468.951,
"text": " You're a master of physics, of philosophy, and of history. You may even be... I think you're assuming way too much about me, Kurt, but I appreciate the compliment."
},
{
"end_time": 7525.879,
"index": 300,
"start_time": 7498.951,
"text": " You may even be a part of that history. So let's imagine 10, 20, 50 years from now, there's a history book, there's a chapter on Jacob in this history of physics book. What do you want it to say? That I was a really nice person to people I cared about and to people like everybody that I was that I tried to make the world a better place that"
},
{
"end_time": 7555.111,
"index": 301,
"start_time": 7526.476,
"text": " kindness was important to me that that I created spaces for the people I care about to feel safe and nurtured and and loved. I mean, that's the thing that immediately jumps out at me. I mean, what what more could anyone want to aspire to? I mean, of course, we all fall short of I fall short of that all the time. But that's my hope is that I get better at that. And and that's"
},
{
"end_time": 7584.087,
"index": 302,
"start_time": 7555.759,
"text": " I mean, I don't have history books talk about those kinds of things. I hope any book that talked about me would talk about that. In terms of contributions to scholarship, I would hope that the projects I'm working on end up panning out. Anything we work on could ultimately not succeed. I'm not claiming to have a theory of everything. My hope is to address what I think are some important problems at the heart of"
},
{
"end_time": 7613.831,
"index": 303,
"start_time": 7585.811,
"text": " deep and foundational questions in physics. I hope that my work ends up succeeding and that the history books say that they succeeded, or at the very least inspired people to go in new directions that they might not have gone in otherwise. You know, I hope that, well, I mean, I hope they talk about my amazing family. My family is amazing and I love them and I hope"
},
{
"end_time": 7642.142,
"index": 304,
"start_time": 7614.548,
"text": " I don't know. It's a hard question to answer. I don't know. Jacob, thank you for spending so much time with me. It's always a delight, Kurt. Every time I come to Toronto, I'll always come and we'll talk more. And you have to come visit me in Boston again. It's a deal. Take care, man. You're a real gem, you know that? I'm a gem. Talk about master. Like, you are a master of what you do."
},
{
"end_time": 7651.51,
"index": 305,
"start_time": 7643.831,
"text": " Hi there, Kurt here. If you'd like more content from Theories of Everything and the very best listening experience,"
},
{
"end_time": 7679.07,
"index": 306,
"start_time": 7651.732,
"text": " Then be sure to check out my sub stack at curtjymungle.org. Some of the top perks are that every week you get brand new episodes ahead of time. You also get bonus written content exclusively for our members. That's C-U-R-T-J-A-I-M-U-N-G-A-L.org. You can also just search my name and the word sub stack on Google. Since I started that sub stack,"
},
{
"end_time": 7699.206,
"index": 307,
"start_time": 7679.36,
"text": " It's somehow already became number two in the science category. Now, Substack for those who are unfamiliar is like a newsletter, one that's beautifully formatted. There's zero spam. This is the best place to follow the content of this channel that isn't anywhere else. It's not on YouTube. It's not on Patreon."
},
{
"end_time": 7728.353,
"index": 308,
"start_time": 7699.445,
"text": " It's exclusive to the Substack. It's free. There are ways for you to support me on Substack if you want, and you'll get special bonuses if you do. Several people ask me like, hey, Kurt, you've spoken to so many people in the field of theoretical physics, of philosophy, of consciousness. What are your thoughts, man? Well, while I remain impartial in interviews, this Substack is a way to peer into my present deliberations on these topics."
},
{
"end_time": 7755.043,
"index": 309,
"start_time": 7728.541,
"text": " And it's the perfect way to support me directly, curtjaymungle.org or search curtjaymungle sub stack on Google. Oh, and I've received several messages, emails and comments from professors and researchers saying that they recommend theories of everything to their students. That's fantastic. If you're a professor or a lecturer or what have you, and there's a particular standout episode,"
},
{
"end_time": 7775.009,
"index": 310,
"start_time": 7755.384,
"text": " that students can benefit from or your friends, please do share. And of course, a huge thank you to our advertising sponsor, The Economist. Visit economist.com slash toe to get a massive discount on their annual subscription. I subscribe to The Economist and you'll love it as well."
},
{
"end_time": 7789.394,
"index": 311,
"start_time": 7775.469,
"text": " Toe is actually the only podcast that they currently partner with. So it's a huge honor for me. And for you, you're getting an exclusive discount. That's economist.com slash toe. And finally,"
},
{
"end_time": 7806.664,
"index": 312,
"start_time": 7789.718,
"text": " You should know this podcast is on iTunes, it's on Spotify, it's on all the audio platforms. All you have to do is type in theories of everything and you'll find it. I know my last name is complicated, so maybe you don't want to type in Jymungle, but you can type in theories of everything and you'll find it."
},
{
"end_time": 7824.872,
"index": 313,
"start_time": 7806.664,
"text": " Personally, I gain from rewatching lectures and podcasts. I also read in the comment that toll listeners also gain from replaying. So how about instead you relisten on one of those platforms like iTunes, Spotify, Google podcasts, whatever podcast catcher you use. I'm there with you. Thank you for listening."
}
]
}No transcript available.