Maybe we're in a kind of meta-turing test Probably it would be a good idea not to tell you so it doesn't change your behavior, right This is a kind of- Heisenberg uncertainty principle situation If I told you, you'd behave differently Maybe that's what's happening with us, of course This is a benchmark from the future where they replay 2022 as a year before AIs were good enough yet, and now we want to see, is it gonna pass Exactly If I was such a program, would you be able to tell, do you think So to the turing test question, you've talked about the benchmark for solving intelligence What would be the impressive thing You've talked about winning a Nobel Prize and AI system winning a Nobel Prize, but I still return to the Turing test as a compelling test The spirit of the Turing test is a compelling test Yeah, the Turing test, of course, it's been unbelievably influential, and Turing's one of my all-time heroes, but I think if you look back at the 1950 paper, his original paper, and read the original, you'll see I don't think he meant it to be a rigorous formal test I think it was more like a thought experiment, almost a bit of philosophy he was writing if you look at the style of the paper And you can see he didn't specify it very rigorously So for example, he didn't specify the knowledge that the expert or judge would have, how much time would they have to investigate this So these are important parameters if you were gonna make it a true sort of formal test And by some measures, people claim the Turing test passed several, a decade ago, I remember someone claiming that with a kind of very bog standard normal logic model, because