本集简介
双语字幕
仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。
理查德,我很好奇。
Richard, I'm I'm curious.
我们现在RSI进展到哪一步了?
Where are we at the moment with RSI?
在各种弱形式下,我们已经有了RSI。
In various weak forms, we already have RSI.
我们还没完全达到那个程度,
We're not quite there yet,
但已经很接近了。
but we're very close.
你觉得我们什么时候能达到ASI?
When do you believe we reach ASI?
我觉得大概还需要几十年。
I think it will take us probably several decades.
在终端测试4.0上,Sonnet 5.5从10%跳到了70%。
On terminal bench 4.o, Sonnet 5.5 jumped from 10% to 70%.
确实挺惊人的。
Pretty extraordinary.
我的推测是,他们想跟中国竞争。中国大概落后三个月,他们得赶在企业转向开源模型之前把这段差距补上。
My theory would be that they're trying to compete with, you know, China, which is about three months behind, and fill that gap before a lot of enterprises go to to open source models.
说实话,我不太明白大家为什么要用 Sonnet 5.5 而不是 OPUS 5.5,除非你有特定的 token 用量、延迟或者其他方面的考量。
It's not at all obvious to me why anyone should be using Sonnet 5.5 over OPUS 5.5 unless you have some token or latency or other consideration.
我是不打算用 Sonnet 5.5 的。
I do not plan to use Sonnet 5.5.
国防部长宣布了‘子午线计划’。
The defense secretary announced Project Meridian.
这是五角大楼针对未来战争形态发起的一项新举措。
It's a new Pentagon effort on the future of warfare.
该项目由埃隆·马斯克和帕尔默·拉奇共同牵头。
It's co led by Elon Musk and Palmer Luckey.
我觉得这是一个具有转折意义的时刻。
This, I think, is a transformative moment.
这是向前迈出的一大步,非常大的一步。
This is a major, major step forward.
关键问题在于……
The big question is gonna be...
各位,这就是那个登月计划。
Now that's the moonshot, ladies and gentlemen.
本期节目由Abundin峰会和Link Ventures赞助播出。
This episode is brought to you by the Abundin Summit and Link Ventures.
欢迎收听《登月计划》,这是你了解奇点的最佳播客。
Welcome to Moonshots everyone, your number one podcast and helping understand the Singularity.
最近怎么样?
What's going on?
这对你和你的家人意味着什么?
What does it mean to you and your family?
还有最新的突发新闻是什么?
And what the breaking news is?
我们每周发布两次,帮你跟上这个飞速变化的时代。
We publish this twice a week to help you keep up with the extraordinary rate of change.
今天和我一起的是神奇四侠:Alexander Wissner-Gross,我们的内部ASI Dave Blundin,我们AI投资大师Salim Ismail,还有我们的环球旅行家,今天终于回家了,太棒了Salim。
With me today is the Fantastic Four, Alexander Wissner-Gross, our in house ASI Dave Blundin, our impresario of AI Investing Salim Ismail, our globetrotter, who's home today, amazing Salim.
哇哦
Woo
呼。
hoo.
还有组织奇点之父。
And the father of the Organizational Singularity.
我是Peter Diamandis,你的主持人和数据驱动的乐观主义者。
I'm Peter Diamandis, your host and data driven optimist.
我们的使命是让你对未来保持乐观。
Our mission here, keep you optimistic about the future.
这是本周的数据。
And here's the numbers from this week.
短短七天里,Google发布了Gemini IV Argon,Anthropic推出了Sonnet 5.5,OpenAI上线了GPT 6.1,而Sol和前沿智能的成本更是降到了原来的三分之一。
In seven days, Google shipped Gemini IV Argon, Anthropic shipped Sonnet 5.5, Open AI shipped GPT 6.1, Sol and the Frontier Intelligence has gotten cheaper by threefold.
SpaceX发射了新一批宇航员前往国际空间站,同时还把Google的TPU送上了轨道,用于“日捕”项目。
SpaceX launched the next batch of astronauts, the ISS, and also launched Google's TPUs into orbit for Project Suncatcher.
如果你是第一次听《Moonshots》播客,记得点击订阅哦。
If you're new to the Moonshots podcast, please hit subscribe.
我们每周更新两期,在这股超音速的信息洪流中,你可千万别错过任何一条重要新闻。
We publish twice a week and you don't want to miss any of this news during this hypersonic tsunami.
我们的目标是让订阅用户数量翻20倍,达到一千万,从而传播乐观精神,让大家看到我们正在构建的非凡未来。
Our moonshot here is to 20x our subscriber base to get to 10,000,000 to help spread the word of optimism and the extraordinary future that we're building.
今天《Moonshots》节目邀请到的嘉宾是现代人工智能的架构师之一:Richard Socher。
Today on moonshots, we're joined by one of the architects of modern AI, Richard Socher.
Richard在德国出生,在斯坦福大学接受训练,是全球被引用次数最多的自然语言处理研究人员之一,也是深度学习和提示工程领域的先驱。他是一位连续创业者,多次将前沿研究成果转化为定义品类的公司。
Born in Germany and trained at Stanford, Richard is among the world's most cited natural language processing researchers, a pioneer in deep learning and prompt engineering, and a serial founder who's repeatedly turned frontier research into category defining companies.
他首先创立了MetaMind,该公司后来被Salesforce收购。在那里,他担任首席科学家,为播客的朋友、Salesforce的CEO Mark Benioff领导AI研究工作。
First he founded MetaMind which was acquired by Salesforce where he then became the chief scientist leading AI research for a friend of the pod Mark Benioff.
接下来,Richard创办了You.com,这家公司在《时代》周刊和世界经济论坛上都获得了认可,估值已经超过15亿美元,此外还有他的基金A.
Next Richard founded you.com recognized by Time in the World Economic Forum and now valued at north of 1,500,000,000 as well as his fund A.
I.
I.
X.
X.
Ventures.
Ventures.
如今,Richard是Recursive的联合创始人兼CEO。这或许是他迄今为止最大胆的一次尝试,专注于打造能够递归自我进化的超级智能。
Today Richard is co founder and CEO of Recursive, perhaps the biggest moonshot he's ever taken, focused on recursively self improving superintelligence.
Richard,恭喜你从Google Ventures、Graycroft、Nvidia和AMD那里筹集了6.7亿美元的资金,还从AWS获得了价值4.1亿美元的算力支持。
Richard, congrats on a $670,000,000 fundraise from Google Ventures, Graycroft, Nvidia and AMD and $410,000,000 in compute from AWS.
个人披露一下,作为Recursive的种子轮投资者,我感到非常自豪。
Personal disclosure, I'm very proud to be a seed investor in Recursive.
当然,Richard,值得一提的是,你的新书《尤里卡机器:为何AI是开启科学发现新时代的钥匙》刚刚发布。
And of course, Richard, important to mention your new book just got released, The Eureka Machine, Why AI is the Key to Unlocking a New Era of Scientific Discoveries.
欢迎来到播客,理查德。
Welcome to the pod, Richard.
能回来真是太棒了。
It's so great to be back.
嘿,让我补充一句,他真是个非常非常棒的人。
Hey, and let me just add a truly, truly awesome guy.
很多听播客的人都担心伦理、风险之类的问题。
A lot of people who listen to the pod are worried about the ethics and the risks and everything.
但说真的,如果你想找一个既讨人喜欢又值得信赖的人来攻克递归自我改进,理查德就是不二人选。
But boy, if you want a person to conquer recursive self improvement that you can like and trust, Richard is the man.
非常感谢。
Thank you so much.
能回到这里真是太好了。
So great to be back here.
我很喜欢你们那种建设性的乐观态度。
I love your guys constructive optimism.
这一集我有一个大胆的预测。
Have a bold prediction for this episode.
是什么?
What's that?
这一集将比我们录过的任何一集都更能证明我们整个播客的核心论点。
This one episode will prove our thesis for this whole podcast more than any other episode we ever record.
太棒了。
Awesome.
开始吧。
Let's go.
开始吧。
Let's go.
亚历克斯,你认识理查德吗?
Alex, do you know Richard?
理查德,我们俩聊过不少次了。
Richard, you and I have chatted quite a bit.
不过我觉得我们其实还没见过面。
I don't think we've actually ever met in person, though.
真的吗?
Really?
我们确实没见过。
We have not.
而且这是我们第一次一起录播客。
And it's the first time on a podcast together.
太棒了。
Amazing.
那我们就来创造历史吧。
It's Well, let's make history.
对,当然。
Yeah, for sure.
那么理查德,我们先从你的书开始聊吧。
So Richard, let's start with your book.
《尤里卡机器》的核心观点是,人工智能将在未来十年内带来一个世纪的科学突破。
The central claim of The Eureka Machine is that AI will deliver a century of scientific breakthroughs in the next decade.
你知道,这正好和亚历克斯和我在《解决一切》里写的内容对应上了,所以我们很看好这个预测。
You know, this maps directly onto what Alex and I wrote in Solve Everything, so we're fans of that prediction.
你在书中的论点是,科学过程的每一个阶段——假设、实验、数据、理论——都会被连接起来并同时发生转变。
Your thesis in the book is that every stage of scientific process gets connected and transformed simultaneously hypothesis experiment data theory.
你称之为“全栈人工智能”。
You call it the full stack AI.
你还说,科学进展已经放缓,而这并不是因为资金不足,而是因为碎片化。
You also say that scientific progress has slowed and that's been caused not by underfunding but by fragmentation.
那么,我们就从这两点开始吧。
So, let's start with those two items.
你能花点时间跟我们聊聊“全栈人工智能用于科学”吗?还有你为什么认为进展放缓了?
Could you take a moment and talk to us about Fullstack AI for Science, and why you think progress has slowed?
是的,进展放缓主要是因为我们有太多不同的子学科和学科,甚至Sonnet 5.3都意识到,哇,那……
Yeah, so progress has slowed largely because we have so many different sub discipline and disciplines, and even Sonnet 5.3 realized, like, wow, that...
比如,如果研究人员就那么多,而细分领域和利基方向又越来越碎片化,那你不可能只靠AI就能搞定一切,对吧?
Like, if there are only so many people, and we have more and more fragmentation of more and more sub disciplines and niches, like, you can not just do AI, right?
很多时候大家做的都是优化、梯度下降方法,还有二阶导数之类的算法,针对这些神经网络进行各种处理……
You're doing often like optimization and gradient descent methods and second order derivative methods and so on of these neural networks that is...
这其实就是AI的一个类别,诸如此类。
Which is one category of AI and so on.
再比如生物学,你学生物的话,要么专攻细胞生物学,要么专攻分子生物学;医学领域更是割裂得厉害,很难把这些东西串起来。这时候正好需要AI介入,帮我们把这些零散的板块重新整合起来,同时也能帮我们要搞清楚这些庞大复杂的系统到底是怎么运作的。
In the same string biology, you study biology, you're gonna be either a cell biologist or a molecular biologist, or you're like in medicine, there's so much separation that it's hard to weave it all together, and that is the perfect time for AI to come in and help us weave back together all these separate pieces and also help us understand how these large complex systems actually work.
比如,我们不能指望有一个模型,让人类把对自然语言的所有认知都列出来,然后把这些规则整合在一起,就能进行对话了。
Like, we can't have one model where humans say, here are all the things I know about natural language, And now, like, we can put all these rules together, and then we have a conversation.
这需要庞大的神经网络和海量数据的支持。
It required a large neural network with a ton of data.
你猜怎么着?
And guess what?
我们会获得大量生物领域的数据,从而能够不断拓展各个学科,将它们从传统上仅致力于理解自然界生物的自然科学,转变为可编程的工程科学。
We're gonna get a lot of data, about biology, and so we can make more and more disciplines and move them, transfer them from being traditionally natural sciences where we just try to understand biology in nature to being programmable engineering sciences.
我觉得,这正是未来众多令人兴奋的方面之一。
And that, I think, is one of the many different exciting aspects of things to come.
那你知道为什么我对现在正在发生的这一切感到如此兴奋吗?主要因素有哪些呢?
And, you know, why why am I so excited that that this is happening right now, and and what are the major ingredients?
基本上是因为我们现在有了以语言模型形式存在的世界知识。
It's essentially that we now have world knowledge in the form of LMs.
我们有越来越多的科学数据被数字化,可以在此基础上进行工作。
We have more and more scientific data that's getting digitized that we can sit on top of.
我们有越来越好的模拟工具,而且机器人流程自动化也即将成为可能。
We have better and better simulations of things, and we have robotic process automation that will soon be possible.
除此之外,我们还将拥有一个智能体集群,这就是如何……
And on top of that, we're gonna have an agent swarm, and that is how this...
整个科学流程可以实现自动化。
The full scientific stack can be automated.
亚历克斯?
Alex?
对,我得说我不同意。
Yeah, I can say I disagree.
就像彼得和你我在《解决一切》里写的那样,数学、科学和工程都已经搞定了。
As Peter, you and I wrote in solve everything, math, science, and engineering are cooked.
理查德,我很好奇你最新的时间表是什么。
I'm curious, Richard, what your latest timelines are.
我觉得每个领域都会达到越来越高的抽象层次。
I mean, think every field is going to get to higher and higher levels of abstraction.
计算机科学在这方面一直做得很好。
Computer science has been very good at that.
现在没人再用零和一编程了。
No one is programming in zeros and ones anymore.
没人……
No one...
比如,只有极少数人还需要懂C++、复杂的指针、内存架构这些。
Like, a very few people have to still know c plus plus and complex pointers and and memory architectures and so on.
计算机科学的抽象程度已经越来越高,基本上已经足够成熟,以至于可以用英语这种自然语言来操作计算机科学了,对吧?
We can get a large and large, computer science has basically abstracted enough so that it met the rest of humanity with English, right, and natural natural language that now can be used to do computer science.
所以我觉得这给了我很大的希望,相信其他领域也能达到类似的抽象水平,最终都能用自然语言来进行科学研究。
And so I think that gives me great hope that we can get other fields into similar stages of abstraction and then all meet and and natural language to do science.
不过我想确认一下,根据我对您那本书的理解,您的意思是物理科学还需要三到五年吗?
But to pin you down, as I recall from my understanding of your book, three to five years for the physical sciences?
你知道的,其实并没有一个明确的界限说到了某个点我们就彻底解决了所有物理科学的问题。
You know, like, there's no, like, single sort of this is the threshold and now we solved all of physical sciences.
不过,在接下来的十二个月里,会有多种不同的疾病被治愈。
But, like, multiple different diseases will get cured in the next twelve months.
这些可能是一些相对简单的疾病,比如只需要修复一个基因就能治好。
They're gonna be the simpler diseases maybe where there's one gene that needs to be fixed for that disease to be cured.
但实际上,单基因疾病在总体数量上非常多。
But there are a lot of single gene diseases that that are out there in aggregate.
所以这些病会被治愈,然后我们会逐步攻克更复杂的疾病。
Like, and so those diseases will get cured, and then we're gonna cure more and more complex diseases.
我们会开发出越来越好的电池材料。
We're gonna develop better and better battery material.
所以我不觉得会像设定一个单一门槛那样,比如三年后所有问题都解决了。实际情况是,我们会逐步解决越来越多的问题,关键就在于你愿意投入多少算力资源去攻克哪些难题。
So I wouldn't call it, like, one threshold and, like, in three years sort of everything is solved, but, like, we're gonna solve more and more problems, and it'll just be a question of how much money do you wanna put into compute to then solve which kinds of problems.
你现在是在跟理查德对话,你应该记得吧?他认为奇点本身可能只是一种视觉错觉,并不存在那种突然的跳跃式变化,而只是一个时间间隔的问题。
You're you're talking to the guy, Richard, remember, who argues that the singularity itself is something of an optical illusion, that there is no step function, it's just in time interval.
那我再试一次。
So I'll try once more.
时间线。
Timelines.
即使不是那种突然的跳跃,拐点什么时候会出现?
Even if it's not a step function, when is the inflection point?
在你看来,物理科学领域大概多久能达到一半的问题被解决?
When is the 50 crossed in your mind for all of the physical sciences getting solved?
人类疾病又是什么时候能基本攻克呢?
All human disease getting solved?
这些时间线在哪里?
Where are those timelines?
亚历克斯,如果我能在此基础上补充一点。
Alex, if I could just add a layer on top of that.
我们在这个话题上已经谈了很多,数学已经被解决了,对吧?
So we've talked on this part a lot that math is cooked, right?
我们看到千禧年大奖问题都在被攻克。
We're seeing millennium prizes all falling.
下一个自然的,如果你愿意这么说的话,可能就是物理学了。
And the next natural, if you would, barbecue is likely to be physics.
被烧掉?
Incineration?
对,被烧掉。
Incineration, yes.
计算机科学也可以说是,理查德,这大概也是递归的前提之一吧。
And computer science arguably, I mean presumably this is part of the premise, Richard, of Recursive as well.
计算机科学已经完蛋了,数学也彻底完蛋了,物理也一样。
Computer science already cooked, math thoroughly cooked physics.
说来也怪,我会用不同的比喻。
In a weird way, I would I I would use different metaphors.
我觉得它们是在蓬勃发展,而不是被淘汰。
I think they're flourishing, not getting cooked.
我觉得奇怪的是,你知道,有些数学家最近说,哦,这可能对这个领域不利,因为我们需要培养人才。
I think the weird thing is, you know, some some mathematicians recently said, oh, this is maybe bad for the field because, like, we need to train people.
是的。
Yes.
我们需要培养人才。
We need to train people.
但想象一下,一个生物学家或医学研究者说,哦,你知道,我们治好了人们所有的疾病,对这个领域来说真是件遗憾的事。
But imagine a biologist or or medical researcher saying, oh, you know, it's really a bummer for the field that we cured all these diseases for people.
那简直太荒谬了。
Like, that would be insane.
当然,你只想尽可能快地解决这些问题。
Of course, you wanna just move as quickly as you can towards solving these problems.
我觉得数学的问题可能在于,数学有很多分支……
I think maybe the problem of math is that there's many sub fields in...
这些分支其实一直……
Of math that haven't really had...
它们几乎纯粹是优美的智力练习,不再有现实影响了。
They were just almost purely beautiful intellectual exercises without real life impact anymore.
但当你接近现实影响时,你应该感到兴奋,并且意识到你的领域正在蓬勃发展,而不是被淘汰。
But as you get close to real life impact, you should be excited about it and you think and realize your field is flourishing, not being cooked.
所以说到时间线,我觉得疾病越复杂,你就越需要和人类进行长期研究,才能把某种药物用到人身上,这样延迟就会越多。
And so to timelines, I think the the further, the more complex a disease is, the more you have to do long term studies with humans before you're allowed to put a certain drug into humans, the more delays you will have.
但我们现在看到,举个例子,生物技术公司以前通常只有一个新药在研发,而且需要十年时间。
But, like, we see now companies, to make this very concrete, biotech companies used to have, like, one new drug in development, and it took them ten years.
他们必须在知道结果之前就上市……
They had to go public before they knew the comp...
药物真的有效。
The drug was really working.
然后过了十年,可能三期临床试验后期还是不行,公司就完了。
And then after ten years, maybe late stage three trials were just not working, and then the company is dead.
现在,新一代公司出现了。
Right now, you have the new age of companies.
他们两三年内就有五到十个不同的化合物进入三期临床试验。
They have five to 10 different compounds in stage three trials after two or three years.
所以我们看到那个层面有很多加速。
And so we see a lot of acceleration in that level.
但再说,疾病要真正大规模用于人体,在美国要获得FDA批准,自然会有一些延迟,大概需要五到十年。
But again, diseases to really be able to get them into humans at scale in The United States with FDA approvals, are just some natural delays that will be more like half a decade to a decade.
但化学、物理等其他很多领域,我们不需要看长期人体试验就能迭代,会更快。
But lots of other things in chemistry and physics and so on where we can iterate without having to look at long term human trials will be even faster.
而且我……
And I...
这个观点很有道理。
The the point is well taken.
我喜欢你那种奥威尔式的说法。
I I like your Orwellian turn of phrase.
也许我不应该说AI在烹饪数学,而应该用“繁荣”作为及物动词,直接说AI在繁荣数学。
Maybe instead of saying AI is cooking math, I should be using flourishing as a transitive verb and just say AI is flourishing math.
其实,前天晚上我和Srtach Karaman在一起,他负责MIT的LIDS实验室。
Actually, I was with Srtach Karaman, who runs LIDS at MIT the night before last.
他现在创办了一家无人机公司,一家AI无人机公司。
He started a drone company now, an AI drone company.
但LIDS是二战期间雷达最初发明的地方。
But LIDS is where radar was invented originally during World War II.
那是个很棒的实验室,非常有创业精神。
It's a great lab, very entrepreneurial.
但他说他在MIT的所有数学家朋友都知道他们完了,而且他们都...
But he said all his mathematician friends at MIT are aware that they're cooked, and they're all...
不不不,
No, no, no,
戴夫,我们现在要用奥威尔式的说法了。
Dave, we're going with the Orwellian language now.
他们不是被淘汰了,而是被赋能了。
They're not cooked, they're being flourished.
有意思,因为他确实说了“被淘汰”,但我回去会告诉他,跟你的朋友们说,你们正在被赋能。
That's funny, because he literally said cooked, but I'll go back to him and tell him, like, tell your friends they're flourishing.
告诉他们,你们都在,嗯,你正在
Tell them they're all as well you're
被赋能。
being flourished.
嘿。
Hey.
别担心。
Not to worry.
如果你的
If your
目标是尽可能多地证明定理,那现在就是抓住机会,尽量多解一些,然后借助AI来共同解决它们的时候。
goal was to prove as many theorems as possible in your lifetime, like, now is the time to just grab, like, grab as many as you can and and work with AI to solve them.
我觉得这样整个领域会发生改变,就像计算机科学在很多方面已经经历的变化一样。到时候会更看重创造力,尤其是当你真正理解数学中所有现有知识之后,能提出什么最有创意的想法。
And then I think the field will change the way computer science has changed in many ways, and it'll be much more about what's the most creative thing when you really understand all the things that are out there in math.
你能创造出什么样的新形式体系?又能构建出哪些新的结构,让这些问题在人与AI协作下变得值得去求解?
What kind of new formalisms can you create, new constructs can you create that then would be interesting to be solved by an AI in collaboration with humans?
刚才Sertosh提到,数学系的人状态不错,因为他们已经被‘煮’透了,全都转去做AI编排了,到时候肯定领先一大截。
Well, Sertosh was saying, the math guys are in great shape because they're so cooked that they're all moving over to AI orchestration, and they're gonna be way ahead of the curve.
他其实最担心的是生物学教授们,他们完全在否认现实,日常工作中几乎不用任何AI。
He's actually most worried about the biology professors who are in complete denial, using virtually no AI in their day to day activities.
这一点上,Richard,你在AI的各个方面都有很深的背景,包括生物领域。
And this is one area where, Richard, you have such a deep background in all facets of AI, including biology.
我觉得我们的生活轨迹简直一模一样,只不过你比我年轻十五岁。
And I feel like we're living exactly parallel lives, except you're fifteen years younger than me.
所以我真的超级嫉妒你的人生轨迹。
So I'm like insanely jealous of your life trajectory.
但你先是连续创业,然后创立了一个非常成功的风险基金,接着又创办了一家基础模型公司。
But be a serial entrepreneur, then start a hugely successful venture fund, then found a foundation model company.
而且,你知道,我们看世界的角度完全一样。
And and, you know, we're seeing the world through the exact same lens.
但你和彼得在生物学方面的背景要深厚得多。
But you and Peter have much more biology background.
我基本上一点都没有。
I I have basically none.
但生物学家们才是真正落后的那群人。
But the biologists are the ones really, really lagging.
而且我觉得你其实在这方面有不少投资,而且都做得很好,对吧?
And I I think you've got a bunch of investments actually that are that have done really well in the area, right?
我很想聊聊其中的一些,比如Peril Bio、Proxima Labs、Ignota Labs,这些公司真的非常令人兴奋。
And I would love to talk about some of those like Peril Bio, Proxima Labs, Ignota Labs, they're truly exciting companies.
我觉得还有一个领域比生物学更落后,那就是经济学。
I think another field that is even more lacking than biology is economics.
经济学现在用的还是那种线性模型。
Economics literally has these models of like a linear model of economics.
就是那种一步到位的经济模型,理论上税收和补贴都算得清清楚楚。
A one step economy that's provably correctly taxed and subsidized and things like that.
这个领域在利用AI制定更好的政策方面进展慢得离谱。
It's just like absurd how slow that field is to adopt AI for making better policy decisions.
我有点自己的想法。
I have some sort of ideology.
既然你提到这个,我们的好朋友埃里克·布林约尔松。
Because you opened the door, Eric Brynjolfsson, our very good friend.
我昨天才知道,斯坦福的HAI实验室发明了“基础模型”这个词。
I did not realize till yesterday that HAI Lab, Hai Lab at Stanford invented the word foundation model.
他——你之前就知道了吗?
He you sent me the knew that already?
哇。
Wow.
对,当然。
Yeah, of course.
是啊,斯坦福有很多朋友,比如梁珀西(Percy Liang)和其他人都做过基础模型的研究。
Like, yeah, lots of Stanford friends and Percy Liang and others worked on foundation models.
我很喜欢埃里克·布林约尔松(Eric Brynjolfsson)。
I love Eric Punjolfsson.
我觉得他其实是现在做研究最有意思的经济学家之一。
He's actually one of the most interesting economists, I think, doing really interesting research right now.
他还创立了 Work Helix,我们很自豪是它的投资人。这家公司能帮我们理解企业到底是怎么落地 AI 的,以及在真实场景中哪些任务真正得到了 AI 的帮助。
He also started Work Helix, which we're a proud investor in, that brings, like, understanding of how companies actually adopt AI and which tasks are getting, you know, helped by in real rollouts for companies.
对,他也是联合创始人之一。
Yeah, he's a co founder of that too.
是的,硅谷真是个特别好的地方。虽然你刚才说搞经济学的人普遍跟不上节奏,但他却远远领先于时代。
Yeah, building is just such a great place because you talk about econ people being way off the curve, but he is so ahead of the curve.
你一走进那栋楼,就能感受到那种氛围。
You walk into the building and you can just feel it.
他还在从MIT挖大量人才,让他们过来
He's also poaching a ton of talent from MIT to come out to
加入他的
join his
实验室。
lab.
接下来,Richard,谈谈你眼中的全栈AI,以及它在科学方法中的应用。
In on path, Richard, talk about full stack AI as you see it in the scientific method.
我投资了一家叫Lila的公司,来自MIT和哈佛。
I'm an investor in a company called Lila out of MIT and Harvard.
你也知道Lila Science。
You know Lila Science as well.
我想我已经介绍你认识那里的Jeff了。
I think I've introduced you to to Jeff there.
而且,你知道的,他们正在构建一种科学超级智能,然后在一个百万平方英尺的机器人空间里运行,把发现的速度提升大概一千倍。
And, you know, they're building a scientific superintelligence that is then running a million square foot of robotic space to sort of like a thousand x the rate of discovery.
你怎么看这件事?
Your thoughts on that?
我特别喜欢这个想法。
I absolutely love it.
我觉得这很棒。在《尤里卡机器》那本书里,我梳理了四大支柱,而像Periodic Labs这样的公司正是少数真正朝着这个方向努力的企业之一。
I think that is, you know, in The Eureka Machine, I sort of lay out these four pillars, and they're actually one of the few that that are really going after this similar to periodic labs.
我们现在更多是在物理和化学领域做这些,而且现在也有好几家公司,我希望能很快跟大家聊聊它们,它们正在努力创造更多的数据,让‘痛苦教训’(bitter lesson)也能应用在生物学上。我很喜欢像礼来制药(Eli Lilly)这样的大公司所做的工作,还有其他几家,包括Lila在内。
We're doing it more in the physics and chemistry side of things, and there are several other companies now that I can hopefully soon talk about that are trying to create more data for the bitter lesson to be applicable in biology, and I love what, you know, the big guys, Eli Lilly and others do, and and Lila too.
我觉得,你知道的,他们最终……
I think, you know, they ultimately...
其实我们可以把科学方法简化为:构思、实施和验证想法。如果我们能更快地完成这个闭环,然后在此基础上建立一个开放式的流程……
You can boil down the scientific method to the ideation, implementation, and validation of ideas, and the faster we can close that loop and then put an open ended process on top of it.
这就是‘开放性’带来的启发,也是我们在Recursive深受鼓舞的地方。在这个AI子领域里,我们聚集了许多世界上最顶尖的研究人员,尽管这个领域目前还没有达到它本应达到的热度。
That's what open endedness, what inspired us a lot at Recursive, and we have many of the world's greatest, like, researchers in that sub domain of AI that is still not quite as as popular as it could and should be.
就是说,你越能让一群智能体以开放式的方式去创新、去进化、去组合各种有趣的不同想法,效果就越好。
Like, the more you can have a swarm innovate in open ended ways and evolve and combine interestingly different ideas, the better.
但当然,在生物学领域,你必须有实际的、物理的、生物湿实验,所以看到Lila在做这件事真的很棒。
But then, of course, in biology, you have to have, like, actual, like, physical, biological wetware experiments, and so it's really great to see Lila doing that.
我们也看到这个……
We're seeing this also...
也许我可以聊聊一家我特别喜欢的公司,叫Peril Bio。
Maybe I can talk about this one company that I really love called Peril Bio.
他们在培养皿上构建微小的类器官。
They build tiny organoids on a petri dish.
你猜怎么着?
And get this.
如果你喜欢动物,你也会喜欢AI的。
If you love animals, you too can love AI.
为什么?
Why?
因为他们获得了FDA的批准,可以跳过动物试验。
Because they had FDA approval to skip animal trials.
事实证明,我们已经在老鼠身上治愈了大多数疾病。
Turns out we cured most diseases in mice.
但这其实没什么用。
It's not that helpful.
老鼠和人类差别太大了。
They're very different to people.
但这些家伙用多能干细胞在培养皿里培育出微小的淋巴结类器官。
But these guys use pluripotent stem cells to create tiny little organoids of lymph nodes.
淋巴结是免疫系统的重要组成部分。
Lymph nodes are big part of your immune system.
免疫疗法是最令人兴奋的疗法之一,它能让你的免疫系统自己去攻击癌细胞,而不是接受痛苦的化疗之类的。
Immunotherapy is some of the most exciting therapies to allow your own immune system to attack a cancer and so on instead of getting crazy chemotherapy and so on.
他们之所以获得FDA的批准,是因为他们证明,当你在这些微型培养皿中平行进行实验时,这些类器官对不同药物的反应和毒性测试等,实际上比传统方法更能预测这些药物在真实人体中的反应。
And so they got FDA approval because they showed that when you run experiments in parallel, hence parallel bio, in these tiny petri dishes, how those organoids react to different drugs and toxicity testing and so on, is actually more predictive of how those drugs will interact in real human bodies.
而这只是众多精彩例子中的一个。
And that is just one of many beautiful
我很喜欢这个例子。
examples I love that.
就是说,你可以拿我的干细胞,比如取我的皮肤,培养出iPSC细胞,然后培育出我自己的器官,看看某种药物对我个人效果如何,而不是对一般人的效果。
Where it will And you can take my stem cell, you can create, take my skin, create an iPSC cell, grow my own organs and see how a particular drug would work for me versus a generic individual.
萨利姆,你想说点什么吗?
Salim, wanna jump in?
我想说几点。
A couple of things.
首先,科学一直是个协调问题。
One is, you know, science has always been a coordination problem.
你就是在努力把……
You're kind of trying to bring...
而且科学一直都被划分成各个部门、期刊之类的,结构很固定。
And it's always been very structured into departments and and journals and all that stuff.
我很喜欢你正在做的这种整合工作。
And I love what you're doing bringing it together.
对我来说,如果要总结你似乎在做的事情,那就是你在缩短从实验到结果,或者从假设到结果的时间。
For me, if I had to summarize what you seem to be doing is you're collapsing the time between an experiment and a result or hypothesis and a result.
当你能缩短这个时间,那就是科学方法在领域上的压缩。
And when you can collapse that, that's domain collapse of the scientific method.
而一旦能做到这一点,我们就觉得一切皆有可能。
And now, we're like, anything is possible from there.
这太棒了。
This is amazing.
我想再就亚历克斯说的话追问一下。
I I am gonna push again on what what Alex said.
物理学,比如说,爱因斯坦的相对论提出的时候。
Physics, when do you, you know, know, Einstein's theory relativity comes out.
从那以后,其实进展不是很大,你知道,有很多理论。
There's not that much progress, you know, since then a lot of theories.
你觉得物理学是下一个在数学基础上蓬勃发展的领域吗?
Do you see physics as the next domain that's gonna flourish on the back of math?
我觉得最大的领域其实是生物学。
I think the biggest domain is actually going to be biology.
物理学在很多方面都停滞不前,挺有意思的。
Physics has been interestingly stuck in many ways.
比如,他们……
Like, they...
有一些非常强大的想法,比如E=mc²,你可以用很少的质量释放出巨大的能量,然后我们从中得到了核能。
There's just a really powerful ideas like e equals m c squared, so you can get a ton of energy out of potentially little mass, and then we got nuclear energy out of that.
所以这在一定程度上演变成了工程学科,这才是真正产生实际影响的地方。
And so that then moved graduated in some ways into an engineering discipline, which is where you have the real real life impact.
我觉得,显然,聚变能最终被攻克会很棒,而且有很多很酷的公司和大实验室,你知道,托卡马克装置已经能平衡里面的等离子体,这是一个非常难的控制问题……
I think, you know, obviously, like, fusion will be great to finally get figured out, and there's a lot of really cool, like, companies and and big labs and, know, you tokamak already to balance, like, plasma inside of tokamak, like, is a very hard control problem that...
人工智能正在被用在这里。
Where AI is being used.
我希望我们最终能对量子引力以及其他各种复杂问题提出更好的理论,并且能有……
I hope we can eventually make better theories for, you know, quantum gravity and all kinds of other complex issues and and have...
得到一个更好的世界公式。
Get a better world sort of formula.
我……
I...
不幸的是,如今的数据集收集往往需要大型氢对撞机,而且动辄就要几十亿美元,实际上相当昂贵。
Unfortunately, the dataset collections these days require often, like, a large hydrogen colliders and just, like, billions of dollars, and it's, like, quite expensive, actually.
所以从某种奇怪的角度来说,生物学更适合AI,因为微积分对物理学的作用,就像……
So in a weird way, biology is a better fit for AI because what calculus did for physics, like, really well micro in...
对个体化、分离的现象一样。
Individualized separated phenomena.
神经网络擅长把这些小东西结合起来。
Neural nets are great in combining all these little things.
比如,我们知道神经元是怎么运作的。
Like, we know what the neuron does.
我们知道微生物组里一个细菌的作用。
We know what one bacteria does in our microbiome.
但当它们聚在一起,形成这些非常复杂的相互作用时,我们就不再真正了解它是如何运作的了,所以这就是我认为会帮助我们更多的地方。
But then as they all come together and form these really complex interactions, we don't really know anymore how that works, and so that's where I I think will help us more.
亚历克斯?
Alex?
我们来聊聊生物学吧。
Let's talk about biology a bit.
那你觉得解决生物学问题的关键路径是通过细胞的数字孪生,还是你有完全不同的看法?
So do you think the critical path to solving biology goes through digital twins of cells, or do you have some wildly different theory of the case?
三年前我刚开始做Eureka Machine Book的时候,有一章专门讲虚拟细胞,我当时很自豪,想把所有内容都讲清楚,但后来我不得不重写那一整章,因为在那期间,马克·扎克伯格基金会启动了虚拟细胞项目。
Three years ago when I started, Eureka Machine Book, I had this chapter on the virtual cell, and I was really proud of, like, trying to lay it all out, and I had to rewrite that whole thing because in the meantime, you know, Mark Zuckerberg Foundation started virtual cell.
大家都在做这个。
Everyone's doing it.
所有人,不只是希。
Everyone, not just Xi.
每个人都有一个虚拟细胞模型。
Everyone has a virtual cell model.
戴夫,这就是我抱歉的原因。
Dave That's that's why I'm sorry.
即使戴夫不认为自己有虚拟细胞模型,我肯定他很快就会搞一个出来。
Even if Dave doesn't think Dave has a virtual cell model, I'm sure he'll spin one up soon.
所以
So
我觉得大多数……
I think that most...
有一篇著名的论文,是里奇·萨顿写的,讲的是AI中的苦涩教训。
So there's this famous, paper by Rich Sutton, on the bitter lesson in AI.
苦涩教训?快给我讲讲苦涩教训。
The bitter Tell lesson me all about the bitter lesson.
这是
This is
对我来说是个新概念。
a new concept for me.
什么什么
What what
这个想法怎么样?
does this use think of?
我不知道。
I don't know.
你可能在开玩笑,但也许有些读者没听说过。
You're probably joking, but probably maybe some some readers, haven't heard of it.
所以“苦涩的教训”基本上是说,人类专家有很多非常聪明的想法和漂亮的理论,但真正需要做的是简化……
So the bitter lesson is basically that human experts had all these really clever ideas and beautiful theories, but really what you needed to do was to simp...
比如,要取得真正的进展,就是你能想到的最简单的方法,一个可以端到端训练的大神经网络,作为通用函数逼近器。
Like, to make real progress is the simplest method that you can come up with, a large neural network that you can train end to end as a general function approximator.
你能想到的最简单的模型,然后就是大量的数据和计算来实际训练那个模型。
The simplest model you can come up with, and then it's just a ton of data and compute to, like, actually train that model.
而且在大规模应用时,这通常比人类专家之前想出的那些聪明的小技巧表现更好。
And that usually outperforms at scale all the clever little hacks that human experts had come up with before.
所以,苦涩的教训在十年前、二十年前的NLP领域就已经应验了。
And so the bitter lesson has worked for NLP ten, twenty years ago.
你问一个NLP专家,能不能有一个模型能跟你进行任何对话,回答任何类型的问题,做提示工程?
You would have asked an NLP expert, can you have one model to have any conversation with you, prompt of any kind of question, prompt engineering?
这个想法是早期GPT论文提出并广泛引用的。
Like, invented and was nicely cited by the early GPT papers.
但同样的情况,同样的状态,生物学现在也正处在其中。
But, like, the same thing, the same state, is biology is currently in.
有太多的复杂性,专家们知道得太多。
There are so many complexities, and the experts know so much.
他们觉得不可能把所有这些知识都灌输到一个模型里。
They feel like there's no way you can instill all of that knowledge into one model.
但如果你有足够的数据,你就能做到。
But if you have enough data, you can.
现在像Tahoe Therapeutics这样的公司正在开展大规模的扰动研究。
And now you have companies like Tahoe Therapeutics and so on that are creating these massive perturbation studies.
是的,所有模型都有缺陷,但随着我们收集越来越多的生物学数据,越来越多的模型会变得有用。
And, yes, all models are wrong, but more and more of them will be useful as we collect more and more data about biology.
我认为这是推动AI影响力的最大因素之一。
And that is, I think, one of the biggest driving factors for the impact of AI.
那么直接回答这个问题,你觉得虚拟细胞模型是解决所有疾病或破解生物学的关键路径,还是其他什么东西?
But so just to answer the question, do you think virtual cell models are the critical path to solving all disease or solving biology, or is it something else?
我觉得它们肯定会发挥关键作用。
I I think they're definitely going to play a crucial part.
这是“尤里卡机器”的第三根支柱。
It's the third pillar of the Eureka Machine.
我们确实需要能够模拟一切、验证一切。
We do need to have anything you can simulate, anything you can verify.
这样AI就能在那个领域解决问题了。
AI will then be able to solve things in that domain.
所以,是的,我确实认为虚拟模型和模拟非常重要。
And so, yes, I do think virtual models and simulations are extremely important.
这周我要讲三个有趣的突发新闻,两个关于科学,一个关于人工智能。
I'm gonna jump into three fun breaking stories this week, two on science and one on AI.
理查德,这些新闻都和你的工作以及你的书有关。
And Richard, they relate back to your work and your book.
我们的第一个故事今天发表在《麻省理工科技评论》上。
Our first story was published in MIT Tech Review today.
它讲述了以色列魏茨曼研究所的研究人员构建了一个名为Brain IT的系统。
It tells the story of researchers at Israel's Weissman Institute who built a system called Brain IT.
这个系统可以在功能性核磁共振成像仪中重建一个人正在观看的图像。
The system reconstructs the image a person is looking at while inside a functional MRI machine.
我这就把幻灯片放上来。
I'm just put up the slide here.
大家看看这张图片。
So take a look at this image.
你知道吗,这真的很了不起。
You know, it's pretty extraordinary.
一边是人在功能磁共振机器里看到的图像。
On one side is the image that a person is looking at inside the FMRI machine.
另一边是AI重建出来的图像。
On the other is the AI reconstruction.
你知道,以前的脑图像解码器能告诉你你在看狗或者钟楼,但会丢失颜色、构图和细节。
You know so earlier brain image decoders could tell you were looking at a dog or a clock tower but it lost the color, the composition and the details.
Brain IT分别学习结构和含义,然后再把图像拼回去。
Brain IT learns structure and meaning separately, and then puts the picture back together.
聪明的地方在这里。
And here's the clever part.
他们还能反向运行这个模型。
They also can run the model in reverse.
一个能预测大脑对图像反应的编码器。
An encoder that predicts how a brain will respond to an image.
展开剩余字幕(还有 480 条)
所以他们可以把人类从未见过的图像输入扫描仪,生成预测的脑部扫描结果,然后在这些数据上进行训练。
So they can feed it images no human has ever seen into the scanner, generate predicted brain scans, and then train on those.
这个模型实际上是在自己构建数据集。
The model effectively builds its own data set.
所以理查德,你在书里说,AI在任何一个可以模拟或验证的领域都超越人类,而在其他领域则不然。
So Richard, you know, you say in your book that AI is superhuman in any domain you can simulate or verify, and nowhere else.
那么大脑是可以模拟的吗?大脑是一个可以模拟的领域吗?
So is a brain simulatable, is the brain a simulatable domain?
还是说这有所不同?
Or is this something different?
目前还不行,但这仍然是一个令人难以置信的成果。
It's not yet, but this is still an incredible result.
我还记得第一个这样的成果出来的时候,我当时还在读博士。
I still remember the first such result came out when I was still a PHD student.
我去了斯坦福的生物信息学系,你知道,那时候我们只能从中提取出非常模糊的小图像,而现在看到这样的清晰度和真实感,真是太不可思议了。
I went over to the bioinformatics department at Stanford and they, know, it was like very grainy little images we could just like extract from this and to see this fidelity now and this realism is just incredible.
我觉得其中一个问题,我不确定这项研究的情况,我今天还没看到,我一直在忙工作,但通常的问题是你得为每个大脑单独训练模型,因为每个人的大脑都有细微差别。
I think one of the problems, I don't know if this study, I haven't seen it today yet, I've been at work, but like one of the problems is often that you have to train for each brain because they're all slightly different.
所以你不能直接把一个从没做过fMRI扫描的人的数据拿过来更新模型,那样对那个人来说就太完美了。这对昏迷患者特别有用,我们想知道他们是否还在思考,你知道的,那将是非常了不起的。
And so you won't be able to just take someone who's never put into an f m r I scanner to see and update the model for that particular person, which would be otherwise amazing for people who are like in a coma and you want to see are they still thinking stuff, you know, like that would be incredible.
Alex,给我们多讲讲今天这个故事吧。
Alex, tell us more about this about this story today.
这其实是三月发布的一项成果。
So this actually is a result from March.
所以,从功能性成像、脑电图或电极数据中解码大脑状态这一更广泛的领域,到现在已经有很长很长的历史了。
So this the broader field of doing decoding of brain states from functional imaging or EEG or electrodes, this has a long, long history at this point.
我记得二十多年前,加州大学伯克利分校的加兰特实验室就在做这件事,用来解码猫的视觉皮层。
I remember twenty plus years ago at this point, the Gallant lab at UC Berkeley was doing this to decode the visual cortex of cats.
其实二十多年前,我们就开始能看到猫感知世界的图像了。
Actually, like twenty plus years ago, we were starting to see images of how a cat perceives the world.
我记得最早出来的那些模糊图像,比如一只猫看到树枝的场景。
I remember like the first grainy images that were coming out were like a cat seeing a branch.
再往后快进到非侵入性的功能性磁共振成像,现在有很多团队在做这个。
And then moving fast forwarding to noninvasive fMRI, there are so many groups at this point.
特别是Meta,一直在资助这个领域的不少研究,比如Jean Marie King,还有很多其他团队在做语言解码、视觉解码。再往后,就在过去二十四小时里,Neuralink刚刚宣布了他们的首个规模定律研究,用Neuralink的电子数据来预训练基础模型和前沿模型。
Meta in particular has been sponsoring quite a bit of work in this area from Jean Marie King, many other groups doing language decoding, vision decoding, More recently, even fast forwarding to just the past twenty four hours, Neuralink just announced their first scaling law studies on pre training foundation models, frontier models, off of Neuralink electronic data.
而且这是在单个患者的基础上进行的,但他们捕获的数据量非常大,时间分辨率也很高,比功能性磁共振成像能捕捉到的高得多。
And this is on an individual patient basis, but they're capturing copious amounts of data at high temporal resolution, much higher than fMRI can capture.
功能性磁共振成像,打个比方,用现在的技术,最多能提供立方毫米级别的空间分辨率,时间分辨率大约是一秒。
FMRI, like rule of thumb, fMRI can give you with today's technology, at best cubic millimeter spatial resolution for voxels and at best approximately one second temporal resolution.
所以这在一定程度上限制了你在解码一个人内部视觉状态方面的能力。
So that somewhat limits how well you can do in terms of decoding a person's internal visual state.
不过别误会,还是有人在做这个的……
You can still make no mistake, there are folks who have...
他们几乎把解码梦境、解码一个人视觉皮层中感知到的或幻觉到的视觉内容,无论是睡着还是醒着,都做成了一门小生意。
Are making a cottage industry out of decoding dreams and decoding visually what a person perceives or what they hallucinate in their visual cortex while they're sleeping or while they're awake.
而且我相信,用大量的功能性磁共振成像数据来训练前沿模型和基础模型,这个领域一定会非常活跃。
And I'm sure this is going to be a vibrant, vibrant space training frontier models and foundation models off of copious amounts of fMRI data.
但归根结底,我觉得这必须得往前走,因为fMRI解码在空间和时间上都有局限。
But ultimately, where I think this has to go, there are spatial and temporal limits to fMRI decoding.
要达到我们真正想要的目标,也就是完全沉浸式的VR和全带宽的脑机接口,就需要更高的时间精度和空间精度。
It's going to require higher temporal precision and higher spatial precision to get where we really want to go, which is full dive VR and full bandwidth BCIs.
我们最终会做到的,但好消息是,总得有个起点。
And we will get there, but the good news is you have to start somewhere.
大型语言模型也得从GPT-1开始,那只是一个能预测亚马逊评论情感倾向的单一人工神经元。
The large language models had to start with GPT-one, just a single artificial neuron that could predict the polarity of Amazon reviews.
同样,如果我们想要实现全带宽脑机接口,就得从Brain IT、Jean Marie King和Jack Gallant这些研究起步。
Similarly here, if we're going to get full bandwidth BCIs, it's going to start with studies like Brain IT and Jean Marie King and Jack Gallant.
太棒了。
Amazing.
Salim,如果有一天你能知道别人的想法,那世界会变成什么样?
Salim, what happens in the world where you can know someone's thoughts?
嗯,我觉得你……
Well, I think you you...
我们得小心一点。
Let's be careful.
我们这里解码的是感知,而不是真正的思想。
We're decoding the perception here, not the actual thought.
那要复杂得多。
That's like quite a bit more complex.
区别。
Difference.
那是什么……
What's the...
除了大脑区域,还有别的吗?
Other than the brain region other than the brain region?
这是没有区别的可视化。
It's the visualization without a difference.
而且我知道那里……
And I know there...
我觉得还是有区别的。
I think there there is a difference.
嗯,不是的。
Well, no.
当你想象的时候,对吧,当你在脑海里想象某样东西,它激活的神经元和亲眼看到时是一样的。
When when you imagine, right, when you imagine something in your mind, it lights up the same neurons as when you're seeing them.
那……
That...
那没问题。
That's fine.
那……
That...
那没问题。
That's fine.
只是……
Just...
我只是想确保我们不要把这两者混为一谈,因为你可以有想法,而不一定伴随着相关的感知。
I just wanna make sure we don't mix the two because you can have thoughts without necessarily the perceptions around it.
但你完全可以有一个而没有另一个,或者反过来。
But you can definitely have one without the other and the other without the other.
所以,但对我来说,这里更有趣的是,你知道,我们已经花了数十亿小时在小小的矩形框里打字。
So, but I think for me, the more interesting thing here is, you know, we've spent billions of hours typing things into little rectangles.
如果我们能改变这种界面,采用更自然的界面,也就是直接与大脑交互,我们在奇点大学的神经科学讲座中经常讨论这个,就是,你知道,我们对大脑如何运作仍然知之甚少,但你不需要完全了解它。
And if we can change that interface to do a more natural interface, which is interface directly with the brain, we used to talk about this in our Singularity University lectures on neuroscience, is, you know, we still have very little idea how the brain works, but you don't need to have...
只要你能有效地与它交互,你不需要知道它是怎么运作的。
Know how it works as long as you can interface effectively with it.
而我认为,这给了我们一个机会,让我们拥有真正深入的界面,然后这也会帮助我们弄清楚大脑是如何运作的。
And this, I think, gives us the opening to give us really deep interfaces, and then that'll help us figure out how the how the brain works.
我会接受这个。
I'll I'll take the
你提出了一个非常...
You bring up a really...
哦,理查德,你先说。
Oh, go ahead, Richard.
抱歉。
Sorry.
你提了一个很好的观点,我之前看到过一个研究,说人分两种。
You bring up a really good point, which is that I I read this result a while back that there are two types of people.
有些人思考的时候,脑子里真的会形成句子。
Some people who think actually think in sentences.
而另一些人,他们思考的时候,脑子里只有一团模糊的想法,只有当他们被要求说出来或者试着写下来的时候,才会把这团模糊的想法整理成真正的句子。
And other people, when they think, they just have a fuzzy thought cloud, and only once they're asked to verbalize their thought or they try to write it down, they actually, like, make a real sentence out of their fuzzy thought clouds.
我绝对是那种脑子里只有模糊想法的人。
And I'm definitely a thought cloud thinker.
我妻子则完全是那种脑子里有句子的人。
My wife is very much a, like, sentence.
比如,她脑子里思考的时候,真的是用完整的句子在想。
Like, in her head, she actually thinks in actual sentences.
而且,没有说哪一种更聪明之类的。
And, like, there's no there's no, like, one is smarter than the other anything.
它们其实是差不多的。
There's, like, they're, like, equivalent.
但我觉得有时候,写作就是思考,对我来说,如果我真的要把某个想法说出来,而不是只是脑子里有个念头,那会非常有帮助。
But, like, I do think sometimes, like, writing is thinking and, like, for me, it is very helpful if I have to really verbalize something versus I just have the thought.
我就在想,如果眼睛真的能直接提取我的想法,那世界会是什么样子,现在我需要越来越多地把我的想法云结构化成句子,或者……
I'm just trying to think, like, what does the world look like if the eye could really just like extract my thoughts, now I need to like structure my thought clouds into sentences more and more Or
理查德,如果你把所有文字都从神经网络训练中去掉,完全不用语言,只训练纯图像和更高层次的思维结构,那训练出来的神经网络会非常不同。
Richard, what would neural net training look like if you took all text out of it, no language at all, just train on pure images and higher level thought constructs, you'd get a very different neural net out the other side.
而且它可能真的会更像你那样思考,而不是像你妻子那样,因为……
And it might actually think a lot more like you do, unless like your wife does, because
也许我们应该持这样的观点:任何没有内心独白的人,都只是行尸走肉。
maybe we should be taking the position that anyone who doesn't have an inner monologue is just a pee zombie.
我会……
I'll do...
我还得再加一点。
I gotta throw one more thing in.
我记得我们请过一位世界顶尖的语言学家来演讲,我们当时觉得,这年头当语言学家肯定不好过。
I remember we had one of the top linguists in the world come in and speak, and we were like, you know, this must be a bad time to be a linguist.
现在谁还讲究拼写、语法这些啊。
Nobody's using spelling or grammar or anything else like that.
他说,不是的。
And he goes, no.
恰恰相反,现在是语言学家最有意思的时代。
On the contrary, this is one of the most interesting times to be a linguist ever.
我们都很惊讶。
And we're like, wow.
为什么?
How come?
他说,因为你看表情符号,这是人类语言史上第一次,你可以用符号来传递情感,因为你可以用数字方式发送情感。
And he said, because when you look at emojis, it's the first time in the history of human language that you can symbolically send emotion because you can digitally send emotions.
我们当时就想,哇。
And we're like, wow.
这挺有意思的……
That's an interesting...
所以他对打开那个全新领域感到特别兴奋。
So he was super excited by opening up that whole aperture.
我觉得这挺有意思的,不过——
I thought it was an interesting Well,
你知道还有什么对你来说有意思的吗?
you know what else for you?
你是说,你是说,你是说表情符号是语言学这么……的原因?
You're saying you're saying you're saying that emojis are the reason why linguistics is so...
不是因为语言学本身已经蓬勃发展起来了。
Not the fact that linguistics itself has been flourished
我是说,我在这里把这一点跟你联系起来。
by I'm AI connecting at this to you.
是你干的。
You did that.
不,不是我。
No, it's not me.
戴夫?
Dave?
哦不,我真正期待的结果是,大脑如何在没有梯度下降的情况下自我训练?
Oh no, the result I really am looking forward to is how does the brain train itself without gradient descent?
现在人工智能领域发生的一切,过去二十年人工智能领域发生的一切,都是由梯度下降算法驱动的,而生物学家在真实的生物学中找不到任何类似的东西。
Everything going on in AI right now, everything going on for the last twenty years in AI is driven by gradient descent algorithms, and the biologists can't find anything even vaguely like that in actual biology.
所以,我认为通过非常详细的成像,我们可能最终破解这个密码:改变突触权重的基本学习算法是什么?
And so that's, I think with really detailed imaging, we might finally crack the code on what is the fundamental learning algorithm that changes the synaptic weights?
这不是我们用于人工神经网络的方法。
It's not what we use for artificial neural nets.
这是另一种不同的方法。
It's something different.
如果我们发现了这一点,我们可能会发现神经网络训练的效率能提高十倍、百倍、千倍甚至百万倍。
And if we discover that, we might find that neural net training can be 10, a 100, a thousand, a million times more efficient.
所以希望这个结果能尽快出来,也许在……
And so hopefully that'll come out Could within a
你能给听众解释一下什么是梯度下降吗?
you define gradient descent for our listeners?
挺有意思的,伊利亚·苏茨克弗在接受采访时常说,其实只有一个算法。
It's funny, Ilya Sutskever, when he's on interviews, he's like, there is only one algorithm.
这个算法就是梯度下降。
The algorithm is gradient descent.
跟它比起来,其他东西都无关紧要……
Everything else is just irrelevant compared to...
所以现在的做法是,你搭建一个有96层或者120层的深层神经网络,里面全是些毫无用处的随机连接,然后给它喂上几万亿个训练样本,比如一万五千亿条。
So what happens right now is you build these 96 or 120 layer deep neural nets, and all it is is a whole bunch of random connections that do absolutely nothing useful, and then you give it trillions, 15,000,000,000,000 training examples.
你就告诉它:看到这张图就输出那个词,或者看到这段文字,下一个字应该是啥。
You're like, when you see this, say that, or when you see this paragraph, this is the next token.
如果你猜错了,就会通过梯度下降受到惩罚。
And if you're guessing wrong, you get punished through gradient descent.
所以,误差,也就是你偏离正确答案的程度,就是你的惩罚,它会反向传播到所有层,计算出误差,然后责怪每个神经元或每条连接,问它们对这个糟糕的答案负有多大责任。
So the error, how far off you are, is your punishment, and it passes back through all the layers, and it calculates an error, and it blames each neuron or each connection for how responsible were you for this terrible answer.
如果你错得很离谱,你就会调整,朝着能帮你答对的方向移动。
And if you're way wrong, you get moved, and you move in the direction that helps you get the answer right.
所以这是一个极其费力的搜索过程,每个突触连接的移动就是一个梯度,你就像爬山一样,爬到最佳状态。
So it's this incredibly laborious search process, and that movement of each synaptic connection is a gradient, and you just hill climb to the best possible state.
然后神奇的是,在花费大约一亿美元的计算资源后,理查德的情况可能是四亿美元,它就开始通过这个单一的算法——梯度下降——进行思考了。
And then it magically, after about $100,000,000 of compute, in Richard's case, I guess 400,000,000, it magically starts thinking through this one algorithm, gradient descent.
我觉得我们说的其实是反向传播,而不是梯度下降,对吧?
Think it's really that back prop that we're talking about synecdochically rather than gradient descent would be the obvious So
也许吧,是的,反向传播,我想,就是那些梯度的高效计算方法。
maybe, yeah, back prop is, I guess, the efficient computation of those gradients.
我想在戴夫的解释上补充一点,梯度下降本质上是一种优化算法,我们用它来训练各种机器学习模型,通过最小化误差来实现。
Maybe I'll add to this explanation from Dave, but, like, gradient descent is essentially an optimization algorithm that we use to train all kinds of machine learning models by minimizing the errors.
我觉得最好的比喻就是,假设你是一个盲人登山者。
And I think the best analogy is to assume you're a blind hiker.
你在山顶上,想找到最低的那个点,但你看不了多远。
You're at the top of the mountain and you're trying to find the lowest the lowest point, and you can't really see that far.
你看不见,但你能感觉到每一步的坡度。
You're blind, but you can feel the slope at each step.
所以,当你感觉坡度大致朝正确的方向时,你应该往下迈多大的步子?
And so how much, like, how big of a step should you take down when you feel like the slope is going roughly in the right direction?
问题是,这些AI试图优化的地形往往是非常非凸的,也就是说,不是只有一个最低点,而是有很多不同的低点。
And then the problem is that the kinds of landscapes these AIs are trying to optimize are highly non convex, which means there's not just one lowest point, but there are many different low points.
如果你……
And if you...
取决于你从哪里开始,你可能会走进不同的山谷。
Depending on where you start, you might go into a different valley.
取决于你从哪座山开始,你会进入这个山谷,而不是那个不同的山谷。
Depending on which mountain you start, you go into this valley versus this this different valley.
其实有很多非常有趣的类比。
And there are actually a lot of really interesting analogies.
我朋友从心理学角度来思考这个问题。
My friend,, like, thinks about this from the psychological perspective.
比如,当你患有创伤后应激障碍并接受训练时,你会过度拟合一种算法,你的大脑就会困在某种思维方式的低谷里。
For instance, when you have PTSD and you train, you overfit to one algorithm, now your brain is kind of stuck in one valley of how to think about something.
有时候人们会使用迷幻药等物质,这些已被证明对抑郁、创伤后应激障碍和其他心理疾病有帮助。
And it takes sometimes people like doing psychedelics and stuff that have shown to to help help with, like, depression and PTSD and other mental diseases.
比如,它们……
Like, they they...
它们有助于提高学习率,跳过另一座山,进入另一个吸引谷,在那里你会有新的思维方式。
It helps to increase the learning rate to jump over another mountain and and go into a different valley of attraction where you then have new kinds of ways of thinking.
所以这个盲人徒步者的类比,我觉得非常直观,对。
And so this blind hiker analogy, I think, is a really intuitive way Mhmm.
用来思考这个问题。
To think about it.
当然,问题在于这不仅仅是三维空间。
And then, of course, the problem is it's not just in three d.
它是在万亿维的空间里,比如你要在这样一个地形中穿越上万亿个参数。
It's in a trillion d, like a trillion parameters that you're trying to traverse in that landscape.
不过思路大概是,试着找出方向,然后朝着那个方向迈出步伐。
But the ideas of, like, try to identify the direction and take steps towards
即便如此,这个方法依然有效。
it still works.
你知道还有什么更惊人的吗?
You know what else is really incredible?
我能就这个话题聊上几个小时。但你看像 Kimi K3 这样的大模型,它有 93 层,经过反复训练。如果你把其中一层随机打乱,然后再进行训练,让它找回原来的状态,它却做不到。
I could riff on this for hours, but if you look at a big model like Kimi K3, it's 93 layers, and it's train, train, train, train, If you take a single layer and you randomize it, and then you train it and say, find yourself again, it can't find itself again.
它永远无法回到最初的状态。这就像在做 fMRI(功能性磁共振成像)观察人脑时一样,比如你说:‘这是 Alex 的大脑,我能把它和 Salim 的对比一下吗?’
It never gets back to where it was, which comes back to in these fMRIs when you're looking at a human brain, and you're saying, okay, here's Alex's brain, can I compare that to Salim's?
你会发现,哇,这两者之间几乎没有任何共同点。当然,也许这是个不太恰当的例子,但你……
And you're like, wow, there's nothing in common going on here, yet, you know, well, okay, maybe that's a bad example, but you're
你就信这个吧,因为这大概率是对的。
You're gonna take that because it's it's probably right.
而且是很聪明的那种对法。
Smartly right.
毕竟呢
The way
你大脑在学习过程中形成的神经连接是独一无二的,但结果却可能得出‘咱们足球踢得一样好’这样的结论。
your brain wires as you learn is completely unique to you, yet it can come out with like, okay, we're equally good soccer players.
但信号在我们网络中传播的方式完全不同,而且对每个人来说都是独一无二的。
But the way the signals are propagating through our networks is completely different and unique to each of us.
这真的非常奇怪,它竟然无法找回自己原本的状态。
Which is really, really strange, that it can't find its own way back to its state.
我觉得随着fMRI数据的不断涌入,我们实际上会学到很多关于它是如何运作以及为何如此运作的知识。
I think we're gonna learn a lot, actually, with the fMRI data coming in, on how and why that works.
肯定存在一些共性,只是我们目前还没能找到而已。
And there have to be commonalities that we just can't find.
旋转会让一切看起来不一样,但其实差别没那么大。
Rotations make everything look different, but they're really not that different.
如果你用变换来看它们,比如傅里叶变换的视角,我们就会突然发现,天哪,原来它们是这样对齐的。
If you put them through a transform, like a Fourier transform view, we'll suddenly say, oh my God, this is why they line up.
前几天我还和我们兄弟会的兄弟戴夫在一起,他是南加州大学神经生物学系的主任。
I was just with my fraternity brother of ours, Dave, who's the head of neurobiology at USC the other day.
现在是脑科学最激动人心的时代。
And this is the most exciting time ever for brain science.
哦。
Oh
我是说,从人类诞生起,大脑就一直是个黑箱。
Mean, brain has been a black box since humanity began.
而我们理解大脑、应对精神疾病的能力,我觉得将会非常惊人。
And our ability to understand the brain and deal with mental disease, I think is gonna be extraordinary.
嗯,所以你可以模拟,这其实就是Liquid AI创立的初衷,因为我们完全逆向工程了C。
Well, so you can simulate, this is why Liquid AI was founded actually, because we completely reverse engineered the C.
把线虫的大脑完全逆向解析,每一个细节都搞清楚了。
Elegans worm brain down to exactly every single thing going on.
然后他们就能模拟它了。
And then they were able to simulate it.
模拟完之后,他们发现,等等,这其实是一个非常高效的神经网络。
And then after they simulated it, they realized, wait, this is a very efficient neural net.
然后他们把它产品化了。
And then they productized it.
我是说,这就是,所以他们两个都……你继续,理查德。
I mean, that's, so they both, so go ahead, Richard.
有件特别酷的事。
There's a really cool thing.
既然你提到了线虫。
Since you mentioned C.
很少有人会提到这个。
Elegans worms, there's not many people that bring that up.
我有个朋友,是哈佛的神经科学教授,叫Sam Gershman,他……
A friend of mine who's a professor of neuroscience at Harvard, Sam Gershman, he...
他是我见过的最聪明的人之一。
One of the most brilliant people I've ever met.
他做过一个实验,把虫子切成两半,然后其中一半……
Like, he actually did a study with with worms where he cut them in half, and one...
C.
C.
秀丽隐杆线虫确实有大脑。
Elegans worms, they do have a brain.
而且它们身体其他部分还有很多神经元。
And then they have a lot of other, like, neurons in the rest.
你可以训练它们对某种刺激做出反应,然后把它们切成两半。
Now you can train them to react to a certain stimuli, and then you split them in half.
没有大脑的那一半会重新长出一个新的大脑,而且,你听好了,这太疯狂了。
The the second half without the brain regrows a new brain, And here, get this, this is crazy.
那个新大脑竟然保留了同样的记忆,太神奇了。
That new brain has the same memories Wow.
而且还能对不同的刺激做出反应。
And react to different stimuli.
所以他就想,也许我们学习的方式还有别的可能。
And so he's like, maybe there's a different way where we learn.
我确实觉得,现在我们对学习的理解太局限于神经网络、电信号这些了。
And I do think there are things that right now we're very much stuck in this, like, it's a neural net, it's all electrical signals and so on.
但很明显,大脑的化学状态可以因为很多因素发生巨大变化,比如你饿了会烦躁,或者感到疼痛,或者摄入某种兴奋剂,大脑立刻就不一样了。
But clearly, like, brain chemistry can change massively with just, like, you can get hangry, you can be in pain, you can have, like, a certain, like, stimulant, and all of a sudden your brain is very different.
而且我觉得还有……
And I think there are...
我最近有了孩子,跟一些妈妈聊过,发现确实有些行为模式会突然出现,比如你生了孩子之后就会想筑巢,就像……
And I've seen this now with, like, having babies and and, like, talking to moms, like, there's certain algorithms where you all of sudden you nest, because you had a baby and now you want to, like...
虽然每个人筑巢的方式不同,但大家都会以某种形式去筑巢。
And how you nest is different, but people nest, you know, in one form or another.
所以,我们DNA里还藏着一些潜伏的机制,过了二十多岁就会突然触发。
And so there are these latent algorithms that we have that are in our DNA that just trigger after, like, twenty something years.
只要身体和生理机能刚好达到那个状态,这些机制就会被激活。
When just the right things then happen with your body and your biology.
我觉得我们还有很多东西没搞明白,大脑的复杂性远超我们的想象。
So I think there's still so much that we don't, we haven't put So much complexity.
接下来,我们聊聊三天前的另一个故事。
I'm gonna move us to our next story from three days ago.
所以周二的时候,总统签署了一项行政命令,要求环保署、内政部和农业部,还要跟卫生与公众服务部合作,把华盛顿特区的入侵蚊子数量砍掉至少90%。
So on Tuesday, the president signed an executive order directing the EPA, the Department of the Interior and Agriculture, working with HHS to cut invasive mosquito populations in Washington D.
也就是D.C.
C.
并且到2028年之前,把蜱虫的数量减少至少50%。
By at least 90% and the tick population by at least 50% by 2028.
这些目标主要针对的是会传播登革热、寨卡病毒和黄热病的蚊子种类。
The targets include mosquito species that spread dengue Zika and yellow fever.
这就是让我眼前一亮的地方。
And here's what caught my eye.
你知道吗,这个行政令明确优先采用不育昆虫技术、安全的基因改造和有益细菌,而不是传统杀虫剂。
You know, the order explicitly prioritizes sterile insect techniques, safe genetic modifications, and beneficial bacteria over conventional pesticides.
我太喜欢这个了。
I love that.
你知道吗,这正是Colossal这家灭绝物种公司正在做的基因驱动工作。
You know, this is the exact kind of gene drive work that colossal, the extinction company is doing.
你知道吗,我觉得大多数人没意识到,就像我养孩子的时候,会问他们一个问题,谁……
You know, I think most people don't realize it's like, you know, when I was raising my kids, would ask them a question, who...
哪种物种是地球上杀死人类最多的?
Which which is the species that kills the most humans on the planet?
你知道吗,有些人会说是鲨鱼。
You know, and some people jump onto sharks.
有些人会说是,你知道的,其他什么动物。
Some people jump onto, you know, whatever it might be.
不过在这点上,我相信大家都知道蚊子是地球上最致命的生物。
But on this part, I'm sure people know mosquitoes are the deadliest life form on Earth.
确实如此。
As far.
光是疟疾每年就能夺去五十万人的生命。
Malaria alone kills half a million people a year.
所以你看,亚历克斯,这标志着生物学作为一门工程学科,已经正式成为联邦政策的一部分了。
So Alex, this is biology as engineering arriving as federal policy.
你对这个故事有什么看法?
Your thoughts on this story.
几十年来,我们一直对自己的影子感到恐惧。
For decades we've been scared of our shadow.
我在麻省理工学院有个同学叫凯文·埃斯费尔特,他是基因驱动技术的先驱之一。他为了让各州和地方政府批准针对蚊子的基因驱动研究,真是费了不少劲,但那些不关注这方面的人根本不知道这有多难。
So I have a classmate Kevin Esfelt at MIT who was a pioneer of the gene drive, one of the pioneers, and he's had a devil of a time getting states, municipalities to approve gene drive studies against mosquitoes and for those not tracking.
这项技术的基本原理是利用CRISPR插入一种能够自我复制的基因,通过蚊子种群传播,从而让蚊子绝育。
The premise of this technique is basically inserting a gene via CRISPR that wants to replicate itself to basically sterilize mosquitoes through propagating virally through the mosquito population.
我们已经有这项技术了。
We have the technology to do this.
缺少的,至少在这个国家,是一项联邦指令来真正实施对非人类动物种群的大规模基因工程。
What it has lacked, at least in this country, is a federal mandate to actually go and implement large scale genetic engineering of non human animal populations.
而现在,看起来是第一次,我们通过行政命令看到了这样的指令。
And now, for the first time it seems, we're seeing via executive fiat just that mandate.
这令人兴奋,原因有二。
And it is so exciting for two reasons.
第一点,彼得你刚才提到疟疾和其他非人动物传播的疾病造成了巨大的人类痛苦,同时也给动物带来了巨大的痛苦。
One, because one is, Peter, you mentioned malaria and other non human animal borne diseases cause an enormous amount of suffering, human suffering and also non human animal suffering.
其次,因为现在有一种方法可以做到这一点,而且历史上我们并不需要直接杀死这些动物。
But secondly, because there's a way to do this that doesn't actually involve killing the animals themselves historically.
回想五十年前,如果你想应对昆虫传播的疾病,通常的做法就是喷洒化学药剂。
Historically, you know, you look back fifty years, you'd see chemical spraying if you wanted to do something about, say, insect borne illness responses.
我们现在不需要再那样做了。
We don't need to do that anymore.
我们其实可以保留那些无意中携带细菌或病毒的昆虫。
We can actually keep the insects that are the inadvertent carriers of bacterial or viral disease.
我们既能保护它们的生命,又能阻止疾病传播。
We can actually preserve their lives while also preventing the disease transmission.
我觉得这对它们来说也是好事。
And I think that's good from their perspective as well.
最让我兴奋的是,我们以前都是喷洒化学药剂。
That was the part that got me most excited was we spray things.
我们基本上是在毒害生物,而现在
We're basically poisoning biology, and now
我们转向真正的编程。
we shift to actually programming.
系统。
System.
然后抛弃有毒的生态系统。
And leave the poison ecosystem.
理查德,你对这个故事有什么看法?
Richard, your thoughts on this story?
我同意大家的观点。
I I concur with everyone.
这真是太棒了。
Like, it's it's it's wonderful.
而且非常有趣。
And it's so interesting.
比如说,人们……
Like, people...
我希望我们能更多地传播这类故事。
I I hope we can amplify these these kinds of stories more.
你知道吗?
You know?
未来需要更好的宣传。
Like, the future needs better marketing.
这个世界需要更多的彼得。
We need more Peters in the world.
这只是众多故事中的一个,你知道的,比如治愈各种疾病、利用合成生物学技术,拯救动物生命,防止它们仅仅被繁殖出来用于实验和解剖。
And and this is one of those many stories, you know, curing various diseases, peril bio, like, saving animal lives and and prevent them from just being bred, to be tested upon and dissected.
像这样的故事,我们真的需要在公众视野中更多地传播开来。
Like, those are all, like, stories we need to amplify more in the public eye.
戴夫,我迫不及待想看到这些从华盛顿特区扩展到佛蒙特州、马萨诸塞州以及全美各地。
Dave, I can't wait for this to come from DC to Vermont and Massachusetts and all of these
我想对听众们说,如果你对你们的房地产基金感兴趣的话,这个基金的主题是:通过无人机轻松抵达山顶和岛屿。
I was gonna say for the listeners that are interested in your real estate fund, which, you know, the theme there is, hey, easy access via drone to hilltops, islands.
但另一方面,如果你住在沼泽边缘,你的房子价格可能只有非沼泽地区同类房产的一半。
But also, if you live on the edge of a marsh, your house probably sells for about half the price of a place that's not on the edge of a marsh.
这种情况会消失的。
That'll go away.
现在有很多针对叮咬性昆虫的解决方案,这只是其中之一。所以如果那片土地本身非常美丽,只是以前很难居住,它的价值将会飙升。
There's so many solutions coming to biting insects, this being one of them, that that also is, you know, if it's beautiful, beautiful land that otherwise is very difficult to live on, it's gonna go through the roof in value.
我确实觉得,尽量让蜜蜂活着真的很重要,对吧,别乱喷一堆农药,确保鸟儿还有足够的虫子吃,诸如此类的事情,是的。
I do think it's really important to try to like, you know, keep the bees, like, alive, all right, and not spray a bunch of pesticides, make sure birds still have enough insects to eat and things like that, yeah.
我想说的是,可能长达八十年,人类一直对自己影子感到害怕。
I was going to say for maybe up to eighty years, humanity has been scared of its own shadow.
整个人类,特别是美国或西方,核能就是另一个例子,我在播客里也提过,我们可能因为太害怕炸弹或者裂变反应堆,白白失去了五十多年的进步。
Humanity in general, America or the West in particular, nuclear energy, another example I've pointed out on the pod where we arguably lost fifty plus years of progress because we were too scared of either the bomb or the fission reactors or some...
整整一代人看了《中国综合症》这部电影,然后就不必要地害怕核能了。
An entire generation watched the movie China Syndrome and then got scared of nuclear power unnecessarily.
这个也是一样的道理,或者地球工程,也是另一个例子。
Same idea with this or or with geoengineering, another example.
这个世界仍然在害怕。
The the world is still scared.
世界上有一部分人害怕改造天气。
Some fraction of the world is scared of engineering the weather.
我们不需要害怕改造我们的物理世界或生物世界。
We don't need to be scared of engineering our physical world or our biological world.
现在,希望人们能看到人类正在走出这种自我担忧阶段的曙光。
And now, hopefully, one can see green shoots of humanity getting past that stage of worrying about its own shadow.
这很有意思……
This is interesting that...
抱歉。
Sorry.
这真的很……
It's really...
确实有意思,有时候那些危言耸听的人觉得自己在做正确的事,就像在说,哎呀,情况能有多糟?
It's it's interesting indeed that, like, sometimes alarmists feel like they're doing the right thing by just, like, oh, how bad could it be?
我在提醒人们有坏事要发生。
I'm warning people of something bad.
但这确实可能让整个人类远离真正的好东西,比如核能带来的能源丰富。
But, like, it can indeed push all of humanity away from something really good, like energy abundance with nuclear.
我觉得人口过剩是另一个大误区,人们会说,如果人太多,各种资源就会短缺,一切都会变得更贵,人们会……
I think overpopulation is one of these other big myths where people are like, well, if we have too many people, there's gonna be scarcity of all these different resources, and everything's gonna get more expensive, and people are...
更多的是贫困之类的问题。
It's more in poverty and so on.
但实际情况恰恰相反。
And the exact opposite happened.
其实有一个网站,我觉得你们都会喜欢,叫 humanprogress.org 或者 .com,它展示了尽管人口更多,很多这些东西其实越来越便宜。
There's actually one website that I think you all would love, which called humanprogress.org or .com, like, that that shows that a lot of these things are actually getting cheaper and cheaper despite there being more people.
嘿,理查德。
Hey, Richard.
你在德国可是个英雄。
You're you're a hero in Germany.
在德国,你简直是个走在街上都会被认出来的英雄。
Like like, can't walk down the street kinda hero in Germany.
但你怎么看德国正是因为这个问题而缺电?
But what do you think about the fact that Germany has no power for exactly this reason?
这真的很遗憾。
It is really unfortunate.
如果德国有很多人想以一种奇怪的方式,从进步中退出来,认为所有消耗能源的东西都对环境有害,那么这种源自普遍善意环保理念的某种‘去增长’倾向,真的让我挺担心的。
If there are a lot of people in Germany that want to, in a weird way, sort of off ramp from progress, and they think that everything that consumes power is bad for the environment, there's, like, a weird sort of degrowth, offshoot from generally, like, well intentioned pro, like, environmental vibes that just worry me worry me quite a bit.
我们待会儿会聊聊末日论,但还没到时候。
We're gonna talk about doomerism in a little bit, but not yet.
你知道,我很久以前就意识到一件事:人类特别擅长预见未来会出现的问题,对吧?
And, you know, one of the things I realized a long time ago is we humans are really incredible at seeing a problem out in the future, right?
我们会看到酸雨、人口过剩、能源短缺等等各种情况。
We see acid rain, we see overpopulation, we see, you know, energy shortage, whatever it might be.
然后因为我们的杏仁核,因为我们思考的方式,我们把未来的问题提前到了今天,于是我们惊慌失措。
And then because of our amygdala, because of way we think, we accelerate that future problem to today, and we freak out.
我们忘记了这样一个事实:等到我们真正面对那个问题时,我们已经取得了十年的进步。
And we forget the fact that there is a decade worth of progress we're gonna make by the time we reach that problem.
这就是创业者做的事情。
And that's what entrepreneurs do.
他们不断地解决问题,一个接一个。
They solve problem after problem after problem.
我想让我们的听众听到这一点,因为如果你担心未来的某个问题,请理解,有一个极其高效的创业和资本主义市场,它会解决世界上最大的问题,也就是世界上最大的商业机会。
And I guess I just want our listeners to hear that because if you're worried about some future problem, please understand there's a incredibly efficient market of entrepreneurship and capitalism that will solve the world's biggest problems, world's biggest business opportunities.
而且我们有一个美好的、向前推进的解决方案体系。
And it's a beautiful forward, you know, forward propagation solution set that we have.
也许我们稍后会谈到这一点,但我在AI末日论中也看到了同样的情况,他们编造出越来越复杂的场景,攻击者拥有近乎神奇的攻击能力,但不知何故,故事中的防御者从来没有近乎神奇的防御能力,这很奇怪,比如,如果我能制造一种超级病毒,完美地无法检测,传播到全世界,没人注意到,然后……
And maybe we'll get there later, but I I see the same thing happen in AI doomerism, where they create more and more complex scenarios where attackers get these, like, near magical abilities to attack, but somehow the defenders in those stories never get near magical abilities to defend, and it's this weird thing of like, man, if I can create a super virus that is like perfectly undetectable and spreads all throughout the world and no one notices it, and like...
然后它还有一个WiFi开关,你只要打开和关闭它就能杀人,那我也会制造一种超级神奇的疫苗,能让你对所有这些东西免疫。
And then it has this WiFi switch and you just turn it on and off and then kill people, like, I I will create a super magical vaccine that just inoculates you against all of these things.
如果你真的能假设……
Like, if you can actually assume...
做出那个假设,那么,这很奇怪……
Make that assumption, then, like, it's a weird...
很奇怪。
Weird thing.
本期节目由Google for Startups赞助。
This episode is sponsored by Google for Startups.
大家不妨花点时间想想。
Think about this for a second.
现在,你能够使用那些训练成本高达数亿美元的生成式AI模型了。
You now have access to the same generative AI models that cost hundreds of millions of dollars to train.
Google为初创企业提供的生成式媒体技术指南,为你提供了在生产环境中部署Google DeepMind模型的完整方案。
Google's Startup Technical Guide for Generative Media gives you a complete blueprint for deploying Google DeepMind's models in production.
无论是图片、视频还是音频,全都涵盖在内。
Images, video, audio, all of it.
真正的架构,真正的成果。
Real architecture, real results.
链接在下面的节目简介里。
Find the link in the show notes below.
接下来我要讲一个最近二十四小时在网上闹得沸沸扬扬的故事。
I'm gonna move us to a story that's been sort of breaking the Internet over the last twenty four hours.
理查德,这正好拿来检验一下你那个关于监管应用的论点。
And it it puts your regulate the application argument to the test, Richard.
有一家叫Tavus的公司发布了Griffin,他们称这是第一个通过视频图灵测试的模型。
So a company called Tavus unveiled Griffin, which it calls the first model ever to pass the video Turing Test.
来看看这些数字。
So here's the numbers.
48%的人在实时面对面视频中与AI虚拟人交谈时,以为自己在和真人说话。
48% of people who talk to an AI avatar on a live face to face video thought they were talking to a real human.
之前的系统只有3%。
Previous systems were at 3%.
我在这里放一下视频,非常酷。
So let me show the video here, and it's super cool.
我们接下来聊聊这个。
And let's talk about it next.
现在,只竖个大拇指怎么样?
Now how about just a thumbs up?
当然可以。
Sure.
好的,马上给你竖个大拇指。
One thumbs up coming right up.
太棒了!
Hell yeah.
那真是太酷了。
That was awesome.
我得说,你是我最喜欢的同事。
I would say you're my favorite coworker.
能和你一起做这个项目,真的非常开心。
It's been it's been really great to work on this with you.
你让我都不好意思了。
You're making me blush.
那个穿着丑毛衣的人是谁?
Who's that with the ugly sweater?
西蒙说,摸摸你的头发。
Simon says touch your hair.
这是你要找的东西吗?
Is this what you're looking for?
好的。
Okay.
不错。
Nice.
西蒙说,指一下。
Simon says point.
好了。
Alright.
我正在做呢。
I'm doing it.
现在摸摸你的下巴。
Now touch your chin.
我才不会上当呢,你没说那个魔法词。
I'm not gonna fall for that, you didn't say the magic words.
被你抓到了,好吧。
You got me, okay.
把松动的连接器重新装回主板上。
The loose connector back onto the motherboard.
好的。
Okay.
让我去拿那个。
Let me go let me go grab that.
但在此之前……
But beforehand...
我已经把烙铁打开了。
I turned the soldering iron on.
我觉得大概需要十二秒,所以等它好了告诉我一声就行。
I think it's gonna take about twelve seconds, so maybe just let me know when that's done.
听起来不错。
Sounds good.
我会盯着它,一到十二秒就告诉你。
I'll keep an eye on it and let you know the second it hits that twelve second mark.
好的。
Alright.
真有意思。
So interesting.
Tavus 称它为第一个人类交互模型。
So Tavus calls it the first human interaction model.
它支持全双工,能同时听和说,就像人类真实交流那样。
It's fully duplex listening and talking at the same time that you do the way humans actually do.
它在 NVIDIA 的全双工 AI 视频基准测试中排名第一。
It's number one on NVIDIA's benchmark for full duplex AI video.
Tavus 把它宣传为“每个学生的导师,能发现他们走神;也是倾听的老年护理伴侣”。
Tavus pitches it as quote a tutor for every student that notices when they're lost an elder care companion that listens.
Tavus 自己说,Griffin 在公开发布前需要先做安全研究,因为它是第一个可能被误认为真人的模型。
Tavus itself says Griffin requires safety work before it can be released publicly because it's the first model that can be mistaken for a real person.
萨利姆,你对这个有什么看法?
Salim, your thoughts on this one.
其实我并没有被它的图像和模仿能力震撼到。
So I'm less kind of floored by the imagery and the the mimicry of it.
这是意料之中的事。
This was expected to happen.
对我来说,我更感兴趣的是它能不能完成一些足够有用的事情,让我不在乎它是不是人类。
For me, I'm more interested in can it accomplish something useful enough that I don't care whether it's human or not.
我觉得那更有意思,也许将来会出现这样的东西。
And I think that that is more interesting, which might come along and have...
总有一天会实现的。
Have that happen at some point.
我们之前讨论过,在不久的将来,比如现在,你会有数字同事出现在Zoom上,你可以打电话、发短信、用Slack联系他们,他们会和你互动。
We've talked about the idea that in the near future, like now, you're going to have digital coworkers that pop up on Zoom, that you call, that you text, you Slack, and interact with you.
我觉得作为未来虚拟公司的一种机制,这挺有吸引力的。
And I think it's pretty compelling as a mechanism for a future virtualized company.
亚历克斯?
Alex?
嗯,彼得,你首先应该让我摸一下我的脸。
Well, first Peter, you should probably ask me to touch my face.
好的。
Okay.
摸一下你的脸。
Touch your face.
西蒙说,摸一下你的脸。
Simon says touch your face.
很好。
Very good.
我只是确认一下,但我想塔瓦斯已经领先我了。
Just checking, but I I guess Tavus is ahead of me.
我觉得,一方面,如果你看看中国实验室,比如阿里巴巴实验室出来的模型,一个主播就让我们预览了将要发生的事情。
I I I think on the one hand, if you look at models coming out of Chinese labs like Alibaba's lab, one streamer gave us a preview of what was going to happen.
在生成式视频模型和交互式生成式视频模型方面,中国实验室的投资力度相对西方实验室来说还是更重一些。
The Chinese labs remain over invested relative to the Western labs in generative video models and interactive generative video models.
所以我觉得,那个流媒体演示算是展示了未来可能性的一个预览。
So one streamer, I think, is a preview of what's possible.
我猜我是看到了关于 Tavus 发布的一些信息。
My guess is I read the information that was put out around Tavus.
我觉得从整体情况来看,先……
I I think in full generality, let...
咱们来聊聊这事儿最终会走向何方。
Let's just talk about where this is going to end up.
短期内的情况很难预测。
It's it's very difficult to predict the short term.
但长期来看,其实挺容易预判的。
I think it's pretty easy to predict the long term.
长远来看,端到端的生成式像素技术会带来那种神奇的镜子效果——可以实时、完全互动,逐像素生成;或者像Anthropic希望的那样,按矢量或程序化生成。总之,就是完全由算法实时生成的互动视频模型。
In the long term, end to end generative pixels will have these magic mirrors that could be real time, fully interactive, pixel wise generated, or if if anthropic has its way, vector wise or procedurally generated, but either way, fully generated real time interactive video models.
而且你能够创建一个包含人物的场景,就像现在技术上已经可行,但延迟很高。
And you'll be able to create a scene that consists of people like it's possible right now, but the latency is high.
你看,像One Streamer这样的模型已经发布并且开源了,或者像Tavus Griffin这种还没真正发布、肯定也不开源的模型,你都能看到未来的雏形。
You see with one streamer, which is already out and already open source, or with this Tavus Griffin type model, which is not really out yet and definitely not open source, you see a preview of the future.
这看起来会是什么样子呢?
What does this look like?
嗯,有几种不同的可能性。
Well, there are a few different ways it can go.
要看看每个token能带来多少收入。
Query how revenue generating per token it is.
它是否接近内容生成的最佳性能边界?
Is it anywhere close to the optimal frontier of cogeneration?
恐怕不是。
Doubt it.
另一方面,如果生成任意场景变得极其便宜,比如生成参加Zoom会议的人或者参加播客的人,那我们真的在乎它是否接近最优性价比吗?
On the other hand, if it becomes so absurdly inexpensive to be able to generate arbitrary, say, humans participating in a Zoom meeting or humans participating in a podcast, do we really care whether it's close to being near the optimal cost performance frontier?
也许吧。
Maybe not.
有很多人类服务行业的岗位需要一张脸、需要互动、需要声音,还需要能随时按要求做出表情,这些工作很可能完全被一个模型自动化掉,而这个模型本来只能做文字交互,没有脸也没有声音。
There are a lot of human service industry jobs that require a face and require interactivity and a voice and the ability to touch one's face apparently on demand on on request that could be probably completely automated away by a model that otherwise would be limited to text based interaction but doesn't have a face and a voice.
所以在最乐观的情况下,这类交互式视频模型——顺便说一句,它的缩写,HIM,是Alex Finn先用的,很明显是在致敬那部电影《她》——
So in the most optimistic scenario, these sorts of interactive video models, open paren, note that the acronym for this, which by the way was there first with Alex Finn, him, h I m, is such an obvious reference to her, the the movie, close paren.
我觉得这这这
I I think that this this has
这这这你应该用破折号,拜托。
this has You should use you should use em dashes, please.
好的。
Okay.
我会深入讲讲。
I'll delve into it.
所以我觉得这会对服务业产生变革性的影响。
So I I I think I I I think this is going to be transformative for the service sector.
而且,希望Tavus以及美国西部更广泛的视频前沿模型和交互式视频前沿模型,能借鉴Tavus的做法,开始与中国竞争。
And, hopefully, Tavus and broader American west of video frontier models and interactive video frontier models, take a page from Tavus and start competing with China.
Richard,你书里的一个原则,你的一条规则是,当你能验证答案时,AI就变得超人类。
Richard, one of the principles in your book, one of the rules you have is that AI becomes superhuman where you can verify the answer.
你知道,像这样通过人类的科学里程碑,通过人类的判断和互动,是否足以作为一个科学里程碑来验证?
You know, is passing a human scientific milestone like this, is passing a human judgment and interaction sufficiently as a scientific milestone for verification?
不完全算。
Not quite.
有点像……
It's sort of like...
当需要人类介入来判断“这像不像人类,对面是不是另一个人”时,就很难规模化。
It's hard to scale when a human has to be in the loop to say, this is like a human, another person on the other side or not.
你没法完全自动化,并以那种自动化的方式去验证。
You can't quite automate it completely and verify it in in that automated fashion.
我确实觉得你说得对。
I do think you're you're right.
这是一个很好的例子,我觉得我们需要做到……
This is a good example where I think we need to do be...
超越KYC,做到KYU,也就是了解你的使用场景。
Go beyond KYC and do KYU know your use case.
比如说,你肯定不希望这项技术出现在Zoom里,假装是CEO,而且确实有一些著名的案例,已经发生过这种事,他们让人转了大概两千万美元。
Like, you don't want this technology to be in Zoom pretending to be the CEO, and, like, there's some famous stories where this has already happened where they got someone to wire, like, $20,000,000
当然。
Sure.
因为他们创建了一个包含五位高管的Zoom会议,而且他们都……
Because they created a Zoom of five other executives, and they all, like...
他被骗得够惨的。
He was fooled well enough.
所以我觉得我们需要小心,Zoom和Google Hangout可能得开始采取反制措施,来识别这是不是真人,诸如此类,防止这类黑客攻击发生。
And and so I think we need to, yeah, to be careful, and like Zoom probably and Google Hangout need to start, like, finding countermeasures to identify, is this a real person, and and things like that to prevent those kinds of hacks from happening.
是的,这类诈骗会越来越多。
Yeah, scams are going to proliferate on this.
我想再提醒一下大家。
I just want to do a call out again.
我之前在播客里说过,如果你还没听过,而且你的祖父母或父母还健在,你还没花时间录下他们的故事,用视频和音频,深入聊上几个小时。
I've said this before on the pod, and if you've not heard this before, if you still have your grandparents with you, or your parents, and you've not taken the time to record their stories on video and audio and go deep spend, you know hours recording them.
你能为你的孩子、孙子或曾孙创造一个超高清晰度、栩栩如生的虚拟形象,我觉得这太棒了,但你需要数据。
Your ability to create a super high resolution lifelike avatar for your kids or your grandkids or your great grandkids, I think is an incredible thing, but you need the data.
所以,如果你在听这个节目,而且你很幸运,父母或祖父母还在身边,那就去收集他们的数据吧,因为这对你的后代和他们来说,都是一个绝佳的机会。
So, if you're listening to this and you're lucky enough to have your parents or grandparents around collect their data, because it's going to be a beautiful opportunity your progeny and theirs.
另外,我还想补充一下,给他们办个LCOR会员,保存他们的连接组,如果有这个考虑的话。
And or I should add, get them an LCOR membership and preserve their connectome if there is a consideration.
何必只停留在行为数据呢?
Like, why stop with just the behavioral data?
把整个父母都保存下来。
Preserve the whole parent.
你知道,我的孩子们都在深度冷冻中,或者至少他们的胎盘细胞是这样。
You know, kids are my kids are in a deep freeze or at least their placental cells.
我对此有些保留意见,主要是基于刚才的讨论。
I have a pushback on that just from I have a pushback on that just from this conversation.
请讲。
Please.
如果从之前的故事里能读取人脑,那你要做的只是想象一下你祖母的样子,然后从中提取出来就行。
If from the earlier story we can read people's brains, all you have to do is picture an image of your grandmother and then extract it from that.
那精度会非常低。
It'll be low low fidelity.
我是说,从第一性原理来看,祖先模拟就是这样运作的。
I mean, do think like to to first order, this is how ancestor simulation will work.
你看,就在过去四十八小时里,到处都是人们用 Opus 5.5 或其他前沿模型重建历史片段的新闻。
You see stories left and right just in the past forty eight hours of people using Opus 5.5 or or other frontier models to reconstruct bits of history that would...
这些片段原本仅凭当时的文物是根本无法得知的。
Were otherwise unknown just based on artifacts of the day.
但到了某个阶段,我确实认为,Salim,你不仅仅想要这个人的记忆,你想要的是这个人本身。
But at some point, I I do think, Salim, you want to go beyond just the memory of the person and you want the actual person.
我还要再强调一下,除了彼得,你保存孩子的胎盘真是很慷慨,但未必是保存你的孩子。
And I'll pound the the drum again in addition to Peter, you know, very generous of you to preserve the placenta associated with your children, but not necessarily your children.
我相信胎盘会感谢你的。
I'm sure the placenta placenta I will will thank you.
但是我们……
But we...
请继续,彼得。
Go go ahead, Peter.
但我想说,是的。
But but I I I would say, like, yeah.
如果这真的是一个严肃的担忧,你担心你的父母或祖父母,并且你想超越仅仅拥有他们的录音或基于AI提示生成的祖先互动模型,那就去给他们办LCOR会员,让他们冷冻保存。
If if if this is a serious concern, you're worried about your parents or your grandparents and you want to go beyond just having recordings of them or AI prompted generative interaction models of your ancestors, go get them LCOR memberships and get them cryopreserved.
理查德,我真的很想问你一个问题。
Richard, really curious to ask you a question.
我们显然已经通过了图灵测试,萨利姆的反应就是我的反应。
We clearly passed the Turing Test, and Salim's reaction is my reaction.
我们刚才看到的,就是一个“那又怎样”的例子。如果你每天都在用这些模型,整天都在用,你知道你只需要把各个组件拼起来,然后你就有……
What we just saw is a so what if you've been using models every day, all day long, you know you just had to stitch together the components, and you have...
但我认为这会让主流世界看到,我们已经跨越了图灵测试。
But I think this will show mainstream world that we've crossed the Turing Test.
然后下一个里程碑就是德米斯·哈萨比斯测试,就是利用1910年之前的信息,重新发现E=mc²。
And then the next milestone is the Demas Hassabis Test, where using information from 1910 and prior, rediscovery equals MC squared.
所以你不能作弊,这真的很难衡量,因为作弊就是,你知道的,但如果不作弊,只用之前的信息,得出E=mc²。
So you can't cheat, which is a really tough one to measure, because cheating is, you know, but without cheating, only using prior information, come up with the equals MC squared.
那么,有没有一个理查德·索赫尔测试,是一个真正有趣、可衡量的里程碑,即将到来呢?
So is there a Richard Socher test that's like a really fun, measurable milestone coming?
我提出了一个反图灵测试,实际上我觉得整个图灵测试已经反转了,现在为了知道对面是不是人类,你反而会问一些难到人类根本答不出来的问题。
I came up with the like anti Turing Test, which actually I think the whole Turing Test has flipped, where now in order to know whether there's a human on the other side or not, you actually ask it questions that are so hard no human could ever answer it.
比如,你让AI给你写一个复杂的网页应用,然后十秒钟后,它给你返回了五万行代码。
Like, if you asked an AI to just write you a complex web app and, like, ten seconds later, it comes back with, like, 50,000 lines of code.
你知道的,你大概就知道那不是人类了。
You know, like, you kinda know it was not a human.
所以我觉得这个测试其实已经完全反过来了。
So I think that test has actually completely flipped.
你不觉得,理查德……
You you don't think, Richard...
我是说,比如你……
I mean, like, you...
它可以自我限制速度。
It could throttle itself.
那个很容易被破解,但就像那个篮子一样,现在就像……
That one's easy to defeat, but just like the basket It's just like now
其实就是关于伪装。
it's just about it's just about fakery.
它确实有点像……
It did like...
它之所以成为人工智能的智力测试,是因为要像人类一样聪明太难了。
The reason it was an intelligence test for artificial intelligence was that it was so hard to be as smart as a human.
现在你只需要把能力限制在人类水平就能通过测试,这让这个测试作为衡量智力的标准完全失去了意义。
Now you just have to throttle yourself down to human level in order to pass the test, makes the test useless as an inspiring test for intelligence.
对,我
Yeah, I
我觉得反直觉地看,最好的验证方法——当然这不是建议——就是问它一个跟生化核放射相关的问题,看看它能不能回答,以此来判断你是不是在和文字聊天机器人交互。
think perversely probably the best way to, like the best CAPTCHA for knowing whether you're interacting, this is not a recommendation, but best way to know whether you're interacting with a text based chatbot is probably to ask it a CBRN related question and see if it's capable of responding.
估计不行。
Probably not.
我再快速跟我们的听众强调一下。
Let me just hit real quick again for our listeners.
如果你怀孕了,或者家人有孕妇,记得把胎盘细胞存起来。
If you're pregnant or someone in your family is pregnant, you know, save their placental cells.
我投资组合里的一家公司叫Life Bank USA,就是做这个的。
One of my portfolio companies called Life Bank USA does this.
我就是在那儿存的孩子的胎盘。
That's where I saved my kids' placenta.
你知道吗,胎盘就像是制造婴儿的3D打印机,它含有干细胞、自然杀伤细胞、T细胞和外泌体。如果我的孩子将来需要任何生物增强或器官,你就有原始的启动盘,用个老词来说,就是你孩子DNA的备份。
You know, the placenta is the three d printer that manufactures the baby, and it has the stem cells, natural killer cells, T cells, exosomes, and it's like from those cells, if my kid should ever need any kind of biological enhancement or organs, you've got the original boot disk, to use an old term, for your kid's DNA.
所以这就是Life Bank USA。
So that's Life Bank USA.
只是……
Just...
我觉得这就像父母的一种道德义务,应该保存这些细胞作为备份。
I just think it's like a moral obligation parents should have to to save those cells as a backup.
作为你孩子的备份,你能用它来替换……
As a backup for your children, could you use it to replace
你的孩子,彼得?
your children, Peter?
当然可以,你绝对可以用它来克隆你的孩子。
You could you could use it to clone your children for sure.
现在他们知道你为什么存这些了。
And and now now they know why you're banking them.
没错。
Exactly.
一支年轻的迪亚曼迪斯大军。
An army an army of young Diamandis.
理查德,接下来我们聊聊你在Recursive正在做的核心事情。
Richard, let's jump next into the core of what you're building at Recursive.
也就是递归自我改进和超级智能。
Namely, Recursive, Self Improvement, and Superintelligence.
那,我先问几个关键问题来开场吧。
So, let me ask a few sort of key questions to kick this off.
首先,我们现在在RSI方面进展如何?
So first, where are we at the moment with RSI?
第二,你怎么定义ASI?
Number two, how do you define ASI?
这是个长期争论的话题。
It's been a long standing debate.
那么,我们离ASI还有多远?
And then, how far away are we from ASI?
你能回答这三个问题吗?
So, can you hit those three?
我觉得有……
So I think there's...
那我们现在在RSI方面进展如何?
So where are we at the moment with RSI?
这是……我们是不是……
This Are we
今年发生了一个重大转变,那就是AI现在能写代码了,对吧?
year something major shifted and that is AI can now code, Right?
这大大提升了它自我改进的能力。
And that is a major shift in the ability for it to change itself.
你知道,我们现在基本上可以充分利用AI本身就是代码、而且AI能写代码这个事实。
Know, like we now are able to essentially lean into the fact that AI is code and AI can't code.
所以这里就形成了一个可以闭环的循环。
So you have a loop that you can close there.
因此,在各种弱形式下,我们已经有了RSI。
And so in various weak forms, we already have RSI.
就连Anthropic和OpenAI在谈论时也常提到,比如看看我们的员工、工程师、程序员有多少人在用Codex或Claude来写代码。
And the weak forms that even Anthropic OpenAI talk about when they often talk about is like, look, how much our employees, our engineers, our programmers use codecs or Claude to create some code.
我认为这其实是递归自我改进的一种弱形式,因为人类仍然深度参与在这个循环里。
And I would argue that that is a weak form of Recursive self improvement because you still have, like, deeply embedded humans in that loop.
我们在Recursive公司做的事情,就是让人类只负责设定奖励、环境和目标,然后让AI完全掌控整个流程,包括构思、实施和验证想法,并让它拥有完全的控制权,从而让所谓的开放式算法、进化搜索算法,能够将不同的有趣想法结合起来,真正蓬勃发展。
And what we're working on at Recursive is to have humans only be involved in setting up the rewards and the environment and the goals, and then allow the eye to have the entirety of the process of ideation, implementation, and validation of ideas and have full control over that and allow for a so called open ended algorithms, evolutionary search algorithms that combine interestingly different ideas, to really flourish.
而且,嘿,这真的很不可思议,但我们已经有一些这样的形式在运行了。
And, hey, like, it's been incredible, but, like, we have, like, forms of that going already.
现在,现实中的瓶颈在于,你仍然需要大量的计算资源。
Now where the the the sort of physical reality hits is that you still need a lot of compute.
如果你想让RSI提出真正优秀的自我改进方案,你需要给它足够的计算能力,让它能够训练出更复杂的自身版本。
If you ask that RSI to come up with really great forms of itself, you need to give it a lot of compute to come up and be able to train very sophisticated versions of itself.
但明年这个就会起飞了。
But this is going to take off next year.
就是说,它……
Like, it's...
所以我们还没到那一步?
So we're not there yet?
我们还没完全到,但已经很接近了。
We're not quite there yet, but we're very close.
而且再说,在弱形式下,已经有一个了。
Like, and again, in weak forms, there's already one.
然后还有别的方式,人们会从不同角度来拆解它。
And then there are other ways that people slice and dice it.
我朋友杰森·韦斯顿,他还在Meta,他写过一篇相关的论文,你可以从不同的轴来思考自我改进的可学习维度,比如参数、训练数据、目标函数、神经架构,还有整体代码和框架等等。
My friend Jason Weston, who's still at Meta, he kind of wrote a paper around this where you can think about different axes, learnable axes of self improvement, the parameters, the training data, the objective function, the neural architecture, and the overall code and the harness and everything else.
而且还没有人真正破解这个难题,就是同时搞定这五个以上,真正想出该优化哪些维度和轴的想法。
And no one has really cracked the nut of doing all of these five plus, like, truly coming up with the ideas on which of these dimensions and axes to optimize for.
而且你可以知道这还没发生,因为所有大公司还在雇佣成千上万的工程师手动去做,
And you can know that that hasn't hasn't happened yet because all the big companies are still hiring thousands of engineers to do it manually to
在很大程度上。
a large degree.
而且越来越多地借助AI来实现。
And And more and more implementation help from an AI.
你对ASI的定义,因为我想让Salim听到这个。
Your definition of ASI, because I want Salim to hear this.
我认为人工超级智能至少要在多个不同能力上达到顶峰,但按照最宏大的定义,它不仅要超越像图灵测试那样的任意人类,还要超越全人类,解决任意困难的任务。
I think artificial superintelligence has to spike at the very least across several different capabilities, but in in the grandest definition of it, it should supersede not just arbitrary humans like a Turing Test, but all of humanity to solve arbitrarily hard tasks.
而且最终,我认为有10个不同的智能领域,我在You里面定义了这些。
And eventually, I would argue there are 10 different spaces of intelligence that I've defined in in the You.
E.
E.
G.
G.
还有机器方面的书。
Machine book too.
但最终,它不能只是机械地、完全按照指令行事。
But eventually, it cannot just purely robotically do exactly what it's told.
它应该具备某种能力,我并不是说像那种……
It should have some capability, and I'm not saying as sort of a more...
道德上的特权,但我想说的是,如果一件事物在某种程度上无法自主选择要处理的工作,那它就不能算作超级智能。
Moral prerogative, but, like, I would argue that something isn't super intelligent if it cannot choose to some degree what it works on.
而且它还得对自己的思考过程有一定的元认知。
And has to have some metacognition about its thought itself.
不过一般来说,衡量它最直观的方法就是看它在各种智能领域的能力表现,比如视觉感知、沟通、语言、社交互动等等,这些能力都要超越人类。
But generally, the most easy way to measure it is just capabilities across many different spaces of intelligence, like visual perception, communication, language, social interaction, and so on that is beyond that of humanity.
而我们离那个目标还远着呢。
And that we we are still far away.
埃隆的定义是:比所有人类加起来还要聪明。
Elon's definition is as smart as all humans combined.
关于 Bayt 播客
Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。