本集简介
双语字幕
仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。
关于人工智能,它让这个领域的人们变得既过于乌托邦,又过于末日论。
Something about AI that causes the people in the field, I would say, to become both excessively utopian and excessively apocalyptic.
话虽如此,我认为实际上发生的是,随着时间推移积累起了巨大的技术进步。
Having said that, I think what's actually happened is an enormous amount of technical progress that built up over time.
比如,我们现在知道神经网络是正确的架构。
And like for for example, we now know the neural network is the correct architecture.
我可以告诉你,这曾经是一个持续六十年,甚至七十年的争议期。
And I will tell you, like, was a sixty year run where that was like a, you know, or even seventy years where that was controversial.
所以,我对正在发生的事情的理解是,我们现在所处的时期,我称之为八十年一夜成名。
And so so the way I think about what's happening is basically, think I think about basically the the period we're in right now is it's I call it eighty year overnight success.
对吧?
Right?
这之所以被称为一夜成名,是因为突然之间,ChatGPT出现了,然后o1出现了,接着OpenClaw也出现了,这些都像是突如其来的、彻底变革性的成功,但它们背后依托的是长达八十年的思想积淀和积累。
Which is like, it's an overnight success because it's like bam, you know, ChatGPT hits and then o1 hits and then, you know, OpenClaw hits and like, you know, these are open these are these are like overnight, like radical overnight transformative successes, but they're drawing on an eighty year sort of Wellspring backlog, you know, of ideas and thinking.
这并不是说一切都是全新的。
It's not just that it's all brand new.
这是对数十年来极其严肃和深入研究的一次全面释放。
It's that it's an unlock of all of these decades of, like, very serious hardcore research.
如果我现在18岁,这正是我会全身心投入的领域。
If I were 18, like, this is a 100 this is what I would be spending all of my time on.
这是一次非凡的概念性突破。
This is, such an incredible conceptual breakthrough.
在进入今天的节目之前,我只想对听众说一小段话。
Before we get into today's episode, I just have a small message for listeners.
谢谢你们。
Thank you.
如果你们没有选择点击并收听我们的内容,我们就无法持续为大家带来你们如此渴望的AI工程、科学与娱乐内容。
We would not be able to bring you the AI engineering, science, and entertainment contents that you so clearly want if you didn't choose to also click in and tune into our content.
我们几乎每天都会收到赞助商的邀约,但幸运的是,足够多的听众订阅了我们,使得我们无需广告也能维持运营,我们希望继续保持这种方式。
We've been approached by sponsors on an almost daily basis, but fortunately, enough of you actually subscribed to us to keep all this sustainable without ads, and we wanna keep it that way.
但我只想请大家帮一个小忙。
But I just have one favor to ask all of you.
你能做的最强大、完全免费的事情就是点击订阅按钮。
The single most powerful, completely free thing you can do is to click that subscribe button.
这是我唯一会向你们提出的要求,它对我和我的团队来说意义非凡,我们每周都竭尽全力为大家带来Latent Space的内容。
It's the only thing I'll ever ask of you, and it means absolutely everything to me and my team that works so hard to bring latent space to you each and every week.
如果你这么做了,我向你保证,我们会不断努力让节目变得更好。
If you do it, I promise you, we'll never stop working to make the show even better.
现在,让我们开始吧。
Now let's get into it.
大家好,欢迎来到《太空文学》播客。
Everyone, welcome to the Lit in Space pockets.
我是Kernel Labs的创始人Alessio,今天和我一起的是《太空文学》的编辑swyx。
This is Alessio, founder of Kernel Labs, and I'm joined by swyx, editor of Lit in Space.
你好。
Hello.
我们现在在a16z与a在一起。
And we're in a16z with a.
马克·安德森,欢迎。
Marc Andreessen, welcome.
是的。
Yes.
是的。
Yes.
A 和什么?
A and what?
16 的一半?
Half of 16?
是那个一。
Of the one.
A 一。
A one.
没错。
Exactly.
没错。
Exactly.
显然,这将是您当前办公室的最后几天。
Apparently, this is the the final few days in your your current office.
你们要搬到马路对面。
You're moving across the road.
我们是的。
We're yeah.
我们有奥利维亚,所以有一些项目正在进行中。
We have Olivia, so we have some projects underway.
但没错,这实际上是原来的办公室,我们确实是在原来的办公室里。
But, yeah, this is actually, although this is the original we're in actually the original office.
我们在里面,我们在里面,我们在整个地方里面。
We're in the we're in we're in the we're in the whole thing.
太美了。
It's beautiful.
是的。
Yeah.
很好。
Great.
谢谢。
Thank you.
所以我得出来。
So I have to come out.
你知道的,我想选个热闹的开场。
This is a you know, I wanted to pick a spicy start.
2022年10月,我刚和Rune成为朋友,我想送他点能让他兴奋的东西。
In October 2022, I just made friends with Rune, and I wanted to give him something to sort of be spicy about.
我说过,a16z一直说未来是聪明人选择投入时间的地方,然后深入加密领域,却忽视了人工智能,这永远都不会不有趣。
And I said, it'll never not be funny that a16z was constantly going the future is where the smart people choose to spend their time and then going deep into crypto and not in AI.
那是2022年10月22日。
And that was in 10/22/2022.
鲁恩说,a16z内部召开过一次会议,重新聚焦生成式AI。
And Rune says there was an internal meeting in a16z to reorient around Gen AI.
当然有,但真的开过会吗?
Obviously, have, but was there a meeting?
那到底是什么情况?
What what was that?
我的意思是,我并不关注这些。
I mean, I don't look.
我从八十年代末就开始做人工智能了。
I've been doing AI since the late eighties.
是的。
Yeah.
所以,那些事我其实不太清楚。
So I I don't know, like, all that.
在我看来,这些东西都是后来才跟风的。
As far as I'm concerned, this stuff is all Johnny come lately.
是的。
Yeah.
你知道,我的意思是,看看,我们从一开始就一直在做人工智能。
You know, I mean, look, we've been doing AI our entire existence.
我的意思是,我们一直在做人工智能、机器学习、深度学习,你知道的,深度学习,我们从一开始就在做这些。
I mean, we've been doing AI machine learning deep you know, deep we've been doing this stuff way from the beginning.
显然,人工智能是计算机科学的核心。
Obviously, AI is just core to computer science.
我实际上认为它们是相当连续的。
I I I actually view them as like quite, quite continuous.
你知道,本和我都拥有计算机科学学位。
You know, Ben and I both have computer science degrees.
你知道,本和我都能清楚地记得20世纪80年代的人工智能热潮。
You know, we we both Ben and I actually both are well enough to remember the actual AI boom in the 1980s.
当时有一个大规模的人工智能热潮,还有一些像专家系统这样的名词,以及Lisp和Lisp机器。
There a big AI boom at the time and there was a just glimmer names like Expert Systems and they are of like Lisp and Lisp machines.
我用Lisp写过代码。
I coded at Lisp.
1989年我就在用Lisp编程,那时它是人工智能未来的语言。
Was coding in Lisp in 1989 when that was the language of the AI future.
是的。
Yeah.
所以这是我们完全熟悉、非常适应的事情。
So this is something that we're like completely, you know, completely comfortable with.
我一直都在做这件事,而且对此充满热情。
I've been doing the whole time and are very enthusiastic about.
这次有什么特别的不同吗?
Is there a strong like this time is different?
因为我觉得最接近的类比是2016到2017年。
Because my closest analog was twenty sixteen, seventeen.
那也是一次AI热潮,但很快就消退了。
It was also an AI boom And it petered out very, very quickly.
嗯
Well
这只是从投资的角度来说。
It's just it's just in terms of investing.
有点吧。
Sort of.
有点吧。
Sort of.
投资的热情。
Investment investment excitement.
不过那正是英伟达现象真正显现的时候,我认为那段时间很明显,当时的术语更多是机器学习。
Although that's really when the the NVIDIA phenomenon really it was I would say it was in that period when it was very clear that at the time, the vocabulary was more machine learning.
但那时很明显,机器学习正达到某种起飞点。
But it it was very clear at that time that machine learning was hitting some sort of takeoff point.
嗯,你们在你们的节目中已经深入讨论过这个问题了。
Well, as you guys you guys have talked about this at length on your on your thing.
但如果你真正追踪发生了什么,我认为真正的故事是,2013年左右AlexNet的突破。
But, know, if you really track what happened, I think the real story is it was it was the AlexNet, basically breakthrough in like 2013.
那才是真正的拐点。
That was the that was the real knee in the curve.
然后就是2017年Transformer的突破。
And then it was obviously the transformer breakthrough in '17.
是的。
Yeah.
之后的一切都是顺理成章。
And then everything that followed.
但你知道,看看机器学习,确实,我一直在做项目,从2004年起就和我的一个朋友在Facebook合作,2007年起就进入董事会。
But but, you know, look, machine learning, you know, there were, know, look I mean, look, I've been working, you know, I've been working with one of my, you know, kind of projects working with Facebook since 2004, and on the board since 2007.
当然,他们很早就开始使用机器学习了。
Of course, you know, they they started using machine learning very early.
而且,我基本上已经用了将近二十年,用于内容推荐优化、广告优化,显然还有许多金融服务业以及其他众多行业都在做这些。
And, you know, I've used it basically, know, for like twenty years for, you know, content, you know, feed optimization and advertising optimization and obviously many, financial services, many, many companies, many different sectors have been doing this.
所以这就像其中一件事。
So it's like one of these things.
它并不是单一的一件事。
It's like it's not a single thing.
它更像是层层叠加,对吧?
It's like layers, right?
这些层次以不同的速度出现,但它们逐渐累积。
And the layers arrive at different paces, but they kind of build up.
它们随着时间逐渐累积。
They kind of build up over time.
然后,回顾来看,2017年确实是Transformer的关键节点。
Then look, in retrospect, was 2017 was kind of the, you know, the key point with the transformer.
然后,正如你们所知,接下来出现了四年左右的奇怪时期,当时Transformer已经存在,但突然之间就变得——
Then as you guys know, was this really weird like four year period where it's like the transformer existed and then it was just like,
我们开始吧。
Let's go.
是的
Yeah.
但2017年到2021年之间,像谷歌这样的公司其实内部已经有聊天机器人了,只是不对外公开使用。
Well, but it was but between 2017 and 2021, I mean that was the era of which like companies like Google had internal chatbots but they weren't letting anybody use them.
是的
Yeah.
对吧?
Right?
然后OpenAI开发了ChatGPT,之后却说这太危险了,不能上线部署。
And then you know, then OpenAI developed ChatGPT two and then they told everybody this is way too dangerous to deploy.
对吧?
Right?
我们觉得,根本不可能让普通老百姓使用这个东西。
We're you know, we can't possibly let normal people normal people use this thing.
然后你们肯定还记得AI Dungeon。
And then you you guys, I'm sure, remember AI dungeon.
嗯。
Mhmm.
所以有一年,普通人想使用GPT-3,唯一的方式就是通过AI Dungeon。
So the for there was, like, a year where, like, the only way for a normal person to use GPT three was in in AI dungeon.
于是我们会进去,假装玩《龙与地下城》。
And so we would do this, you'd go in there and you'd pretend to play Dungeons and Dragons.
但实际上,你只是在尝试和GPT对话。
In reality, you're just trying to talk GPT.
所以当时有个很长的时期,大公司都很谨慎,大公司确实都很谨慎。
And so there was this long you know, big companies are cautious and the big companies were cautious.
顺便说一下,OpenAI自己也提到过这一点。
By the way, took OpenAI you know, they they talk about this.
OpenAI花了些时间才真正调整并重新引导他们的研究方向。
It took OpenAI time to actually adjust, you know, kind of redirect their research path.
我认为,那是在Rosewood。
I think, it was at Rosewood.
对吧?
Right?
他们创立OpenAI的那顿晚餐就在这里。
The the dinner they founded OpenAI was right there.
是的。
Right.
但那顿晚餐应该发生在2018年。
But that that dinner would have taken place in '20 '18.
2018年。
'18.
OpenAI的成立,嗯。
The formation of OpenAI Uh-huh.
直到2018年。
As late as 2018.
抱歉。
Sorry.
不。
No.
我错了。
I'm I'm I'm wrong.
可能是2020年。
Probably '20.
是的。
Yeah.
他们刚刚庆祝了十周年纪念,所以现在是2025年。
They just celebrated a ten year anniversary, so it it is 2025.
是的。
Yeah.
那可是2015年。
That's so 2015.
是的。
Yeah.
2015年。
2015.
是的。
Yeah.
2015年。
2015.
但后来,亚历克·拉多福德是在哪一年做的GPT-1?
But then, Alec Radford did GPT one in what?
大概是2017或2018年。
Probably 1718.
2017或2018年。
1718.
所以是的。
So it yeah.
然后呢,他们并没有真正……然后GPT-3是什么时候?
For the and then and then they didn't really and then GPT three was what?
2020年,二十
2020, twenty
二〇二〇年。
Twenty twenty.
那变成了协作者。
That became copilot.
2021年。
2021.
就连OpenAI,这个在过去十年里一直引领这一领域的机构,也不得不适应并拥抱新事物。
Even OpenAI, which has been, you know, the leader of this thing in the last decade, you know, even they had to adapt and lean into the new thing.
所以,是的,我认为这本质上是一个一波又一波、一层又一层不断累积的过程,然后你会遇到一些催化时刻,让整个体系突然爆发。
And so, yeah, I I think it's just this process of basically sort of wave after wave, layer after layer, you know, building on itself and then you kind of get these catalytic moments where where the whole thing pops.
而显然,现在正在发生这样的事。
And and, obviously, that's what's happening now.
思考一下是否会迎来AI寒冬,有帮助吗?
Is it useful to think about, will there be an AI winter?
因为总会有这样的模式。
Because there's always these patterns.
比如,这是永恒的夏天吗?
Like, is this endless summer?
我一直在思考这个问题,因为我是不是只会不断被 hype 激动,然后相信自己只会提前入场,永远不会错?
It's something I constantly think about because do I get do I just, like, just get endlessly hyped and just trust that I will only be early and never wrong?
还是会迎来寒冬?
Or will there be a winter?
所以这里有一件事是
So there's something about
说下面的话。
say the following.
AI 的一些特性导致了这种反复出现的模式。
There's something about AI that has led to this repeated pattern.
而且你们都知道这一点。
And and and and you guys know this.
是夏天,冬天,夏天,
It's summer, winter, summer,
夏天,冬天,夏天,冬天,这种模式已经持续了八十年。
Summer, winter, summer, winter, and it goes back eighty years.
是的。
Yeah.
八十年。
Eighty years.
所以最初的神经网络论文发表于1943年,对吧?这真是太惊人了,竟然那么早就有了。
So the original neural network paper was 1943, right, which is which is amazing that it was far back that long.
然后,我不知道你们在节目里有没有讨论过,1950年达特茅斯大学举办过一次AGI会议。
Then there was I don't you guys have ever talked about this on your show, but there was an AGI conference at Dartmouth University in 1950.
1955年。
'55.
1955年。
'55.
是的。
Yeah.
他们获得了美国国家科学基金会的资助,让当时所有的AI专家一起度过一个夏天,他们认为如果能在一起十周,就能实现通用人工智能。
And they got an NSF grant for all the AI experts at the time to spend the summer together, and they figured if they had ten weeks together, they could get AGI, of the other end.
他们确实拿到了资助,也有了十周时间,但到了1955年,你知道的,根本没有出现通用人工智能。
They got their by way, they got the grant, they got the ten weeks and then, you know, 1955, you know, no no AGI.
就像我说的,我亲身经历了八十年代的类似情况,当时有过一次大繁荣,随后又遭遇了崩溃。
And like I said, I I lived through the eighties version of this where there was a big a big boom and a crash.
所以,AI领域存在一种现象:我认为,这个领域的人往往会变得极度乐观,同时也极度悲观,这种倾向在繁荣与萧条的周期中都会表现得非常明显。
And so so there is this thing and there there is something about AI that causes people in the field, I would say, to become both excessively utopian and excessively apocalyptic and it's probably on both sides of like the boom bust cycle, you kind of see that play up.
话虽如此,我认为实际上发生的是——如今我们回过头来看,发现随着时间推移,已经积累了巨大的进步。
Having said that, I think what's actually happened is like just, you know, and we now know in retrospect, like an enormous amount of progress that built up over time.
例如,我们现在知道,神经网络才是正确的架构。
And for example, we now know that neural network is the correct architecture.
我可以告诉你,在长达六十年,甚至七十年的时间里,这个观点一直存在争议。
And I will tell you, there was a sixty year run where that was like a or even seventy years where that was controversial.
我们现在知道情况确实如此。
And we now know that that's the case.
因此,我们今天所构建的一切,都源自1943年的最初构想。
So everything we're building on today sort of derives from the original idea in 1943.
所以回顾来看,我们知道这些人的方向是对的,只是他们对时间的判断出了错,以为能力会更快到来,或者能更快商业化,诸如此类。
And so in retrospect, we now know that like these guys are right, you know, they would get the timing wrong and they thought, you know, capabilities would arrive faster or it could be turned into businesses sooner or whatever.
从根本上说,几十年来从事这项工作的科学家们,对他们的研究方向是完全正确的,而他们所有工作的回报如今正在显现。
Like they were fundamentally, the scientists who worked on this over the course of decades were fundamentally correct about what they were doing and payoff from all their work is happening now.
因此,我认为当前发生的事情,本质上可以称为‘八十年一夜成名’,对吧?
And so the way I think about what's happening is basically, think about basically the period we're in right now is it's I call it eighty year overnight success, right?
这之所以被称为一夜成名,是因为突然之间,ChatGPT出现了,然后o1出现了,接着OpenClaw也出现了,这些都像是突如其来的、颠覆性的成功,但它们背后是长达八十年积累下来的思想与理念的源泉。
Which is like, it's an overnight success because it's like bam, you know, ChatGPT hits and then o1 hits and then, you know, OpenClaw hits and like, you know, these are open these like overnight, like radical overnight transformative successes but they're drawing on an eighty year sort of Wellspring backlog, you know, of ideas and thinking.
这并不是说一切都全新的,而是这些数十年来严肃而深入的研究与思考终于被释放出来了。
It's not just that it's all brand new, it's that it's an unlock of all of these decades of like very serious hardcore research and thinking.
当然,曾经有一些人工智能研究者,用尽了自己的一生。
Look, there were AI researchers who spent their entire lives.
他们获得了博士学位,研究了四十年,然后退休了。
They got their PhD, they've researched for forty years, they retired.
在很多情况下,他们已经去世,却从未亲眼看到成果实现。
In a lot of cases, they passed away and they never actually saw it work.
真令人难过。
So sad.
很令人难过。
Is sad.
很令人难过。
Is sad.
杰克·欣顿是最后一位这样的人。
And Jack Hinton was like the last guy.
是的。
Yeah.
嗯,那些人是艾伦·纽厄尔。
Well, were guys Alan Newell.
意思是,约翰·麦卡锡这样的人多得是。
Mean, there's tons of John McCarthy.
约翰·麦卡锡是这个领域的奠基人之一。
John McCarthy was like one of the inventors of the field.
他是组织达特茅斯会议的人之一,曾在斯坦福大学任教四十年,十年前左右去世了,我也不太记得具体时间。
He's one the guys who organized the Dartmouth Conference and he taught at Stanford for forty years and passed away, I don't know whatever ten years ago or something.
但他从未亲眼看到这一切实现,不过回过头来看,真是令人惊叹。
Never actually got to see it happen but like it is amazing in retrospect.
这些家伙极其聪明,非常努力,而且他们的观点是正确的。
Like these guys were incredibly smart and they worked really hard and they were correct.
所以,总之,正如人们所说,历史不会重复,但会押韵。
So anyway, so then it's like okay, you know, as they say history doesn't repeat but it rhymes.
也就是说,会不会再出现另一个类似的大起大落周期呢?我可以告诉你,从某种意义上说,是的,一切都会经历周期,人们会过度兴奋,也会过度沮丧,这种模式是永恒的。
It's like okay, does that mean that there's going be another like you know, basically boom bust cycle and I will tell you like look, like in a sense like yes, everything goes through cycles and you know, people get overly enthusiastic and overly depressed and there's a timelessness to that.
话虽如此,这一点毫无疑问。
Having said that, there's just no question.
在投资中最有危险性的说法是,你知道投资中最危险的十二句话是什么吗?
The dangerous words in Do investing are is you know the 12 most dangerous words of investing?
不是。
No.
投资中最危险的一句话是:这次不一样。
The foremost dangerous words in investing are this time is different.
是的。
Yeah.
所以那十二句最危险的话。
So the 12 most dangerous words.
就像我说的,现在情况不同了,因为现在真的奏效了。
And so like, I tell you what's different like, now it's working.
我的意思是,毫无疑问,顺便说一下,我来分享一下我的看法:从ChatGPT问世到2025年,即使是有良好意图、信息充分的怀疑者,仍然可能说:这不过是模式匹配,这些系统其实并不真正理解自己在做什么,幻觉率太高了,它只适合用于创意写作,比如创作莎士比亚十四行诗、说唱歌词之类的,它在这些方面确实很出色,但我们不可能用它来真正应用于编程、医学、法律,或者那些真正重要的领域,感觉上就是如此。
Like there's just no I mean look, there's just no question and by the way, I'll just give you guys my take, like LLMs like from basically the ChatGPT moment through to '25, I think you could still, I think well intentioned, well informed skeptics could still say, oh, this is just pattern completion and oh, these things don't really understand what they're doing and you know, the hallucination rates are way too high and you know, this is going to be great for creative writing and creating, you know, Shakespearean sonnets and you know, as rap lyrics or whatever, it's gonna be great at all that stuff, we're not gonna be able to harness this to make this relevant in, you know, coding or in medicine or in law or in, you know, you know, kind of feels that, you know, kind of really, really matter.
我认为关键突破在于推理能力。
And I think basically it was the reasoning breakthrough.
是o one和r one回答了这个问题。
It was o one and then r one that basically answered that question.
基本上说,哦,不会吧。
Basically said, oh, no.
我们真的能把它变成能在现实世界中发挥作用的东西。
We're gonna be able to actually turn this into something that's gonna work in the real world.
然后,显然,在假期期间促成的编程突破是这一过程的第三步。
And and then, obviously, the coding breakthrough over the basically, the coding breakthrough that kinda catalyzed over the holiday break was kind of the third step in that.
但他却说,好吧。
But he's like, alright.
如果林纳斯·托瓦兹都说AI编程比他还要强,那这以前从未发生过。
If if, you know, if Linus Torvalds is saying that AI coding is not better than he is, like like that's that's never happened
以前从未有过。
before.
这才是衡量标准。
That's the benchmark count.
是的
Yeah.
这以前从未发生过,所以我们知道它将席卷编程领域,而既然它能在编程中奏效,那它在其他所有领域也都能奏效。
That's never happened before and so now we know that it's it's gonna sweep through coding and and then and then we we know, you know, we know that if it's gonna work in coding, it's gonna work in everything else.
对吧?
Right?
正因为如此,这在很多方面都是最难的例子,而现在其他所有领域都将以此为基础衍生出来。
It's just that then because that's that's like that's that's the hardest in many ways, that's the hardest example and now everything else is going be a derivative of that.
此外,我们刚刚获得了OpenClaw的代理突破,这太棒了,令人惊叹且极其强大。
And then on top of that, we just got the agent breakthrough with OpenClaw, which is fantastic, is amazing and incredibly powerful.
接着,我们又实现了自动研究和自我改进,现在我们进入了自我改进的突破阶段。
And then we just got the auto research, the self improvement, We're now into the self improvement breakthrough.
因此,我认为我们已经经历了四项根本性的功能突破:大语言模型、推理、代理,以及现在的RSI。
And so way I think about it is we've had four fundamental breakthroughs in functionality, LLMs, reasoning, agents and then now RSI.
而且它们全都真正发挥作用了。
And they're all actually working.
所以我只是觉得,你可以跳起来,我简直要跳起来了。
And so I'm just like, you can jump, I'm jumping out of my shoes.
就像这样,这就是了。
Like, this is like, this is it.
这确实是八十年来努力的巅峰,现在这一切终于成真了。
Like, this this is the culmination of eighty years worth of worth of work, this is the time it's becoming real.
是的。
Yeah.
我完全相信。
I'm completely convinced.
我认为人们感受到的焦虑,就像晶体管时代那样,当时有摩尔定律,大家明白为什么这些东西在不断变好。
I think the anxiety that people feel is like during the transistor era, you had Moore's Law, and it's like, alright, we understand why these things are getting better.
我们理解其中的物理原理。
We understand the physics of it.
对。
Yeah.
对于AI来说,它的进步非常跳跃,像是突然间的飞跃。
With AI, it's it's so jagged in, like, the jumps.
就像你所说的,三个月内就出现巨大的突破,人们会想,这种事还能继续发生。
Where like like you said, it's like, in three months, you have, like, this huge jump, like and people are like, well, this can keep happening.
对吧?
Right?
但这种事真的还在继续发生。
But then it keeps happening.
它还会继续发生。
It will keep happening.
那么,你如何看待哪些东西值得投入时间去构建的时间线呢?
And so, like, how do you think about also timelines of, like, what's worth building?
我们每次和嘉宾讨论时都会遇到这个问题:你该花时间去构建当前模型的坚固性,还是等着下一个模型直接在潜在空间里一步到位?
I think we always have this question with guests, which is, like, you know, should you spend time building hardness for a model versus, like, the next model just gonna do it one shot in the latent space?
对。
Right.
这如何影响你对技术形态的思考?
And how does that inform, like, how you think about the shape of the technology?
你提到这是一个新的计算平台。
You know, you talk about how it's a new computing platform.
如果这是一个计算平台,那么每六个月,它的形态都会发生巨大变化。
If you have a computing platform, then, like, every six months, it, like, drastically changes in what it looks like.
在它之上建立公司很难。
It's hard to build companies on top of it.
是的。
Yeah.
所以有几点要说。
So so a couple things.
首先,你看。
So one is, look.
摩尔定律其实就是我们现在所说的扩展定律。
The the Moore's Law was what we now call a scaling law.
就像摩尔定律是一种扩展定律。
Like, Moore's Law was a scaling law.
对于年轻观众来说,摩尔定律指的是每18个月,芯片的性能就会翻倍,或者成本降低一半。
And for your younger viewers, Moore Moore's Law was every chip chips either get twice as powerful or twice as cheap every every 18 months.
而且在过去几年里,情况变得更加复杂,但这就是计算机行业五十年来的整体发展趋势。
And that and that and then, know, that it's gotten more complicated in the last few years, but, like, that that was, like, the fifty year trajectory of of of the computer industry.
顺便说一句,正是这种趋势,让价值2500万美元的大型计算机,变成了你口袋里那部性能高出百万倍、仅售500美元的手机。
And then and then by the way, and that's what took the mainframe computer from a $25,000,000 current dollar thing into, you know, the phone in your pocket being, know, a million times more powerful than that, like that, you know, for for $500.
所以,这确实是一种扩展定律。
And so that that was a scaling law.
而任何扩展定律的关键——包括摩尔定律和AI的扩展定律——其实它们并不是真正的定律,对吧?
And then and then and then key to any scaling law, including Moore's Law and the AI scaling laws is, you know, they're not really laws, right?
它们是预测,但当这些预测成真时,就会变成自我实现的预言,因为它们设定了一个基准,整个行业、所有聪明的人都会努力确保它真的实现,从而推动了维持这一趋势所需的突破性进展。在芯片领域,这种趋势持续了五十年,对吧?
They're predictions but when they work, they become self fulfilling predictions because they set a benchmark and then the entire industry, right, all the smart people in the industry kind of work to make sure that that actually happens And so they kind of motivate the breakthroughs that are required to keep that going and in chips, that was a fifty year that was a fifty year run, right?
这非常了不起,而且在某些芯片领域,这种趋势至今仍在继续。
And it was amazing and it's still happening in some areas of chips.
我认为同样的事情正在AI的核心扩展定律上发生。
I think the same thing is happening with the core scaling laws, the core scaling laws in AI.
你知道,它们其实不是真正的定律,但更像是预测,而这些预测又成为推动所需研究工作乃至投资资金的催化剂,以维持这些增长曲线的持续发展。
You know, they're not really laws but like they are basically their predictions and then they're motivating catalysts for the research work that is required to be and by the way also the investment dollars, you know, required to basically keep the curves going.
当然,这会变得复杂且多变,会有一些障碍看似即将来临,但工程师们会投入工作,找到突破这些障碍的方法。
And look, it's going to be complicated and it's going to be variable and there, you know, there are going to be walls that are going to look like they're fast approaching and then they're going to be, you know, engineers are going get to work and they're going to figure out a way to punch through the walls.
显然,这种情况已经发生过很多次了。
And obviously that's, you know, that's been happening a lot.
而且,有时候看起来这些定律似乎已经放缓了,但随后又会重新加速并迎来爆发。
You know, and then look, there's going be times when it looks like the have know, the laws have petered out and then they're going to pick up again and surge.
然后,看起来AI现在有了多个扩展定律。
Then it appears what's happened to the eye is there's now multiple scaling laws.
有多个改进领域,我认为目前可能已经发现了若干个,但可能还有更多我们尚未发现的。
There's multiple areas of improvement and I think, I don't know how many more there are already yet discovered but there are probably some more that we don't know about yet.
例如,可能还存在一个关于世界模型和机器人技术的扩展定律,涉及在现实世界中大规模获取数据,而我们目前尚未完全理解。
For example, there's probably some scaling law around world models and robotics that we don't fully kind of acquisition of data at scale in the real world that we don't fully understand yet.
这个定律可能会在某个时候开始发挥作用。
That one will probably kick in at some point here.
有很多非常聪明的人正在研究这个问题。
There's a bunch of really smart people working on that.
所以,我认为人们的预期是,扩展定律总体上将继续发挥作用。
And so yeah, I think the expectation is that the scaling laws generally are going to continue.
是的,进步的速度将继续非常迅速。
Yeah, the pace of improvement will continue to move really fast.
关于你问该构建什么,我完全相信扩展定律将继续,我完全相信AI的能力将继续取得惊人的飞跃。
To your question on like what to build, so I'm a complete believer that the scaling laws are going to continue, I'm a complete believer the capabilities are going to keep getting amazing, you know, leaps and bounds.
在这一点上,我和所谓的AI纯粹主义者有些分歧,我会把他们描述为这个领域中最聪明的一群人,但他们一生都待在实验室里,几乎没有任何外部世界的经验。
The part where I kind of part ways a little bit with what I would describe as the AI purists, you know, which I would characterize as like the people who are many ways the smartest people in the field, but also the people who spend their entire life like at a lab, and have to have I would say have very little experience in the outside world.
我想补充的细微差别是,由80亿人、机构、政府、公司以及经济和社会系统构成的外部世界极其复杂。
The the nuance I would offer is the outside world of 8,000,000,000 people and institutions and governments and companies and economic systems and social systems is really complicated.
要知道,地球上80亿人做出集体决策的过程,并不像你现在看到的那样简单。
Doesn't know, it it 8,000,000,000 people making collective decisions on planet Earth is not a simple process of like just like you see this happening now.
很多AI公司的首席执行官都有这么一种观点,就是社会过去总是做某些事情,而现在他们公开谈论时,总觉得社会不再做这些事了。
It's like a bunch of the AI CEOs have this thing, which is just like, well, there's just this they just all have this kind of thing when they talk in public where they're just like, well, there's this obvious set of things that society used to do.
嗯。
Mhmm.
然后他们就说,社会现在连这些事都不做了。
And then they're like, society is not doing any of those things.
对吧?
Right?
可问题是,社会为什么看不到他们理论中的那些显而易见的事情呢?
And it's like, how can society not you know, whatever their theory is, how can society not see x y z?
答案是,首先,根本不存在单一的社会。
And the answer is, well, society is number one, there's no single society.
这里有80亿人,每个人都有发言权,最终如何应对变化,每个人都有一票,而人类现实就是如此复杂而混乱。
It's like 8,000,000,000 people and they like all have a voice and they all have a vote like at the end of the day of how they react to change and then you know, it just like it's just human reality is just really complicated and messy.
所以,针对你这个问题的具体回答是,和往常一样,视情况而定。
And so the specific answer to your question is like, as usual, it depends.
你知道,这要看情况。
You know, it depends.
听好了,毫无疑问人们会喜欢,毫无疑问会有公司出现,这已经在发生了。
Look, there's no question people are going to like, there's no question there are going be companies, it's already happening.
有些公司认为自己是在模型之上构建价值,但它们会被下一个模型彻底击垮。
There are companies that think that they're building value on top of the models and they're just going get blitzed by the next model.
这毫无疑问正在发生。
There's no question that's happening.
但我认为,毫无疑问的是,任何技术融入人类真实而混乱的世界,其适应过程都将是混乱而复杂的。
But I think there's no question also that just the process of adaptation of any technology into the real messy world of humanity is just going to be messy and complicated.
这不会简单直接。
It's not going to be simple and straightforward.
它将会是混乱而复杂的。
It's going be messy and complicated.
将会有很多公司和很多产品,甚至整个行业,将被建立起来,真正帮助这些技术触及普通人群。
And there are going be a lot of companies and a lot of products and in fact, entire industries that are going to get built to basically actually help all of this technology actually reach real people.
这些公司投入的资金规模,我的意思是,Dario在DoorDash播客上谈过,DoorDash还说,你为什么不直接多买十倍的GPU呢?
The amount of capital going into these companies I mean, Dario talked about it on the DoorDash podcast, and DoorDash was like, why don't you just buy 10 x more GPUs?
他回答说,如果模型没有达到确切的性能水平,我会破产的。
And he's like, because I'm gonna go bankrupt if the model doesn't exactly hit the the performance level.
你如何看待这种风险?毕竟你们投资了OpenAI、Thinking Machines和World Apps。
How do you think about that also as a risk on you know, you guys are investors in OpenAI and Thinking Machines and World Apps.
看起来我们正在以相当高的速率利用规模递减效应。
It seems like we're leveraging the scaling loss at a pretty high rate.
也就是说,你对下行风险有多大的把握?
Like, how comfortable, I guess, do you feel with the downside scenario?
比如,谢谢,Al。
Like and say, like, thanks, Al.
你觉得你能重新调整这些基础设施建设和资本投入吗?
You think you can kinda, like, restructure these build outs and, you know, capital investments?
是的。
Yeah.
我应该先说一下,我亲身经历了互联网泡沫破裂,我可以花几个小时跟你讲关于互联网泡沫破裂的故事,那真是糟糕透顶。
So I should start by saying so I lived through the .com crash, and I can tell you stories for hours about the .com crash, and it was horrible.
不。
No.
那太惨了。
It was awful.
那简直是末日般的景象。
It was it was it was apocalyptic.
顺便说一下,当时互联网泡沫破裂的很大一部分实际上是电信泡沫破裂。
By the way, the a lot of the .com crash was actually at the time, it was actually a telecom crash.
那是一场带宽危机。
It was a bandwidth crash.
真正导致资金全军覆没的是电信公司。
Like, the the thing that actually crashed that wiped out all the money was the the telecom companies.
Global Crossing?
Global crossing?
环球
Global.
是的
Yeah.
所以我来自新加坡,他们在这片海域铺设了大量光纤。
So I'm from Singapore, and they they laid so much cable over over our oceans.
实际上,在互联网泡沫时代有一条规模定律,美国商务部在1996年发布了一份报告,称互联网流量每季度翻一番。
Actually, there was a scaling law in the .com era, and it was literally the the US Commerce Department put out a report in 1996, and they said Internet traffic was doubling every quarter.
而在1995年和1996年,互联网流量确实每季度翻倍,因此这便成了公认的规模定律。
And and actually in 1995 and 1996, internet traffic actually did double every quarter and so that became the scaling law.
于是,所有这些电信创业者都出去融资,建设光纤网络,预期带宽需求会持续每季度翻倍。
So what all these telecom entrepreneurs did was they went out and they raised money to build fiber anticipating that the demand for bandwidth was gonna keep doubling every quarter.
但每季度翻倍就像国际象棋棋盘上的麦粒,到了某个时候数字会变得极其庞大,对吧?
Doubling every quarter though is like, you know, grains of chess on the chessboard, like at some point the numbers become extremely large, right?
而实际上,互联网自诞生以来一直在持续增长。
And it really and really what happened was the internet, by the way, continuously kept growing basically since inception.
它一直在增长,从未萎缩,而且相比人类历史上的任何其他事物,它的增长速度都快得惊人,但到了1998年、1999年,它已经不再每季度翻一番了。
It's, you know, it's continuously grown, it's never shrunk and it's grown really fast compared to anything else, you know, in human history, but it wasn't doubling every quarter as of 1998, 1999.
所以,他们对所谓增长规律的预期与现实之间出现了巨大落差,而这正是导致互联网泡沫破裂的原因——像Global Crossing这样的公司过度建设了光纤网络,顺便说一句,还包括光纤电信设备,也就是所有网络硬件,还有后来的数据中心建设,以及数据中心的过度建设。
And so there was this gap in the expectation of what they thought was a scaling law versus reality and that's actually what caused the dot com crash, which was way over companies like Global Crossing way overbuilt fiber, which is sort of the and by the way, fiber telecom equipment, you know, so all the all the networking gear, you know, and then and then by the way, the actual physical data centers, like that was the beginning of the of the of the data center build and then and then data center overbuild.
所以当时,确切地说,大约有两万亿美元的市值蒸发了。
And so you had that, but it was it was literally, I think it was like $2,000,000,000,000 got wiped out.
对吧?
Right?
简直让人难以置信。
It was like Jesus Christ.
而且顺便说一句,另一个容易被忽略的细节是,互联网公司本身其实几乎没有债务,因为科技公司通常不依赖债务运营,但电信公司却高度依赖债务。
It was like a big it was and by the way, the other the other subtlety in it was the Internet companies themselves never really had any debt because tech tech companies generally don't run on debt, but the telecom companies run on debt.
实体基础设施公司都是靠债务运营的。
Physical infrastructure companies run on debt.
所以像Global Crossing这样的公司,不仅筹集了大量股权资金,还借了巨额债务。
And so the companies like Global Crossing not just raise a lot of equity, they also raise a lot of debt.
所以它们的杠杆率很高。
So they're highly levered.
于是你就做了这么一件事:搞一个高杠杆的项目,疯狂地过度建设产能。
And so then you just do the thing of just like, okay, have a highly levered thing where you're just overbuilding capacity.
需求在增长,但没你预期的那么快,然后就破产了,对吧?
Demand is growing, but not as fast as you hoped and then boom bankrupt, right?
就像人们说的酒店行业,总是酒店的第三个主人能赚钱。
And then it's like they say about the hotel industry, which is it's always the third owner of a hotel that makes money.
它得破产两次,对吧?
It has to go bankrupt twice, right?
你必须把所有过度乐观的狂热情绪都洗掉,才能达到一个稳定的状态,然后才能赚钱。
You have to wash out all of the overoptimistic exuberance before it gets to actually a stable state and then it makes money.
顺便说一句,那些数据中心和所有光纤现在都在使用中,只是已经过去了二十五年。
So by the way, all of those data centers and all of those, all the fiber that they're used, it's all in use today, but twenty five years later.
实际上,所经历的时间是十五年。
And actually the elapsed time was it took fifteen years.
展开剩余字幕(还有 480 条)
从2000年到2015年,花了十五年时间才真正填满所有容量。
It took fifteen years from 2000 to 2015 to actually fill up all the capacity.
警示在于,过度建设是可能发生的。
The cautionary warning is the overbuild can happen.
你知道,当你进入这种状态时,几乎所有拥有机构资本的人都会想:我不懂怎么投资那些疯狂的软件项目,但我肯定能建数据中心,肯定能买GPU,能部署计算网格这些东西。
And you know, you get into this thing where basically everybody who basically has any sort of institutional capital is like, it's just, I don't know how to invest in these crazy software things, but for sure I can put build data centers and for sure I can buy GPUs and I can deploy you know, compute grids and all these things.
所以,作为一个悲观者,你可以看到这一切,觉得这简直就是在重演2000年的情况,显然这会很糟糕。
And so you know, you're a pessimist, can look at this and you can say, wow, this is like really set up to be able to basically replicate you know, what we went through in 2000, obviously that would be bad.
但与之相对的论点——也是我认同的观点——有几点。
The counter argument which is the one I agree with, which is the counter on the other side is a couple of things.
第一,这些投资的公司都是最顶尖、最可靠的公司。
One is the companies that are investing all the the companies that are investing the money are like the bluest chip of companies.
当年的Global Crossing还像是一个创业者创办的新创企业。
And so back back in the Global Crossing was like an it was like an entrepreneur, was like a new venture.
但如今大规模投入的资金来自微软、亚马逊、谷歌、脸书、英伟达,还有现在像OpenAI和Anthropic这样的公司,它们已经成长为规模庞大、收入可观的真正企业。
But like the money that's being deployed now at scale is Microsoft and, you know, and Amazon and Google, right, and Facebook and NVIDIA and, you know, these these these and and now, you know, by the way, OpenAI and Anthropic, which are now at like, know, really serious size, you know, as companies with, you know, very serious revenue.
这些是非常大规模的公司,拥有大量现金和从未使用过的债务融资能力。
These are very large scale companies with like lots, lots of cash, lots of debt capacity that they've never used.
因此,如今的这种投资方式在性质上与当年完全不同。
And so this is institutional in a way that that really wasn't at the time.
此外,至少目前来看,每一美元投入任何能产生运行中的GPU的项目,都会立即转化为收入。
And then the other is, at least for now, every dollar that's being put into anything that results in a running GPU is being turned into revenue right away.
你们都知道,所有人都在渴求算力,渴求计算能力,以及相关的内存、互联设备和数据中心空间等一切资源。
Like so, and you guys know this, like everybody starved for capacity, everybody starved for compute capacity and then all the associated things, memory and interconnect and everything else, data center space.
因此,如今每一美元投入建设,都会立即转化为收入。
And so every dollar right now that's being put in the ground is turning into revenue.
事实上,我认为正在发生一件有趣的事:由于所有人都在渴求算力,我们今天实际能使用的模型,其实是受制于供应瓶颈的、不如理想状态的版本。
In fact, I actually think there's an interesting thing happening, which is because everybody's starved for capacity, the models that we actually have that we can use today are inferior versions of what we would have if not for the supply constraints.
确实如此。
It's true.
没错。
If if right.
假设有一个假设的世界,其中GPU便宜了十倍且丰富了十倍,模型会好得多,因为你只需投入更多资金进行训练,就能构建出更好的模型,而且它们会更优秀。
Suppose a hypothetical universe in which GPUs were 10 times cheaper and 10 times more plentiful, the models would be much better because you would just allocate a lot more money to training and you'd just build better models and they would be better.
所以我们实际上得到的是技术的简化版。
And so we're we're actually getting the sandbag version of the technology.
不,我们使用的所有东西都是经过量化的,因为实验室必须保留完整版本。
No, everything we use is quantized because the labs have to keep the full versions.
对。
Right.
我们连好东西都还没拿到。
We're not even getting the good stuff.
但即使技术进步停滞,一旦GPU制造能力、内存以及未来五到十年内必须发展的所有其他方面大规模扩张,即使当前的技术也会变得好得多。
But getting the good stuff, it's just even if technical progress stops, once there's like a much bigger build of like GPU manufacturing capacity and memory, you know, all the things that have to happen in the course of the next five or ten years, once it happens, even the current technology is gonna get much better.
而且你知道的,这种技术有上百万种用法。
And then as you know, like there's just like a million ways to use this stuff.
简直有上百万种应用场景。
Like there's just like a million use cases for this.
这不仅仅是发送数据包然后指望别人找到用途那么简单。
Like it it you know, this isn't just sending packets across a a thing whatever and hoping people find something to do with it.
这是在人类活动的每一个领域都应用智能,然后它表现得极其出色。
This is just like, oh, we apply intelligence in every domain of human activity and then it works like incredibly well.
是的。
Yeah.
我知道这一点,我知道这一点。
Here's what I know, here's what I know.
在未来三到四年左右,基本上所有东西都卖断货了。
In the next three or four years, it's like somewhere between three or four years out, basically everything is selling out.
整个供应链都在售罄或即将售罄,因此在未来几年里,我们将面临持续的供应短缺。
So like the entire supply chain is sold out or selling out and so there's no like we're just going to have like chronic supply shortage for you know, for years to come.
市场将做出回应,现在已经在发生,大量投资将涌入新建晶圆厂产能以及其他相关领域,以实现这一目标。
There's going to be a response from the market that's gonna result in an enormous you know, it's happening now, an enormous flood of investment in a new fab capacity and, you know, every everything else to be able to do that.
在某个时候,供应链的限制至少会在一定程度上得到缓解。
At some point, the supply chain constraints will unlock, at least to some degree.
当这种情况发生时,这将成为行业增长的另一个推动力,因为产品会变得更好,一切都会变得更便宜。
That will be another accelerant to industry growth when that happens because the products will get better and everything will get cheaper.
所以我知道这一定会发生。
And so I know that's going to happen.
我知道这些部署和实际应用场景都非常有吸引力。
I know that the deployments, the actual use cases are like really compelling.
然后就像我说的,随着推理和智能体等技术的发展,我知道它们会从现在开始变得越来越好。
And then like said, I you know, with reasoning and agents and so forth, like I know they're just going to get like much, much better from here.
所以我知道这些能力真的非常强大。
And so I know the capabilities are like really, really serious.
我也知道技术进步不会停止。
I also know that the technical progress is not going to stop.
它正在加速。
It is accelerating.
这些突破非常巨大。
Like the breakthroughs are tremendous.
我的意思是,即使从月到月来看,这些突破也十分显著。
I mean, even just month over month, the breakthroughs are really dramatic.
所以,你知道,如果你是个愤世嫉俗的人——确实也有人这样——你可以看2000年,找到一些相似的影子,但我根本无法想象,未来几年内,这件事会让人失望。
And so, you know, I think if you were a cynic and there there are cynics, you can look at 2,000, you can find echoes, but I can't even imagine betting on that this is gonna like somehow disappoint in, you know, at least for years to come.
我认为下这样的赌注几乎是自杀行为。
I think it would be essentially suicidal to make that bet.
那是迈克尔·伯里吗?
Was that Michael Burry?
那是个有趣的人。
That's an interesting guy.
是的。
Yeah.
我们挑个家伙来讨论吧。
We'll pick on a guy.
我们挑一个家伙来讨论吧。
We'll pick let's pick on one guy.
他确实这么做了。
Well, he did.
他发布了,就是那个
He he came out with it was it was the
他并不介意。
He doesn't mind.
是英伟达的空头头寸,对吧?
It was the NVIDIA Short, right?
他发布了英伟达的空头头寸。
He came out with the NVIDIA Short.
然后,你们可能已经讨论过这一点了:现在的模型在软件层面的进步速度如此之快,以至于如果你今天还在使用三年前的英伟达推理芯片,你今天的收益反而比三年前还高,因为软件的改进速度超过了芯片的折旧周期。
And then if you guys probably talked about this, which is the analysis now that like the current models are getting better faster at such a rate that if you are running an NVIDIA inference chip today that's three years old, you're making more money on it today than you did three years ago because the pace of improvement of the software is faster than the depreciation cycle of the chip.
据我了解,谷歌正在使用非常老旧的TPU,我不知道这些是传闻还是已经公开的信息,但我认为谷歌用这些老芯片赚得盆满钵满。
Then my understanding is Google is running, I don't know exactly what these are rumors that I've heard or maybe it's public, but I think Google's running very old TPUs, very profitable.
是的。
Yeah.
而且利润非常丰厚。
And very and very profitably.
是的。
Yeah.
所以据我所知,实际情况恰恰与伯里论点相反,他完全搞反了。
And so so it actually turns out, as far as I can tell, it's actually the opposite of the Bury thesis is actually he was actually a 180 degrees wrong.
实际上,旧款NVIDIA芯片正变得越来越有价值,这在历史上是前所未有的。
It's actually the the old NVIDIA chips are getting more valuable, which is something that's like literally never happened before.
从来没有任何时候,旧型号的芯片会变得更有价值,而不是更不值钱。
Like it's never been the case that you have an older model chip that becomes more valuable, not less valuable.
而这再次体现了软件进步的惊人速度,以及你在这一端所获得的惊人能力回报。
And again, that's an expression of that just in ferocious pace of software progress, ferocious pace of capability payoff that you're getting on the other side of this.
所以,我无法想象有人会押注反对这一点,就像……
And so I just the idea of betting against that, like
是的。
Yeah.
我其中一个
One of my
这就像邀请别人把你脸撕掉。
It's like an invitation to get your face ripped off.
我早期的一个成功案例是建模H100和H200的使用寿命,通常建议是四到七年,但你实际关心的可能缩短到两到三年,但实际上使用年限反而在延长,而不是缩短。
One of my early hits was like modeling the lifespan of the h 100 and h two hundreds and and going like, you know, usually they advise like four to seven years and it was, you know, maybe you sort of realistically care, cut it down to two to three, but actually it's going up and not down.
而这,我认为,正是我们的梦想。
And and that's, I mean, that's I think that's the dream.
我们正在提高利用率,我认为利用率能解决所有问题。
We are finding utilization and I think utilization solves all problems.
比如,你甚至能找到像端口这样的用途,就连内存我们都有短缺。
Like, you can you can find use use cases for even like the port like, even memory, we're having a shortage.
对吧?
Right?
甚至我们拥有的那些更差的内存版本,我们也在找到它们的用途。
And and even like the the shittier versions of of memory that we do have, we are finding use cases for it.
所以,这很棒。
So, like, that's great.
是的。
Yeah.
在面临三年供应短缺的世界里,开源AI和边缘推理有多重要?
How how important is open source AI and kinda like edge inference in a world in which you have three years of supply crunch?
比如,如果你展望五年后,你会如何看待数据中心推理与边缘推理的区别?
Like, do you think in the like, you know, if you fast forward, like, five years, like, how do you think about inference in the data center versus at the edge?
好吧,首先,是的。
Well, so just to start yeah.
我认为开源在很多方面都非常重要。
So I think I think open source is very important for a bunch of reasons.
我认为边缘推理在很多方面也同样重要。
I think edge edge inference is very important for a bunch of reasons.
从实际角度来看,如果我们未来三年持续面临根本性的供应短缺——你们也知道,如果把未来三年的需求与供应进行对比,其中一个主要预测就是核心区域推理成本将如何变化。
I I think just practically speaking, if we're just gonna have fundamental supply crunches for the next I mean, you you guys know, if you just project forward demand over the next three years relative to supply, one of the main predictions you can do is what's gonna happen to the cost of inference in the core over the next three years.
而且,这可能会大幅上涨,对吧?
And like, it may rise dramatically, right?
所以,目前大型模型公司正在大力补贴,那情况是怎样的呢?
Like, so what is, and then is, you know, like the big model companies are subsidizing heavily right now.
对,没错。
Right, right.
那么,三年后,普通用户每天、每月为完成所有想做的事情,需要支付多少令牌成本呢?
And so what's the, what will be the average person's, you know, per day per month token cost, you know, three years from now to do all the things that they wanna do?
我不知道未来会怎样。
And I I don't know what's gonna be.
我的意思是,你们可能也有朋友。
I mean, I have you guys probably have friends.
我今天就有朋友,每天花一千美元购买OpenClaw的令牌来运行OpenClaw。
I have friends today who are paying a thousand dollars a day for OpenClaw, for claw tokens to run OpenClaw.
对吧?
Right?
所以,好吧,每个月三万美元。
And so, okay, dollars 30,000 a month.
对吧?
Right?
顺便说一下,那些朋友还有上千个想法,想让他们的Claw去做更多事情。
And and by the way, those those friends have like a thousand more ideas of the things that they want their claw to do.
对吧?
Right?
因此,你可以想象,对于一个完全部署的个人代理,潜在的需求可能高达每天五万到十万美金的token。
And so you could imagine there there's like latent demand of up to, I don't know, 5 or $10,000 a day of of tokens for a fully deployed, you know, personal agent.
显然,消费者无法承担这样的费用。
And obviously consumers can't pay that.
对吧?
Right?
但这让你对未来的需求规模有了一个概念。
And so but it gives you a sense of the future scope of demand.
对吧?
Right?
所以即使价格性能提升十倍,每天仍然要花100美元,这仍然远远超出了人们的支付能力。
And so even if there's a 10x improvement in price performance, that still goes to a $100 a day, which is still way beyond what people can pay.
所以需求将会极其旺盛。
So there's just gonna be like ferocious demand.
顺便说一下,关于智能代理,另一个有趣的问题是,到目前为止,很多限制都来自GPU的限制。
By the way, the agent thing, the other interesting thing is I think the agent thing so up until now, a lot of the constraints have been GPU constraints.
我认为现在智能代理也带来了CPU的限制。
I think the agent thing now also translates into CPU constraints.
CPU和内存,是的。
CPU and memory, yes.
CPU和内存,对吧?
CPU and memory, right?
所以整个芯片生态系统
So like the entire chip ecosystem
是
is
只是
just
将会受到网络瓶颈的限制。
gonna get Wait for network constraints.
那个,那个
That that
这将是致命的。
will be the killer.
未来几年都可能被瓶颈所限制。
It's all bottlenecked potentially for years.
所以,我认为这一点是可能的。
And so so I I think that and and I think it's actually possible.
我的意思是,一般来说,推理成本会持续下降,但让我们这么讲。
I mean, generally, inference costs are gonna keep coming down, but I think the let's put it this way.
我认为,由于这些供应限制,下降速率可能会在此处暂时趋于平稳。
The rate of decline, I think, may level out here for a bit because of these supply constraints.
然后在某个时候,实验室可能不再提供如此多的补贴,这又会成为一个问题。
And then at some point maybe the lab stops subsidizing so much and that again will be an issue.
因此,推理需求将远远超过集中式模型所能满足的范围。
And so there's just gonna be so much more demand for inference than can be satisfied, know, kind of with the centralized model.
你们知道,但像苹果芯片在推理能力上发生的那些巨大创新,真是令人惊叹。
And then you guys know this, but like all the just the dramatic innovations that have happened in the Apple Silicon to be able to do inferences, it's quite amazing.
开源社区正在投入巨大的努力,去实现这种反复出现的模式:大型模型一开始根本跑不动,但六个月后就能在PC上运行了。
The level of effort being put like the open source guys are putting incredible effort into getting This recurring pattern where the big model will never run on a PC and then six months later, it runs on a PC.
对吧?
Right?
这真是太惊人了。
It's like amazing.
有很多非常聪明的人在研究这个问题。
And there's very smart people working on that.
所以这一切都存在。
So there's all that.
而且你看,还有其他的驱动因素。
And then look, there's also, you know, there's also like other, there's other motivators.
还有其他的驱动因素,就是大中心化模型提供商到底有多可信?
There's other motivators, which is just like, okay, how much trust are the big centralized model providers?
你知道,他们在市场上建立了多少信任,而相比之下,在某些情况下,对某些人来说,有些人觉得:我并不愿意把一切都交出去。
You know, How much trust are they building in the market versus how much are, at least for in certain cases with some people for certain use cases, people being like, well, I'm not willing to just like turn everything over.
所以还有所有的信任问题。
So there's all the trust issues.
顺便说一下,还有纯粹的价格优化问题。
By the way, there's also just like straight up price optimization.
有很多AI应用场景并不需要云端的爱因斯坦。
There's many uses of AI where you don't need Einstein in the cloud.
你只需要一个聪明的本地模型。
You just need like a smart local model.
还有性能问题,你希望你的设备内置一个AI模型,以便能够实现访问控制。
There's also performance issues where you wanna you know, you you want you know, you're gonna want your darn op to have an AI model in it, you know, to be able to, you know, do, you know, to be able to do access control.
显然,所有带芯片的设备都会内置AI模型,而且其中很多都会是本地运行的。
Obviously, like everything with a chip is going to have an AI model in it and a lot of those are going to be local.
因此,我认为你会看到可穿戴设备也是如此,你不想进行完整的往返通信。
And so, yeah, no, like I think I think you're going to have and then you're going to, by the way, also wearable devices, you know, you you don't wanna do a complete round trip.
你希望你的智能设备响应速度极快,延迟极低。
You want you know, you you whatever your smart devices are, you want it to be, like, super low latency.
是的。
Yeah.
问题是,我们是否在意是谁制造的?
The question, do we care who makes it?
本周最大的新闻之一是AI2(艾伦研究所)的倒闭,这是美国一家真正的开源模型实验室。
One of the biggest news this week was the collapse of AI two, the Allen Institute, one of the actual American open source model labs.
对。
Yep.
我对美国的开源项目没那么乐观。
And I'm not that optimistic on on American open source.
是的。
Yeah.
你们投资了 Mistral,而 Mistral 在中国以外的地方表现得非常好。
Like, you you guys invested in miss trial, and miss trial is doing extremely well outside of China.
就这些了。
That's about it.
是的。
Yeah.
我们走着瞧。
We'll see.
我们走着瞧。
We'll see.
我看看。
I look.
第一,我认为我们确实关心由谁来主导这件事。
Number one, I do think we care I do think we I do think we care who makes it.
我想说的是。
I would say this.
前一届总统政府曾想在美国扼杀它。
The the the previous presidential administration wanted to kill it in The US.
就像想把它淹死在浴缸里一样,他们就是想把它搞垮。
Like, wanted to drown in the bathtub, and so they wanted to kill it.
所以至少我们现在有一个真正希望它成功的政府。
So at least we have a government now that actually, like, actually wants it wants it to happen.
那你是在委员会里吗?
And you're in the council?
我已经问过了。
And I've asked.
还有新的P P阵营。
And the new and the p p cast.
是的。
Yeah.
所以,尽管这个政府在其他政治问题上——而这些问题很多——存在争议,但我认为它对人工智能,尤其是开源人工智能,有着非常开明的看法。
So the the know, this admin for whatever other political issues people have, which are many, you know, this administration has, I think, a very enlightened view and in particular an enlightened view on AI and in particular on open source AI.
因此,他们非常支持。
And so they're very supportive.
我的理解是,中国各大公司有非常具体的原因推动开源,因为它们从根本上认为,目前无法在中国以外,尤其是无法在美国,成功销售商业人工智能产品,原因多种多样。
My read is the the Chinese have a very the various Chinese companies have a very specific reason to do open source, which is they they they don't fundamentally, they don't think they can sell commercial AI outside of China right now and or at least specifically not not in The US for a combination of reasons.
因此,它们似乎将开源人工智能视为一种亏损导向策略,用以对抗国内的付费服务以及一些附属产品。
And so they they kind of view, I think, open source AI as a bit of a loss leader against basically domestic, you know, paid paid services and then kind of you know, kind of ancillary products.
你知道,它们对此非常热衷。
You know, they're they're very excited about it.
顺便说一句,我觉得这很棒。
By the way, think it's great.
我觉得它们这么做非常好。
I think it's great that they're doing it.
你知道吗,我觉得DeepSeek就像是送给世界的礼物。
You know, I think DeepSeek was like a gift to the world.
我认为开源的影响体现在两个方面。
I think the great thing about open source open source the impact of open source is felt two ways.
一方面,你可以免费获得软件。
One is you you get the software for free.
另一方面,你可以学习它是如何工作的。
But the other is you get to learn how it works.
对吧?
Right?
还有那篇论文。
And so like The paper.
那篇论文。
The paper.
那篇论文和代码。
The paper and and the code.
对吧?
Right?
还有代码。
And the code.
所以,比如说,我觉得这太棒了。
And so like, for example, I thought this was amazing.
所以OpenAI推出了o1,这是一个了不起的技术突破,简直完美。
So OpenAI comes out with o one and it's an amazing technical breakthrough and it's just like absolutely fantastic.
但他们当然没有详细解释它是如何工作的,而且他们还隐藏了推理过程,对吧?
But of course, they don't explain how it works in detail and then of course they hide the reasoning traces, right?
然后大家都说,好吧,这确实很棒,但谁能复现呢?
And then everybody's like, okay, this is great, but like who's going be able to replicate this?
其他人能做得到吗?
Are other people going be able to do this?
你知道吗?里面是不是有什么独家秘诀?
You know, is there a secret sauce in there?
然后R1发布了,代码和论文都公开了,现在全世界都知道该怎么做了。
And then r1 comes out and it's just like, there's the code and there's the paper and now the whole world knows how to do it.
三个月后,其他所有AI模型都开始加入推理能力,所以即使中国自己的模型没有被广泛使用,但这种知识传播和教育对全世界的影响依然极其强大。
And then, you know, three months later, every other AI model is is adding reasoning and so so you get this kind of double, like even if the Chinese models themselves are not the models that get used, the education that's taken place to the rest of the world, the information diffusion, you know, is incredibly powerful.
于是这种情况发生了,我不知道,我们会看到,现在有一大批美国的开源AI模型公司。
So that happens and then I don't know, we'll we'll see, you know, there are a bunch of American, you know, open source, you know, AI model companies.
我的意思是,主要模型公司之间的竞争将极其激烈,按不同统计方式,目前大约有四到五家大型基础模型公司,彼此在不同方面不相上下,而且显然,Axon、Meta和Valder都在全力推进,试图实现跨越式发展。
I mean, there's going to be tremendous, you know, there's going to be there's tremendous competition among the primary model companies, know, there's depending on how you count, there's like four or five, you know, big co model companies now that are, you know, kinda neck and neck in different ways, you know, and and and, you know, and then obviously both both Axon and MetaWireb and Valder, you know, both have huge, you know, huge attempts to, you know, kinda to kinda leapfrog underway.
此外,还有一大群初创公司,包括许多我们之前提到的公司,正在尝试不同的技术路径。
And then you've got, you know, a whole fleet of startups, new companies, including a whole bunch that we're back in that are, you know, trying to come up with different approaches.
然后还有其他各种各样的东西。
And then you've got whatever it is.
我不知道。
I don't know.
到目前为止,中国有多少家主要的基础模型公司?
How how many how many, like, mainline foundation model companies are there in China at this point?
大概是六个。
It's probably six.
他们称之为五虎。
It's five tigers is what they call it.
由于权利问题,Quinn的情况有些悬而未决。
Quinn is in in questionable because of Right.
领导层发生了变化。
There's change in leadership.
对。
Right.
是的。
Yeah.
但这还不包括像月之暗面这样的公司。
But that does not include that that includes, like, Moonshot.
对。
Yes.
Kimi、DeepSeek、z AI,Quinn o one 也在里面。
Kimi, DeepSeek, z AI, Quinn o one is in there.
对。
Right.
还有字节跳动。
And then, and ByteDance.
然后如果你看字节跳动的话
And and then if you see ByteDance
就会是下一个梯队。
would be like the next tier.
字节跳动。
ByteDance.
他们没那么突出。
They weren't as prominent.
他们
They
并没有拥有
weren't have a
但现在,你知道,
But now, you know,
但它们,你知道,字节跳动非常鼓舞人心,而且 presumably 它们会有更多产品推出,腾讯可能也会有更多产品推出,等等。
But they're, you know, CDance is very inspiring and presumably they have more stuff coming and Tencent probably has more stuff coming and and so forth.
所以,你看,这里有一件你可以预见的事:目前中美之间并没有这么多市场,而是大约有一打主要的基础模型公司,它们已经达到了某种规模或关键门槛。
And so so like, look, here would be a thing you can anticipate which is there are not these markets, there are not going to be between The US and China right now, there's like a dozen primary foundation model companies that are like at scale at some level of like critical mass.
三年后不可能还有一打吧?
It's not going be a dozen in three Right?
因为这些行业根本支撑不了这么多公司。
Like, just because these industries don't bear a dozen.
最终只会剩下三到四家大赢家,或者可能只有一两家大赢家。
It's it's gonna be three you know, there's gonna be three or four big winners or maybe one or two big winners.
所以,会有大量这类公司不得不寻找替代策略。
And so there's gonna be like a whole bunch of those guys that are gonna have to figure out alternate strategies.
我认为开源就是其中一种策略。
And I think like open source is one of those strategies.
所以我觉得你可能会看到,整个问题在于谁会去做开源?
And so I I think you could see like a whole I think the question's like who's gonna do open source?
我认为这种情况可能会迅速变化。
I think that could change really fast.
我觉得这是一件非常动态的事情。
I I think that that that's a very dynamic thing.
我觉得很难预测会发生什么。
I think it's very hard to predict what happens.
而且我觉得这非常重要。
And and I think it's very important.
英伟达正在做很多工作。
NVIDIA is doing a lot.
你知道你
You know what you're
说?
say?
没错,正是如此。
Well, exactly.
然后你有英伟达,接着,你知道的,在商业战略中有个老概念,叫做‘使互补品商品化’。
And then you got NVIDIA and then and then, know, just to get an industrial an there's old thing in business strategy, which is called commoditize the Commoditize the complement.
所以,没错。
And so right.
所以,如果你是黄仁勋,这简直显而易见。
And so if you're Jensen, it's just kind of obvious.
当然,你希望把软件商品化。
Of course, you wanna commoditize the software.
是的。
Yeah.
而且,值得高度赞扬的是,他正投入大量资源来推动这一点。
And he's and to his enormous credit, he's putting enormous resources behind that.
所以也许这真的是英伟达,我觉得这会很棒。
And so maybe it maybe it's literally NVIDIA, and I think that would be great.
是的。
Yeah.
对。
Yeah.
对欧洲项目的叙事造成破坏。
Narrative violation to European projects.
一开始的时候。
In the beginning.
搞定。
Bam.
我很快就要举办我的欧洲会议了,我请到了他们两位。
I I'm hosting my Europe conference soon, and I got both of them.
他们把我们给拿下了。
They got us.
他们盯上我们了,马克。
They got us, Marc.
他们盯上我们了。
They got us.
等一下。
Wait a minute.
彼得在哪?
Where was Peter?
斯图伊伯格在……的时候在哪?
Where was Stuyburger when
他当时在奥地利。
he did He was in Austria.
是的。
Yeah.
是的。
Yeah.
他在哪儿?
He was in what?
他在维也纳。
He in Vienna.
哦,他在维也纳。
Oh, he was in Vienna.
那他现在在哪里?
And then where is he now?
他要搬到旧金山。
He's moving to SF.
好的。
Okay.
好的。
Okay.
好吧。
Alright.
好的。
Okay.
搞定。
There we go.
然后,是的,那个Pi guy没问题。
And then, yeah, the Pi guy alright.
Pi guys是欧洲人。
The Pi guys are European.
是的。
Yeah.
他们在奥地利是朋友。
They're they're buddies in Austria.
马里奥也在那里。
Mario is also there.
是的。
Yeah.
对。
Right.
而且他们确实是。
And are they yeah.
他们还没有宣布任何变更,是吧?
They haven't announced yet any sort of change change till or have they?
没有。
No.
他们在那儿有一家公司。
They're they have a company there.
好的。
Okay.
明白了。
Got it.
好的。
Okay.
很好。
Good.
很好。
Good.
很好。
Good.
是的。
Yeah.
很好。
Good.
不管怎样,我觉得 Pi 和 OpenClaw 是非常重要的软件,我只是想听听你对它们的看法。
Anyways, I think Pi and OpenClaw are very important software things, and and I just wanted you to just go off on what you think.
是的。
Yeah.
所以我认为,这两者的结合是最重要的十大软件之一
So I think in the the combination of the two of them, I think, is one of the 10 most important software
OpenClaw得到了所有关注,但没错。
OpenClaw got all the attention, but Right.
谈谈Pi吧。
Talk about Pi.
Pi,Pi算是个终点。
Pi Pi is kind of the end.
是的。
Yeah.
Pi是一种架构上的突破。
Pi's Pi's kind of the architectural breakthrough.
对于我们这些年纪较大的人来说,从大约1970年到我不知道什么时候,软件界一直有一整套非常重要的理念。
For those of us who are older, there was this whole thing that was very important in the world of software basically from, like, 1970 to I don't know.
它至今仍然非常重要,但从1973年到Linux诞生为止,我们曾经称之为Unix思维的东西。
It it still is very important, but like '19 from 1973 to like basically the creation of Linux, which is basically this this thing we used to call like the Unix mindset.
因为当时有各种各样的理论。
Like, so so because there were all these different, you know, theories.
有各种各样的操作系统和大型机,还有Windows、Mac等等这些东西。
There are all these different operating systems and mainframes and and then, you know, all these windows and Mac and all these things.
但在这一切背后,有一种理念,也就是Unix思维。
Then there was this, kind of behind it all was this idea of kind of the Unix mindset.
Unix思维指的是,在过去,让计算机行业真正运转起来的操作系统,比如20世纪60年代的OS360,这是IBM开发的一个庞大操作系统,旨在运行一切。
And the Unix mindset was this thing where basically you don't have these like, like in the old days, like the operating system that like made the computer industry really work like in the 1960s was this thing called OS360, which was this big operating system IBM developed that was supposed to basically run everything.
它是一种巨大的、整体式的架构,高高在上。
And it was this, like, giant monolithic architecture in the sky.
它就像一座巨大的软件城堡。
It was like a, you know, it was like a giant castle, of software.
顺便说一句,它确实运行得非常好,IBM也因此非常成功。
And and by the way, it worked really well, and they were very successful with it.
但它就像一座高高在上的巨大城堡。
But, like, it was this huge castle in the sky.
但这种系统几乎难以接近,你必须是IBM内部的人,或者与IBM关系非常密切,而且必须彻底理解系统的每一个细节。
But it was this thing that was almost unapproachable, which is like you had to be kind of inside IBM or very close to IBM and you had to really understand every aspect of the system worked.
然后,来自AT&T和伯克利的Unix团队提出,让我们采用一种完全不同的架构。
Then the Unix guys originally out of AT and T and then out of Berkeley, know, came out and they said, no, let's have a completely different architecture.
这种架构的工作方式是:我们提供一个提示符和一个shell。
And the way architecture is gonna work is we're gonna we're gonna have a prompt and and a shell.
所有功能都将以独立的模块形式存在,你可以将这些模块串联起来。
And then and then we're gonna all the functionality is gonna be in the form of these discrete modules, and then you're gonna be able to chain the modules together.
因此,操作系统本身几乎就像一种编程语言。
And so like the the the it's almost like the operating its operating system itself is gonna be a programming language.
这使得shell变得至关重要。
And then that led to the sort of centrality of the shell.
接着,这促成了Unix工具之间的串联使用。
And then that led to sort of, you know, basically chaining the other Unix tools.
随后,出现了像Perl这样的脚本语言,让你可以非常轻松地实现这种操作。
And then that led to the emergence of these these scripting languages like Perl where you could basically kind of very easily do this.
之后,shell变得越来越复杂。
And then the shells got more sophisticated.
然后,你看,首先,这套方案是行得通的,这正是我成长起来的世界。
And then and then and then look, like, you know, that that that number one, that worked and that that was the world I grew up in.
我基本上从1988年就开始是个Unix用户了,一直到我的整个职业生涯都是如此。
Like, was I was a Unix guy, you know, sort of from call it 1988 to, you know, kind of all the way through my work.
它运作得非常好。
And it worked really well.
它一直存在于后台,普通用户根本不需要了解它,但如果你从事系统架构或应用开发,那你对它了如指掌。
It's in the background, you know, normal people didn't need to necessarily know about it, but like if you were doing like system architecture or application development, you knew all about it.
从那以后,它就一直默默存在于后台。
And then, you know, it's been in the background ever since.
你看,你的Mac里仍然有Unix壳层,你的iPhone里也 somewhere 隐藏着一个Unix壳层。
And, you know, look, your Mac still has a Unix shell, you know, kind of in there and your iPhone still has a Unix shell kind of buried in there somewhere.
所以它们都藏在里面,而Windows的壳层则是这种架构的一种奇怪衍生物。
So they're kind of in there and then, you know, the Windows shell is kind of a, you know, sort of a weird derivative of that.
但你看,互联网是基于Unix运行的,智能手机也是如此——无论是iOS还是Android,都是Unix的衍生系统。
But, you know, but look, Internet the Internet runs on Unix, and then smartphones, actually both iOS and Android are Unix derivatives.
所以,你看,Unix 最终还是胜出了。
And so, you know, kind of Unix did end up winning.
但不管怎样,我们后来就开始把这一切视为理所当然了,而关于 Pi 和 OpenClaw 的情况,那些人真正发现的是——我认为,伟大的突破在事后看来总是显而易见的,对吧?
But anyway, but and then we just started taking that for granted and then and then so so basically, the the way I think about what happened with Pi and then with OpenClaw is basically what those guys figured out is, I would say the great breakthroughs are obvious in retrospect, right?
这才是最好的类型。
Which is The best kind.
这才是最好的类型。
The best kind.
但在当时它们并不明显,否则早就有其他人做出了这些成果。
They weren't obvious at the time or somebody else would have done them already.
所以这确实是一次真正的概念飞跃,但当你回头去看时,就会觉得:哦,当然如此。
And so there is a, like, a real conceptual leap, but then you look at it sort of the backwards looking and you're just like, oh, of course.
对我来说,这些永远都是最棒的突破。
Like, to me, those are always the best breakthroughs.
实际上,语言模型本身也是如此。
So actually, language models themselves are like that.
就是,下一个词预测而已。
It's just like, oh, next token completion.
当然了。
Oh, of course.
是的。
Yeah.
还有什么其他目标重要吗?
What other objective mattered?
对。
Yeah.
没错。
Exactly.
但她说得对,直到有人真正做出来之前,这根本不算明显,对吧?
But but, like, right, but she's even saying it wasn't obvious until somebody actually did it, right?
所以这个概念上的突破是真实、深刻、有力且极其重要的。
And so the conceptual breakthrough is real and deep and powerful and very important.
所以我认为Pi和OpenClaw的方式,本质上是将语言模型的思维与Unix shell命令行的思维结合起来。
And so the way I think about Pi and OpenClaw is it's basically marrying the language model mindset to the Unix basically shell prompt mindset.
因此,这基本上是在探讨什么是智能体,对吧?
And so it's basically this idea that what so what is an agent, right?
正如你所知,许多聪明人几十年来一直在试图弄清楚什么是智能体,提出了各种架构来构建智能体,而最终我们发现,什么是智能体呢?
And as you know, like many smart people have been trying to figure out what an agent is for decades and they've had many architectures to build agents in the whole thing and it turns out what is an agent?
所以我们现在知道,智能体其实就是这样一个东西:一个语言模型,再在其上叠加一个bash shell。
So it turns out what we now know is an agent is the following, it's it's it's a language model and then above that, it's a bash it's a bash shell.
也就是说,它是一个Unix shell,智能体可以访问这个shell,当然,最好是在一个沙盒环境中,也许就是沙盒环境。
So it's a it's a Unix shell and then it's and then the agent has access has access to to the shell and you know, hopefully hopefully in a sandbox, maybe maybe sandbox.
所以它包含模型、shell,以及文件系统。
In So it's it's the model, it's the shell, and then it's a it's a file system.
然后状态存储在文件中,文件本身采用markdown格式,而在Unix中,这类似于所谓的cron作业。
And then the state is stored in files and then, you know, there's the markdown format for the, you know, for for the files themselves and then and then there's basically what in Unix is called a cron job.
它有一个循环,有一个心跳机制,这个机制会让系统定期唤醒。
There's a loop and then there's a heartbeat for the there's heartbeat and and the thing basically wake wakes up wakes up.
所以这本质上就是大语言模型加上壳层、文件系统、Markdown 和 cron,结果发现这就是一个智能体,而除了模型之外的每一部分,我们早已完全了解和掌握。事实上,Unix 壳层所蕴含的潜在能力是惊人的,因为壳层本身就有巨大的潜在力量。
So it's basically LLM plus shell plus file system plus markdown plus cron and it turns out that's an agent and and and every part of that other than the model is something that we already completely know and understand and in fact, it turns out the like the latent power of the Unix shell is like extraordinary because basically like all like there's just like an there's just enormous latent power in the shell.
Unix 命令的数量极其庞大。
There's enormous numbers of Unix commands.
已经有海量的命令行接口可以访问各种各样的功能,你的整个系统——我是说,你的电脑本身就是运行在壳层之上的。
There's enormous number of command line interfaces into all kinds of things already in the, you know, your entire, I mean your entire, just to start with your computer runs on a shell.
如果你用的是 Mac 或者手机,你的电脑本来就运行在壳层之上。
If you're running a Mac or or a phone, your computer your computer is running on a shell, already.
因此,你电脑的全部功能都可以通过命令行直接调用。
And so like the full power of your computer is available at the command line level.
而且,把其他功能暴露为命令行接口其实非常简单。
And then it turns out it's really easy to expose other functions as a command line interface.
所以,像我们之前需要 MCP 这类复杂协议的想法,根本没必要。
And so like this whole idea where we need like MCP and these like fancy protocols, whatever, it's like, don't.
我们只需要一个简单的命令行工具就够了。
We just need like a command command line thing.
所以这就是架构。
So that's the architecture.
然后你会发现,你的智能体是什么?
And then it turns out, what is your agent?
你的智能体是一堆存储在文件系统中的文件。
Your agent is a bunch of files stored in a file system.
而当我真正理解这一点时,它彻底震撼了我:这意味着你的智能体实际上与它所运行的模型脱钩了,因为你完全可以更换底层的LLM,智能体的个性会因模型不同而略有变化,但所有存储在文件中的状态都会被保留。
And then there's the thing that just like completely blew my mind when I wrap my head around it as a result of this, which is like, okay, this means your agent is now actually independent of the model that it's running on because you can actually swap out a different LLM underneath your agent and your agent will change personality somewhat because the model is different, but all of the state stored in the files will be retained.
是的。
Yeah.
不同的指令集,但你只是编译它们。
Different instruction set, but you just compile them.
对。
Right.
没错。
Exactly.
这样也没问题。
And it's alright.
这就像更换芯片并重新编译一样。
It was like swapping out a chip and recompiling.
但它仍然是你的代理,保留了所有的记忆和能力。
But it's still your agent with all of its memories and with all of its capabilities.
顺便说一下,你还可以更换外壳,将其迁移到另一个也是 bash shell 的执行环境中。
And then by the way, you can also swap out the shell so you can move it to a different execution environment that is also a bash shell.
顺便说一下,你也可以更换文件系统,对吧?
By the way, you can also switch out the file system, right?
你还可以替换心跳机制、cron 框架、循环和代理框架本身。
And you can swap out the heartbeat for the cron framework, the loop, the agent framework itself.
所以归根结底,你的代理其实就是它的那些文件。
And so your agent basically is basically at the end of the day, it's just its files.
然后还有一个课程
Then there's a course
简单的调用。
Simple call.
是的,本质上就是这些文件。
Yeah, it's basically, it's just the files.
顺便说一下,由此带来的结果是,代理本身实际上带来了一些重要的特性。
And by then the way, as a consequence of that, the agent and then the agent itself, it turns out a couple important things.
所以第一点是,它可以自我迁移,对吧?
So one is it can migrate itself, right?
你可以指示你的代理:迁移到不同的运行环境,迁移到不同的文件系统,或者迁移到不同的语言模型——你的代理会为你完成所有这些操作。
And so you can instruct your agent, migrate yourself to a different runtime environment, migrate yourself to a different file system, migrate yourself to a different, know, like we swap out the language model, your agent will do all that stuff for you.
还有一件非常惊人的事,就是代理具备完整的自省能力,它实际上了解自己的文件,并且能够重写自己的文件,对吧?
And then there's the final thing which is just amazing, which is the agent actually has full introspection and actually it actually knows about its own files and it could rewrite its own files, Right?
顺便说一下,这在历史上几乎是前所未有的——没有任何一个广泛部署的软件系统,其本身能如此全面地了解自身的运行机制并能如此修改自身。
Which by the way, is basically no widely deployed software system in history where the the the thing that you're using actually has full introspective knowledge of how it itself works and is able to modify itself like that.
我意思是,过去确实有过一些演示性质的系统具备这种能力,但从未有过一个真正广泛部署的系统拥有这样的能力。
That I mean, there have been toy systems that have had that, but there there's never been a widely deployed system that has that capability.
这引出了一个能力,当我真正理解它时,简直让我震惊——你可以告诉代理为自己添加新的功能和特性,而它真的能做到。
And then that leads you to the capability that just like completely blew my mind when I wrap my head around it, which is you can tell the agent to add new functions and features to itself, and it can do that.
扩展你自己。
Extend yourself.
对吧?
Right?
扩展你自己。
Extend yourself.
就是,扩展你自己。
Like, extend yourself.
给自己赋予新能力。
Give yourself a new capability.
对吧?
Right?
所以,真的就像你在聚会上遇到一个人,他们说:‘我让我的OpenClaw做各种事,连接我的EatSleep床,它能给我更好的睡眠建议。’
And so and so literally, it's just like you run into somebody at a party and they're like, I have my OpenClaw do whatever, connect to my EatSleep bed and it gives me better advice in sleep.
到了晚上回家时,你可以告诉你的爪子,或者如果他们在派对上,你就对爪子说:‘给自己增加这个功能吧。’
And you go home at night and you tell your claw or if they're at the party by way, you tell your claw, oh, add this capability to yourself.
你的爪子会说:‘好的,没问题。’
And your claw will say, oh, okay, no problem.
它会上网查找所需的一切,然后去云代码或其他地方。
It'll go out on the Internet, it'll figure out whatever it needs, and then it'll go out to cloud code or whatever.
它会编写所需的内容,然后你一眨眼,它就有了这个新功能。
It'll write whatever it needs, and then the next thing you know, it has this new capability.
所以你甚至不需要做任何事,你只需要告诉它你想让它这么做,它就能自己升级。
And so you don't even have to like, you can have it upgrade itself without even having to without having to do anything other than tell it that you wanted to do that.
总之,所有这些结合在一起,简直太震撼了,我的天,这真的太不可思议了。
And so anyway, so the the combination of all this is just, I mean, this is just like a massive, incredible I mean, it's just incredible.
如果我十八岁的话,这绝对是我要全身心投入的事情。
Like if I if I were if I were 18, like this is a 100 this is what I would be spending all of my time on.
这简直是一次了不起的概念性突破。
This is like such an incredible conceptual breakthrough.
而且,人们会看着它,他们已经对此有了反应。
And again, people are gonna look at it and they already get this response.
人们会看着它,他们会说:哦,那突破在哪里?
People are gonna look at it they're gonna say, oh, well, where's the breakthrough?
因为所有这些组件之前就已经为人所知了。
Because all of these components were already known before.
但这才是关键。
But this is the key.
突破的关键在于,利用所有这些此前已知的组件,你就能将所有底层能力隐含其中。
The key to the breakthrough was by using all these components that were known before, you get all of the underlying capability of this buried in there.
例如,计算机使用突然变得微不足道了。
And for example, computer use all of a sudden just kind of falls trivial.
当然,它能够轻松使用你的电脑。
Of course, it's gonna be able to use your computer.
它拥有对命令行的完全访问权限。
It has full access to the shell.
对吧?
Right?
然后你给它访问浏览器的权限,这样一来,计算机和浏览器结合起来,它就开始自行运作了。
And then you you you give it access to a browser and then you've got the computer and the browser and and off and away it goes.
接着你就拥有了浏览器的所有功能,因此这里解锁的能力是极其深远的。
And then you've got all the abilities of the browser And so and so the capability unlock here is profound.
我那些真正深入这一领域的朋友,正在让他们的AI助手在生活里真正地完成上千件事情。
My friends who are, you know, deepest into this are having their claw do like a like literally, like a thousand things in their lives.
他们每天都会产生新的想法。
They have new ideas every day.
他们不断地给这个系统抛出新的挑战。
They're just like constantly throwing new challenges at the thing.
顺便说一下,现在还处于早期阶段,这些都只是原型,正如你们所知,还存在一些安全问题。
And by the way, it's early and you know, these are, you know, these are prototypes and there's, you know, as you guys know, there's security issues.
所以还有很多事情需要完善,但能力的解锁确实令人惊叹。
And so, you know, there's a bunch of stuff to be ironed out, but the unlock of capability is just incredible.
我完全相信,世界上每个人都会拥有至少这样一个代理,甚至是一整套代理,我们即将生活在一个几乎不可避免的世界里——人们将用这种方式使用电脑。
And I I have absolutely no doubt everybody in the world is gonna is gonna have at least, you know, an agent like this, if not an entire family of agents, and we're gonna be living in a world where I think it's almost inevitable now that this is the way people are gonna use computers.
我想对那些对社交媒体非常熟悉的人来说,下一步就是你的代理和我的代理对话,嗯。
I was gonna say for someone who is deeply familiar with social networks, the next step is your claw talking to my claw Mhmm.
在Claw Facebook上发帖,在Claw LinkedIn上发布工作,在Claw X(AI)或其他平台上发推文。
Posting on claw Facebook, posting their jobs on claw LinkedIn, and post posting their tweets on claw x a I or whatever.
你知道的?
You know?
我认为,确实存在一些风险,比如对齐问题,以及我们是否真的希望这些代理自行运行。
I do think that that is how, you know, we we get into some danger there in terms of, like, alignment and whether or not we want these things to to to run.
你们知道rentyrentyhuman.com这个网站吗?
Do you guys know rentyrentyhuman.com?
是的。
Yeah.
Renty。
Renty.
是的
Yeah.
是的
Yeah.
是的
Yeah.
是的
Yeah.
我的意思是,这是Fiverr。
I mean, it's Fiverr.
这是TaskRabbit。
It's TaskRebit.
当然。
Sure.
当然。
Course.
长期的 Mechanical Turk。
Chronic Mechanical Turk.
是的。
Yeah.
但反过来。
But flipped.
是的。
Yeah.
对吧?
Right?
代理人雇佣这些人。
The agent hiring the people.
是的。
Yeah.
而这当然会发生。
Which, of course, is gonna happen.
对吧?
Right?
这显然会发生。
It's obviously gonna happen.
我想知道你对工程方面有什么看法。
I'm curious if you have any thoughts on the engineering side.
所以当你构建浏览器和互联网时,你知道,那基本上只是一堆纯文本文件加上一些图片。
So when you build the browser, the Internet, you know, just a bunch of mostly plain text file plus some images.
而今天,每个网站和应用都变得如此复杂,某种程度上,浏览器不断进化以适应这种变化。
And today, the every website and app is, like, so complex and, like, somehow, you know, the browser kept evolving to fit that in.
在浏览器和互联网及协议的早期,有没有什么设计选择,是你现在看到智能体时觉得相似的?
Are there any design choices that were made, like, early in the browser and kinda like the Internet and the protocols that you're seeing agents similar today?
嘿。
So, hey.
这东西根本无法适用于这种新型计算,我们应该现在就把它彻底废弃。
This thing is just not gonna work for, like, this type of new compute, and we should just rip it out right now.
有很多,但我先给你举几个例子。
There were a whole bunch, but I'll give you a couple.
所以一个是,我们要说清楚,这完全不一样。
So one is and we didn't you know, to be clear, like, this this was not you know, this was totally different.
我们没有今天这样的能力,因为我们当时没有底下这些语言模型。
We didn't have the capabilities we have today, but because we didn't have we didn't have the language models underneath this.
但我们确实有一个理念,那就是人类可读性非常重要。
But we did have this idea that human readability actually mattered a great deal.
尤其是在那个年代,这并不仅仅是英语的问题,而是我们在二进制协议和文本协议之间做了一个设计选择。
And and so and specifically in those days, it was it was not so much English language, but it was there there was a design decision we made between binary protocols and text protocols.
基本上,所有在20世纪60年代到90年代之间成长起来的资深系统架构师都会说,你知道互联网是什么吗?
And basically every every every basically old school systems architect that had grown up between like the nineteen sixties and the nineteen nineties basically said, you know, the Internet is what do know about the Internet?
它是带宽的瓶颈。
It's star for bandwidth.
你就是有这些非常细的吸管。
You you just you have these very narrow straws.
你知道吗,当我们做Mosaic的时候,家里有互联网的人用的都是14千比特的调制解调器。
You know, look, people when we did the work on Mosaic, like people who had the Internet at home had a 14 kilobit modem.
对吧?
Right?
所以你得尽可能地优化网络上传输的每一个字节。
So you're you're trying to, like, hyper optimize every bit of data that that travels over the network.
因此,如果你要设计像HTTP这样的协议,你自然会希望它是一个二进制的、高度压缩的协议,以达到最高效率,还会希望使用一个持久的单一连接,而绝不会想要频繁地建立和断开连接。
And so obviously, if you're gonna design a protocol like HTTP, you're gonna want it to be binary you know, highly compressed binary protocol for maximum efficiency, and you're gonna wanna have it be like a single connection that persists, and you're you're the last thing you're gonna wanna do is, bring up and tear new connections.
你绝对不希望使用文本协议。
And you definitely you're not gonna not gonna want a text protocol.
所以我们当时说,不,不要那样做。
And so, of course, we said no.
我们实际上想完全走相反的方向。
We actually want to go completely the other direction.
显然,我们只想要文本协议。
It's obviously we only want text protocols.
顺便说一下,HTML本身也是如此。
By the way, same thing in HTML itself.
我们希望HTML相对冗长一些。
We want HTML to be relatively verbose.
我们希望标签实际上是可读的。
You know, we want the tags to actually be like human readable.
我们想要使用
We wanna use
最低效的东西。
the- The most inefficient things possible.
是的,我们要做那些低效的事情。
Yeah, wanna do the inefficient things.
你才是真正的令牌最大化者。
You're the original TokenMaxer.
是的,正是如此。
Yeah, exactly.
是的,是的。
Yeah, yeah.
基本上它是
Basically it's
嗯,你的课程讲得很好,
Well, your lesson well,
实际上,这正是一个有意识的决定,基本上就是假设未来拥有无限带宽,并以此为设计基础。
actually this was actually the conscious thing, basically says just assume a future of infinite bandwidth built for that.
那么,本质上它是一种赌注:如果系统的潜在能力足够强大,并且这一点能被人们明显意识到,就会催生对带宽的需求,从而推动带宽供应的建设,最终让整个体系得以实现。而我们具体想要的是,让所有内容都具备人类可读性,因为在工程层面,我们希望人们能够直接通过肉眼阅读网络上传输的协议,并理解其内容,而无需进行反编译或其他复杂操作,对吧?
Then basically what it was, it was bet that if system, if the latent capabilities of the system were powerful enough and that was obvious enough to people that would create the demand for the bandwidth that would cause the supply of bandwidth to get built, would actually make the whole thing And then specifically what we wanted was we wanted everything to be human readable because at the engineering level, we wanted people to be able to read the protocol coming over the wire and be able to understand it with their bare eyes without having to disassemble it or whatever, right?
并且能从二进制转换出来,对吧?
And have it converted out of binary, right?
因此,所有的HTTP以及其他协议,一直都是基于文本的协议。
And so all the HTTP and everything else were, it was always text protocols.
HTML也是如此。
And the same thing with HTML.
在许多方面,有些人认为浏览器的关键突破在于‘查看源代码’功能——你访问的每个网页都可以查看源代码,这意味着你可以看到它是如何工作的,从而自学如何构建和编写新的网页。
In many ways, some people say that the key breakthrough in the browser was the view source option, which is every webpage you go to, you could view source, which means you could see how it worked, which means you could teach yourself how to build, write new to build new web pages.
确实有这一点。
There was that.
所以人类可读性,而在那个年代,这仍然意味着技术规范。
So human readability and again, human readability in those days still meant technical specs.
你知道,现在它意味着英文,但给予每个系统使用者一个机会,让他们能够深入下去,真正理解并看到系统是如何运行的,这种潜在的力量是惊人的。
You know, now it means English language, but there's an incredible latent power in giving everybody who uses the system the option to be able to drop down and actually understand and see how it's working.
这对网页来说非常成功,我认为它对人工智能也同样有效。
And that worked really well for the web, I think it's working really well for AI.
这是其中之一。
That was one.
网络服务器理念的另一个重要部分,是揭示操作系统底层的潜在能力,并能够展现数据库的底层潜在能力。
What was the other a big part of the idea of web servers was to actually surface the underlying latent capability of the operating system and to be able to surface the also the underlying latent capability of the database.
因为本质上,网络服务器是什么?
Because basically what was a web server?
从架构上来说,Web服务器本质上是什么?
What what is a web server fundamentally architecturally?
它就是操作系统。
It's it's it's the operating system.
所以,它实际上是运行在操作系统之上的操作系统功能。
So it's it's the operating system's ability to, you know, it's running on top of an OS.
也就是说,操作系统管理文件系统并完成你想要做的所有事情,处理各种请求。
So it's the OS's ability to manage the file system and do everything else that you want to do and process everything.
当然,许多早期的网站都是数据库的前端。
And then of course, a lot of early, know, a lot of websites are front ends to databases.
因此,你希望释放底层的潜在能力,无论是Oracle数据库,还是其他什么PostgreSQL之类的数据库。
And so you wanted to unleash the underlying latent power of whether it was an Oracle database or some other, you know, some other postgres or whatever it was.
所以,Web服务器的许多功能就是连接进来互联网请求,以解锁操作系统和数据库的底层能力。
And so a lot of the function of the web server was to just bridge from that Internet connection coming in to be able to unlock the underlying power of the OS and the database.
而且当时人们看到这一点时,会想:这真的重要吗?
And again, people looked at it at the time and they were like, well, is this really does this really matter?
这重要吗?
Like, is this important?
因为我们一直都有数据库,也一直有数据库的用户界面,这不过是另一个数据库用户界面而已。
Because we've had databases forever and we've always had, you know, user interfaces for databases and this is just another user interface for database.
好吧,这么说也有道理。
And it's like, okay, yeah, fair enough.
但另一方面,这现在成了一个更优秀的数据库界面,将有八十亿人使用,而且更容易使用、更灵活。
But on the other side of that, it's just like this is now a much better interface to databases and one that 8,000,000,000 people are going to use and is going to be like far easier to use and far more flexible.
你不再只是拥有旧式的数据库,而是有了一个系统,让人们真正理解为什么他们想要构建比过去多百万倍的数据库应用。
You're not just going to have old databases, now you have a system where people can actually understand why they want to build, you know, a million times more database apps than they have in the past.
然后,世界上数据库的数量激增。
And then the number of databases in the world exploded.
所以,这又回到了分层构建的问题。
And so, again, this goes to this thing of like building in layers.
行业里一些最聪明的人面对任何新挑战时,都会想:好吧,我需要构建一种新的应用程序。
Some of the smartest people in the industry look at any new challenge and they're like, okay, I need to build a new kind of application.
关于 Bayt 播客
Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。