The a16z Show - Can Anyone Catch NVIDIA? | The Future of Chips and Infrastructure 封面

Can Anyone Catch NVIDIA? | The Future of Chips and Infrastructure

Can Anyone Catch NVIDIA? | The Future of Chips and Infrastructure

本集简介

作为我们夏季重播系列的一部分,我们重新回顾了关于AI基础设施未来的一次精彩对话。 SemiAnalysis创始人Dylan Patel与Erin Price-Wright、Guido Appenzeller和Erik Torenberg共同探讨了AI硬件经济的快速演变,涵盖GPU、定制硅片、数据中心、电力以及全球算力竞赛。 对话深入分析了NVIDIA的竞争优势、谷歌、亚马逊和Meta定制芯片的崛起、前沿AI模型的经济性,以及塑造行业下一阶段的基础设施瓶颈。他们还讨论了AI初创公司、出口管制、机器人技术、企业软件,以及为何仅仅复制NVIDIA不足以打造一家成功的AI硬件公司。 无论你是正在构建AI产品、投资基础设施,还是试图理解行业未来走向,这场对话都将为你提供关于塑造算力未来的现实力量的实用洞察。 资源: 在X上关注Dylan Patel:https://x.com/dylan522p 在X上关注Erin Price-Wright:https://x.com/espricewright 在X上关注Guido Appenzeller:https://x.com/appenz 了解更多关于SemiAnalysis的信息:https://semianalysis.com/dylan-patel/ 保持更新: 在YouTube上关注a16z:YouTube 在X上关注a16z 在LinkedIn上关注a16z 在Spotify上收听a16z节目 在Apple Podcasts上收听a16z节目 关注我们的主持人:https://twitter.com/eriktorenberg 请注意,此处内容仅用于信息参考,不应被视为法律、商业、税务或投资建议,也不应用于评估任何投资或证券;且并非针对任何a16z基金的投资者或潜在投资者。a16z及其关联方可能持有文中讨论的公司股份。更多详情请参见a16z.com/disclosures。 由Simplecast(AdsWizz公司旗下)托管。有关我们为广告目的收集和使用个人数据的详细信息,请访问pcm.adswizz.com。

双语字幕

仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。

Speaker 0

英伟达的网络性能会更强。

NVIDIA's gonna have better networking.

Speaker 0

他们的HBM也会更先进。

They're gonna have better HBM.

Speaker 0

制程节点也会更优。

They're gonna have better process node.

Speaker 0

他们推向市场的时间会更快。

They're gonna come to market faster.

Speaker 0

他们的产能爬坡也会更迅速。

They're be able to ramp faster.

Speaker 0

无论是在与台积电、SK海力士这些内存和芯片供应商的谈判上,还是在机架、铜缆等配套环节,他们的成本效率都会更高。

They're gonna have better negotiations with whether it's TSMC or SK Hynix and the memory and silicon side or all the rack people or, like, copper cables, everything, they're gonna have better cost efficiency.

Speaker 0

所以你不能只是照搬英伟达的做法。

So you can't just, like, do the same thing as NVIDIA.

Speaker 0

你必须在别的方面实现真正的突破。

You have to really leap forward in some other way.

Speaker 0

你得比他们强上五倍才行。

You have to be, like, 5x better.

Speaker 1

人工智能的竞争不仅仅是模型的比拼。

The AI race isn't just about models.

Speaker 1

更重要的是支撑这些模型的底层基础设施。

It's also about the infrastructure underneath them.

Speaker 1

包括芯片、数据中心、电力、网络,以及决定谁能持续扩产的经济因素。

Chips, data centers, power, networking, and the economics that determine who can keep scaling.

Speaker 1

在这次对话中,SemiAnalysis的联合创始人戴伦·帕特尔加入了埃琳·普赖斯-赖特、吉多·阿彭策勒和我,一起探讨AI硬件的现状,为什么英伟达如此难以被超越,以及谷歌、亚马逊、Meta和OpenAI这些公司是如何布局下一代AI基础设施的。

In this conversation, SemiAnalysis co founder Dylan Patel joins Erin Price-Wright, Guido Appenzeller, and me to discuss the state of AI hardware, why NVIDIA remains so difficult to compete with, and how companies like Google, Amazon, Meta, and OpenAI are approaching the next generation of AI infrastructure.

Speaker 1

我们还深入讨论了定制芯片、AI经济、机器人技术、出口管制,以及随着算力竞赛加速,创业者和投资人应该重点关注哪些方向。

We also explore custom silicon, AI economics, robotics, export controls, and what founders and investors should be paying attention to as the compute race accelerates.

Speaker 2

戴伦,欢迎来到我们的播客。

Dylan, welcome to the podcast.

Speaker 0

谢谢你们邀请我。

Thank you for having me.

Speaker 2

我们早就想邀请你来做客了。

We've been trying to get you for a while.

Speaker 2

你一直很忙,不过总算安排上了。

You're a busy man, but it worked out.

Speaker 2

Guido,你来给大家说说,为什么我们这么期待 Dylan 来做客,以及我们最想聊哪些话题?

Guido, why don't you introduce why we're so excited to have Dylan on the podcast and what we're excited to discuss?

Speaker 3

Dylan,你在 AI 硬件、AI 芯片,还有越来越多的数据中心领域,做得特别出色。

I think, Dylan, you've done an exceptional job in covering what's happening in the AI hardware space, AI Semi space, and now more and more data center space as well.

Speaker 3

现在看来,全球最有价值的公司,就是一家 AI 芯片公司,对吧?

And just looking at it, currently, most valuable company on the planet is an AI Semi company, right?

Speaker 3

到目前为止,AI 领域最大的一次 IPO,是一家 AI 云公司。

The, I think, biggest IPO so far in AI was an AI cloud company.

Speaker 3

现在真正的热点就在这里,对吧?

This is currently where it's happening, right?

Speaker 3

任何淘金热刚开始的时候,真正赚钱的都是那些抓住高峰和低谷的人。

And any gold rush in the early days is the peaks and troughs that make money.

Speaker 3

我觉得我们现在就处在这个阶段。

And I think this is the stage that we're in.

Speaker 3

非常高兴你今天能来。

So super excited to have you here today.

Speaker 0

太棒了。

Awesome.

Speaker 0

谢谢。

Thank you.

Speaker 0

我很乐意聊聊我最感兴趣的话题。

Happy to talk about my favorite topics.

Speaker 0

真厉害。

Amazing.

Speaker 2

那我们先从GPT-5说起吧。

Well, maybe let's start with g p five.

Speaker 2

上周我们刚请了克里斯蒂娜和伊莎贝拉来分享一些研究。

We just had some of the research, Christina and Isabella, on here last week.

Speaker 2

你说这让人失望,能说说你的感受吗?或者你原本期待看到哪些功能?

You said it was disappointing.

Speaker 2

这整体上是怎么回事?

Why don't you share your reactions or what capabilities you were hoping to see or overall

Speaker 0

我觉得这得看你属于哪一类用户。

I think it depends on what tier of user you are.

Speaker 0

对吧?

Right?

Speaker 0

如果你只是普通用户,以前每月花二十或二百美元订阅,现在却用不了 GPT-4.5 了——在我看来,它在某些任务上依然是更好的预训练模型,也用不了 GPT-3,那模型平均也就思考三十秒左右。

If you're just using g p d five and before you were $20 or $200 a month subscriber, you no longer have access to 4.5, which, in my opinion, is still a better pre trained model for certain things, or you no longer have access to o three, which would think for thirty seconds on average, maybe.

Speaker 0

对吧?

Right?

Speaker 0

但 GPT-5,就算开启思考模式,平均也只思考五到十秒。

Whereas g p d five, even when you're using thinking, only thinks for, like, five to ten seconds on average.

Speaker 0

这其实是个挺有意思的现象。

Right, which is an interesting sort of phenomenon.

Speaker 0

对吧?

Right?

Speaker 0

但说白了,GPT-5 并没有增加多少计算量。

But basically, like, g p d five is not spending more compute per se.

Speaker 0

这个模型在基础性能上确实有小幅提升。

The model did get a little bit better on a vanilla basis.

Speaker 0

对吧?

Right?

Speaker 0

从 GPT-4 到 GPT-5,进步其实挺明显的。

Four o to five is is actually quite a bit better.

Speaker 0

但你要想想,所谓智能的发展曲线,不就是算力越多、模型越强吗?

But when you think about, you know, what is this curve of intelligence, right, it's like the more compute you spend, the better the model gets.

Speaker 0

这不管是通过扩大模型规模,还是其他方式,GPT-5 并没有变大。

And that's whether it's a bigger model, which g p d five isn't.

Speaker 0

对吧?

Right?

Speaker 0

你可以看到,它并不是一个更大的模型。

You can see it's not a bigger model.

Speaker 0

大小差不多,你知道的,或者你可能会觉得大了一点。

It's roughly the same size, you know, or you think more.

Speaker 0

对吧?

Right?

Speaker 0

但再说一次,OpenAI 最早的那些思考型模型,比如 o1、o3,都会花很长时间思考,浪费大量令牌。

But, again, like, this is something that OpenAI's first thinking models, you know, the first few generations of o one, o three would think for a long time and waste a lot of tokens, if you will.

Speaker 0

而你看 Anthropic 的思考型模型,就算开启思考模式,它们也用少得多的思考时间,就能达到和 OpenAI 一样甚至更好的结果。

And when you look at, for example, Anthropics thinking models, even when you put them in thinking mode, they think a lot less, right, to get to the same results or better results, right, as OpenAI was.

Speaker 0

所以 OpenAI 后来优化了很多,比如说,我问过的一个最傻的问题是,我曾经问 o3:猪肉算红肉还是白肉?

And so OpenAI, I think, optimized a lot of, well, if I ask like, think the silliest one I had asked was, I asked o three once, is pork red meat or white meat?

Speaker 0

它居然想了整整 48 秒。

And it thought for, like, forty eight seconds.

Speaker 0

我当时就想,你到底在干嘛?

I was like, what are you doing?

Speaker 0

他们直接告诉我不就行了嘛。

Like, they should just, like, tell me the answer.

Speaker 0

所以呢,GPT-5 的好处在哪儿呢?就算你手动选了思考模式,它思考的时间也会少很多。更重要的是,它有个自动路由的功能,能自己判断该走哪条路:是走普通模型,还是因为速率限制走迷你版,或者是走思考模式。

And so, like, the nice thing is that g p d five will think a lot less even if you select thinking manually, but more importantly, they have the sort of auto functionality, the router, which lets them decide whether or not, hey, do I route to the regular model?

Speaker 0

该不该走思考模式?

Do I route to maybe mini if you're out of rate limits, or do I route to thinking?

Speaker 0

思考到什么程度?

And how much do I think?

Speaker 0

不过总的来说,思维模型思考的时间会变短。

But in general, the thinking model will think less.

Speaker 0

所以,对于普通用户来说,处理平均查询所需的算力比以前少了。

So there's less compute going into a power user's average query than before.

Speaker 3

但这不是更有趣吗?

But isn't it even more interesting?

Speaker 3

OpenAI 无法控制分配给你的算力有多少。

OpenAI cannot control how much computer wants to allocate to you.

Speaker 3

对吧?

Right?

Speaker 3

如果负载很高,也许可以稍微调整一下路由,让它更保守一些,对吧?

If we're in a high load situation, maybe tune the router a little bit so it's less, right?

Speaker 3

也许用 Skype。

Maybe Skype.

Speaker 3

我不清楚他们背后具体怎么做,但现在网上有个段子,说他们根本没做什么别的,就是把三个主力模型加几个小模型,前面加个路由,然后打包低价卖,对吧?

I have no idea what they're doing behind the curtain, but there's this meme out there at the moment that basically all they did which is a meme, right?

Speaker 3

这说法不靠谱,但说白了,他们就是把三个主力模型加几个小模型,前面加个路由,然后打包卖个更低的综合价格,对吧?

It's not true but all they did was take all three plus a couple of smaller models, put a router in front, and offer that at a lower blended price, essentially, Right?

Speaker 3

我觉得确实有那么一点道理。

I think there's a little bit of that.

Speaker 3

成本突然变得重要了,他们找到了一种方式来调控这一点。

Cost suddenly matters, and they figured out a way how they can steer that.

Speaker 0

我觉得是的,他们还提到过,如何大幅提升了基础设施的承载能力。

I think, yeah, and they talked about how they've been able to dramatically increase their infrastructure capacity.

Speaker 0

因为我自己之前一直都在用三号或者4.5号模型,对吧?

Because I myself was just regularly using three or 4.5, Right?

Speaker 0

现在却被强制用自动模式,有时候给我的是三号那种思考型模型,有时候却只是普通基础版。

And now I'm forced to use auto, which sometimes gives me the o three equivalent thinking model, but sometimes gives me just the regular base model.

Speaker 0

是的。

Yeah.

Speaker 0

这真让人头疼。

Which sucks.

Speaker 0

不过我觉得,对免费用户来说,其实还挺有意思的。

But, like, I think for the free user, it's actually quite interesting.

Speaker 0

对吧?

Right?

Speaker 0

以前免费用户几乎根本用不上思考型模型,很多时候就是打开网站问个问题就完了,但现在他们的请求偶尔会被分配到思考型模型上。

The free user was not getting thinking models pretty much ever or not using them, or in many cases, just opened the website and asked their query, and now sometimes their query gets routed there.

Speaker 0

所以有时候他们能用上好很多的模型,但有时候OpenAI也会平滑地降级到普通版本。

So sometimes they get a way better model, but now sometimes the OpenAI can gracefully degrade them

Speaker 3

没错。

Exactly.

Speaker 0

如果有必要的话。

If they need to.

Speaker 0

对吧?

Right?

Speaker 0

我觉得这个路由机制体现了OpenAI未来的商业方向。

And I think the router points to the future of OpenAI from a business.

Speaker 0

你可以看看其他模型公司,比如Anthropic,完全专注于企业客户、API、代码工具之类的。

You can look at sort of the model companies, Anthropic is fully focused on B2B, API, code, etcetera, or Cloud Code, whatever it is.

Speaker 0

OpenAI当然也有企业业务,比如代码工具和API,但他们的主要收入其实来自个人用户。

OpenAI, yes, they have that business, Codecs and API business, but really, majority of the revenue is consumer.

Speaker 0

而且是靠个人订阅收入。

And it's consumer subscriptions.

Speaker 0

但他们现在没法把免费用户转化为付费用户。

But they have no way to upsell, to make money off of all the free users.

Speaker 0

在其他任何消费类应用里,免费用户其实都是通过广告来付费的。

In any other application consumer app, the free user still pays via ads.

Speaker 0

但这种模式跟人工智能不兼容。

But this is not compatible with AI.

Speaker 0

它是个帮你的助手。

It's a helpful assistant.

Speaker 0

你不能因为插广告就让用户的使用体验变差。

You can't just make the users result worse by injecting ads.

Speaker 0

横幅广告在AI产品里也行不通。

Banner ads don't really work in AI either.

Speaker 0

那该怎么让这些用户变现呢?

So it's like, how do you now monetize them?

Speaker 0

我觉得有了这个路由系统,他们已经很接近解决这个变现问题了。

And I think with the router, they're getting really close to figuring out how to monetize that user.

Speaker 0

在新涌现的大量应用里,你要是看过她为Shopify发布的产品,那是个购物助手。

With the new sea of applications, if you saw her product that she launched at Shopify, I think it was Shopify, was an agent for shopping.

Speaker 0

对吧?

Right?

Speaker 0

现在这就一下子明白了,如果用户问个没什么价值的问题,比如‘天空为什么是蓝的?’

And now this like immediately clicks like, oh, if the user asks a low value query, hey, why is the sky blue?

Speaker 0

那就直接转给轻量模型好了。

Just route them to mini, right?

Speaker 0

这个模型完全能答得上来。

The model can answer perfectly fine.

Speaker 0

这类问题其实占了不小的比例。

And that is a chunk of queries, right?

Speaker 0

但如果他们问‘附近最好的酒驾律师是谁?’,那就不一样了。

But if they ask what's the best DUI lawyer near me, Right?

Speaker 0

这时候你就知道,情况可就严重了。

All of a sudden, this is like, you know, you're in jail.

Speaker 0

你只有一次机会。

You have one shot.

Speaker 0

你干脆不管了。

You're like, screw it.

Speaker 0

我直接问下Chad GPT,附近最好的醉驾律师是谁。

Let me ask Chad GPT what the best DUI lawyer is.

Speaker 0

现在这模型还做不到,但很快就能连上本地所有律师,查他们的胜诉率,甚至翻他们的法庭文件之类的。

And now all of a sudden, the model's not capable of it today, but soon enough, it'll be able to contact all the lawyers in the area and figure out what their results are and maybe search their, like, court filings and whatever.

Speaker 0

对吧?

Right?

Speaker 0

帮你预约最好的律师,或者订机票。

Book the best lawyer for you or an airplane ticket.

Speaker 3

这中间肯定要抽成。

A cut as part of that.

Speaker 0

是的。

Yeah.

Speaker 0

当然,他们肯定会抽成。

Of course, they're gonna take a cut.

Speaker 0

对吧?

Right?

Speaker 0

但这才是更好地从免费用户身上赚钱的方式。

But this is a much better way of monetizing the free user.

Speaker 0

就像 Etsy 那样,你知道的。

It's like, you know, it's like Etsy.

Speaker 0

现在有百分之十的流量来自聊天,但 OpenAI 目前在这上面一毛钱都没赚到,不过很快就会了。

10% of their traffic now comes from chat, and OpenAI makes nothing off of that, but they really, really will soon.

Speaker 0

对吧?

Right?

Speaker 0

部分原因是亚马逊屏蔽了聊天功能,但其实从购物决策中赚钱是完全可行的,不管是订机票还是找商品。

And partially, that's because Amazon blocks chat, but there's a way to make money from shopping decisions, whether it's booking flights or looking for items.

Speaker 0

至于那些免费用户,你现在可以说:我不在乎。

And those you now say, free user, I don't care.

Speaker 0

我会直接把你引向我最好的模型。

I'm gonna send you to my best model.

Speaker 0

我会把你转接到智能代理那里。

I'm gonna send you to agents.

Speaker 0

我会为你动用海量算力,因为我能从你身上赚钱。

I'm gonna spend ungodly amounts of compute on you because I can make money off of this.

Speaker 0

但如果只是帮您做作业这类问题,我就给你用个还不错的模型。

But if it's a query that's like, help me with my homework, I'll send you, like, a decent model.

Speaker 0

对吧?

Right?

Speaker 0

我没必要在你身上花钱。

I don't need to spend money on you.

Speaker 0

所以,这就是我想的,通过这个方式,终于能从免费用户身上赚到钱了。

And so this is how I think, like, opening, I can finally make money off of the free user.

Speaker 0

我觉得,这正是路由系统最核心的价值。

And I think that's the biggest, like, thing about the router.

Speaker 0

对吧?

Right?

Speaker 0

这太有意思了。

This is super interesting.

Speaker 0

我觉得这一点

I think this

Speaker 3

这是我们第一次看到,新模型发布时,成本竟然成了主要话题。

is the first time that we've seen that there's a launch of a new model where, to some degree, cost is the headline item.

Speaker 3

对吧?

Right?

Speaker 3

以前大家总是关心谁的模型最聪明。

Mean, so far, was always like, Who has the smartest model?

Speaker 3

谁的MLL评分最高。

Who has the highest MLL use score?

Speaker 3

现在突然间,有人每天用模型写代码八个小时,结果发现,要是用大上下文窗口加顶级模型,一个月光算力成本就能烧掉上千美元。

Now we have suddenly people who use models for coding for eight hours a day, and surprise that if you take a large context window and the best model creates thousands of dollars of cost a month.

Speaker 3

所以,成本真的很重要。

So, cost matters.

Speaker 3

所以,成本和性能之间的权衡点,现在成了衡量模型竞争力的新标准,而不再只是看成本本身。

And so, to some degree, so where you're on the Pareto frontier between cost and performance is the new benchmark for model competitive no longer cost alone.

Speaker 3

我们看到的正是这种情况吗?

Is that what we're seeing here?

Speaker 0

我的意思是,确实如此。

I mean, I think definitely right.

Speaker 0

OpenAI 说他们为大量用户提高了使用限额。

OpenAI said they doubled their rate limits for big amounts of users.

Speaker 0

他们在这次更新后大幅增加了提供的 token 数量,这实际上说明这是一次以经济性为导向的发布。

They've dramatically increased the number of tokens they're serving from this launch, which effectively says this is an economic release.

Speaker 3

这也意味着每个 token 的成本可能降下来了。

Probably also means the tokens are now cheaper.

Speaker 3

对吧?

Right?

Speaker 0

不然的话,确实如此。

Otherwise Yeah.

Speaker 0

是的

Yeah.

Speaker 0

当然

For sure.

Speaker 0

当然

For sure.

Speaker 0

我觉得最有趣的是,你提到的这个成本问题,我们在代码工具领域其实已经见过类似情况了。

I I think the funniest thing is this whole cost thing you mentioned is, we've seen this in the code space.

Speaker 0

对吧?

Right?

Speaker 0

Cursor 不得不取消了那个无限使用的版本。

Cursor had to pull away the unlimited clogged code.

Speaker 0

他们最初推出的是一个非常昂贵的套餐,号称无限使用,后来改成了每周使用上限。

Initially, they had this super expensive plan, and it had, like, unlimited rates, and then they or only, like, a weekly rate limit.

Speaker 0

现在他们改成了按小时计费的使用限制。

Now they have, like, hour based rate limits.

Speaker 0

我看到推特上有个特别疯狂的帖子,说有个人调整了自己的作息。

And I saw the craziest, like, thread on Twitter where this guy said he changed his sleep schedule.

Speaker 0

对吧?

Right?

Speaker 0

他是模仿海湾里的单人帆船手的做法。

Modeled after, like, house sailors in the bay.

Speaker 0

如果你在航海,根本没法好好睡觉。

If you're sailing, you can't sleep.

Speaker 0

对吧?

Right?

Speaker 0

单人航海的时候,他们会在合适的时间抓空打个盹,保证安全。

Like, solo sailing, they'll take, like, power naps when they get to the right spots so that they can still be safe.

Speaker 4

早上风小的时候。

In the morning when it's not very windy.

Speaker 0

但他们不可能一觉睡到天亮。

Well, but they can't sleep uninterrupted.

Speaker 0

对吧?

Right?

Speaker 0

所以因为Anthropic设置的使用限制不只是按周,还要按小时算,他每天得多次休息,

And so because Anthropic had to put rate limits that are not just week based, but number of hours based, and he, like, basically sleeps multiple times a day, but

Speaker 3

每次只睡一小会儿

small chunks

Speaker 0

就是为了最大化利用额度。

just so he can maximize the usage.

Speaker 0

Reddit上还有个排行榜,有人在比谁用的token最多,有个家伙一个月花三万美元。

And there's also a leaderboard on Reddit where people are, like, competing to see how many tokens they're using through their subscription, and there's, like, a dude spending, like, $30,000 a month.

Speaker 3

所以我打算找一个印度的开发者,和我一起做结对编程,我白天用,他晚上用,咱们俩一起把账户的配额用到极致。

So I'm gonna find some developer in India that can do pair programming with so I can get the day cycle, he can get the night cycle, and we both can maximize together the quota for the account.

Speaker 3

那这就是未来了吗?

Is that the future then?

Speaker 3

这算

It's

Speaker 0

我的意思是,这很明显。

I mean, but it's clear.

Speaker 0

人们都在利用负毛利的模式,说白了就是这么回事。

Like, people are taking advantage of the negative gross margin, like, sort of Yeah.

Speaker 0

那些订阅服务就是这样。

Subscriptions that are offered.

Speaker 0

我觉得Anthropic从我的订阅上其实还是赚了毛利的。

I think Anthropic probably makes a positive gross margin off of my subscription.

Speaker 0

我自己的使用量不够大,但肯定有很多人是在亏钱的。

I don't encode enough, but there's plenty of people that are definitely losing money.

Speaker 0

所以就像你说的,这本质上是个经济问题。

And so as you said, it's an economic

Speaker 3

我认为这会推动更多转向按使用量计费的模式。

It'll push more and more to, I think, just usage based pricing.

Speaker 3

如果你转售的商品在成本中占了这么大比例,那就只能改用按使用量收费了。

If you have an underlying commodity that you're reselling to some degree that is that large a part of your cost of goods, you need to go to usage based pricing.

Speaker 0

你觉得这些代码类产品在吸引和留住用户方面能有多强?

How much do you think the customer capture and stickiness for these code products is?

Speaker 0

我很好奇你对这个问题怎么看?

I'm curious what you think on that, right?

Speaker 0

一旦你开始用某个IDE,或者集成某个命令行工具,用户还会轻易换掉吗?

Once you use an IDE, once you integrate one of the CLI products in, how sticky is it?

Speaker 0

这真的能轻易切换吗?

Is it going That's switch that

Speaker 3

这是个价值十亿美元的问题。

a billion dollar question.

Speaker 3

这还是个相当保守的估计。

That's a very conservative estimate.

Speaker 3

你看,埃里克·帕西有一张特别棒的幻灯片,他说,如果你现在要构建一个智能代理系统,对吧?

Look, Eric Parthy has this great slide where he basically says, If you're building agentic system today, right?

Speaker 3

但本质上,它就是一个循环,其中一半是模型在思考,然后试图去执行任务。

But fundamentally, what it is is of this loop, right, where half of the loop is the model thinking, right, and then trying to lose them.

Speaker 3

另一半则是用户在确认代理做了什么,是不是做对了,给出反馈,并引导它往正确的方向走,因为我们不能让它无休止地运行下去。

The other half is then the user verifying what did the agent do, is it the right thing, providing feedback, and trying to steer it in the right direction because we can't run forever.

Speaker 3

最终,我们还是得把它拉回正轨。

Eventually, we need to steer it back.

Speaker 3

这一半是模型提供方,对吧?

Half of that is the model provider, right?

Speaker 3

他们在努力打造最好的模型。

They're trying to build the best models.

Speaker 3

另一半则主要是,我觉得,设计出最理想的用户界面,让用户能方便地提供反馈。

The other half is really about, I think, designing the best possible UI to enable the user to get feedback.

Speaker 3

我觉得这里面确实有value。

And I think there's value in that.

Speaker 3

所以,我觉得这里面是有一定粘性的,对吧?

So, I think there's a certain amount of stickiness in there, right?

Speaker 3

那各种不同的工具都有哪些呢?比如,拿代码编辑来说,对吧?

So, what are all the different tools, like, say, take code editing, right?

Speaker 3

我该怎么最简单地看出代码改了哪些地方?

How can I most easily visualize what the code changes are?

Speaker 3

我该怎么最清楚地看到这些改动影响了哪些文件?

How can I most easily visualize what they impact, which files?

Speaker 3

对于小改动,怎么才能快速得到反馈?对于复杂改动,又怎么获得更详细的反馈?

How can I, for small changes, get very quick feedback versus for complex ones, get complex feedback?

Speaker 3

有些工具会直接给你画出它们做了什么的图示。

There's some tools that actually draw diagrams for you of what they do.

Speaker 3

我觉得这场竞争就会在这里展开。

So, I think this will be the battle.

Speaker 3

我觉得这里面确实有黏性。

I think there's stickiness in that.

Speaker 3

具体会有多强呢?

How much exactly?

Speaker 3

这是个非常好的问题。

This is a great question.

Speaker 0

所以从这个角度看,企业应该靠订阅制来绑定用户,而不是转向按使用量收费,对吧?

So in that sense, people should be doing subscriptions to get people locked in, right, instead of moving to usage based pricing?

Speaker 4

我觉得是客户不想用按使用量收费,因为很难预测成本。

Well, I think it's the customers that don't want to do usage based pricing because it's so hard to guarantee.

Speaker 4

这种模式太难控制了,而你其实想要的是确定性,愿意承诺高额支出,就是为了避开按使用量计费。

It's so hard for it to get away from them, and you actually want guarantees, and you're willing to commit to pretty high spend in order to not have usage based pricing.

Speaker 4

我觉得反而是公司更倾向于按使用量收费的模式。

I think it's the model companies that want usage based pricing.

Speaker 3

说到消费者,说实话,不用按使用量收费几乎不可能,因为使用差异实在太大了。

I think with consumers, it's frankly very hard to not have usage based pricing just because the variability is so massive, right?

Speaker 3

比如我们自己写代码,和那些靠这个吃饭的专业人士相比,使用量差个二十倍都很正常。

If it's us coding versus somebody who does this as their full time job, right, you just have a factor of 20 or so difference in usage.

Speaker 3

这可是不小的开销啊。

That costs a lot of money, right?

Speaker 3

对企业来说,我们可能会看到更多固定费用的定价方式,因为可以平均分摊。

Think for enterprises, we could see, like, more flat fee pricing because we can average it out more.

Speaker 4

有个开发者整天都在用这个工具。

You have a developer that's using it all day.

Speaker 4

你大概能猜到,他们每天编程大概多久,大概是什么样子。

You kinda know, in a general sense, like, how many hours a day they're programming and what that sort of looks like.

Speaker 3

配额的设定

The vibe quotas are

Speaker 4

很难搞。

hard.

Speaker 4

是啊。

Yeah.

Speaker 2

在那之前。

Before Yeah.

Speaker 2

我们离开OpenAI之前,我想问个大问题:如果有人坐在这儿,对你说,嘿,戴伦。

We leave OpenAI, I wanna ask a broad question, which is if someone was sitting here and saying, hey, Dylan.

Speaker 2

你让干什么我都听。

I'll listen to anything you tell me to do.

Speaker 2

只要你觉得能提升OpenAI的价值,有什么建议尽管说?

Any advice you have as long as it makes OpenAI more valuable, what would you tell them?

Speaker 0

我建议立刻推出一个功能,让用户能把信用卡绑定到ChatGPT上,同意让AI代表你办事时从中抽成一定比例,然后马上上线。毕竟,它不是已经在帮人购物了吗?

I would say immediately launch a method for you to input your credit card into ChatGPT and agree that for anything it, like, agentically does for you, it'll take x cut and then launch that product because where it does shopping, right?

Speaker 0

大家都知道,Anthropic、OpenAI这些实验室都在买Amazon、Shopify、Etsy这些电商平台,还有各种在线订票网站的RL环境。

Because, like, everyone knows that, like, Anthropic and OpenAI and all the other labs are buying RL environments of Amazon and of Shopify and of Etsy and of all the different ways to shop on the Internet, of airline websites.

Speaker 0

直接说,把我的日历接入一下。

Just like, hey, integrate my calendar.

Speaker 0

我周四想飞那儿,别让我错过会议。

I wanna fly to there on Thursday, make sure I don't miss a meeting.

Speaker 0

好的,帮我订票。

Cool, book.

Speaker 0

把这个功能做得特别扎实。

Do that integration super well.

Speaker 0

了解我的偏好,比如我喜不喜欢靠窗或靠过道,全都记下来,然后收个服务费就行。

Know my preferences on whether I like aisle or window, all this stuff, and just take a take rate.

Speaker 0

我觉得只要一上线,这笔钱就稳了。

I think this will make them so much money the moment they launch it.

Speaker 0

我觉得他们可能已经在做了,但我真想听听他是怎么想的,毕竟过去半年他对广告的态度转变太大了。

And I think they're working on it already, but I'd like to hear how he thinks about it, because he shifted his tone massively on ads over the last six months.

Speaker 0

以前他可是坚决说不行。

He used to be like, no way.

Speaker 0

现在呢,他倒说也许可以。

And now he's like, maybe.

Speaker 0

其实有办法做,又不会影响用户体验。

There's a way to do it without harming the user.

Speaker 0

我觉得这才是变现免费用户的好办法。

I think this is how you monetize the free user.

Speaker 0

对吧?

Right?

Speaker 0

所以这大概就是我想跟他聊、或者问他的一整套问题了。

So I think that's probably what I'd tell him slash ask him about, like a whole line of questions around this.

Speaker 2

他几周后会来我们的播客节目,

Well, he's coming on the podcast in a few weeks,

Speaker 3

那太好了。

so Oh, nice.

Speaker 2

到时候我们直接问他。

We'll ask him.

Speaker 2

我想换个话题,聊聊英伟达。

I wanna shift to NVIDIA.

Speaker 2

英伟达今年真是大爆发。

NVIDIA's having a monster year.

Speaker 2

股价已经涨了将近百分之七十。

They're up almost 70%.

Speaker 2

接下来会有什么走向?

What are the possible paths from here?

Speaker 2

你觉得会怎样

How do you see

Speaker 0

会怎么发展呢?

it playing out?

Speaker 0

这取决于你对持续增长有多乐观,不过我觉得你们有很好的观察视角。

Depends how pilled you are on the continued growth, but I think you guys have a good vantage point.

Speaker 0

我们能清楚看到很多公司的收入增长有多快,尤其是那些做代码相关的企业,甚至很多其他应用领域也是如此。

We have a good vantage point of how fast revenue is growing for a lot of these companies, especially the code companies, but even many other applications.

Speaker 0

我觉得需求端明显在加速上升。

I think we can clearly see the demand side is accelerating.

Speaker 0

再看训练端,我觉得竞争已经打响了。

And then if you look at the training side, I think the race is on.

Speaker 0

Meta正在大幅加码。

Meta is upping hugely.

Speaker 0

谷歌也在大力投入。

Google is upping hugely.

Speaker 0

如果你看看OpenAI和Anthropic今年从谷歌、亚马逊、微软、CoreWeave和Oracle那里获得的算力,光是这两家公司就拿走了30%的芯片。

If you just look at, again, just Open Eye and Anthropic and the compute that they have and are getting this year from Google and Amazon for Anthropic and from Microsoft, Coreave, Oracle for OpenAI, 30% of the chips are going to them, just those two companies.

Speaker 0

但事实上,70%的东西里,有三分之一的收入来自广告,不管是字节跳动、Meta,还是其他做广告的公司。

But that's actually like, okay, well, like, 70% of the stuff, like, who's making off one third of it is ads, whether it be ByteDance or Meta or many of the other people who are doing ads.

Speaker 0

那剩下的三分之一芯片,又是谁在买呢?

So then it's still like, okay, well, where are the rest of these one third of the chips coming from?

Speaker 0

主要是些经济上不划算的玩家,我觉得他们未必能持续融到越来越大的资金。

Well, they're mostly uneconomic providers who I don't think it's an obvious bet that they're going to keep raising bigger and bigger rounds.

Speaker 0

那接下来会发生什么?

So what happens there?

Speaker 0

我们之前聊过编程的事。

I think with the We talked about coding earlier.

Speaker 0

实际上,Qwen-Coder 3这个模型,不管是本地部署还是用云服务配合这些推理库,成本都低得惊人。

Actually, the Quen Coder three model is actually super cheap if you're running it on prem or if you're running it in the cloud with all these inference libraries.

Speaker 0

像这类情况也不少。

And so there's stuff like that as well.

Speaker 0

所以关键问题是,它还能增长多少?

So I think the question is how much does it keep growing?

Speaker 0

很明显,前三分之一的支出,尤其是OpenAI和Anthropic的投入,正在急剧上升。

Because clearly, I think the first third is definitely skyrocketing of open eye, anthropic lab spend.

Speaker 0

中间那三分之一的广告收入也会增长。

The second third of ads is gonna grow.

Speaker 0

虽然不会暴涨,但我认为生成式AI广告可能会迎来一个关键转折点。

It's not gonna grow like crazy, but I think there's definitely an inflection point that could be hit with Gen AI ads.

Speaker 0

我知道Meta已经在大量测试这方面的应用,但我完全相信,个性化广告的转化率会迎来巨大提升——比如开始向我推送定制化的广告。

I know Meta's been experimenting with it a lot, but I could totally be convinced that there's gonna be a huge inflection in take rate there, right, where you start showing me personalized ads.

Speaker 0

每一条广告都长得跟我本人似的,我就会想:嗯,有点意思。

Like, every person that's an ad is, like, looks like me, and I'll be like, okay.

Speaker 0

对。

Yes.

Speaker 0

而且做得更好一点,让我感觉更舒服。

Except, like, slightly better, so I, like, feel better.

Speaker 0

对吧?

Right?

Speaker 0

我就想买它了。

And I'm like, I wanna buy it.

Speaker 0

对。

Yeah.

Speaker 0

我有

I have

Speaker 3

完全不知道这该怎么规模化。

no idea how this is gonna gonna scale.

Speaker 3

对吧?

Right?

Speaker 3

但如果你问,它能发展到多大?

But if you ask the question, how much could it scale?

Speaker 3

我们在这里创造了多少价值?

How much value are we creating here?

Speaker 3

我们能创造足够的价值,支撑长期增长吗?

Can we create enough value to actually keep growing for a long time?

Speaker 3

你就说人工智能软件开发吧,对吧?

If you just take AI software development, right?

Speaker 3

是的。

Yeah.

Speaker 3

我们很清楚,用它开发能轻松提升大约百分之十五的效率。

We know we can easily get about 15% more productivity out of it developing.

Speaker 0

我不这么认为。

I don't think that's right.

Speaker 0

我觉得要高得多。

I think it's way higher.

Speaker 3

不对。

No.

Speaker 3

不对。

No.

Speaker 3

我是说,我接触过很多企业。

With the straight like, I talk to a lot of enterprises.

Speaker 3

比如,传统企业直接部署 GitHub Copilot,大概能提升 15% 的效率。

Like, a classical enterprise, straight up GitHub Copilot deployment, that gives you about 15%.

Speaker 3

我们完全可以做到比这更多。

We can do much more than that.

Speaker 0

但是,兄弟,你知道 GitHub Copilot 有多难用吗?

But, bro, like, you know how bad GitHub Copilot is?

Speaker 0

比如,他们是怎么看自己的年度经常性收入(ARR)的?

Like, how did they how are look at their revenue ARR.

Speaker 0

这其实是

This is

Speaker 3

稍微有点夸张了。

a little overbar.

Speaker 0

挺逗的。

Funny.

Speaker 0

真的挺有意思的。

It's so funny.

Speaker 0

你要是看他们的收入ARR图表,就会发现Cloud Code才三个月就超过他们了。

If you look at their revenue ARR chart, it's like Cloud Code and three months has surpassed them.

Speaker 0

Cursor更是轻松就超过了他们。

Cursor, you know, easily surpassed them.

Speaker 0

还有像Replen、Windsurf和Cognition这样的公司,迟早也会超过他们。

And then, like, even, like, companies like Replen or, like, and Windsurf slash Cognition are, like, gonna pass them.

Speaker 0

你得承认,这压力确实不小。

It's like, You appreciate the crunch.

Speaker 3

假设我们能把效率提升到100%,就能让每个开发者的工作效率翻倍。

Let's assume we can get this to 100%, so we can double the productivity of a developer.

Speaker 3

全球大概有三千万名开发者,差不多就是这个数。

About 30,000,000 developers worldwide, give or take.

Speaker 3

我们按每个开发者创造一百单位的价值来算。

Let's say 100 value add per developer.

Speaker 3

这个数字在全球范围内可能有点偏高了。

This might be a little high worldwide.

Speaker 3

美国这边偏低,但全球范围就很高了。

The US is low, but worldwide is high.

Speaker 3

三千亿美元。

It's $3,000,000,000,000

Speaker 0

是啊,没错。

Yeah, yeah.

Speaker 3

对吧?

Right?

Speaker 3

所以我们正在开发的技术,很可能为全球GDP增加三万亿美元的价值。

So we're probably building technology here which adds $3,000,000,000,000 of GDP value.

Speaker 3

理论上,我们可以把这些投入GPU,因为那是主要的

In theory, we could put that into GPUs because that's the main

Speaker 4

成本现在主要来自代码模型。

cost Just for from a coding model, now.

Speaker 4

所以关键在于

So the point of

Speaker 3

至少在理论上,价值创造还会持续增长。

at least, in theory, the value generation is here to keep growing.

Speaker 3

但这种价值如何转化为产业现实,就要复杂多了。

Now how that translates to the industry is much more complicated.

Speaker 0

我觉得我们已经看到AI创造的价值了,现在不是有3000亿、2000亿的问题,估计很快就是6000亿的问题了。

I think we've already seen AI's value creation so of there's the whole, like, the famous, like, oh, 300,000,000,000 problem or 200,000,000,000 problem now, 600,000,000,000 problem, I'm sure.

Speaker 0

所以Quiz很快就会抛出一个一万亿美元的挑战,没错。

So Quiz is gonna put out like a $1,000,000,000,000 problem, right, soon enough.

Speaker 0

当然,这里面确实有现实依据,但人们忽略了现在的基础设施投入,覆盖的是五年收入,而不是一年,而且收入曲线也不是平的。

But like, like, there is some like reality in that, of course, but you know, ignores that like infrastructure spend today is accounting for five years of revenue, not like one, and the revenue looks like this, not like flat line.

Speaker 0

但我认为关键是,AI创造的价值已经超过了投入,问题出在价值分配上。

But I think the main thing is that AI is already generating more value than the spend, it's that the value capture is broken.

Speaker 0

对吧?

Right?

Speaker 0

我真心觉得,OpenAI通过聊天机器人创造的价值,自己连10%都没拿到。

Like, I legitimately believe OpenAI is not even capturing 10% of the value they've created in the world already, just by usage of chat.

Speaker 0

对吧?

Right?

Speaker 0

我觉得同样的情况也适用于Anthropic、Cursor,还有其他你关注的公司。

And I think the same applies to, you know, Anthropic and Cursor and whoever else you're looking at.

Speaker 0

价值捕获真的出了大问题。

Think the value capture is really broken.

Speaker 0

就连我们内部,四个开发人员就能实现这么多自动化,我们在Gemini API上的开支低得离谱,但每个数据中心的每一份许可和监管文件,我们全靠AI来处理。

Even internally, I think what we've been able to do with four devs in terms of automation, our spend on Gemini API is absurdly low, and yet we go through every single permit and regulatory filing around every single data center with AI.

Speaker 0

我们还会用卫星图像拍摄每一个数据中心,然后标注数据集,识别出对方用的是什么发电机、冷却塔、施工进度,还有变电站等等。

And it's like and we we take satellite photos of every data center, and we, like, we're able to label our data set and then recognize what generators people are using, what, like cooling towers and the construction progress and substation.

Speaker 0

所有这些工作都是自动完成的,全靠生成式AI,而我们只用了极少的开发人员。可我通过销售这些数据、提供咨询服务所创造的价值却非常高,但公司自己却没得到多少。

All this stuff is automated, and it's only possible because of Gen AI, and we do it with very few developers, and then the value capture that I'm able to generate by selling this data, by consulting with it is so high, but the company is making it.

Speaker 0

他们根本没从中获益。

It's like they get nothing out of it.

Speaker 0

我觉得这里的价值捕获问题,远远超过了价值创造本身。

I think there's a value capture challenge here that far out exceeds the sort of creation.

展开剩余字幕(还有 480 条)
Speaker 0

随着像GPT-5这样的模型出现,或者开源模型持续压低成本,这些公司想赚到钱就越来越难了,很多时候它们的推理业务毛利率连50%都不到。

And as you get models like GPT-five or open source models continuing to drive it down, it's like the value capture is just harder and harder and harder for these companies because they're making 50% gross margin on inference if they're or less in many cases.

Speaker 0

在这么多

In so many

Speaker 3

换句话说,你的意思是我们在被商品化,所以赚不到钱,那也就该收敛一下在GPU上的投入预期了?

words, you're saying we're getting commoditized, and and therefore you can't capture the value, and thus you should temper your expectations of how much how much you can spend GPUs?

Speaker 0

不,不是这样。

Well, no.

Speaker 0

我觉得还是有办法能大幅提高价值回报的。

I think I think you can I think there's still ways to, like, inflect hugely on value capture?

Speaker 0

对吧?

Right?

Speaker 0

我刚才提到,广告是个巨大的价值提升点。

I mentioned the ads are a huge value capture inflection.

Speaker 4

在大规模增长之前,这种情况还得先发生。

To happen before before we see massive increase.

Speaker 0

不是。

No.

Speaker 0

我觉得另一点是,还有很多资本还没花出去。

I think I think the other thing is, like, there's a lot of capital that's not been spent.

Speaker 0

对吧?

Right?

Speaker 0

像那些超大规模云服务商,明年资本支出还能再涨30%,比今年还高。

Like, the hyperscalers still can grow CapEx 30% next year, right, from what they're doing this year.

Speaker 0

另外,像CoreWeave和Oracle这样的公司,因为能从资本市场融资,资本支出增幅能远超20%到30%。再往下看,全球最大的基础设施基金,比如布鲁克菲尔德和黑石,现在也都把目光转向了基础设施,尤其是AI基础设施,更别提各国的主权财富基金了,像G42、挪威的那家,还有新加坡的GIC。

In addition, companies like CoreWeave and Oracle, because they're tapping capital markets, can raise way more than 20 to 30% CapEx, and then you go down the list further and it's like, oh, the largest infrastructure funds in the world, like Brookfield and Blackstone, well actually they're turning all of their eyes to investing even more into infrastructure, AI infra, and then you're like, the sovereign wealth funds of the world, like the G42s, or you know, the Norway one or GIC in Singapore.

Speaker 0

这些人对AI的投入才刚起步,所以我觉得,未来还有大量资本会涌入,而且不一定从一开始就冲着经济回报去的。

Like, these people have barely started touching AI, and so I think there's a whole lot more CapEx that can come without it being necessarily, like, economically motivated day one.

Speaker 0

我想说的是,纯粹出于经济动机的资本支出,增长空间终究有限,但还有很多其他情况——比如你拿张表格算来算去,按实际业务来看,根本看不出该花这么多钱。

I'm more so saying, like, economically motivated CapEx can only grow, like, so much, but there's so much other, like like like, where it's not clear from you know, if you have a spreadsheet, you know, and you're basing it on real business that you should actually spend this much.

Speaker 0

但人们还是会花,因为他们相信。

But people will because they believe.

Speaker 0

我相信。

I believe.

Speaker 0

我觉得你也相信。

I think you believe.

Speaker 0

比如基础设施这块,大家觉得投了总能赚回来,但其实并没有什么百分百确凿的依据能说得通。

Like, infra you know, people believe that this will be you'll get profit out of it, but there's no, like, 100% certain, like, you know, way to argue it.

Speaker 0

是的。

Yeah.

Speaker 2

NVIDIA在多大程度上受到定制芯片的威胁?

How's threatened, if at all, is NVIDIA by by custom silicon?

Speaker 0

我觉得这才是最关键的问题,你看谷歌、亚马逊,还有Meta下的订单。

I think that's the biggest thing, right, is when we look at orders from Google and from Amazon, right, especially, and and Meta.

Speaker 0

他们的定制芯片,可不是微软那种。

Their custom silicon is not not Microsoft.

Speaker 0

他们的定制芯片其实挺差的。

Their custom silicon kinda sucks.

Speaker 0

但另外三家在过去一年里大幅增加了订单量。

But the other three, they're really upping their orders massively over the last year.

Speaker 0

亚马逊正在生产数百万颗Trainium芯片。

You know, Amazon is making millions of Trainium.

Speaker 0

谷歌也在生产数百万颗TPU芯片。

Google's making millions of TPUs.

Speaker 0

TPU显然已经满负荷运转了。

TPUs clearly are, like, 100% utilized.

Speaker 0

对吧?

Right?

Speaker 3

是的。

Yeah.

Speaker 0

他们目前还没做到,但我认为亚马逊迟早能搞定,Anthropic也会。

They didn't really not there, but I think Amazon will figure out how to do that, and Anthropic will.

Speaker 0

所以我觉得对英伟达最大的威胁,其实是越来越多公司掌握了定制芯片的使用方法。

So so I think I think that's the biggest threat to NVIDIA is that people figure out how to use custom silicon more broadly.

Speaker 0

所以如果人工智能的资源越来越集中,定制芯片的优势就会更明显。

And this sort of becomes the sort of, like, if AI is concentrated, then custom silicon will do better.

Speaker 0

这还没算上OpenAI的芯片团队之类的事情呢。

And that's not even talking about, like, OpenAI's silicon team and stuff.

Speaker 0

对吧?

Right?

Speaker 0

要是人工智能真的被少数公司垄断,那定制芯片就会更有优势。

Like, if AI is really concentrated, then they'll do better, custom silicon.

Speaker 0

但如果因为中国出现了大量开源模型,再加上NVIDIA在中国推出的开源软件库,让部署成本降到了极低,那情况就可能不一样了。

But if it gets dispersed broadly because there's all these open source models from China, and there's all these open source software libraries from NVIDIA in China, it makes the deployment costs rock bottom, then potentially

Speaker 3

你听我说完。

Hear me out here.

Speaker 3

理论上,如果谷歌的TPU真能和NVIDIA抗衡,它完全可以在公开市场上竞争。

If Google's TPU is able to compete with NVIDIA, in theory, it could do it on the open market.

Speaker 3

现在谷歌的市值还不如NVIDIA高。

NVIDIA is worth more than Google these days.

Speaker 3

谷歌难道不应该把他们的芯片卖给所有人吗?

Shouldn't Google start selling their chips to to everyone?

Speaker 3

我的意思是,理论上他们完全有可能获得更高的市值。

I mean, in theory, they should be able to achieve a higher market cap.

Speaker 0

我完全同意。

I I absolutely think so.

Speaker 0

我觉得谷歌内部其实已经在讨论这件事了。

I think Google's even discussing it internally.

Speaker 0

但这需要彻底重组企业文化,重新调整谷歌云、TPU团队,还有Jack软件团队和XLA软件团队的工作方式。

I think it would require a big reorg of culture and a big reorg of how Google Cloud works and how the TPU team works and how the Jack software team and XLA software teams work.

Speaker 0

我坚信他们做得到。

I totally think they could.

Speaker 0

只是他们得狠狠地自我革新一番才行。

It would just take them shaking themselves pretty hard to be able to do it.

Speaker 0

对。

Yeah.

Speaker 0

但我真的觉得谷歌应该把TPU卖出去,不只是出租,而是真正地出售硬件。

But I I I totally think Google should sell TPUs externally, not just renting, but, like, physically.

Speaker 3

挺讽刺的是,理论上这个副业的公司估值潜力反而比主业还高。

It's kind of funny if a side hobby in theory has a higher company value potential as you

Speaker 4

尤其是当你考虑到搜索业务在核心业务中的衰退时。

move business, especially as you think about the degradation of search since the core business.

Speaker 4

我的意思是。

I mean

Speaker 0

是的。

Yeah.

Speaker 0

我觉得如果你去问谢尔盖,他会怎么说。

I think but I think, like, if you were to ask, like, Sergei.

Speaker 0

对吧?

Right?

Speaker 0

比如说,嘿。

Like, hey.

Speaker 0

你觉得卖芯片和机架,跟卖云服务或者Gemini相比,哪个更有价值?

Do you think selling chips and and racks is more valuable or cloud or or Gemini?

Speaker 0

他肯定会说,不会。

He'd be like, no.

Speaker 0

不会。

No.

Speaker 0

不会。

No.

Speaker 0

不会。

No.

Speaker 0

Gemini未来的价值会高得多得多。

Gemini is gonna be worth way, way, way more.

Speaker 0

只是现在还没到那一天。

It's just not yet today.

Speaker 0

所以现在来看,你还是会说NVIDIA最厉害,这其实是个集中度的问题。

So I think today, you say NVIDIA is the most again, it's like a whole concentration thing.

Speaker 0

对吧?

Right?

Speaker 0

如果客户高度集中,那么英伟达就不会是全球最有价值的公司。

If the world is super concentrated in terms of customers, then NVIDIA will not be the most valuable company in the world.

Speaker 0

但如果分布越来越分散,比如现在开源模型越来越强大,部署也越来越容易,那英伟达很可能在未来很长一段时间里,依然是全球最有价值的公司。

But if it gets dispersed more and more, which arguably we're starting to see with a lot of these open source models getting better and better and better, and with the ease of deploying them getting better, then you would see I think you could argue NVIDIA will remain the most valuable company in the world for a long period of time.

Speaker 0

历史上看,不会。

Historically, no

Speaker 3

这话有双关的意思——软件已经吞噬了大多数行业。

pun intended, software has eaten the world in most markets.

Speaker 3

你看早期网络时代,思科曾经是全球最有价值的公司。

Mean, if you look at early networking days, Cisco was the most valuable company on the planet for a while.

Speaker 3

但它现在不是了。

It's no longer.

Speaker 3

那些在上面构建服务的公司,比如谷歌、亚马逊、Meta,最终都超越了它。

The guys that built services on top like Google or Amazon or Meta eventually eclipsed.

Speaker 0

所以英伟达才在开发这么多软件库,对吧?

Which is why NVIDIA is making all these software libraries, right?

Speaker 0

他们正试图让推理服务变得商品化。

And they're trying to commoditize inference.

Speaker 0

对吧?

Right?

Speaker 0

我觉得你们应该没有投资过专门做推理API的公司吧?

You guys don't, I think, even have an inference API provider investment, do you?

Speaker 0

我们确实和很多模型提供商都有合作。

Well, we have all kinds of model providers.

Speaker 0

模型提供商。

Model providers.

Speaker 0

我说的是纯粹做API服务的公司,我觉得是这个意思。

I'm talking about a pure API provider investment, I think.

Speaker 0

对吧?

Right?

Speaker 0

这么说对吗?

Is that correct?

Speaker 0

我记得我跟团队里某个人聊过,问过为什么你们没投资像 Together 或 Fireworks 这样的平台。

I think I talked to one of the team members, maybe maybe or someone about, like, why you guys don't didn't invest in, like, you know, like a together or, like, a fireworks.

Speaker 0

他们的说法是,光做模型服务而不自己开发模型,迟早会变成红海。

And sort of the argument was, like, well, we think just serving models alone without making them will sort of be commoditized.

Speaker 0

是的。

Yeah.

Speaker 0

对吧?

Right?

Speaker 0

我们确实投了一些

We have some in

Speaker 3

比如在 Stable Diffusion 生态里。

the stable diffusion ecosystem.

Speaker 3

像那种 FOUL FOUL 的项目。

Like, with, like, a FOUL FOUL.

Speaker 3

是的。

Yeah.

Speaker 3

逐渐变成是的了。

Decay to Yeah.

Speaker 0

我觉得那边的情况有点不一样。

It's a little bit different dynamics there, I think.

Speaker 3

他们更倾向于打造更复杂的模型,而不是像语言模型团队那样。

They tend to be make much more compound models than the the LM folks.

Speaker 0

对,没错。

Think Yeah.

Speaker 0

是的。

Yeah.

Speaker 0

不一样。

Different.

Speaker 0

但你们自己并没有类似Base10那样的API投资,是因为你们觉得,这种基础设施会因为软件和视频的发展而被商品化?毕竟像VLM和SD这样的开源项目,最初来自伯克利,现在已经有自己的生态体系,还得到了广泛支持。

But but, like, you guys don't have one of these, like, know, base 10 or any of these, like, sort of, like, API investments because you think this is from someone on the infra team that you guys think it'll get commoditized because of software and video is making, because VLM and SD LAN, which is like open source software coming out of Berkeley and now sort of has their own environments now and supported by many.

Speaker 0

这意味着API提供商的价值可能没那么高,这大概是你的观点吧。

This being commoditized means that API providers aren't necessarily worth a ton, right, is sort of your argument maybe.

Speaker 0

我觉得这跟整个话题都相关,你知道的,为什么呢?

And I think that's relevant to this whole thing, is, you know, why?

Speaker 0

对吧?

Right?

Speaker 0

那为什么会有

Like, why would

Speaker 3

人这么做呢?

you do this?

Speaker 3

换个话题,那硅芯片领域的初创公司呢?

Shifting gears, what about the silicon startups?

Speaker 3

你怎么看这些公司?

What's your take on those?

Speaker 3

我的意思是,现在有大量资金涌入这个领域,对吧?

I mean, there's a ton of capital flowing into that, right?

Speaker 3

我们看到,虽然没有具体数字,但芯片初创公司已经吸引了数十亿美元的投资。

We've seen, not numbers, but probably billions being invested in chip startups?

Speaker 3

是的,确实如此。

Yeah, for

Speaker 0

当然,毫无疑问。

sure, for sure.

Speaker 0

你看,像Etched、Rivos,还有Maddox等一批公司,连芯片都没发布,就拿到了这么多融资,这真的很了不起。

I mean, whether you're looking at companies like I think it's pretty impressive that a few companies like Etched and Revos and a number of other companies, Maddox and others, have gotten the amount of funding they've had without even launching a chip.

Speaker 0

过去,半导体公司要想融资或盈利,至少得先把芯片推出来。

In the past, yes, silicon companies would make money or raise money, but they would at least launch a chip before they get a big round.

Speaker 0

但Etched和Rivos没公开发布过任何芯片,就融到了巨额资金,这说明一点:硅芯片领域确实烧钱,尤其是做加速器这种结构复杂的芯片,牵涉的环节太多了。

But Etched and Rivos have raised a lot of money without ever launching a chip publicly, which I think is I mean, it speaks to well, yes, silicon is super capital intensive if you're building a chip, especially an accelerator, which has so many moving pieces.

Speaker 0

现在市面上至少有十家新兴的AI加速器公司,都是最近几年才冒出来的。

And there's there's, like, there's, like, 10 different AI accelerator companies out there, right, like, are newish in the last few years.

Speaker 3

我觉得实际数量还要更多。

I think there's a lot more.

Speaker 0

是的

Yeah.

Speaker 0

那些公司确实如此

That that are like yeah.

Speaker 0

是的

Yeah.

Speaker 0

是的

Yeah.

Speaker 3

这很

That's

Speaker 0

合理

fair.

Speaker 0

还有那些老牌企业,也在持续融资

And then and then and then there's the old guard, which continues to raise money.

Speaker 0

是的

Yeah.

Speaker 0

对吧?

Right?

Speaker 0

比如Grok、Cerebras,还有那个。

Like, Grok and Cerebras and Mhmm.

Speaker 0

还有SemiNova、Tensor,诸如此类。

And SemiNova and and Tensor and so on and so forth.

Speaker 0

对吧?

Right?

Speaker 0

比如Graphcore被软银收购了,软银也在往这个项目里砸钱。

Like, or Graphcore getting bought out by SoftBank, and SoftBank dumping money into this effort as well.

Speaker 0

对吧?

Right?

Speaker 0

现在有大量资金涌入,想打破英伟达的垄断地位。

There's there's a lot of capital being invested to disperse dispel sort of NVIDIA's top dollar or top position.

Speaker 0

但这变得很有挑战性。

But it becomes challenging.

Speaker 0

对吧?

Right?

Speaker 0

那你怎么才能超越英伟达呢?

It's like, how do you beat NVIDIA?

Speaker 0

对吧?

Right?

Speaker 0

我觉得那些超大规模云服务商挺幸运的,因为他们基本上能做和英伟达差不多的事。

Like, the hyperscalers, I think, are, like, kind of lucky in that they can they can do mostly the same thing as NVIDIA.

Speaker 3

对吧?

Right?

Speaker 3

他们是自己的客户,完全被自己绑定了。

They're they're captive customer, which is themselves.

Speaker 3

对吧?

Right?

Speaker 3

没错。

Right.

Speaker 3

这可是个巨大的优势。

It's a huge asset.

Speaker 3

而且这

And it's

Speaker 0

他们完全可以靠供应链取胜。

they can they can just win on supply chain.

Speaker 0

对吧?

Right?

Speaker 0

比如,我用的是更便宜的供应商。

Like, I'm using cheaper providers.

Speaker 3

说白了,这就是个压缩利润的过程。

So it's a margin compression exercise, essentially.

Speaker 3

是的。

Yeah.

Speaker 0

没错。

Yeah.

Speaker 0

对于某些特定的工作负载,比如Meta的推荐系统,他们可能能做得更好,更专注一些。

And maybe maybe for certain workloads, like Meta for recommendation systems, they'll have a better you know, they can specialize more.

Speaker 0

但大多数情况下,答案是否定的。

But for the most part, it's like, no.

Speaker 0

我们针对的其实是相同的工作负载。

We're we're targeting the same workloads.

Speaker 0

我们只要简化供应链,或者把大部分环节内部化,压缩一下利润空间,就能搞定。

We can just simplify supply chain or in house a lot of it and compress margin, and it'll be fine.

Speaker 0

但像这些其他公司,问题在于他们没有自家的固定客户。

But in the case of these other companies, it's like, well, they don't have a captive customer.

Speaker 0

所以现在你得面对一个问题:我用的是同样的生态,要么找一家定制芯片供应商,他们照样要抽一层利润,这会压低我的售价;要么自己从头做起,但说实话,这难度太大了。

So now you have to contend with, well, I'm using the same ecosystem, and either I can use some custom silicon provider who's gonna take a margin anyways on top, and that's gonna compress my like, what I can sell for, or I can try and in house everything, but then it's like, this is really hard, right?

Speaker 0

我要自己做全部的软件设计。

Like, I'm gonna do all the software design.

Speaker 0

还要自己做全部的芯片设计。

I'm gonna do all the silicon design.

Speaker 0

我得自己开发所有这些不同的知识产权。

I'm gonna build all this different IP.

Speaker 0

我还得管芯片、机架这些所有环节的供应链,对吧?

I'm going to manage the supply chain on chips, racks, on everything, right?

Speaker 0

最后需要的团队规模大得惊人。

Ends up being a huge effort in terms of team size.

Speaker 0

归根结底,我像英伟达一样能拿到75%的毛利。

All in the end, hey, I make a 75% gross margin as NVIDIA.

Speaker 0

AMD的GPU毛利只有50%,他们工程能力很强,却还是很难超越英伟达。

AMD sells their GPUs for 50% gross margin, and they have a hard time out engineering NVIDIA, and they're great at engineering.

Speaker 0

他们用的芯片面积更大,内存更多,才能达到同样的性能,但售价还更低,利润就被压得厉害。

They're they but yet they still take more silicon area, more memory to achieve the same performance, and they have to sell for less, so their margin gets compressed.

Speaker 0

这倒说得通。

That makes some sense.

Speaker 3

说实话,从历史上看,新进入者通常不是靠小幅改进现有产品而胜出的。

Look, the I think historically, if you look at it, typically, new entrants in markets didn't win by marginally improving on something existing.

Speaker 3

这种情况偶尔会发生,但更常见的是,新进入者抓住了某种颠覆性的技术突破,采用了完全不同的思路和技术。

That happens sometimes, but more likely, they jumped on some kind of disruptive technology leap, where it's like, we have a different approach, we have different technology.

Speaker 3

这里有可能出现这种情况吗?

Is that possible here?

Speaker 3

这么说吧,虽然有点简化,但我认为Transformer模型胜出的部分原因,是因为它在GPU上运行得实在太出色了。

Mean, to some degree, this over simplifying a little bit, but I think part of the reason why the transformer model won was because it runs so incredibly great on GPUs.

Speaker 3

对吧?

Right?

Speaker 3

比如循环神经网络,性能看起来也差不多,但在GPU上跑起来却糟糕透顶。

Like, a, recurrent neural network is similarly performing, it looks like, but it it runs terribly on a on a GPU.

Speaker 3

所以我们是不是因为架构选了这个模型,现在就很难再想出一个真正……

So so did we sort of pick the model for an architecture, and now it's it's hard to come up with an architecture that, you know, really

Speaker 0

这其实是硬件和软件协同设计的结果。

Well, it's it's hardware, software co design.

Speaker 0

对吧?

Right?

Speaker 0

现在不是到处都在吹神经形态计算吗?

Like, there's, like, there's all this hype about neuromorphic computing.

Speaker 0

对吧?

Right?

Speaker 0

理论上确实很厉害,效率也超高。

Like, theoretically, it's amazing and super efficient.

Speaker 0

说白了,就是这么回事。

It's like, okay.

Speaker 0

挺好的。

Great.

Speaker 0

但硬件生态根本不存在。

Like, there's no ecosystem of hardware.

Speaker 0

软件生态也一样没有。

There's no ecosystem of software.

Speaker 0

要证明这玩意儿值不值得搞,光是硬件、软件和模型这三个方面,就得让现在最顶尖的成千上万名AI专家全身心投入才行。

It would take, like, you know, tens of thousands of people who are the best AI today focusing on that to even prove out if it's worthwhile or not, right, on a hardware side, on a software side, on a model side.

Speaker 0

所以你看Grok、Ebris、SambaNova这些公司,设计芯片时都过度押注了当时最主流的模型。

And so, like, you look at, like, Grox or Ebris, SambaNova, they all, like, sort of over indexed to the models that were leading at the time when they designed their chips.

Speaker 0

因此他们做了一些权衡。

And so they made certain trade offs.

Speaker 0

对吧?

Right?

Speaker 0

他们在芯片上集成的内存多得多。

They put a lot more memory on chip.

Speaker 0

而NVIDIA却说,我们不这么干。

And and NVIDIA was like, well, we're not gonna do that.

Speaker 3

至少速度更快一些。

A lot faster, at least.

Speaker 3

对吧?

Right?

Speaker 0

更准确地说,如果你对比NVIDIA芯片上的SRAM内存容量,那真的低太多了。

Well, more like like, if you compare the amount of memory of SRAM on NVIDIA's chips, it's much, much lower Yes.

Speaker 3

没错。

Correct.

Speaker 3

用的是SRAM,而不是DRAM。

Than SRAM instead of DRAM.

Speaker 3

但确实如此。

But Right.

Speaker 3

所以他们的DRAM容量通常更小,这也是一种权衡。

Then they usually have less DRAM, so there's a trade off there as well.

Speaker 0

对。

Right.

Speaker 0

DRAM更少。

There's less DRAM.

Speaker 0

SRAM更多。

There's more SRAM.

Speaker 0

因为芯片上SRAM多了,计算单元就得减少,结果他们反而输了。

And because there's more SRAM on the chip, you have to have less compute on the chip, and so they ended up losing.

Speaker 0

对吧?

Right?

Speaker 0

因为模型变得太大了,各种原因吧。

Because the model sizes got too big and all this.

Speaker 0

对吧?

Right?

Speaker 0

于是就出现了一个特别奇怪的局面:他们押注的其实是更优的方案。

And so you have this super weird dynamic where they bet on something that was actually better.

Speaker 0

毫无疑问,Cerebras 在运行某些类型的模型时,比 NVIDIA、Grok,甚至 Dojo 都更出色。

Have no doubt that Cerebras would run certain types of models better than NVIDIA or Grok or, hey, Dojo.

Speaker 0

特斯拉的 Dojo 在运行某些特定模型时,性能远超 NVIDIA 芯片,因为它们就是为此优化的。

Dojo runs certain Tesla's Dojo would run certain types of models way better than NVIDIA chips, because they're optimized to that.

Speaker 0

但问题是,就连视觉任务现在也普遍用视觉变换器了。

But then it's like, oh, well, actually, even in vision tasks, he's vision transformers now.

Speaker 0

所以嘛,好吧,挺有意思。

So it's like, okay, cool.

Speaker 0

因为模型规模越来越大,还有各种其他因素。

Because model sizes grew, and all these things.

Speaker 0

所以这就成了一个进退两难的境地,你为了某个目标去优化。

So it ends up being a catch 22 in that you optimize for something.

Speaker 0

所以现在,当今时代出现了一批新的AI加速器公司,它们说,好吧,我们要针对Transformer进行优化。

And so now, today, you have this new age of AI accelerator companies that are like, okay, we're gonna optimize for transformers.

Speaker 0

但在它们开始设计的时候,情况是这样的,好吧,Transformer是这种体量的稠密模型。

But the time they started designing, they're like, okay, transformers are dense models that are this big.

Speaker 0

大家知道,隐藏层维度是八千,批次大小和序列长度也都很大,所以干脆搞个超大的脉动阵列,好实现最高效率。结果发现,看看 DeepSeek,或者去查查那些实验室都在做什么。

What's the best know, the hidden dimension is eight k, and your batch sizes are this big, and your sequence lengths are this big, so let's just make a super large systolic array so you can, you know, create the maximum efficiency, and that turns out, oh, look at DeepSeek or, you know, go look at what the labs are doing.

Speaker 0

实际上,他们的形状要小得多。

Actually, their their shapes are much smaller.

Speaker 0

实际上,你需要做很多小矩阵乘法,而不是每层都搞那种巨大的、单一的矩阵乘法。

Actually, you need to do a bunch of small matrix multiplies, not massive, massive, massive, you know, singular matrix multiplies per layer.

Speaker 0

结果你会发现,你为那个场景设计的芯片,其实效率并不高。

And then it ends up, you know, oh, well, that chip you're designing for that is actually not super effective for

Speaker 3

是的

Yeah.

Speaker 0

就是这样。

That.

Speaker 0

软件一直在不断演变,因为要适应英伟达硬件上表现最好的方式,你看DeepSeek、阿里巴巴,还有各大实验室内部的做法,都是这样。

And And so the software is evolving constantly because of what because of what works best on NVIDIA, and you see that with, you know, whether it be what DeepSeek's doing or Alibaba's doing or what the labs are doing internally.

Speaker 0

就连谷歌也不例外。

And you even see this, like, for Google.

Speaker 0

对吧?

Right?

Speaker 0

他们的开源Gemma模型做出的不同选择,就是因为TPU的结构和GPU不一样。

Like, their open source Gemma models make different decisions because the shapes of a TPU are different than a GPU.

Speaker 0

其实GPU和TPU的差距并没有那么大。

And those the GPU and the TPU are actually not that far apart.

Speaker 0

对吧?

Right?

Speaker 0

比如说,它们确实很不一样,但Blackwell和TPU其实正在朝相似的设计方向靠拢。

Like, would say, yes, they're very different, but, like, Blackwell and TPUs are are very, very they're converging on similar designs actually.

Speaker 0

要想超越NVIDIA,光靠供应链优势是不够的。

Whereas, like, to beat NVIDIA, you can't just have the supply chain, you know, win.

Speaker 0

对吧?

Right?

Speaker 0

你没有那种锁定的客户群体。

You don't have this captive customer.

Speaker 0

所以你现在得做出点东西,比如在特定工作负载上把硬件效率提升五倍,然后祈祷这个负载别突然变了。

So now you need to do something, you know, that will give you five x advantage, right, in hardware efficiency for a certain type of workload, and then pray the workload doesn't shift.

Speaker 0

对吧?

Right?

Speaker 0

因为NVIDIA也在不断优化他们的架构迭代。

Because NVIDIA is also optimizing their architecture generation.

Speaker 0

他们加了很多功能,让芯片对现有模型的支持好了很多。

They've added a lot of stuff to make their model their chips way better for the existing models.

Speaker 0

但他们每年或每两年都在稳步前进,而你却得跑到很远的偏门里去赌,希望模型别跑偏。

But it's like they're taking, you know, large steps every year, every two years towards something, whereas you have to, like, go way over there in left field and hope that models stay over there.

Speaker 0

对吧?

Right?

Speaker 0

因为你必须比他们强五倍,毕竟NVIDIA在供应链效率上压着你。

Because you have to win by five x because NVIDIA is gonna have supply chain efficiency over you.

Speaker 0

他们在新制程、新内存,或者任何新技术的上市时间上,都能比你快一步。

They're gonna have time to market over you in terms of, like, a new process node or new memory or, you know, whatever whatever technology.

Speaker 0

对吧?

Right?

Speaker 0

就连AMD也做到了。

Even AMD.

Speaker 0

对吧?

Right?

Speaker 0

他们比NVIDIA更早推出了2纳米工艺。

They got to two nanometer before NVIDIA.

Speaker 0

他们的HBM密度更高。

They had higher density HBM.

Speaker 0

他们用了三维堆叠技术。

They used three d stacking.

Speaker 0

在供应链的这些方面,他们本该比英伟达更强,可还是输了。

All these things on supply chain that should be better than NVIDIA, and yet they still lose.

Speaker 3

还有软件这一块。

There's still the software angle.

Speaker 3

对吧?

Right?

Speaker 3

英伟达的软件确实厉害。

NVIDIA is fantastic.

Speaker 0

没错。

Yeah.

Speaker 0

软件方面也是个关键因素。

And and then there's software as well.

Speaker 0

对吧?

Right?

Speaker 0

但NVIDIA的网络性能还是会比你强。

But it's like NVIDIA is gonna have better networking than you.

Speaker 0

他们的HBM也会更优。

They're gonna have better HBM.

Speaker 0

他们的制程节点也会更先进。

They're gonna have better process node.

Speaker 0

他们上市速度会更快。

They're gonna come to market faster.

Speaker 0

他们产能爬坡也会更快。

They're be able to ramp faster.

Speaker 0

无论是在台积电、SK海力士这些芯片和内存供应商,还是机架、铜缆这些环节,他们的议价能力都会更强,成本效率也更高。

They're gonna have better negotiations with whether it's TSMC or SK Hynix and the memory and silicon side or all the rack people or, like, copper cables, everything, they're gonna have better cost efficiency.

Speaker 0

所以你得比他们强五倍才行。

So you have to be, like, 5x better.

Speaker 3

但说真的,如果真有哪个竞争对手能拿出性价比稍微好一点的产品,我猜很多大型GPU用户都会立刻把一部分订单转过去,就为了有个第二选择。

But but to be fair, if if somebody had a viable competitor, which would even be marginally cost competitive, my guess is many of the big consumers of GPUs would immediately shift some revenue there just to have a number two.

Speaker 3

对吧?

Right?

Speaker 3

就只是为了

Just to just to

Speaker 0

等一下。

Hold on.

Speaker 0

这不就是今天AMD的情况吗?

That's that's AMD today.

Speaker 0

对吧?

Right?

Speaker 0

微软已经退出了。

And Microsoft stopped.

Speaker 0

没错。

Yeah.

Speaker 0

我是说,那个

I mean, like, the the

Speaker 3

不过,目前他们的市场接受度还是很有限。

There's still pretty limited traction, though.

Speaker 3

对吧?

Right?

Speaker 0

没错。

Sure.

Speaker 0

但Meta还在持续采购,微软之前也买过一批,后来就停了,因为虽然AMD确实提供了不少优势,但在能效比上还是不如NVIDIA,而且他们的软件团队规模大得多。

But Meta continues to buy from them, and Microsoft did buy a bunch, and then they stopped because it's like, well, yes, they're you know, AMD is giving you all these advantages, but ends up still not being better on a performance per watt basis, and they have a way bigger software team.

Speaker 0

在我说的那些方面,他们确实有一定程度的竞争力。

They're somewhat competitive on, like, all these dynamics that I mentioned.

Speaker 0

对吧?

Right?

Speaker 0

所以你不能简单地照搬NVIDIA的做法。

So you can't just, like, do the same thing as NVIDIA.

Speaker 0

你得真的做得更好,或者像AMD那样执行得更到位,对吧?

You really and and do it better, right, or try and execute better like AMD.

Speaker 0

你必须在别的方面实现真正的突破。

Like, you have to really leap forward in some other way.

Speaker 0

但设计周期太长了,等你做出来,市场趋势早就变了。

But that's the the design cycle takes so long that models will shift.

Speaker 0

对吧?

Right?

Speaker 0

因为他们会想,下一代TPU和GPU会是什么样子?

Because they're like, oh, what's the next generation TPU and GPU look like?

Speaker 0

明白了。

Okay.

Speaker 0

那就朝着那个方向优化吧。

Let's optimize for that.

Speaker 0

至于研究路径,确实挺不错的。

And the research path is, you know, like, great.

Speaker 0

没错,类脑计算可能是我们最该走的方向,但没人干,因为你得在自己选的这条技术路线上往前推进。

Like, yes, neuromorphic computing could be the most optimal thing for us to do, but no one's working on that because you have to advance in the tech tree you've chosen.

Speaker 0

对吧?

Right?

Speaker 0

要是你重开一条技术路线,那结果肯定惨不忍睹。

If you restart the tech tree, you're gonna be like, well, this sucks.

Speaker 0

所以,一旦技术路线分岔,而你偏偏选了这边,那就完了,因为你必须做到

And so, like, if it branches this way and you're over here, you're screwed because you have to be

Speaker 3

五倍

five x

Speaker 0

差不多得

kind of

Speaker 3

有个模式。

There's a mode.

Speaker 0

因为供应链的问题,所谓的五倍实际只能做到两倍半,而如果你真有竞争力,英伟达还能稍微压缩一下利润空间。

Because the supply chain stuff means that five x actually turns into a two and a half x, and then NVIDIA can compress their margin a little bit if you're actually competitive.

Speaker 0

然后这2.5倍的提升,实际上就变成了50%的改进。

And then that two and a half x becomes like a 50% better.

Speaker 0

接着呢,

And then yeah.

Speaker 0

所以到最后,事情变得太复杂了,尤其是软件方面。

So it's like it ends up being way too difficult to and the software stuff.

Speaker 0

对吧?

Right?

Speaker 0

所有这些因素都会把你原本5倍的提升,拉回到只有50%的改进。

Everything, like, takes your five x and makes it like, oh, you're actually only 50% better.

Speaker 4

国防供应链肯定也是。

And defense supply chain for sure.

Speaker 0

没错。

Yeah.

Speaker 0

国防供应链。

Defense supply chain.

Speaker 0

然后他们就明白了。

And then, like, they get they get that.

Speaker 0

对吧?

Right?

Speaker 0

卢特尼克自己也说过,我们必须为稀土矿物这么做。

Like so it's like and and Lutnick himself said we had to do the this for rare earth minerals.

Speaker 0

我觉得这挺有意思的。

I was like, interesting.

Speaker 0

中国有些省份有规定,说H20能效不够,不能部署,这简直太奇怪了,因为这明明是中国最好的AI芯片。

China there's, like, provinces in China that have, like, rules that say the h 20 is not efficient enough to be deployed, which is, like, super bizarre because it's clearly the best AI chip China has.

Speaker 0

华为还是稍微落后一点。

Huawei is still a little bit behind.

Speaker 4

有意思的是,效率在中国根本没那么重要,因为他们电力基础设施足够强大,完全撑得起来。

Well, what's interesting is that, you know, efficiency is just not is is so much less of an issue in China than here because they just have the power infrastructure to be able to support.

Speaker 4

就算用性能稍弱的芯片,也没太大关系,毕竟中国的电力供应几乎是无限的,他们根本不在乎。

So even if they're running less powerful chips, you would imagine that it doesn't really matter because China has just such an infinite supply supply of power that they'd sort of be okay with it.

Speaker 4

这挺有意思的。

So it's interesting.

Speaker 0

这在美國是個大問題。

Which is it's a big challenge in America.

Speaker 0

对吧?

Right?

Speaker 0

詹森老说H20在美国白送都没人要,可我现在真听说有公司说,是啊,我真不想要,因为我电就这么多。

There have been companies that were like, wouldn't Jensen keeps saying he couldn't give away H20 in America for free, but I've literally heard companies now say, Yeah, no, I I wouldn't because I only have this much power.

Speaker 0

接下来一年,我那些准备就绪的数据中心该怎么安排?

How am I going you know, in data centers ready to go over the next year?

Speaker 0

我要是买了H20,算下来算力反而更少,那我不是亏了?

If I bought an h 20, I'd literally have less compute capacity, and then I'd lose.

Speaker 0

对吧?

Right?

Speaker 0

就算白送也不行。

Even if it was free.

Speaker 0

这根本说不通。

Like, it doesn't make sense.

Speaker 0

而中国根本不在乎。

Whereas China doesn't care.

Speaker 0

他们能建得出来。

They can build these things.

Speaker 0

他们有这个实力。

They have the muscle.

Speaker 0

我很想知道最后会怎样。

I'm I'm curious how this all shakes out.

Speaker 0

你知道吗,中国现在态度特别强硬。

You know, China's posturing really hard.

Speaker 0

他们甚至放出话说,要调查H20有没有后门。

They even, like, put out something that was like, we're investigating to see if there's backdoors in the h 20.

Speaker 0

根本就不存在什么H20的后门。

It's like, there's no backdoor in the h 20.

Speaker 0

别紧张。

Like, chill.

Speaker 0

你知道,GPU 本来就不直接连着公网,本来就有多重防护。

You you know, it's like, you know, GPU GPUs are usually, like, firewalled from the public Internet anyways.

Speaker 0

在接触到 GPU 集群之前,早就过好几道关了。

Like, you you step through stuff before you get to the GPU clusters.

Speaker 0

所以,说什么后门,根本没意义。

So, like, a back wall backdoor wouldn't even matter.

Speaker 0

我不太确定。

I don't know.

Speaker 0

我觉得挺值得观望的,因为中国一旦下定决心,立刻就能把海量资源砸到 AI 上。

I think I think it'll be it'll be interesting to see because China can definitely deploy way, way, way more power to AI the moment they decide to.

Speaker 0

但这里面牵扯着各种不同的利益诉求。

But there's these, like, there's, like, competing interests.

Speaker 0

对吧?

Right?

Speaker 0

就是

Like

Speaker 4

因为他们希望华为能超越英伟达。

Because they want Huawei to be better than NVIDIA.

Speaker 0

对。

Yeah.

Speaker 0

这就是英伟达向政府游说的理由。

And then this is how NVIDIA argued to the administration.

Speaker 0

他们说,如果我们不这么做,其实这是一个非常有力的论点,比如在Triton这个常用的机器学习库里。

They're like, if we don't do this actually, I think it's like a very, like, powerful argument that, like for example, within Triton, which is a common ML library.

Speaker 0

总之,字节跳动已经开源了一些能接入这个系统的很棒工具,还有其他很多类似的库。

Anyway, ByteDance has open sourced some stuff that plugs into this that is super awesome, and there's all these other libraries.

Speaker 0

中国开源的不只是模型。

It's not just models that China open sources.

Speaker 0

还有中国公司为英伟达开发并开源的软件。

It's software for NVIDIA that Chinese companies open source.

Speaker 0

从某种角度说,英伟达卖GPU本身就是在论证:他们成功阻止了华为构建自己的软件生态,而西方的生态确实更强大。

In a sense, like, by NVIDIA selling GPUs is NVIDIA's argument again, like, was like, they were able to, you know, stop Huawei from building up a software ecosystem, and the Western ecosystem is better.

Speaker 0

但反过来想,如果你认为模型给社会带来的经济价值比硬件更大——我个人就这么觉得——那现在的问题其实是价值分配不均。如果你真这么想,那给中国卖降配版的H20,甚至像特朗普说的那样,给个缩水版的Blackwell,其实比直接卖芯片给中国带来的好处要大得多。

But then on the flip side, it's like, again, if you believe the models deliver more economic value to society than the hardware, which which I actually think they do, it's just there's a value capture problem today, then you're giving China way more by giving them h twenties and soon a version of Blackwell that's cut down, like like Trump said, right, versus versus, you know, selling them the chips.

Speaker 0

对吧?

Right?

Speaker 0

卖芯片带来的经济收益,远不如通过提供AI服务来获取的收益大。

The economic value derived from selling them the chips is not as large as, you know, being able to somehow sell them AI services.

Speaker 4

那中国是在掌控AI的主导权吗?

So is is China gatekeeping power for AI?

Speaker 0

我不这么认为。

I don't think so.

Speaker 0

我觉得,即便现在H20已经卖到中国,未来还有H20E和其他芯片,我们还是能看到像阿里这样的中国公司,宁愿到海外租GPU,因为海外的GPU在性能性价比上实在强太多了。

I think I think, again, there's a lot of what we see is that even with h 20 being sold to China into China and and and future versions of the chip, the h 20 e and other chips, we still see, like, Chinese companies like Alibaba renting GPUs outside of China because the GPUs they can get outside of China are just so much better on a dollar spend per performance basis.

Speaker 0

他们要么直接租,要么通过像新加坡的公司——其实本质上还是中资背景——建数据中心,把芯片装进去。

Renting them or even going through sort of like a Singaporean company that is effectively a Chinese company and building data centers and putting chips in them.

Speaker 0

所以我觉得中国并不是在主动限制算力。

So it's like I don't think China's limiting the power per se.

Speaker 0

关键是,你知道,明年中国企业的资本支出增长率会远超美国企业。

It's that it's you know, you can only if you can spend like, Chinese companies are growing their CapEx way more than US companies on a percentage basis next year.

Speaker 0

从绝对金额来看,美国公司目前在AI上的投入还是更多。

The absolute dollar number is you know, obviously, The US companies are spending more still on AI.

Speaker 0

但按增长率算,明年中国企业增长更快,可问题在于,这些芯片性能较差,每美元投入换来的AI输出——不管是token还是别的——都会更低。

The percentage basis, Chinese companies are growing more next year, and you you still have the problem of, well, dollars spent to AI output in tokens or in whatever is gonna be lower because these chips are worse.

Speaker 0

所以算力并不是关键瓶颈。

So power is not the gating factor.

Speaker 0

真正卡脖子的一直是资金。

It's always capital.

Speaker 0

对吧?

Right?

Speaker 0

至少现在是这样。

At least today.

Speaker 0

对吧?

Right?

Speaker 0

现在中国要是想多花钱,完全能花得起。

Now China can spend a lot more capital if they wanted to.

Speaker 0

他们通过国企、非营利性资本支出等方式,每年补贴半导体行业高达一千五到两千亿美元。

They're subsidizing the semiconductor industry to the tune of, like, 150, $200,000,000,000 a year through SOEs, through CapEx that's not generating revenue, etcetera.

Speaker 0

所以他们不是不能把同样力度的钱投到AI生态里,毕竟Meta一年的资本支出才六百亿,谷歌才八百亿。

So it's not like they couldn't do this to the AI ecosystem, right, given, you know, Meta's CapEx is, like, 60,000,000,000.

Speaker 0

对吧?

Right?

Speaker 0

谷歌的资本支出大概八百亿。

And Google's CapEx is, like, 80,000,000,000.

Speaker 0

对吧?

Right?

Speaker 0

他们完全有能力在单一项目上花更多钱,只是还没下定决心而已。

Like, they could totally spend way more than that on a single effort, they just haven't decided to.

Speaker 0

我觉得美国这边的建设主要受限于电力供应。

And I just think for The US, our build outs are constrained by power.

Speaker 0

谷歌有大量TPU芯片闲置着,就等数据中心通电上线;Meta的GPU也是一样。

Google has a ton of TPUs sitting, waiting for data centers to be powered and ready, as does Meta with GPUs.

Speaker 0

我们之前提到过,Meta现在正在搭这种临时性的棚屋式数据中心。

We posted about how Meta is now building these effectively tents.

Speaker 3

这在多大程度上也跟他们不愿把算力开放给更广泛的生态有关呢?

Is this to some degree also coupled to their unwillingness to sell them to a broader ecosystem?

Speaker 3

他们只想把资源锁在自己的数据中心里,如果没及时扩大自己的超大规模数据中心建设,那确实会限制自己。

I mean, they want to be confined in their own data centers, and they didn't ramp data center build out for their own hyper scale use cases quickly enough, right, then yes, that constrains them.

Speaker 3

如果他们面向公开市场,我们还会受这种限制吗?

They were on the open market, will we still be constrained?

Speaker 0

是的,毫无疑问。

Yeah, yeah, for sure.

Speaker 0

比如CoreWeave这样的公司,为什么它会有价值呢?

Because, like, companies like CoreWeave you know, why is CoreWeave valuable?

Speaker 0

主要是因为他们建设基础设施的速度特别快。

It's really because they build infrastructure really fast.

Speaker 0

对吧?

Right?

Speaker 0

没错。

Yeah.

Speaker 0

他们的软件确实不错,但很多客户用的都是裸金属服务器。

And and their software is nice, I think, but, like, a lot of their customers are bare metal.

Speaker 0

对吧?

Right?

Speaker 0

坏了就换GPU,网络也得跟上。

Replace the GPUs whenever they're broken and network They they

Speaker 3

他们扩张得更激进,我觉得不是这样。

grew more aggressively, and I I think And no.

Speaker 0

别走远了。

Don't go anywhere.

Speaker 3

詹森也很喜欢他们

Jensen likes them as well,

Speaker 0

公平地说。

to be fair.

Speaker 0

是的。

Yeah.

Speaker 0

他们会的。

They'll go yeah.

Speaker 0

是的。

Yeah.

Speaker 0

这也很重要,但他们这么做是因为这样能让生态更分散,对英伟达更有利。

That's very important as well, but they'll, like, go because it's it it it it unconcentrates the ecosystem, which is better for NVIDIA.

Speaker 3

对吧?

Right?

Speaker 3

我们以前在英特尔工作过吗?

Have we worked at Intel?

Speaker 3

我完全明白Chip当时在想什么。

I know exactly what Chip was going through his mind.

Speaker 0

是的。

Yeah.

Speaker 0

我觉得真正重要的是,CoreWeave根本不在乎,对吧?

I think what's really important is that like, Core Weave doesn't care, right?

Speaker 0

他们就想,哦,加密货币数据中心?我把它转成AI数据中心就行,对吧?

They're like, Oh, crypto data center, I will convert it to AI data center, right?

Speaker 0

他们花了一百亿美元收购了一家做加密挖矿的公司,而那家公司几年前估值才二十亿美元——不是因为他们的比特币挖矿业务在增长,而是因为他们拥有电力数据中心。

They bought a company for like $10,000,000,000 that's doing crypto mining, which is worth $2,000,000,000 a couple years ago, and it's not because their Bitcoin mining business is growing, it's because they have power data centers.

Speaker 0

无论哪里,大家都在建电力数据中心,像CoreWeave和甲骨文这样的公司都在往这个方向走;对了,今天谷歌不是也收购了加密挖矿公司TeralWright的8%股份吗?

Anywhere and everywhere, people are trying to build power data centers, and companies like CoreWeave and Oracle are moving to the actually, today, Google just didn't bought 8% of a crypto mining company called TeralWright?

Speaker 4

并不是因为他们想进军加密挖矿。

Not because they're getting into crypto mining.

Speaker 4

当然不是。

No.

Speaker 0

因为他们需要数据。

Because they need the data.

Speaker 4

想要电力。

Want the power.

Speaker 0

他们需要电力。

They need the power.

Speaker 0

对吧?

Right?

Speaker 0

所有超大规模云服务商都说了,别管什么可持续发展承诺了,他们急需电力。

And it's like, all the hyperscalers have, like, said, screw off to my sustainability pledges because they need power as fast as possible.

Speaker 0

是的。

Yeah.

Speaker 0

对吧?

Right?

Speaker 0

他们确实做了一些事,虽然改变方向没那么快,但即使不在自己建的数据中心里做,公开市场上也还有很多难题。

They're, you know, they're they're doing things that are not that they take a little bit longer to move the ship, but even if you didn't do it in your own self built data centers, there's still a lot of challenges in the open market.

Speaker 0

现在存在缺口。

There's a deficit.

Speaker 0

这严重限制了美国芯片的部署进度。

And that's that's constraining American chip build outs heavily.

Speaker 0

没错。

Yes.

Speaker 0

其他人可能能快一点,比如Core Weave之类的公司。

Others could maybe do it a little bit faster like Core Weave or or others.

Speaker 0

对吧?

Right?

Speaker 0

甲骨文的态度也挺开放,但还是严重拖慢了美国这边的建设速度。

Oracle's got an open mind as well, but it's still constraining US build outs heavily.

Speaker 0

就算资金已经投了,芯片也占了整个集群成本的六到八成,具体看用的是哪种芯片。

Even though the capital's been spent, the chips are 60 to 80% of the cost of the cluster depending on what chips you're getting.

Speaker 0

所以他们其实已经把芯片买好了。

So it's like they've already bought the chips.

Speaker 0

他们根本没法把芯片装进去,因为数据中心还没准备好。

They just can't put them anywhere because the data centers aren't ready.

Speaker 0

这问题不仅影响谷歌,微软、Meta,还有好多公司都一样。

Supplies to Google, applies to Microsoft, applies to Meta, applies to a lot of folks.

Speaker 4

说实话,在美国建电力基础设施真的特别难。

I mean, it's really hard to build power infrastructure in The US.

Speaker 4

所以呢。

So

Speaker 0

电力供应、电网接入、输电线路、变电站,所有这些环节都卡住了。

Power, grid interconnections, transmission, substations, all of this stuff.

Speaker 0

在德克萨斯,如果你愿意当流动电工,收入简直跟石油行业一样高。

Electrical contractors, electricians in Texas, if you're willing to be a travel electrician, it's like oil pay.

Speaker 0

以前身体好点的人去西德克萨斯能挣一百美元,可谁愿意干这活儿啊?

It used to be that if you're physically adept, you could go make $100 in West Texas, but who the fuck wants to do that?

Speaker 0

现在不一样了,你离达拉斯两百英里,找个还算像样的小镇,建个数据中心,干干布线、搞搞输电,收入直接翻倍,跟几年前完全没法比。

Now it's like, well, you could go 200 miles away from Dallas in what's still a reasonable town and build a data center and work on the wiring within the data center and all this other stuff, the transmission stuff, and your pay is up like 2x now versus what it was just a few years ago.

Speaker 0

劳动力问题也是一个挑战。

This labor problem's a challenge too.

Speaker 0

我觉得中国那边根本没这些麻烦,只是还没把钱花出去而已。

I think in China, they don't have any of these problems, but they just haven't spent the capital yet.

Speaker 0

但资金也是个问题,毕竟投入的规模太大了。

But capital is an issue as well because of the scale of what's being spent.

Speaker 0

对吧?

Right?

Speaker 0

比如英伟达今年的收入就要超过两千亿美元,明年预计还要超过三千亿,再加上谷歌打算花五百亿美元建TPU数据中心。

Like like, NVIDIA's revenue this year is gonna be, like, over $200,000,000,000, and next year expects over 300,000,000,000, plus Google's gonna spend, like, $50,000,000,000 on TPU data centers.

Speaker 0

对吧?

Right?

Speaker 0

亚马逊也要在Tranium数据中心上砸大笔钱。

And it's like, and Amazon's gonna spend tons and tons on Tranium data centers.

Speaker 0

这笔钱的规模正在迅速攀升到国家层面。

It's like the scale of dollars is is quickly growing to nation state level stuff.

Speaker 0

更重要的是,得能决定把钱花在哪儿,哪些才最划算。

And and what's more important is being able to decide to spend the dollars and what's cost effective.

Speaker 0

某种程度上,中国还是受这限制,但他们能偷偷把芯片带进来。

And so to some extent, China's still constrained by that, but they can smuggle chips in.

Speaker 0

他们可以在国外建数据中心。

They can build data centers outside of China.

Speaker 0

他们也可以在国外租用数据中心,用上最划算的Blackwell芯片之类的。

They can rent data centers outside of China and be more and have the most cost effective, you know, Blackwell chips or whatever.

Speaker 0

对吧?

Right?

Speaker 0

字节跳动之所以成为谷歌云最大的客户,或者第二大客户,是有原因的。

ByteDance is, you know, either the biggest or the second biggest customer of Google Cloud for a reason.

Speaker 0

对吧?

Right?

Speaker 0

他们从谷歌那边拿到了大量Blackwell芯片。

And they're getting, you know, over you know, they're getting many, many black well from them.

Speaker 0

对吧?

Right?

Speaker 0

甲骨文、微软,还有其他这些公司,也都把大量芯片租给中国,因为这么干比自己建更划算。

And the same with Oracle and the same with Microsoft and all these other companies are renting tons of chips to China anyways because it's more cost effective to do that than build it yourself.

Speaker 0

所以中国并不是所有企业都抱定‘必须自建’的想法——政府可能这么想,但像阿里、腾讯、字节这样的基础设施公司并不会这么干。

So it's not like China has this mentality where we only have to well, the government does, but the infrastructure companies don't, like Alibaba, Tencent, ByteDance, etcetera.

Speaker 3

那数据中心的最终方向会是什么?

So what's the endgame for data centers?

Speaker 3

我的意思是,我们确实需要更多电力。

I mean, like, we we need more power.

Speaker 3

我们还需要更强的散热能力。

We need more cooling.

Speaker 3

以后所有的数据中心都会建在核反应堆旁边,或者大量用太阳能,又或者靠近深海冷水来散热?

Will the m p every all data systems will be next to a nuclear reactor or lots of solar, you know, next to deep level, like deep sea water that we use for cooling or something like that?

Speaker 3

你觉得会怎样?

What's the think

Speaker 0

数据中心的散热其实没那么夸张,大家总说它耗电厉害,但事实并非如此。

that cooling is like, the physical cooling of a data center are like you know, there's this whole narrative about, oh, It uses so much power, it's like, not really.

Speaker 0

种苜蓿用的水,比AI数据中心多出一百倍。

You know, farming alfalfa uses, like, 100x the water of of AI data centers.

Speaker 0

就算到十年底,情况也不会变,而苜蓿本身价值很低。

Even by the end of the decade, it'll be the same, and it's, alfalfa's, like, worth very little.

Speaker 0

至于散热,有人试过把数据中心建在海底来省冷却成本,但其实……

So it's, anyway there's, like, it's, like, cooling is, like, not that you know, people have, like, experimented with, like, undersea data centers to reduce the cooling cost, but it's

Speaker 3

这根本说不通。

That doesn't make sense.

Speaker 0

省下的成本也就10%,可代价却大得多。

It's like 10% savings, but then It's

Speaker 3

把数据中心放进海里容易,可怎么把海水排出去呢?

hard to get the water out of the ocean then then put their data center into the ocean.

Speaker 0

要是想维护,那可就麻烦了。

It's like if you wanna service it, like, yeah, you're screwed.

Speaker 0

对吧?

Right?

Speaker 0

电力也是同样的道理。

So the same with power.

Speaker 0

我们总说电力其实没那么贵。

It's like we talk a lot about, like, the power is not actually that expensive.

Speaker 0

只是建造起来太难了。

It's just hard to build.

Speaker 0

对吧?

Right?

Speaker 0

我得

I have to

Speaker 3

找到合适的地方。

get to the right place.

Speaker 0

还得找到合适的场地,把电压降到芯片需要的水平,还要处理各种配套问题。

And I have get to the right space and convert it down to the voltages and and all the stuff that that chips need.

Speaker 4

所以关键不在于电力的总量,而在于它在哪里、怎么流动。

So it's less the magnitude of power and more where it is how it moves.

Speaker 0

但总量也很重要。

Well, the magnitude too.

Speaker 0

对吧?

Right?

Speaker 0

就像说,它将会是

Like, it's gonna be

Speaker 3

从全球能源消耗总量来看,AI数据中心所占的比例仍然微不足道。

In terms of total worldwide energy consumption, AI data centers is still the full

Speaker 0

简直可以忽略不计。

It's like like nothing.

Speaker 3

是的。

Yeah.

Speaker 3

只占不到百分之一。

It's a fraction of a percent.

Speaker 3

它只是

It's

Speaker 0

不是那样。

not Yeah.

Speaker 0

就算到本十年末,美国的数据中心耗电量也只会占我们总用电量的10%左右,但这仍然

Even by the end of the decade, you know, The US will be, like, 10% of our Power BI data centers, which is still

Speaker 3

只是用电量的一部分。

like Of electricity.

Speaker 0

我们总用电量的一部分。

Of our electricity.

Speaker 3

从能源总量来看,这个比例还要更小。

And in terms of energy, that's even a smaller fraction.

Speaker 3

对吧?

Right?

Speaker 0

是的。

Oh, yeah.

Speaker 0

是的。

Yeah.

Speaker 0

因为你觉得

Because you think

Speaker 3

转向电动汽车也能带来更大的改变,比我们建的所有AI数据中心加起来影响还大。

about Shifting to electric vehicles also, you can probably make a bigger swing than than, you know, with all the AI data centers we can build in

Speaker 0

第一季度。

the first quarter.

Speaker 0

比如在欧洲,这个数字增长得并不快,其他很多国家确实需要建设更多电力设施,但也没多到离谱。

Outside, like, it's like in Europe, like, that number's not moving up that fast, and all these other countries I think we need to build a lot more power, but it's not some crazy, crazy amount.

Speaker 0

只是做好这件事很难,确实。

It's just doing it properly is the hard Yeah.

Speaker 0

我同意。

I agree.

Speaker 0

再说电力成本,你去看看那些企业签的合同,还在不断签下新单。

And again, the cost of power, you go look at these deals people are signing, they're still signing.

Speaker 0

尽管这些大规模采购的电价从每千瓦时几美分飙升到了10美分,但你想想整个TCL集群的总成本——GPU本身、网络设备这些,加起来远比电费高得多。

Even though the price has skyrocketed from a few cents a kilowatt hour for these massive, massive purchases to 10, It's still you know, when you think about the full TCL cluster, you know, the GPU cost and networking, all of this stuff far outstrips the power.

Speaker 0

是的。

Yeah.

Speaker 0

制冷也是同样的情况。

And same with cooling.

Speaker 3

如果我算一个四年摊销的GPU数据中心,电力成本大概占多少比例?

But what what percentage is power from like, if you if I do four year amortized GPU data center, what percentage will be power?

Speaker 0

如果你在建Blackwell这样的数据中心,80%的成本都花在硬件采购上。

80% of the cost of a GPU data center if you're building Blackwell is capital.

Speaker 0

对。

Yeah.

Speaker 0

没错吧?

Right?

Speaker 0

主要就是GPU的购置费用。

It's the GPU purchases.

关于 Bayt 播客

Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。

继续浏览更多播客