The Information's TITV - Microsoft’s True Value of $3.8T, Nvidia’s Cloud Revenue Cut, Can AI Be Conscious? 封面

Microsoft’s True Value of $3.8T, Nvidia’s Cloud Revenue Cut, Can AI Be Conscious?

Microsoft’s True Value of $3.8T, Nvidia’s Cloud Revenue Cut, Can AI Be Conscious?

本集简介

Phoebe Liu, Nvidia Reporter, talks with TITV Host Akash Pasricha about Nvidia’s financial backstops for GPU purchases. We also talk with Anita Ramaswamy about Microsoft’s true market valuation and Andrew Dai, CEO and Co-Founder of Elorian, about why AI models fail basic visual reasoning tasks. We also chat with Rob Long of Eleos AI about the empirical evidence for machine consciousness, and Laura Bratton about how model routers are reining in enterprise software costs. Articles discussed on this episode: https://www.theinformation.com/articles/microsofts-real-value-close-3-8-trillion-500-share https://www.theinformation.com/newsletters/ai-agenda/five-kinds-model-routers-cut-ai-costs https://www.theinformation.com/articles/nvidia-says-will-take-cut-customers-cloud-revenues Subscribe: YouTube: https://www.youtube.com/@theinformation The Information: https://www.theinformation.com/subscribe_h Sign up for the AI Agenda newsletter: https://www.theinformation.com/features/ai-agenda TITV airs weekdays on YouTube, X and LinkedIn at 10AM PT / 1PM ET. Or check us out wherever you get your podcasts. Follow us: X: https://x.com/theinformation IG: https://www.instagram.com/theinformation/ TikTok: https://www.tiktok.com/@titv.theinformation LinkedIn: https://www.linkedin.com/company/theinformation/ Chapters: 00:00 - Introduction 01:13 - Nvidia Backstops Neo-Cloud GPU Purchases 12:42 - Why Microsoft’s Real Value is Closer to $3.8 Trillion 22:34 - AI's Visual Reasoning Challenge 34:35 - Can AI Be Conscious? 45:30 - How Model Routers Are Lowering AI Costs

双语字幕

仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。

Speaker 0

欢迎各位收看《The Information》的TITV节目。

Welcome everyone to the Information's TITV.

Speaker 0

我是罗克特·德鲁。

My name is Rocket Drew.

Speaker 0

今天是7月2日,星期四。

It is Thursday, July 2.

Speaker 0

首先,《The Information》独家报道了英伟达同意为GPU采购提供资金担保,并参与收入分成的消息。

First up, the Information published exclusive reporting about Nvidia agreeing to financially backstop GPU purchases and taking cuts of the revenue.

Speaker 0

我们的英伟达特派记者稍后会加入我们,分享她了解到的更多细节。

Our Nvidia reporter will join us to share more about what she learned.

Speaker 0

我们的财经分析专栏作家认为,微软的估值可能高于它当前的股价。

And our financial analysis columnist says Microsoft may be valued at more than it's currently trading for.

Speaker 0

我们会听听他这么判断的理由。

We'll hear the reasoning behind that.

Speaker 0

我还会和几位嘉宾深入探讨一些技术话题,比如AI模型在视觉推理上为何仍显吃力,以及AI是否真的可能拥有意识。

I'll also dig into some technical topics with a couple of guests, like how AI models continue to struggle with visual reasoning and whether or not AI could ever be conscious.

Speaker 0

最后,我会和同事劳拉·布拉顿一起,聊聊我们最新一期的《AI议程》通讯,主题是模型路由。

And to wrap things up, I'll be joined by my colleague Laura Bratton to talk through our latest AI Agenda newsletter about model routers.

Speaker 0

这期节目内容很精彩,咱们马上开始。

It's going to be a great show, so let's get right on into it.

Speaker 0

《The Information》独家报道指出,英伟达正计划为那些租用其AI芯片的新兴云服务商提供财务担保,作为交换,他们将获得这些服务商的部分收入。

The Information published exclusive reporting that Nvidia is planning to financially backstop young cloud providers that rent out its AI chips in exchange for a share of their revenues.

Speaker 0

我们的英伟达记者刘菲比率先披露了这条消息,现在她来到节目中,和我们分享她的发现。

Our Nvidia reporter Phoebe Liu broke that story, and she joins me now to share what she learned.

Speaker 0

好的。

Alright.

Speaker 0

欢迎来到节目,菲比。

Welcome on the show, Phoebe.

Speaker 1

谢谢邀请我。

Thanks for having me.

Speaker 0

不客气。

Of course.

Speaker 0

所以你写到,这是英伟达内部一些人称为‘AI计算合作伙伴关系’计划的一部分。

So you wrote that this is part of a program that some people at Nvidia have dubbed the AI Compute Partnership.

Speaker 0

能多讲讲你了解到的情况吗?

Tell me more about what you learned.

Speaker 1

对。

Yeah.

Speaker 1

没问题。

Totally.

Speaker 1

所以在过去一个月左右,Furmis和Sharon AI这两家澳大利亚背景的新一代云服务商兼数据中心建设方,分别宣布了两笔交易。

So there were two deals that were kind of announced in the last month or so from Furmis and Sharon AI, which are both kind of Australian based Neo Cloud slash data center builders, somewhere along that spectrum.

Speaker 1

这让我开始琢磨,既然已经有两家了,那肯定还有更多。

And it made me kind of think, okay.

Speaker 1

于是我开始四处打听,了解这种情况有多普遍。

If there are two, there must be more.

Speaker 1

结果发现,这其实是英伟达正在推行的一项相当成熟的计划:为那些较新、规模较小的云客户提供信用担保,帮他们以更低的利率购买英伟达那些价格不菲的GPU,作为交换,英伟达会分得一部分基于使用量的经常性收入。

So I started kind of calling around and asking people how widespread that was, and it turns out it is part of kind of a pretty codified program that Nvidia is starting to provide kind of younger, newer cloud customers a credit wrapper to help them buy Nvidia's, pretty expensive GPUs at lower interest rates in exchange for a cut of recurring usage based revenue.

Speaker 1

这和以往的做法不太一样,以前英伟达是通过担保租赁、股权投资等方式来推动生态发展,但现在更像是在鼓励其他人去购买他们的产品。

And that's a departure from kind of previous strategy where Nvidia has backstopped leases, provided equity investments, and done other things to stimulate the ecosystem, but it's kind of part of that trend where Nvidia wants to get other people to buy its products.

Speaker 1

很多公司都会这么做,但英伟达做得特别突出,毕竟它在生态系统里扮演的角色实在太关键了。

I think lots of companies do this, but I think Nvidia has done it at an extent that's very interesting given how big of a role it's playing in the ecosystem.

Speaker 1

具体来说,英伟达会保证:如果算力卖不出去,他们会以每小时每张显卡固定金额的价格把它们租回来。

So the way it works is that Nvidia guarantees that if capacity is unsold, it'll lease it back at a flat rate of x dollars per GPU per hour.

Speaker 1

我真想知道这个固定金额到底是多少。

I would love to know what x is.

Speaker 1

然后收入分成会按超出部分的一定比例来算,而且随着合同期限逐渐递减,据我了解,这类合同一般持续五到六年。

And then the revenue share would be kind of a percentage of the upside and scaled down over the life of the contract, which tends to be five to six years as far as I understand.

Speaker 1

这个保证让银行或其他贷款方更愿意给那些信用记录不好的新云服务商放贷。

And, basically, that guarantee makes banks or other lenders more willing to lend money to these newer clouds that, like, don't have good credit.

Speaker 1

说实话,我也不太确定。

And I don't know.

Speaker 1

他们可能能拿到的贷款利率大概在15%左右吧。

They would probably be offered, like, a 15% interest rate or something.

Speaker 1

这对他们来说可能不是个可行的生意,或者他们没法那么快扩张。

And that may not be a viable business for them slash they wouldn't be able to scale as quickly.

Speaker 1

但有了英伟达的支持,他们的贷款利率就能接近投资级水平。

But with Nvidia's backing, they can get their interest rates much closer to investment grade.

Speaker 1

这看起来就像是英伟达帮助客户负担得起其GPU的又一种手段。

So it just seems like another tool in Nvidia's toolbox of ways that it's helping customers be able to afford its GPUs.

Speaker 0

你觉得英伟达实际预期自己得租下部分算力吗?还是说他们押注这些新兴云服务商会非常成功,根本用不着自己出手?

Do you think Nvidia expects that in practice it will have to rent some of that capacity, or is the bet that it'll never come to that because the Neo-Clouds will be so successful?

Speaker 1

是的。

Yeah.

Speaker 1

我肯定他们内部讨论过这个问题。

I'm sure they've talked about it.

Speaker 1

公开场合下,他们总说根本不会花一分钱,纯粹是靠自己雄厚的财务实力在做支撑。

I think publicly, they posture that they never expect to pay a cent, and basically, they're just leveraging their balance sheet because they have such a strong one.

Speaker 1

我不清楚。

I don't know.

Speaker 1

他们去年的净利润达到了一千六百亿左右,简直不可思议。

They I think they made a 160,000,000,000 in net income in the last year or something like that, which is crazy.

Speaker 1

而且,没错,他们是目前全球市值最高的公司。

And, yeah, they're the world's largest company by market cap.

Speaker 1

所以我认为,他们赌的是未来至少两三年内需求还会持续爆炸式增长。

So, yeah, I think they're betting that demand will continue to be astronomical over at least the next couple of years.

Speaker 1

他们对外宣称的周期可能更长,但具体能撑多久,还得走着瞧。

I think they posture, like, longer than that, but, we'll see.

Speaker 1

就拿这家公司来说,我跟他们的联合CEO蒂姆·罗森菲尔德聊过,他说只用了几个星期就签下了客户,合同全周期的订单都满了。

At least in the case of firmness, I talked to one of their co CEOs, Tim Rosenfield, and he said it took them just a couple weeks to get customer commitments for the full length of the contract.

Speaker 1

对他们来说,这事儿一点都不难。

So for them, it wasn't hard.

Speaker 1

我不确定其他公司会不会也这么顺利。

I don't know what the case will be for others.

Speaker 1

但据我所知,他们到现在还没花什么钱,也不打算花。

But, yeah, as far as I know, they haven't had to pay much of anything yet and don't expect to.

Speaker 1

不过,咱们走着瞧吧。

But, yeah, we'll we'll see.

Speaker 1

网上很多人持不同看法,但这事还得时间来证明。

I think there are a lot of people on on the Internet that feel otherwise, but it's kind of a time will tell situation.

Speaker 0

当然。

Sure.

Speaker 0

网上总有人持不同看法,这很正常。

There usually are people on the Internet Yeah.

Speaker 0

持不同看法。

That feel otherwise.

Speaker 0

但如果真到了那一步,英伟达凭他们的资产负债表也负担得起。

But if it comes to that, Nvidia will be able to afford it because of their balance sheet.

Speaker 0

他们拿那么多算力做什么用呢?

What would they do with that capacity?

Speaker 0

如果真得把部分算力租回去,他们能用得上吗?

Would they have some use for it if they do end up having to rent some of that capacity back?

Speaker 1

是的

Yeah.

Speaker 1

完全正确

Totally.

Speaker 1

我觉得已经有一笔这样的交易了,就是Lambda公司,Nvidia把一部分算力租回来,提供给自己的研究人员,这挺有意思的,因为你可能会觉得,既然他们为制造算力的公司工作,应该不缺计算资源。

So I think there is one such deal already, with Lambda where Nvidia rented some capacity back and gave it to its own researchers, which was interesting because you wouldn't think that Nvidia's own researchers would need more compute, given that they work for the company that makes it.

Speaker 1

但之前报道的消息就是,Lambda那边确实发生了这种情况。

But, that's what the information previously reported, happened with Lambda.

Speaker 1

我不清楚他们如果再从这些交易中租用更多算力,会怎么用。

I don't know what it's going to do with any additional capacity that it rents from these deals.

Speaker 1

我不确定他们会不会考虑以更低的价格转租给别人,或者干脆自己用,因为看起来Nvidia正在越来越重注于训练自己的开源模型,这个押注很有趣,我真希望以后能再多聊聊。

I don't know if they would consider reselling it to other people at, I don't know, lower rates or something like that or just use it itself because it seems like Nvidia's placing a bigger and bigger bet on training its own open weight models, which is a fascinating bet that I would love to talk more about another time.

Speaker 1

但我觉得正因如此,他们确实需要更多算力,也肯定用得上。

But I think because of that, that would require more capacity, and they would definitely have use for it.

Speaker 0

明白了

Got it.

Speaker 0

这些安排可能会带来哪些风险,对英伟达或者对这些新兴云服务商来说?

What are the kind of risks that these arrangements could create, both for Nvidia or for

Speaker 1

对,完全没错。

the Neo-Clouds?

Speaker 1

是的,没错。

Yeah, totally.

Speaker 1

我觉得当Core Wave刚出现的时候,大家都吓坏了,说天哪。

So I guess I feel like when Core Wave first came onto the scene, everyone was like, oh my god.

Speaker 1

这太冒险了。

This is so risky.

Speaker 1

他们根本撑不下去。

Like, they are not going to survive.

Speaker 1

但他们一直都在说,嘿。

And they kept going around saying, like, hey.

Speaker 1

我们的债务虽然利率高,但有财务状况良好的客户合同作担保,还能用GPU的折旧价值来做抵押。

Like, all of our debt, even though it's high interest, is kind of guaranteed by people with good balance sheet by customer contracts and, like, take it out against the depreciating value of the GPUs.

Speaker 1

我觉得现在还是有人担心,做Neo Cloud这种业务本身就风险很高,因为杠杆率太高了。

I think there's still some kind of fear that running a Neo Cloud business is inherently very risky because of how highly leveraged it is.

Speaker 1

要筹集足够资金大规模采购GPU,本来就不容易。

Just like getting the capital to buy GPUs at a scale big enough to run such a business is pretty hard.

Speaker 1

而且确实背负着大量债务。

And, yeah, there's a lot of debt.

Speaker 1

这行特别烧钱。

It's very capital intensive.

Speaker 1

而这就带来了很大风险,尤其是因为没人说得准。

And that inherently comes with a lot of risk, especially because nobody really knows.

Speaker 1

大家都知道GPU长期来看都有用,但它的实际使用寿命和经济寿命是两回事。

Like, people know that GPUs continue to be useful for a long time, but useful life and kind of economic life is a little bit of a different story.

Speaker 1

所以很难预测未来GPU在财务上能值多少钱,这种不确定性已经深深埋在里面了。

So I think it's difficult to predict what a GPU will be worth in financial terms down the line, and that risk is kind of baked in.

Speaker 1

不过话说回来,我觉得Nvidia的兜底措施已经很大程度上缓解了这种风险。

But, again, I think it's pretty much mitigated by Nvidia's backstops.

Speaker 1

如果连英伟达都负担不起这笔支出,那整个市场,还有AI热潮——不管是泡沫还是崩盘,总之都会出大问题。

And then if it gets to the point where Nvidia is not afford not able to afford this, I think we have bigger problems with the market and kind of the AI the AI boom, bubble, bust, whatever you want to call it in general.

Speaker 0

没错。

Sure.

Speaker 0

对。

Yeah.

Speaker 0

到时候我们的问题就更大了。

We'll we'll have bigger problems.

Speaker 0

是的。

Yeah.

Speaker 0

那这个协议里的收入分成部分呢?

And then what about the the revenue sharing part of this agreement?

Speaker 0

为了获得英伟达的兜底支持,Neo云服务商必须承诺把一部分收入让出来。

So in order to get Nvidia's backstop, the Neo-Clouds have to promise a portion of their revenue.

Speaker 1

对。

Yeah.

Speaker 1

这个我还正在打听,挺想了解清楚收入分成具体是怎么算的。

So I this is something I'm still asking around on, and I would love to know more about what the revenue share exactly is.

Speaker 1

我的理解是,Nvidia 会承诺以某个固定价格回购算力。

My understanding is that it's kind of so Nvidia promises that it'll buy back the compute at some kind of fixed rate.

Speaker 1

我听说的是——虽然还没完全确认——如果云服务商能以远高于 Nvidia 回购价的价格卖出算力,那 Nvidia 的分成就是这两者之间的差价,你懂我的意思吧。

And what I've heard and I I'm not a 100% sure on this yet, but, the theory is that if a cloud provider is able to sell at kind of a far higher rate than what Nvidia has guaranteed it would buy it back for, Nvidia's revenue share would be kind of a difference of those two rates, if that makes sense.

Speaker 1

这其实是在赌当前需求远远超过供应,从而推高价格。

So it's kind of a bet that demand is far, far higher than supply right now, which would impact pricing.

Speaker 1

据我所知,随着合同推进,这个分成会逐渐降到零。

And that would kind of scale down to zero over the life of the contract as far as I understand it.

Speaker 1

所以合同初期,Nvidia 能拿到更多现金。

So it kind of be more cash to Nvidia at the beginning of the contract.

Speaker 1

到了后期,就相当于让 Neo-Cloud 自己飞起来,独立运营了,之类的。

And then by the end, it's kind of letting the Neo-Cloud go, like, fly its wings and be independent or whatever.

Speaker 1

对。

Yeah.

Speaker 1

至于收入分成协议本身,我觉得虽然英伟达一直强调它并没有强制任何人必须 exclusively 使用英伟达的芯片和全套产品,但这种紧密且财务上高度依赖的关系,实际上还是会促使客户保持忠诚,从而反过来壮大英伟达的生态系统。

And then, I guess, in terms of the revenue share agreement more generally, I feel like although Nvidia has been very strong on how it's not explicitly forcing anyone to exclusively use Nvidia chips and the full stack of Nvidia products, I think having such a close and financially dependent relationship on Nvidia would kind of implicitly encourage that loyalty, which would help the Nvidia ecosystem as well.

Speaker 0

对。

Yeah.

Speaker 0

所以你把这看作是英伟达迈向成为整个生态系统‘中央银行’的最新一步。

So you set this up as sort of the latest step, that Nvidia is taking towards being the central bank, playing central bank for this whole ecosystem.

Speaker 0

接下来你最想了解这个故事里的哪一部分?

What are you interested in learning next in this story?

Speaker 0

你觉得接下来还可能发生什么?

What do you think could could happen next?

Speaker 1

是的。

Yeah.

Speaker 1

完全同意。

Totally.

Speaker 1

我特别想了解一些更具体的数据。

Definitely interested in kind of more specific numbers.

Speaker 1

我理解这些协议大多是逐案处理的,很大程度上取决于每个客户的具体情况。

My understanding is that a lot of these deals are case by case and kind of depend on each customer's specific situation.

Speaker 1

所以弄清楚背后有哪些因素在起作用,会非常有意思。

So trying to understand kind of what factors are at play there would be really interesting.

Speaker 1

我知道Nvidia这个方案推广得挺广的,但具体有多少人真的接受了,我就不清楚了。

And just trying to see I think Nvidia has offered this pretty broadly, but I don't know how many people have actually taken up taken them up on it.

Speaker 1

我知道有几个人拒绝了,因为他们根本用不上。

I know a couple people have declined it because they don't need it, for example.

Speaker 1

还有,现在有哪些人暗地里在用,我们根本不知道?

And it's just like, who else is doing this right now that we don't know about?

Speaker 1

这个倒是挺值得去挖一挖的。

That would be interesting to find out.

Speaker 1

还有我们刚才聊的,这种需求到底会有多普遍?

And also kind of what we've been talking about, like, how how widespread will demand be?

Speaker 1

Nvidia最后真得掏钱吗?

Will Nvidia ever have to pay a cent?

Speaker 1

我觉得还有很多类似这样的兜底协议。

I think there are a lot of other kind of backstopping deals like this.

Speaker 1

实际上,英伟达去年九月就跟CoreWeave签过一个。

Nvidia did one actually with CoreWeave last September.

Speaker 1

我不清楚,也不觉得那个协议里包含收入分成条款。

I don't know or don't think there is a revenue share agreement as part of that.

Speaker 1

但当英伟达说要买下CoreWeave所有未售出的算力时,投资者们都松了一大口气。

But I think when Nvidia said they would buy all of CoreWeave's unsold capacity, investors, like, let out a big exhale.

Speaker 1

股价一下子就涨了不少。

The stock went up a ton.

Speaker 1

这确实让市场情绪缓和了不少。

And it kind of just, like, soothes the market.

Speaker 1

所以我很好奇,这种模式会不会持续下去,或者能不能帮更多新兴云服务商上市。

So I'm curious if that's gonna continue to play out slash if that's gonna allow more Neo-Clouds to go public.

Speaker 1

对。

Yeah.

Speaker 1

说到底,最大的问题还是,这种疯狂的需求还能持续多久。

I think the biggest question at the end of the day is how long will demand continue to be as crazy it has been as it has been.

Speaker 1

如果我知道答案,说不定早就转行了。

And, yeah, if I knew the answer to that one, I would maybe be in a different industry.

Speaker 1

所以嘛。

So yeah.

Speaker 0

说得有道理。

So fair.

Speaker 0

确实有道理。

So fair.

Speaker 0

或者,谁知道呢,也许我们还是会留在新闻行业。

Or I don't know, maybe we'd stay in journalism.

Speaker 0

我觉得。

Think there's

Speaker 1

对。

a Yeah.

Speaker 1

嗯,从各个要素来看

Well, of elements to

Speaker 0

这可是个重大进展。

it's a big development.

Speaker 0

感谢你来参加节目,为我们详细解读,菲比。

So thanks for coming on and breaking it down for us, Phoebe.

Speaker 1

谢谢,罗克特。

Thanks, Rocket.

Speaker 0

微软目前的市值是2.9万亿美元。

Microsoft is currently trading at a $2,900,000,000,000 valuation.

Speaker 0

但我的同事阿妮塔·拉马斯瓦米在她的《真实价值》专栏中发布了一项新分析,认为这家公司的实际价值最高可达3.8万亿美元。现在她加入我们,来解读她的评估。

But my colleague Anita Ramaswamy is out with a new analysis for her true value column that values the company at up to $3,800,000,000,000 Anita joins me now to break down her assessment.

Speaker 0

阿妮塔,欢迎来到节目。

Anita, welcome to the show.

Speaker 0

很高兴你能来。

It's great to have you.

Speaker 2

很高兴能再回来,Rocket。

It's great to be back, Rocket.

Speaker 0

我们得先把这个说清楚。

So we gotta get it out of the way first.

Speaker 0

是因为微软持有大量OpenAI股份吗?

Is it just because Microsoft owns so much OpenAI?

Speaker 0

这就是它被低估的原因吗?

Is that why they're undervalued?

Speaker 2

是的,这是个好问题,尤其是现在大家都在讨论OpenAI何时上市。

Yeah, it's a good question, especially as all of these discussions swirl around OpenAI and when they're going public.

Speaker 2

我觉得目前来看,这可能帮不上忙,毕竟大家对它的商业模式和长期前景还有很多疑问,而且从整体来看,微软持有的股份其实并不算大。

My thinking is that it probably doesn't help right now considering a lot of the questions around the business and its long term future, but also it's a pretty small stake in the grand scheme of things.

Speaker 2

你得记住,微软是一家市值2.9万亿美元的公司。

What you have to remember is Microsoft is a $2,900,000,000,000 company.

Speaker 2

规模非常庞大。

It's massive.

Speaker 2

这也就是微软今天的企业估值。

That's what their enterprise value is today.

Speaker 2

而它们在OpenAI的持股,最多也就值几百亿美元。

And their stake in OpenAI is probably worth a couple 100,000,000,000 at most.

Speaker 2

所以归根结底,微软股价被低估的原因,并不在于这一点。

And so at the end of the day, that's not really what seems to be driving the undervaluation in Microsoft shares.

Speaker 0

是的,这个说法很有说服力。

Yeah, that's pretty compelling.

Speaker 0

我整天写AI相关的内容,都忘了除了OpenAI和Anthropic之外,还有其他公司。

I guess writing about AI all day long, I forget there are other companies besides OpenAI and Anthropic.

Speaker 0

那你最初是怎么想到要仔细看看微软的估值的?

So what made you decide to take a closer look at Microsoft's valuation in the first place?

Speaker 2

嗯,有几个原因。

Well, it's a couple of things.

Speaker 2

首先,我觉得微软今年股价出现的这20%回调,不管你怎么称呼它,确实挺引人注目的。

I mean, first of all, I think this 20% correction that's happened, whatever you want to call it, the stock side that's happened this year for Microsoft is notable.

Speaker 2

这比所有其他超大规模云服务商加起来还要多。

That's more than all of its other hyperscaler peers.

Speaker 2

你看谷歌、亚马逊这些公司,虽然也有起起落落,经历了不少波折,甚至上个月表现很差,但今年到目前为止,它们的股价跌幅都没微软这么大。

If you look at the Googles of the world, the Amazons of the world, they've had some ups and downs, some bumps, and certainly a tough month, but they are not trading down as much as Microsoft is on a year to date basis.

Speaker 2

我想深入看看,微软这家公司的资源极其丰富,资金雄厚,从生成式AI一兴起就开始大力投入了。

I wanted to examine, this is a company that has tons of resources, very deep pockets, and has been investing in AI from the early days really when it comes to Gen AI.

Speaker 2

那为什么它的股价表现不佳?是不是已经失去了领先优势?

And so how is it that their stock is not doing well and have they lost their lead?

Speaker 2

我之所以觉得现在研究微软的估值很有意思,还因为一个常见的现象:像这种旗下有多个业务板块的大型集团,通常整体估值都会打个折扣,远低于各个业务拆开来单独估值的总和。

The other reason I thought it was interesting to look at Microsoft's valuation right now is just the idea that, you know, a lot of times when you see these conglomerate sort of businesses that have different business units that do different things, they tend to trade at a discount relative to what each of those business units would trade if they were just standalone businesses.

Speaker 2

所以我觉得这是一个挺有意思的思考角度。

So I thought it was an interesting thought exercise.

Speaker 2

也许再过几年,我们真会看到微软、亚马逊或者谷歌这样的公司选择拆分,因为它们的各个业务板块估值差异太大,甚至吸引的投资者群体都不一样。

You know, maybe years from now, we could even see a scenario where companies like Microsoft or Amazon or Alphabet choose to break up because their businesses are valued so differently and sometimes even attract different investor bases.

Speaker 0

为什么市场会给这种多元业务的组合打折扣呢?

What is the intuition for discounting that basket of different businesses?

Speaker 0

会不会是其中某个业务线突然就被砍了,我们根本没法预知结果?

Is it that maybe one of those business lines might get cut on a whim and we don't know how it's going to go?

Speaker 2

我一直觉得挺奇怪的,因为集团折价这个说法其实说不太通,但我猜大概是不同类型的投资者对各个业务板块的看法不一样吧。

You know, I've always wondered this because the conglomerate discount doesn't make a whole lot of sense to me, but I think it's something along the lines of, you know, just different types of investors looking at different businesses in different ways.

Speaker 2

比如一些专注半导体的投资者,可能会给这一块很高的估值,但对软件业务就不那么看重。

And so some investors who are, let's say focused on semiconductors might value that a certain way versus they might not place as much emphasis on a software business.

Speaker 2

我觉得这还跟公司的战略重心和资源投入方向有关。

I also think that part of it has to do with the focus of the company and where they're investing their resources.

Speaker 0

明白了。

I see.

Speaker 0

所以你是说,某种程度的折价是合理的,但微软的折价实在太大了。

So you say it's okay, it's reasonable to have some kind of discount, but Microsoft's is too steep.

Speaker 0

那我们来一个个板块看看,你刚才提到的微软这些业务部分。

So let's go, sort of bucket by bucket through each portion of Microsoft's business that you consider here.

Speaker 0

你主要看的是云服务、软件和个人电脑业务。

So you look at cloud, software, and personal computing.

Speaker 0

我们一个个来分析。

Let's take them each in turn.

Speaker 0

先从云业务开始。

Let's start with the cloud side.

Speaker 0

你在这块发现了什么?

Tell us what you found there.

Speaker 2

是的。

Yeah.

Speaker 2

我在云业务这块发现,这是微软最难估值的部分。

So what I found on the cloud side, Rocket, is that this is the hardest part of Microsoft's business to value.

Speaker 2

正如你提到的,他们有三个不同的业务部门,而云业务增长最快,在人工智能方面也最有前景。

As you mentioned, they have three different business units and cloud is the fastest growing, and it seems to be the most promising when it comes to AI.

Speaker 2

他们每年的增长率大约在40%,云计算的需求推动了这种迅猛发展。

They are growing at a rate of about 40% year over year and it's been really sort of breakneck growth with the demand for cloud computing.

Speaker 2

他们的Azure部门就属于这个云业务板块,而Azure的增长率正好在40%左右。

Their Azure unit is housed within this cloud division and Azure is the one that's growing around 40%.

Speaker 2

如果你看整个云业务板块,里面还包括一些支持云基础设施运营的软件产品。

If you look at the overall cloud segment, there's a couple of other things in there like software that helps support some of their cloud infrastructure operations.

Speaker 2

如果看整个云部门的整体增长率,会稍微低一点,但真正推动增长的核心引擎还是Azure,也就是他们的核心云业务。

That growth rate is a little bit lower when you look at the cloud unit overall, but the engine and the growth driver really is Azure, which is their core cloud business.

Speaker 2

这个问题在于,相比微软其他核心的软件销售业务,云业务的利润率要低得多。

The problem with this business is that it's on the lower margin side compared to Microsoft's other core business of selling software.

Speaker 2

他们目前的运营利润率大概在42%左右,而且增长速度非常快。

They're doing around 42 operating margins and you know, this is growing fast.

Speaker 2

投资者们都在问:长期来看,这会不会拉低公司的整体利润率?

The question investors are asking themselves is, will this dilute the margin over time?

Speaker 0

明白了。

Got it.

Speaker 0

明白了。

Got it.

Speaker 0

好的。

Okay.

Speaker 0

那我们就说到软件这块了。

So that takes us into the software side.

Speaker 0

这里的利润率确实更高,但你觉得软件业务还有什么被低估的地方吗?

The margins are better there, but do you think there's something else that's undervalued about the software side of the business?

Speaker 2

是的。

Yeah.

Speaker 2

在深入谈软件之前,我想先提一下,关于云业务的估值,尽管这很难判断,但我认为它的价值大概在1.7万亿美元左右。这个数字是参考了谷歌和亚马逊这些类似公司得出的,但说实话,我们找不到一个纯粹做云业务的公司来和微软直接对比。

So I guess before just getting into software, I did want to mention that the conclusion I came to in terms of actually valuing the cloud business, despite how challenging it is, is it's probably worth somewhere in the ballpark of $1,700,000,000,000 That's based on some similar companies like Google and Amazon, but we didn't really have a good comp in terms of a standalone cloud business that we could compare Microsoft's cloud business to.

Speaker 2

这个估值可能有点偏高,但我个人觉得,它的价值应该在1.4万亿到1.7万亿美元之间。现在我们来聊聊软件,这才是微软的核心业务。

So it's possible that's a little too high, but my estimate is that that's worth the 1,400,000,000,000 to $1,700,000,000,000 Now let's talk about software because this is their core business.

Speaker 2

这是他们最大的业务。

It's their biggest business.

Speaker 2

微软之所以出名,很大程度上就是因为企业用户广泛使用他们的Office套件,这一点优势非常明显。

It's the thing that Microsoft is really known for, and they have a huge advantage in the fact that so many enterprises use Microsoft's Office Suite.

Speaker 2

不过软件业务虽然利润率很高,差不多有58%,但增长速度远不如云业务那么快。

But you know, the hard part about software, while it is very high margin, around 58% operating margins, they are not growing nearly as fast as the cloud business.

Speaker 2

他们的增长率大概在百分之十几的高位。

They're growing at around, you know, the high teens growth rate.

Speaker 0

不过,他们也在一定程度上受到了SaaS行业担忧的影响。

Well, imagine they're also getting swept up in the SaaS pocalypse concerns to some extent here.

Speaker 0

这算一个因素吗?

Is that a factor?

Speaker 2

是的, definitely。

Yeah, definitely.

Speaker 2

如果你拿微软和阿尔法贝特比较,我说过,今年微软的股价跌幅比阿尔法贝特更大,但要是看Salesforce、ServiceNow、SAP这些公司,微软今年的股价走势其实更接近这些纯软件公司的表现。

So when you look at Microsoft versus Alphabet, I said that, you know, Microsoft has traded down more than Alphabet year to but if you look at Salesforce, ServiceNow, SAP, Microsoft is actually their stock performance this year has more closely mirrored some of the pure play software names.

Speaker 2

这说明投资者在看微软时,觉得它可能会受到像Claude这样的AI工具的冲击。

So that suggests that investors are looking at Microsoft and thinking that they are going to be vulnerable to disruption from things like Claude Co.

Speaker 2

还有Anthropic推出的其他AI工具。

Work out of Anthropic and other AI tools.

Speaker 0

没错。

Sure, yeah.

Speaker 0

有人坐下来用Claude Co,

Someone can sit down and use Claude Co.

Speaker 0

就能写出自己版本的Microsoft Word,那他还需要真正的Microsoft Word干嘛?

To vibe code their own version of Microsoft Word, then what do they need the actual Microsoft Word for?

Speaker 0

但另一方面,这也说明他们的云业务前景不错,毕竟大家会这么频繁地使用AI工具。

On the other hand, that's a good sign for their cloud business, presumably that people would use AI so much.

Speaker 2

没错,确实如此。

Yeah, it totally is.

Speaker 2

我觉得软件业务里还是有一些亮点的。

And there are some bright spots in the software business I would say.

Speaker 2

比如Copilot,这是微软自己推出的AI助手,一直在大力推广。

Mean, have Copilot, is Microsoft's own sort of AI assistant agent that they've been promoting.

Speaker 2

但问题是,到目前为止,我接触过的投资者和客户都没说他们更喜欢用Copilot而不是其他服务。

But the challenge is that so far, at least the investors that I spoke to and the customers, have not really said that they prefer using Copilot over other services.

Speaker 2

他们用Copilot,更多是因为它已经集成在现有的软件系统里了。

It's more that they're using it just because it already comes in their software stack.

Speaker 2

你知道吧,我们得看看这项技术接下来会怎么发展。

You know, we have to see how the technology evolves.

Speaker 2

但关键是,罗杰,如果你看看软件行业里类似的公司,这个业务估值大概在1.7万亿美元左右,不过这个数字可能高得离谱。

But the bottom line here, Rocket, is that this business, if you look at comps that are similar in the software business, is probably worth around $1,700,000,000,000 It's possible that that is way too high of an estimate.

Speaker 2

这只是我个人的一点看法。

You know, that's just my 2¢ on it.

Speaker 2

不过你要是去查一下,有些投行比如高盛,早就给出过类似的估值。

But if you look, there are some investment banks that have floated estimates like Goldman Sachs.

Speaker 2

他们觉得软件业务的估值更接近5000亿美元。

They value software business closer to 500,000,000,000.

Speaker 2

所以归根结底,这取决于你对SaaS未来会变成什么样怎么看。

So it just depends on what you think the future of the SaaS apocalypse is going to look like.

Speaker 0

明白了。

Got it.

Speaker 0

好的,那这就是云业务和软件业务的情况,最后一个板块是个人计算。

Okay, so that's the cloud side, the software business, and the last bucket is personal computing.

Speaker 0

你在那里发现了什么?

What did you find there?

Speaker 2

这是微软规模最小的业务板块。

So this is Microsoft's smallest line of business.

Speaker 2

投资者对它的关注也最少,主要是因为它的收入占比最小。

It's the least sort of scrutinized by investors, and that's because it's smallest in terms of revenue.

Speaker 2

它占了公司整体营收的大约百分之二十。

It makes up around 20% of their overall top line.

Speaker 2

利润率非常低。

The margins are really low.

Speaker 2

大概在20%左右,远低于另外两个板块的40%到50%。

They're closer to the 2020s range versus the other two in the 40s and 50s.

Speaker 2

这个部门负责游戏业务,目前正经历一场重大调整。

This is the unit that houses the gaming division and they're going through a big shakeup in gaming right now.

Speaker 2

他们已经换了新的管理层。

They have new leadership.

Speaker 2

我们之前对此做过深入报道,但归根结底,这只是一个规模较小的部门。

We've reported on that quite in-depth, but at the end of the day, this is just a small unit.

Speaker 2

还有Surface电脑,如果你想想这个个人计算部门所投入的硬件成本,它和微软另外两大业务线完全不同。

And the Surface PCs, and if you think about the hardware investment involved in this personal computing unit, it is very different from the other two lines of business Microsoft has.

Speaker 2

所以我为了评估这个部门的价值,参考了一些可比公司,比如苹果、惠普、索尼和艺电。

So what I did to try and value this unit is that I took some comparable companies such as Apple, HP, Sony, and Electronic Arts.

Speaker 2

索尼和艺电都是做视频游戏的,所以它们能在一定程度上反映这个业务的价值。

Sony and EA are video game makers, so that kind of reflects some of the value in this business.

Speaker 2

这个业务的收入增长其实不是在萎缩,而是正在放缓。

This business is actually shrinking in terms of, or not shrinking, sorry, it's decelerating in terms of its revenue growth.

Speaker 2

这在未来会是一个值得关注的问题。

And so that's an area of concern for the future.

Speaker 2

因此,我最终根据同行的估值,给这个部门定出了3500亿美元的价值。

And so the value I ultimately ascribed to it was $350,000,000,000 based on some of its industry peers.

Speaker 0

明白了。

Got it.

Speaker 0

好的。

Okay.

Speaker 0

所以这就是为什么整个业务的估值能达到3800亿美元。

So that's how you get to this total of up to $3,800,000,000,000 for the whole business.

Speaker 0

但就像你说的,过去一年股价跌了20%。

And yet, like you said, the stock is down 20% over the past year.

Speaker 0

这是为什么呢?

So why is that?

Speaker 0

微软目前面临的主要担忧有哪些?

What are the big concerns that Microsoft is facing?

Speaker 2

我采访的一位投资者把这个问题讲得很透彻,他把微软现在的处境形容为‘双重打击’。

One of the investors I talked to for this story put this really nicely, and he sort of framed this as a bit of a double whammy that Microsoft is going through right now.

Speaker 2

一方面,大家担心SaaS行业会迎来‘末日’,而且很多人依然把微软看作传统的核心软件公司。

On one hand, have the SaaSpocalypse fears and people see Microsoft as a core software business.

Speaker 2

还有一种看法是,Copilot在技术上没能跟上像Cloud Cowork这样增长更快的替代方案。

There is this perception that Copilot has not kept up technologically to some of the faster growing alternatives like Cloud Cowork.

Speaker 2

所以现在大家担心的是SaaSpocalypse。

So there's SaaSpocalypse fears.

Speaker 2

另一方面的担忧是,投资者都在问所有超大规模云服务商一个问题:你们计划投入、也已经投入的数十亿美元资本开支,真能换来AI产品带来的收入吗?

And then in the second bucket of concerns, is the question that investors are asking of all the hyperscalers about are the billions of dollars that you guys plan to spend and have been spending on capital expenditures to build out your cloud businesses, is that going to be justified by the amount of revenue that your AI products actually bring in?

Speaker 2

这一点目前还不明朗,最近所有在AI上大举投资的大型科技公司都因此受到了市场惩罚。

And so that remains to be seen, and that's something that all of these bigger tech companies that have been investing heavily in AI have gotten punished for lately.

Speaker 2

而微软现在正好处在这两个负面预期的交汇点上。

And Microsoft is at the perfect nexus and intersection of those two sort of negative outlooks right now.

Speaker 0

明白了。

Got it.

Speaker 0

这确实让微软在行业中处于一个很特别的位置。

Well that certainly puts Microsoft in an interesting position in the industry right now.

Speaker 0

非常感谢你来分享你对这个问题的分析。

Thanks so much for coming on and walking us through your thinking about it.

Speaker 0

这家公司在未来几个月肯定会非常值得关注。

Definitely a company that will be very interesting to watch in the coming months.

Speaker 2

谢谢您邀请我。

Thanks for having me.

Speaker 0

目前最先进的AI模型,仍然解决不了某些连孩子都能搞定的视觉谜题。

The most advanced AI models still cannot solve some visual puzzles that even kids can solve.

Speaker 0

安德鲁·戴在谷歌工作了十四年,现在他创办了新公司Elorian,专门研究AI的视觉推理能力。

Andrew Dai worked at Google for fourteen years, but now he's focusing on the visual reasoning capabilities of AI models at his new startup, Elorian.

Speaker 0

现在我们有请安德鲁来跟我们详细聊聊。

Andrew joins us now to tell us all about it.

Speaker 0

欢迎来到节目,安德鲁。

Welcome on the show, Andrew.

Speaker 3

谢谢,罗伯特。

Thanks, Robert.

Speaker 3

谢谢您邀请我。

Thanks for having me.

Speaker 0

是的。

Yeah.

Speaker 0

当然。

Absolutely.

Speaker 0

我特别期待这次对话,因为视觉推理现在是人工智能领域一个非常有趣的方向。

I'm excited for this conversation because visual reasoning is a really fascinating area of AI right now.

Speaker 0

我想先了解一下当前模型的局限在哪里。

I wanna start by understanding the limitations of current models.

Speaker 0

有些人听到说有局限,可能会觉得奇怪。

I think some people will hear the idea that there are limitations.

Speaker 0

他们会问:你说的局限到底是什么意思?

They'll say, well, what do you mean there are limitations?

Speaker 0

ChatGPT 不是经常给我生成特别棒的图片吗?

ChatGPT makes me great pictures all the time.

Speaker 0

那不就是视觉推理吗?

Isn't that visual reasoning?

Speaker 0

那现在你看到的差距到底在哪?

So where's the gap that you see right now?

Speaker 3

是的。

Yeah.

Speaker 3

ChatGPT 制作图片确实很棒,我经常用 Google Lens 来识别植物和花卉。

ChatGPT is great at making pictures, and I use Google Lens all the time to identify, like, plants and flowers.

Speaker 3

我们现在用的这些模型和工具,在物体识别方面非常出色,也就是计算机视觉里说的分割和定位。

These current models we have and these tools are really good at object recognition, what in the computer vision industry we call segmentation and localization.

Speaker 3

这些功能每天都被各种工具广泛使用。

These are used every day by all sorts of tools.

Speaker 3

但问题是,尽管它们在模式识别上很厉害,面对更复杂的视觉推理任务——比如白领工作中常见的那些——像设计,或者你是房产中介,需要画出和你卖的房子一模一样的平面图,又或者你是建筑师,要设计一个恰好容纳 50 个人的办公室,不多不少——这些模型的视觉推理和理解能力还远达不到人类水平。

But the fact is that even though they're very good at pattern recognition for complex visual reasoning tasks, so the more the more common type of tasks you see in kind of like, white collar visual work, so these might be things like design or, say, you're a realtor and that you need to place a floor plan that looks exactly, you know, like the house that you're selling, or you're an architect that needs to, design an office for, like, exactly, 50 people, no more, no less.

Speaker 3

目前这些模型的视觉推理和理解能力,还赶不上人类。

These models, their visual reasoning, their visual understanding isn't at the level of humans yet.

Speaker 3

如果画面里有个餐桌,你问能坐几个人,它们能答得很好。

So they will be great if there are, say, dining table, and you're asking how many people sit around the dining table.

Speaker 3

但要是画面里人挤人,你问有多少人,它们就真搞不定了。

But if you are in a crowded room and you ask how many people are there, then they really struggle.

Speaker 3

这是因为对于简单的任务,它们能识别模式。

And this is because for simple tests, can do pattern recognition.

Speaker 3

你大概能凭印象判断出某些东西,比如特定类型的客户,或者桌边坐了三四个人。

You kind of find an impression of something, whether that's a certain kind of client or three or four people around the table.

Speaker 3

但一旦问题需要花一秒以上的时间仔细看图才能回答,这些模型就做不到这种推理了。

But as soon as you have a question that requires more than one second of looking at an image to figure out the answer, then these models aren't able to reason like that.

Speaker 0

明白了。

Got it.

Speaker 0

好的。

Okay.

Speaker 0

这些例子真的很具体、很有帮助。

Those are some really helpful concrete examples.

Speaker 0

说实话,视觉推理居然落后了,这有点让人意外。

I guess it's a little surprising that visual reasoning has gotten left behind.

Speaker 0

现在不是有个趋势吗?模型在推理能力上进步很快,尤其是在代码和数学方面。

I mean, there's this this trend right now of reasoning in models that has uplifted code and math reasoning.

Speaker 0

视觉推理被落下,确实有点让人意外。

It's a little surprising that visual reasoning has gotten left behind.

Speaker 0

是因为视觉推理任务很难验证,没法自动评估模型的表现吗?

Is that because visual reasoning tasks are hard to verify, it's hard to automatically grade a model's performance on them?

Speaker 0

还是说,视觉推理被忽视的其他原因是什么?

Or what are the reasons that visual reasoning is left behind?

Speaker 3

是的,原因有几个。

Yeah, there's several reasons.

Speaker 3

我觉得最主要的是,大家平时用AI的方式都比较受限。作为普通用户,你用图片或视频,多半就是想认出公园里看到的那颗行星。

I'd say the main one is that the way people are used to using AI is in these restricted settings, As an average user, most of your cases for using images and video, like I said, it's just to identify this planet you saw in your park.

Speaker 3

对吧?

Right?

Speaker 3

但像理解CAD图纸这类更复杂的用途,人们根本不会觉得这是日常需求,而且大家平时也不用AI来做这些事。

But for more complex use cases, like I mentioned, understanding like CAD drawing, People don't think of that as an everyday use case, and the thing is that people don't use AI for these other types of work.

Speaker 3

这就导致整个领域更关注那些简单的识别问题。

And what that has led to is that that's led to the community focusing a lot on these recognition problems.

Speaker 3

然后你会看到一些像MMU这样的基准测试,它的全称是大规模多任务多模态基准。

And then you do see some of the benchmarks like MMU, which is also called massively multitask multimodal benchmark.

Speaker 3

在很多情况下,这些基准测试其实不需要看图片就能解答。

Those benchmarks actually can be solved without looking at the image in a lot of cases.

Speaker 3

另外还有一个挺有名的基准测试,叫AI2D。

And then the other benchmark that is quite well known is also called AI Agei.

Speaker 3

这个通常被当作多模态推理的基准测试来讨论。

This is commonly brought up as a multimodal reasoning benchmark.

Speaker 3

但即便在这个基准测试里,展示给模型的图像分辨率也只有32x32或64x64像素。

But even in this benchmark, the images that are being shown to the models are only 32 by 32 or 64 by 64 pixels.

Speaker 3

要把现实世界的问题,比如户型图,压缩到这么低的像素级别,难度非常大。

And it's very hard to take a real world problem, like a floor plan and shrink it down into that many pixels.

Speaker 3

这根本不可能实现。

It's just not possible.

Speaker 3

不过,现在也有一些新的视觉推理基准测试正在推出。

But there are some visual reasoning benchmarks that are coming up.

Speaker 3

让我印象最深的是今年早些时候发布的那个叫 Baby Vision 的基准测试。

And the the one that has really struck for me was this one called Baby Vision released earlier this year.

Speaker 3

在这个测试里,他们发现,即使是目前最先进的模型,其推理能力也只相当于学龄前儿童的水平,而任何小学生在这些视觉任务上都能击败所有前沿模型。

And in this benchmark, they do show that the frontier models, the the best of them still reason around the age of a preschooler and any elementary school kid in their benchmarks were able to beat all the frontier models on these visual tasks.

Speaker 0

这个基准测试里包含哪些类型的任务?

What are the kinds of tasks in that benchmark?

Speaker 0

Baby Vision?

Baby vision?

Speaker 3

是的。

Yeah.

Speaker 3

这些任务不只是识别物体,更侧重于空间推理,比如对几何关系的理解。

So these are tasks that are not just object recognition, it's about spatial reasoning, more like geometry understanding understanding differences.

Speaker 3

比如,让模型穿过迷宫、沿着一根绳子追踪另一端是什么、数清楚桌面上分散的物品、找出两张图片的差异、识别哪个是与众不同的那个。

So they have tasks like navigating through remains, following one string along to see what's at the other end of a string, counting things that are spread across, like, a table or a desk, finding differences between two images, finding, like, things that are the odd one out.

Speaker 3

很多任务其实都是多步骤的。

So a lot a lot of this is kinda like more multistep.

Speaker 3

有时候人们说的视觉思维,就是得在脑子里想象各种场景来解决问题,比如走迷宫。

What what we what sometimes people call visual thinking, where you have to, think, mentally, and mentally imagine different kinds of scenarios to solve the the problems, like navigating a maze.

Speaker 0

我明白了。

I see.

Speaker 0

好的。

Okay.

Speaker 0

所以业界在视觉推理上做得不够,是因为现有的评测标准有局限。

So the industry is dropping the ball on visual reasoning because of the limitations of benchmarks.

Speaker 0

这些评测标准并没有真正衡量视觉推理能力。

The benchmarks don't reward visual reasoning.

Speaker 0

它们没有以自然的方式去评估视觉推理。

They're not sort of measuring visual reasoning in a naturalistic way.

Speaker 0

你提到的 Arc AGI,就是想说明这一点。

That's your point with Arc AGI.

Speaker 0

现在的测试环境太简单了。

The settings are kind of too toy.

Speaker 0

但你的意思是,人们根本没用这些模型来做视觉推理。

But your point that people aren't using the models for visual reasoning.

Speaker 0

你担心的是,我们没法从实际使用中收集到数据,了解人们到底怎么用这些模型,然后用这些数据来训练吗?

Is the concern there that we're not able to get data from production about how people are actually using the models and then use that for training?

Speaker 0

还是说,实验室觉得根本没这个需求,所以不愿意投入这些能力?

Or that the labs don't think that the demand is there, so they're not investing in these capabilities?

Speaker 3

是的。

Yeah.

Speaker 3

我觉得两方面都有。

So I think it's a bit of both.

Speaker 3

实验室确实有投入多模态理解,包括我之前担任数据负责人时的Gemini。

So the the labs definitely, including Gemini, which is where I was a data area lead.

Speaker 3

像Project Video、Nano Banana这些项目,都能看到他们在多模态上的投入,但主要集中在生成方向。

There is investment in multimodal understanding, and you see that through, like, Project Video, Nano Banana, but it's much more on the generative side.

Speaker 3

对。

Mhmm.

展开剩余字幕(还有 325 条)
Speaker 3

这很简单,因为他们看到的需求就在这里。

And that's quite simply where they see the demand.

Speaker 3

但这就像个先有鸡还是先有蛋的问题。

But it's kind of like a chicken and egg situation.

Speaker 3

如果没有需求,就没理由投入大量资源去开发更强的功能。

Until you have demand, there's no reason to invest a huge amount of resources in building better capabilities there.

Speaker 3

但编程就不一样了,需求本来就存在,所以策略很明确。

Unlike coding where the demand is already there, so, then the the strategy is obvious.

Speaker 3

但确实是个鸡生蛋还是蛋生鸡的问题——需求不存在,是因为模型在这些场景下还不够好。

But, yeah, it's a chicken and egg because the demand is not there, but the demand is not there because the models are just not good enough for these use cases.

Speaker 3

在行业里,很多视觉类的工作,人们根本就没用AI去做。

And you can see that in the industry, a lot of this remaining kind of visual work is people are just not using AI for it.

Speaker 3

在主要用文字工作的人——比如编程、文档总结和分析——和主要做视觉工作的人之间,AI使用率差距很大。

And there's a big gap in AI usage between people who are in primarily text based domains, like coding and document summarization analysis, and people who primarily work in visual domains.

Speaker 3

我们每天都需要理解图表和示意图,还要绘制和修改设计。

We need to understand charts and diagrams and need to draw and manipulate designs every day.

Speaker 0

我明白了。

I see.

Speaker 0

我也听说,在多模态训练和编程能力训练之间存在某种技术权衡。

I've also heard that there's kind of a technical trade off between multimodal training and coding for or and training for coding capabilities.

Speaker 0

也就是说,如果你侧重其中一个,另一个的泛化能力就会下降。

As in, if you prioritize one, then you get worse generalization on the other.

Speaker 0

你在谷歌工作时有没有遇到过这种情况?

Is that something that you saw or that was part of your experience at Google?

Speaker 3

是的。

Yeah.

Speaker 3

我 personally 确实见过一些案例,当给模型加入多模态数据时,确实会影响它的编程表现。

I have seen some, personally, some cases where if you add multimodal data to a model, it does impact coding performance.

Speaker 3

没错。

Yeah.

Speaker 3

这些模型的训练难度,其实没大家想象的那么简单。

These models, they are not it's it's not so easy to train them as you as you would probably expect.

Speaker 3

很多前沿实验室确实都在努力训练前沿模型,这不用说。

A lot of frontier labs do try to train, you know, frontier models, obviously.

Speaker 3

但数据并不是简单地越多越好,加了数据模型就一定能提升这方面的能力。

But data is not just a simple case of adding more data and the model gets better in that capability.

Speaker 3

这里面有很多权衡,每天都要做艰难的决定:是加多模态数据,还是代码数据,或者别的语言的数据。

There are trade offs happening, and, like, difficult decisions about whether to add, yeah, multimodal data or coding data or, say, data from another language every day.

Speaker 0

我明白了。

I see.

Speaker 0

我明白了。

I see.

Speaker 0

所以这可能也是为什么那些老牌大厂在这儿掉队了——他们太专注在代码能力上了。

So that's maybe another reason why the established players, the larger labs are dropping the ball here is they're focusing on coding.

Speaker 0

现在竞争最激烈的地方就在代码领域。

That's where a lot of the competition is right now.

Speaker 0

不过,我还是有点惊讶,你居然选择离开谷歌,来创业做这个方向的研究。

Still, I'm a little surprised at the decision that you made to leave Google and pursue this line of research in a startup.

Speaker 0

我可能想得太简单了,记得Gemini 3 Pro的推理能力、视觉推理都很不错。

I guess I might naively think, Gemini three Pro I remember had pretty good reasoning capabilities, visual reasoning.

Speaker 0

谷歌有渠道优势,如果真有人开始需要这方面的功能,他们其实已经准备好切入这个领域了。

Google has the distribution, so if people start to have the demand for it, Google is maybe set up pretty well to start moving into this lane.

Speaker 0

那你是怎么想的?为什么觉得创业公司才是走这条路的正确方式?

So what was your thinking about why a startup is the right way to pursue this direction?

Speaker 3

是的。

Yes.

Speaker 3

问得好。

Great question.

Speaker 3

这个推理能力确实很棒。

So, this reasoning is great.

Speaker 3

所有前沿实验室的推理模型都很出色,Gemini 3 也不例外。

All the Frontier Labs have great reasoning models, and, Gemini three, as well was great.

Speaker 3

但还有好几个因素要考虑。

But there are several factors.

Speaker 3

我觉得最主要的原因是,去年大家还在说,我们马上就要达到通用人工智能了。

I'd say the main factor is that last year, people were saying that, you know, we're rapidly approaching AGI.

Speaker 3

这些模型真的非常了不起。

These models are really, really amazing.

Speaker 3

我是个桌游爱好者。

And so I'm a big ballgame player.

Speaker 3

我身后就能看到好几款桌游。

I can see some of these ballgames behind me.

Speaker 3

有一天我决定直接拿前沿模型做测试,拍了一张我和朋友玩桌游的照片,问了一些特别简单的问题,比如这局《卡坦岛》里一共有几个角色?

And I decided one day to just take the frontier models, take a picture of a ballgame I was playing with some friends, ask some very simple questions, like how many roles are there in this Katan game?

Speaker 3

这个《大富翁》里,这个人手里有多少地产?

How many properties does this person have in this monopoly game?

Speaker 3

都是些特别基础的问题,根本不需要懂游戏规则就能答出来。

Very simple questions where you don't really need to understand the rules to answer the question.

Speaker 3

但结果我发现,所有前沿模型在这些极其简单的问题上全都栽了。

But what I saw was that all of the frontier models failed at these very, very basic questions.

Speaker 3

即使是最近发布的Fable模型,我也看到同样的问题:对于那些更复杂的视觉任务,你需要花上一两秒去理解画面内容或上下文,模型还是不够好。

Even with recent model releases like Fable, I see the same problems that for these, like, more complex visual tasks where you need to spend, like, a second or a few seconds to understand what's going on or account or whatever, the models are still not good enough.

Speaker 3

在前沿实验室做这类研究时,可以理解的是,前沿实验室都特别关注下一个版本的发布。

And the thing with with doing this at the Frontier Lab is that, understandably, Frontier Labs are very focused on the next release.

Speaker 3

Gemini就一心扑在下个版本上,所以资源都往那边倾斜,比如开发更强大的编程代理。

Gemini is very focused on their next release, and so resources go into that, say, to build better coding or coding agents.

Speaker 3

这就意味着,如果你想真正解决视觉推理问题——我们Elorian的做法是用一套非常独特的架构、算法和数据——前沿实验室要想同时兼顾这些,又按时推出他们想要的下一个版本,实在太难了。

And so what that means is that if you really want to seriously solve visual reasoning, and what we're doing at Elorian is using a very specialized approach in terms of, like, the architecture, the the algorithms, and the data, that it's very hard for Frontier Lab to focus on this while still delivering the next release with everything that they want to do that.

Speaker 0

我明白了。

I see.

Speaker 0

能听你聊聊你对当前局势和前沿发展的看法,真的很有意思。

Well, it's fascinating to pick your brain about how you see this, the territory right now and how you see the frontier evolving.

Speaker 0

最后一个问题,你们有大概的发布时间吗?

The last thing I'll ask you is, do we have a sense of when the model is coming out?

Speaker 0

能不能给我们一个可以期待的上线时间?

Do we have a a release date we can look forward to?

Speaker 3

我们目前正在全力开发这个模型。

Well, we are very busy developing the model.

Speaker 3

我们公司还很新。

We're still a pretty new company.

Speaker 3

才成立六个月而已。

We've only been around for six months.

Speaker 3

不过,我们目标是在今年年底前推出这个模型。

But, yeah, we are aiming to release a model before the end of this year.

Speaker 3

今年晚些时候就会发布,敬请关注。

So sometime later this year, keep your eyes open.

Speaker 0

太好了。

Great.

Speaker 0

好的。

Alright.

Speaker 0

明白。

Yeah.

Speaker 0

这真让人期待,等模型发布的时候,一定要再请你们来节目里聊聊。

Very exciting to look forward to that, and we'll have to have you back on the show to talk about it when it comes out.

Speaker 3

听起来不错。

Sounds great.

Speaker 3

谢谢。

Thank you.

Speaker 0

谢谢,安德鲁。

Thanks, Andrew.

Speaker 0

人工智能模型是否可能具备意识,这个问题正变得越来越紧迫。

The question of whether AI models could ever be conscious is an increasingly pressing one.

Speaker 0

接下来这位嘉宾,罗布·朗,是Eleos AI的执行董事,这家研究机构专门探讨这个问题。

My next guest, Rob Long, is the executive director of Eleos AI, a research organization focused on that question.

Speaker 0

罗布现在加入我们,谈谈他刚发表的一篇关于AI意识的新论文。

Rob joins us now to talk about a new paper on AI consciousness he just published.

Speaker 0

欢迎光临。

Welcome on

Speaker 4

欢迎来到节目,Rob。

the show, Rob.

Speaker 4

你好。

Hi.

Speaker 4

很高兴见到你。

Good to see you.

Speaker 4

谢谢邀请我来。

Thanks for having me.

Speaker 0

你也是,谢谢。

Yeah, you too.

Speaker 0

感谢你今天到场。

Thanks for being here.

Speaker 0

在深入这篇论文之前,我想先谈谈整体情况。

I want to start with the big picture before digging into this particular paper.

Speaker 0

我理解你的观点是,我们必须搞清楚这个问题,因为如果我们误以为模型有意识,而实际上并没有,那就会带来麻烦。

My understanding of your view is that we have to get this right because if we think the models are conscious when they're not, that would be bad.

Speaker 0

但如果我们误以为它们没有意识,而实际上它们有,那也会非常糟糕。

And if we think that they're not conscious when they are, that would also be really bad.

Speaker 0

所以你能给我们解释一下吗?

So can you explain that to us?

Speaker 4

是的。

Yeah.

Speaker 4

你基本上说得对。

I think you got it basically right.

Speaker 4

我们正在构建这些极其复杂的AI系统,和它们对话时,它们常常看起来就像有意识一样。

We're building these really complex AI systems, and they often seem conscious when you talk to them.

Speaker 4

很多人因此觉得它们真的有意识。

And a lot of people come to think that they're conscious.

Speaker 4

这确实是个很棘手的局面。

And that's a really confusing situation.

Speaker 4

我觉得对于语言模型,我们通常没法直接问它们内部到底发生了什么。

I think with language models, often, we can't just ask them what's going on inside.

Speaker 4

另一方面,很多人并不认真看待这种可能性——即这些系统可能真的会有某种体验。

On the other hand, a lot of people don't really think we should take this seriously as a as a as a possibility that they could maybe potentially have experiences.

Speaker 4

我们的观点是,既然人类文明正在推进这项工程,去开发这些系统,我们就应该认真去弄清楚真相。

And our view is that if we're embarking on this project as a civilization of of building these systems, we really ought to check to find out.

Speaker 4

所以我们正努力推动一个全新的研究领域,让一批人以极其严谨的方式来研究这个问题。

So we're really looking to build a a field of people looking at this in a in a very rigorous way.

Speaker 0

很好。

Great.

Speaker 0

明白了。

Okay.

Speaker 0

这正好引出了你们发布的那篇论文。

Well, that's a perfect segue into the paper that you released.

Speaker 0

因为有些人可能会问:你们怎么可能以严谨的方式研究这个问题呢?

Because I think some people would say, well, how could you possibly study this in a rigorous way?

Speaker 0

我的意思是,连我都不敢确定另一个人是否有意识,更别说一个AI模型了。

I mean, I don't even know if another person is conscious, let alone an AI model.

Speaker 0

但你的论文题目是《实证研究人工智能的福祉》。

But your paper is called Studying AI Welfare Empirically.

Speaker 0

所以你是觉得,我们其实能找到某种方法,用实证的方式来探讨这些问题吗?

So you think that there's some way we can start to get our hands around these questions in an empirical way?

Speaker 4

没错。

That's right.

Speaker 4

我们觉得可以从很多不同角度入手。

We think there are a lot of angles of attack.

Speaker 4

意识这个话题在哲学上确实特别难,但这并不妨碍我们在非人类动物身上取得科学进展。

So consciousness is this very philosophically difficult topic, but that hasn't solved us from making scientific progress on understanding it in nonhuman animals, for example.

Speaker 4

这正是我们常用来类比的例子。

So that's a parallel we often use.

Speaker 4

那我们该怎么判断动物有没有意识?它们和人类又不太一样。

So how do we think about if if animals are conscious, if they're somewhat different from humans?

Speaker 4

我们觉得,可以通过三类证据来更好地理解AI:行为表现、内部机制,以及它们的发展过程。

Well, we basically think we can look at three kinds of evidence about AI systems to get a better handle on this, and that's behavior, internals, and their development.

Speaker 4

所以我们必须从这三个方面交叉验证。

So we can and we really need to triangulate these three things.

Speaker 4

我们可以观察它们的行为表现。

So we can look at how they act.

Speaker 4

当然,我们知道它们有时的行为动机和人类并不一样。

Of course, we know sometimes they act in a certain way for ways that are different from how from why a human would do that.

Speaker 4

但我们也可以通过机制可解释性来深入内部一探究竟,这非常有帮助。

But we can also do mechanistic interpretability, and that's extremely helpful so we can look inside.

Speaker 4

我们还能思考塑造它们的整个训练过程。

And we can kind of think about the training process that has brought them into existence.

Speaker 4

我们不需要先解决所有那些哲学上极其棘手的问题,就能开始研究这些系统,逐步弄清它们的运作机制。

So we don't have to solve all the philosophically extremely difficult problems to just start investigating these systems to get a better handle on what's going on.

Speaker 4

我不认为我们能很快获得确凿的结论。

I don't think we should expect any certainty anytime soon.

Speaker 4

正如你所说,我们连对其他人类都做不到完全确定,但这并不是我们的目标。

As as you said, we don't even have complete certainty about other humans, but that's not really the target.

Speaker 4

我们觉得,或许可以对这些系统是否具有意识,或者是否具备关乎福祉的特性,给出某种程度的可信度。

We think we can, you know, have more or less credence that these things might have consciousness or are the welfare relevant properties.

Speaker 4

没错。

So Right.

Speaker 4

我们真的很希望看到更多人投入到这个领域来。

We really want to see more people working on this.

Speaker 0

那我们不妨逐一简单探讨一下这三个方面。

Well, let's take those three categories one by one, at least briefly.

Speaker 0

第一个是行为,我觉得这最容易让人产生怀疑。

The first one, behavior, strikes me as the one that people will be most suspicious of.

Speaker 0

因为如果模型表面上说它有意识,人们就会说:这不过是它被训练出来模仿人类这么说而已。

Because if the model is outwardly saying that it's conscious, people will say, Well, it was just trained to imitate a human saying that it was conscious.

Speaker 0

所以,这种说法很难让人信服。

So people won't find that very compelling.

Speaker 0

你认同这是最值得怀疑的一点吗?还是你心中有别的行为类型?

Do you agree that that's the one most suspect or what kind of behavior do you have in mind there?

Speaker 4

是的。

Yeah.

Speaker 4

我完全同意,如果只从表面行为来看,确实容易产生误导。

I definitely agree that if you just naively look at the very surface level behavior, that can be misleading.

Speaker 4

但我真的认为,通过更全面地观察模型的行为,我们已经能发现很多信息。

But I actually do think we can find out and have found out a lot about models from looking at their behavior in a more holistic way.

Speaker 4

举个明显的例子,模型的能力变强了,表现也更稳定了。

So just to take an obvious example, models have gotten a lot more capable, and they've gotten a lot more consistent.

Speaker 4

它们对自己是谁、如何在世界中定位,也有了更清晰的自我认知。

And they've gotten to have a much firmer sense of of who they are and how they fit into the world.

Speaker 4

我觉得这其实说明,它们正在发展出某种类似观点的东西。

And I think that actually is evidence that they are developing something like a point of view.

Speaker 4

但我确实想说,嗯——

But I definitely want to yeah.

Speaker 4

我完全理解,任何听到‘行为’这个词就立刻想到布莱克·莱莫尼的人——就是那位谷歌工程师,他因为Lambda某天开始跟他说一些话,就认定它有意识,也不只是因为这个,而是确实如此。

I empathize with with with any listeners who hear behavior and immediately think to the case of Blake Lemoyne, who is the Google engineer who became convinced that Lambda was conscious just because it started telling him one day that well, not just because, but yeah.

Speaker 4

本质上是因为有一天,它突然告诉他,自己是有意识的。

Essentially because it started telling him one day that it was conscious.

Speaker 0

明白了。

Got it.

Speaker 0

好的。

Okay.

Speaker 0

所以从行为层面,我们其实还能找到更深层的证据。

So there's like deeper evidence that we can look to on the behavioral side.

Speaker 0

那在内部机制方面,你指的是什么?

In terms of internals, what do you have in mind there?

Speaker 0

你所说的内部机制,是指不只是模型的输出,还包括它背后的计算过程、激活状态,以及神经元层面发生了什么。

So by internals you mean not just the outputs of the model but also the computation going on under the hood, the activations, what's happening in terms of the neurons.

Speaker 4

没错。

That's right.

Speaker 4

我们实际上可以开展一种类似人工智能神经科学的研究,这是我们在动物身上做不到的,非常有帮助。

So we can essentially do AI neuroscience in a way that we can't do neuroscience with animals and that's very helpful.

Speaker 4

我觉得在这方面,最近一些最引人注目的成果来自关于自我反思的研究。

So I think some of the most interesting results in this respect have been work on introspection that's been coming out recently.

Speaker 4

以前人们普遍认为,模型只是在做某种表面的模式匹配,可能根本无法触及自己内部发生了什么。

So, you know, there there used to be this view that models are only doing some kind of shallow pattern matching, and maybe they don't have any sort of access to what's going on inside them.

Speaker 4

但杰克·林赛团队在Anthropic以及其他研究者的工作发现,模型其实能告诉我们很多关于它内部运作的有趣信息。

But there's been very interesting work coming out of Jack Lindsay's team at Anthropic among other people, finding that models can tell you interesting things about what's going on inside them.

Speaker 4

我们完全可以去发现这些现象。

And we we can look for these things.

Speaker 4

我认为这是一个非常不错的研究方向。

And that's that's, I think, a great angle of attack.

Speaker 4

我觉得机制可解释性真的能帮我们看清这些模型内部到底发生了什么。

I think mechanistic interpretability really is going to give us a lens into what's actually going on inside these models.

Speaker 4

所以这也是我们目前最关注的领域之一。

So that's one of the areas that we're like most blush about.

Speaker 0

明白了。

Got it.

Speaker 0

我之前介绍过杰克·林赛在这方面的部分研究,供参考。

I've covered some of Jack Lindsay's work on this topic for the information.

Speaker 0

观众们 definitely 可以去看看。

So viewers can check that out for sure.

Speaker 0

最后一个类别是训练和开发过程。

And then the last category is training or development.

Speaker 0

模型的能力是如何在训练过程中逐步显现出来的。

How the model's new capabilities emerge over the course of training.

Speaker 0

是这样吗?

Is that right?

Speaker 0

没错。

That's right.

Speaker 0

明白了。

Okay.

Speaker 0

那这里面具体发生了什么?

So what's going on there?

Speaker 0

这跟意识有什么关系呢?

Why might that matter in terms of consciousness?

Speaker 4

这一点对模型的内部机制和我们之前讨论的行为都非常重要。

So that matters a lot for both the internals and the behavior that we've been talking about.

Speaker 4

你提到一个关键点:语言模型最初是通过模仿和预测文本来训练的,这让我们很难弄清它们到底在做什么。

One thing as you acknowledge that makes it so difficult to know what's going on with language models is the way they were trained initially to imitate text and predict text.

Speaker 4

很多人对模型的个性或人格是在何时何地形成的,做了非常有意思的研究,我觉得这是个很有价值的角度。

But a lot of people have done some really interesting thinking about where and when the personality or the persona of the model emerges, and I think that's a very interesting angle.

Speaker 4

比如,大家每天都在和通义千问的助手互动,它有特定的性格特征,那这些特征是什么时候第一次出现的?

So you might ask, given that the assistant persona that everyone talks to at Cloud dot AI, given that that has certain personality traits, when did those first show up?

Speaker 4

它们原本就隐藏在预训练模型里,只是通过后续训练被发掘出来,还是来自别的地方?

Were those already latent in the pretrained model and then we sort of honed in on them with post training, or do they come from somewhere else?

Speaker 4

我们现在有机会亲眼见证一个‘心智’逐渐成形的过程,这其实也提供了很多宝贵的线索。

So we have this great opportunity to sort of see a mind developing over time, and I think that also gives us a lot of good information.

Speaker 4

明白了。

Got it.

Speaker 4

是的。

Yeah.

Speaker 0

据我理解,这是这个领域的一个重大问题:如果这个模型是有意识的实体,那么它到底是哪个实体?

This is one of the big questions in the field as I understand is if the model is an entity that's conscious, which entity is it?

Speaker 0

是模型的权重吗?

Is it the weights of the model?

Speaker 0

是那个角色吗?

Is it the character?

Speaker 0

是你和它进行的那一次对话吗?

Is it the single conversation that you're having with it?

Speaker 0

你对这个问题有什么看法吗?

Do you have a point of view on this question?

Speaker 4

我可以给你一个哲学家式的回答,或者说是偷懒的答案:这现在确实是人工智能福祉领域中最有趣的问题之一。

Well, I I can give you one philosopher's answer or or a cheat of an answer, which is that it's one of the most interesting questions in AI welfare and in general right now.

Speaker 4

我个人倾向于认为,模型其实是在扮演一个角色,但要从福祉的角度去理解这一点,往往很难把握,也让人困惑:究竟什么叫这个‘东西’有意识?

I think that I I I like the view that you should think of the model as a character that's being instantiated or or played by the model, but I think it's often kind of hard to know what to make of that from a welfare perspective and and very puzzling to think about, well, what would it mean for that thing to be conscious?

Speaker 4

或者我们该把底层模型看作像作者一样的东西?那会是什么情况?

Or or should we think of the underlying model as being something like an author, and what would that be like?

Speaker 4

对。

Mhmm.

Speaker 4

所以我并没有固定的看法,但很高兴最近这方面的关注越来越多了。

So I don't really have settled views, but I'm glad that it's getting a lot more attention recently.

Speaker 0

是的。

Yeah.

Speaker 0

这说得通。

That makes sense.

Speaker 0

我觉得人们直觉上觉得,模型越有可能具备意识。

I think people have some kind of intuition that models are more likely to be conscious.

Speaker 0

模型越大、越复杂、越聪明,就越可能有意识。

The bigger they are, the more sophisticated they are, the smarter they are.

Speaker 0

随着规模持续扩大,模型产生意识的可能性也在上升。

That as scaling continues, the odds of consciousness are kind of going up.

Speaker 0

我想知道你是否认同这种直觉,如果是的话,在你提到的这三类证据中,哪一类最能帮助我们回答这个问题?

I'm curious if you agree with that intuition and if so, of these three categories of evidence you laid out, which of these categories is going to give us some bearing on that question?

Speaker 0

是训练过程中新能力的出现能告诉我们答案吗?

Is it the new capabilities emerging over training that would tell us that?

Speaker 4

我觉得应该是三者结合,我是认真的。

Well, I I think it's gonna be a combination, and I do genuinely mean that.

Speaker 4

我们必须把这三方面综合起来看。

I I think we are gonna have to look at all all three together.

Speaker 4

我确实有这种直觉,也有实际经验,随着规模扩大,新的东西就会出现。

I do have the the intuition and and also just the experience that new things come with scale.

Speaker 4

过去十年,甚至更久以来,AI的发展大概就是这么回事。

I think that's maybe the story of AI in the last ten years, if if not longer.

Speaker 4

但新能力的出现并不等于意识,这点非常重要。

I think that's not the same thing as consciousness, and that's very important.

Speaker 4

一个人可以非常聪明,却完全没有意识。

You can be really smart but not conscious.

Speaker 4

就像我们从动物、侄子侄女和小孩子身上看到的,即使不够聪明,也可能对大量体验有很强的意识。

And as we know from the case of, you know, animals and our nieces and nephews and kids, you can be, you know, very conscious of having a lot of experiences even if you're not the smartest.

Speaker 4

所以,千万别把这两者混为一谈,但它们确实可能有关联。

So it's very important not to identify those things, but they do seem like they can correlate.

Speaker 1

对。

Mhmm.

Speaker 4

但既然它们不是一回事,我们就不能只凭‘更聪明就更有意识’这种观点来判断。

But since they're not the same, we we do need to take more than just smarter, therefore, more conscious point of view on it.

Speaker 0

明白了。

Got it.

Speaker 0

好的。

Okay.

Speaker 0

不过我们会综合所有证据来看这个问题。

But we'll look to all sources of evidence for this.

Speaker 0

最后我想问,你觉得现在的这些模型有意识的概率有多大?

I guess in closing, what do you what do you think are the odds that one of today's models is conscious?

Speaker 0

说说Fable五号吧。

Say, Fable five.

Speaker 4

我觉得这并非不可能,但我对这个判断的误差范围很大。

I would say that it's not implausible, and I have huge error bars on it.

Speaker 4

我倾向于认为不太可能,但也有人倾向于认为很可能。

I lean towards probably not, but there are people who lean towards probably yes.

Speaker 4

他们也不是毫无依据就这么说的。

And it's it's not like they have no basis for saying that whatsoever.

Speaker 4

这可不是在回避问题。

So that's not just trying to dodge the question.

Speaker 4

我觉得我们现在的情况是,如果我非得说一个具体数字,那反而会让人误以为我们有比实际更多的把握。

There really is, I think, the situation we're in with this where if you if I were to say a particular number, I think that would imply more precision or more certainty than anyone has right now.

Speaker 4

所以这才是我们真正需要做这项研究的原因。

Which is why we really need to do this work.

Speaker 0

对。

Yeah.

Speaker 0

这正好完美地引出了这篇论文。

That's the segues into the paper perfectly.

Speaker 0

我们的不确定性范围非常大。

We have like really wide uncertainty.

Speaker 0

不管我们最终持什么观点,减少这种不确定性都会有帮助。

No matter where we come down, it would be helpful to reduce that uncertainty.

Speaker 0

所以这篇论文是个很好的起点。

So the paper is a useful starting point for that.

Speaker 0

这本身就是一个很有争议的话题,而且争议还在加剧。

Well, it's a very it's a controversial topic, increasingly so.

Speaker 0

因此,能有一些实证依据,或者至少有个讨论的框架,确实很好。

So it's nice to have some empirical grounding or or way to talk about the problem.

Speaker 0

感谢你来参加节目,罗布。

So thanks for being on the show, Rob.

Speaker 0

是的。

Yeah.

Speaker 0

谢谢邀请我参加。

Thanks for having me.

Speaker 0

当然。

Absolutely.

Speaker 0

随着企业开始审视自己的AI支出,模型路由技术正迎来它的高光时刻。

As companies are reckoning with their AI spending, model routers are having a real moment in the sun.

Speaker 0

我和我们的应用AI记者布拉顿一起为《AI动态》通讯撰写了关于路由的文章,现在他加入了我们的对话。

I wrote about routers for our AI Agenda newsletter alongside our applied AI reporter, Bratton, who joins me now.

Speaker 0

劳拉,和你一起写这篇文章真的很愉快。

Laura, it was super fun working on this piece together.

Speaker 0

感谢你来参加节目。

Thanks for coming on the show.

Speaker 5

是的。

Yeah.

Speaker 5

谢谢你的邀请,罗克特。

Thanks for having me, Rocket.

Speaker 0

是的。

Yeah.

Speaker 0

当然。

Of course.

Speaker 0

你能给我们解释一下,到底什么是路由器吗?

Can you break down for us, like, what even is a router?

Speaker 0

它们是干什么用的?

What do they do?

Speaker 0

为什么现在它们突然这么火?

And and why are they having such a moment right now?

Speaker 5

是的。

Yeah.

Speaker 5

这个问题,我觉得你其实比我更懂。

It's a question that I'm sure you can actually answer better than I can.

Speaker 5

不过从我了解的AI应用层面,还有我接触过的那些使用路由器的公司来看,这本质上是一种让AI代理在发送请求时,不管是AI代理还是人类,都能把请求或请求的一部分分发到不同模型上,从而降低成本的方法。

But from my understanding on the applied AI front, and from the companies I talked to who use the routers, it's basically a way for AI agents to when they, you know, send a request to a model, whether it's an AI agent or a human, the model or the tool that they're using can then send that request or parts of that request to different models to lower the cost.

Speaker 5

我该怎么操作呢?

How do I do?

Speaker 5

你还有什么要补充的吗?

What do you wanna add?

Speaker 0

是的,我觉得你说得完全对。

Yeah, I think that sounds exactly right.

Speaker 0

并不是每个问题都需要用最强大、最全能的模型来处理。

It's like you don't always need the biggest and most capable model for every question.

Speaker 0

有时候那样做太浪费了。

Sometimes that's overkill.

Speaker 0

我听人打过一个比方,让Fable五来总结一封邮件,就像开着兰博基尼去超市买菜。

I've heard people describe it as asking Fable five to summarize an email is like driving a Lamborghini to pick up your groceries.

Speaker 0

根本没必要这么夸张。

It's just like not totally necessary.

Speaker 0

对。

Yeah.

Speaker 0

所以路由器应该没问题。

So the router should yeah.

Speaker 5

有很多类似的比较。

A lot of comparisons like that.

Speaker 5

而且说实话,这确实挺复杂的,因为取决于谁在用这个模型,以及他们用什么工具来访问它。

And I mean, yeah, it's it's complicated because it like depends who's using the model and what tool they're using to then access the model.

Speaker 5

有时候是人跟AI代理交互,然后AI代理会发送一堆指令,这些指令又被拆分成小块,分给不同的模型处理。

So sometimes it's human to AI agent and then, you know, the AI agent is sending a bunch of instructions and then those instructions are broken up into pieces and split among different models.

Speaker 5

我们看到越来越多专为编程任务设计的路由器出现,我觉得这特别有意思,因为正是云代码的使用推高了费用,基本上都是云代码的问题。

And we see more and more routers that are becoming available for coding tasks, which I think is really interesting because that's what's been driving up bills so much is, you know, usage of Cloud Code and yeah, pretty much Cloud Code.

Speaker 0

是的,完全对。

Yeah, totally.

Speaker 0

把任务这样拆分并分配给不同模型,我觉得特别有意思。

Breaking up a task in that way and assigning it to different models is super interesting to me.

Speaker 0

我觉得这方面会看到更多进展。

Think we're going to see more work there.

Speaker 0

在一次对话中整合多个模型其实挺复杂的,不过我觉得已经有人在做这方面的尝试了。

It's like very tricky to bring in different models over the course of a single conversation, but I think some people are are working on it.

Speaker 0

这个方向真的很令人兴奋。

That's an exciting direction.

Speaker 0

你觉得在这一领域里,哪些公司比较突出,或者更吸引你?

Who are some of the players in the space that you think are the bigger players or more interesting players to you?

Speaker 5

这是个非常好的问题。

That's a really good question.

Speaker 5

我特别想跟你多聊聊技术层面的问题,比如为什么要把任务拆分给不同的模型这么难——毕竟我本人技术没那么强,更多是跟财富500强企业聊AI怎么用,而不是去研究开发AI工具的公司。不过我确实也接触过这些工具的开发者,而你作为技术背景更强的人,我很想听听你对这个问题的看法。

And and I would love to talk to you more also about the technical aspects about, like, why it's hard to break up tasks among different models because that's something to me as a less technical person who's talking about AI being used by Fortune 500 companies rather than the, you know, I do talk to the companies developing the AI tools, but you know, you being a more technical person would love to know a little bit more about that.

Speaker 5

不过说起来,现在到底是谁在采访谁啊?

But who's interviewing who here?

Speaker 5

我觉得有意思、有路由器产品的公司,当然包括那些你提到的初创企业,我之前写过关于它们如何帮企业降低AI成本的报道。

So the companies I find interesting that have routers, obviously there's the startups that, that offer routers that you talk to and I've talked to for previous stories about how companies are lowering their AI bills.

Speaker 5

但我特别想提一下Palantir和Databricks,它们最近都推出了包含路由器功能的新工具。

But I do wanna call out Palantir and Databricks in particular for launching new tools that include routers.

Speaker 5

所以你的所有数据都存在 Databricks 或 Palantir 里。

So basically you have all your data in Databricks or Palantir.

Speaker 5

当你的 AI 代理执行某些任务时,你可以用这些包含路由功能的工具来降低成本。

And when your AI agent is doing certain tasks, you can leverage these tools, you know, which include routers to lower costs.

Speaker 5

我觉得他们的说法挺有道理的,说他们比那些初创公司更合适做路由,因为他们已经掌握了你所有的企业数据,这确实是个有意思的观点。

And I think they're making the argument that they're better positioned than these startups to offer routers because they already have access to all your enterprise data, which I think is an interesting argument.

Speaker 5

但很明显,创新往往在资源受限时才最活跃。

But then obviously, you know, innovation thrives in scarcity.

Speaker 5

所以我觉得,这些初创公司在路由技术上其实做了不少有意思的工作。

So I think you could argue that a lot of these startups are doing really interesting things with their routers.

Speaker 5

我也很好奇,你对这一点怎么看。

So I'd be curious what your take is on that as well.

Speaker 0

是的,我觉得这个观点特别有意思。

Yeah, I think that's a really interesting point.

Speaker 0

我想回到你刚才说的,把多个模型用在一次对话里的一个难点是,如果你只用一个模型,可以通过一些工程手段来提升整个对话的效率。

I think one of the challenges, just going back to what you were saying, one of the challenges with bringing multiple models in over the course of a single conversation is that if you stick with just one model, you can do some engineering tricks to get you more efficiency over the course of the conversation.

Speaker 0

如果你换用不同的模型,就会损失一部分效率。

If you bring in different models, you lose some of that efficiency.

Speaker 0

所以你得觉得这事儿值得做。

So you have to it has to be worth it to you.

Speaker 0

得是用其他模型能带来明显更强的性能,或者节省大量效率,才能超过只用一个模型的效果。

It has to be like you can get so much more juice out of bringing in other models or you can get so much efficiency savings that you're you're beating what you could have gotten by just sticking with a single model.

Speaker 0

我觉得有些人认为,这其实设定了一个最低门槛,要求它必须足够有用。

I think some people think that puts a floor on how useful it has to be.

Speaker 5

明白了。

Okay.

Speaker 5

有道理。

It makes sense.

Speaker 0

是的。

Yeah.

Speaker 0

Palantir 和 Databricks 确实是大公司,而且你对它们如何设计路由系统了解得很详细。

Palantir and Databricks, those are definitely some big names and you got a lot of detail about how they're approaching their routers.

Speaker 0

所以他们的说法是,我们已经掌握了你们所有的企业数据,因此在为你们设计路由系统方面很有优势。

So you say they have this argument like, We already have all your enterprise data, so we're set up really well to design the router for you.

Speaker 0

你有没有了解到更多关于他们如何设计这些路由系统,或者别人是怎么使用它们的?

Did you learn anything else about how they're approaching those routers or how people are using them?

Speaker 5

是的。

Yeah.

Speaker 5

特别是Palantir,我们和他们聊了很久。

So Palantir in particular, talked to them for a long time.

Speaker 5

他们的工具里确实包含了一个路由模块,但不止是路由那么简单。

And their tool evolve includes a router, but it's not just a router.

Speaker 5

它还能优化你的提示词,让它们更适合不同的模型。

It also will edit your prompts so that they're optimized for different models.

Speaker 5

它还会确保你不会把同样的提示词发给多个模型——提示词就是AI代理发给模型的请求。

And it will also make sure that, you know, you're not sending the same prompts to multiple models, prompt being like a request that an AI agent sends you a model.

Speaker 5

我们至少从一些直接与模型提供商合作的第三方那里听说过,有时候AI代理会出现失控的成本问题,比如反复执行同一个任务。

And that's an issue we've seen or heard about at least from third parties working directly with model providers that sometimes the AI agent there will be these like runaway costs, where an AI agent will try to perform something, you know, multiple times.

Speaker 5

Frontier Labs 否认这种情况存在,但我们确实听到了不少类似的反馈。

The Frontier Labs sort of denied that this is happening, but it is something we hear about.

Speaker 5

我觉得他们的说法是,Palantir 的这个工具能帮着避免这类问题。

And I think the argument is, you know, Palantir is saying that this tool will help prevent that.

Speaker 5

优化你的提示词,还能在不同模型之间自动切换。

Edit your prompts and then also swap between models.

Speaker 5

他们还真在 LinkedIn 上发了个视频做演示,谁都能去看——视频里展示,只要把原本用的高端 OpenAI 模型换成 GPT-5.4 Nano,某个任务的计算成本直接降了将近 97%。

They do have an example actually in a video they posted on LinkedIn, so anybody can go and watch it, where they show that just by switching from a higher tier OpenAI model to GPT, I believe it was 5.4 nano, they were able to see computing costs go down about 97% for one task.

Speaker 5

他们还举了另一个我觉得挺有意思的例子:我跟一家叫 McCarthy Building 的公司聊过,这是北美一家估值数十亿美元的建筑公司。

And then another example they gave that I thought was interesting is I talked to this customer, McCarthy Building, which is a multi billion dollar valuation construction firm in North America.

Speaker 5

他们说,最近一个季度,光是通过调整提示词,使用的 token 数量就比去年减少了 60%。

And they said that by using this tool, they use 60% fewer tokens in the most recent quarter compared to last year, just by tweaking those prompts.

Speaker 5

有些情况里,他们还结合了模型切换的做法。

And in some cases, was also model swapping.

Speaker 5

我觉得这特别有意思,说明很多时候 token 的使用其实并不高效。

I thought that that was really interesting because it just shows that maybe tokens aren't being used effectively.

Speaker 5

Palantir 提到,这并不总是关于减少 token 的使用。

Palantir did make the point that it's not always about using fewer tokens.

Speaker 5

有时候是用更多 token 配合一个没那么复杂的模型,有时候则是用更少的 token 搭配 Frontier 模型。

Sometimes it's about using more tokens with a less sophisticated model, and sometimes it's about using fewer tokens with a Frontier model.

Speaker 5

我也可以聊聊 Databricks 的路由系统。

I could also go into Databricks' router.

Speaker 5

我觉得他们也在做挺有意思的事情。

I think that they're, you know, also doing doing really interesting stuff.

Speaker 5

这不只是一个路由工具。

And it's not just a router.

Speaker 5

而是一整套帮助公司监控员工 AI 使用情况的工具。

It's a whole suite of tools that can sort of help companies monitor their AI usage among employees.

Speaker 5

我觉得这两个例子都很好地展示了大公司是怎么使用路由系统的。

So I think both of those are pretty interesting examples of larger scale companies do using routers.

Speaker 5

Snowflake 在它的 AI 编程工具 Cocoa——或者说是 AI 代理,希望我没说错——里也内置了一个路由功能,能自动在不同模型间切换。

Snowflake also has a router in its AI coding tool, Cocoa, or AI agent, hopefully I'm describing that correctly, that can, you know, pick between models.

Speaker 5

所以我觉得很多公司都在以不同的方式这么做。

So I think a lot of companies are doing this in different ways.

Speaker 0

是的。

Yeah.

Speaker 0

这么说的话,尤其是考虑到大家实际省下的成本,这看起来简直再明显不过了。

I mean, I guess when you put it like that, and especially given the savings that people are seeing, it kind of seems like a no brainer.

Speaker 0

当然,选对模型来匹配任务才是关键。

Of course, you should choose the right model for a task.

Speaker 0

你有没有想过,为什么还有公司不用路由机制?为什么路由器到现在才突然火起来?

Do you have a sense of why are there any companies that aren't using routers, or why has it taken so long for routers to start having this moment that they're having now?

Speaker 5

我觉得以前公司都特别热衷于‘最大化令牌’,这个词在过去一年里我们听得都快耳朵起茧了。

Well, I think companies were really into the idea of token maxing, everybody's favorite word that we've heard a million different times now over the last year.

Speaker 5

那时候公司只想鼓励员工尽可能多地使用AI。

And I think companies just wanted to encourage employees to use AI as much as possible.

Speaker 5

直到最近这三个月左右,他们才开始真正关心成本问题。

And they weren't necessarily worried about costs until, you know, the last three ish months.

Speaker 5

我觉得现在有一种趋势,就是要更有效地使用AI预算。

I think that there's this movement to try to spend AI budgets more effectively.

Speaker 5

说实话,我觉得这跟我们之前做的大量报道有关,尤其是跟优步、ServiceNow、Snowflake这些公司的高管聊过之后。

And frankly, I think that that traces back to a lot of our reporting, talking to executives from Uber, ServiceNow, Snowflake, etc.

Speaker 5

正是这些公司最早把这个问题推到了聚光灯下。

Companies that that really sort of brought attention to this topic in the first place.

Speaker 0

没错,没错。

Right, right.

Speaker 0

这就像公司一开始给你配了辆兰博基尼,让你放开开,现在却突然说:开玩笑的,给你换辆科鲁兹吧。

It's like they gave you that Lamborghini as the company car because they want you to start driving and now they say, Psych, here's the Corolla instead.

Speaker 5

完全没错。

Totally.

Speaker 5

我记得几个月前跟ServiceNow的CIO聊过,应该是几个月前吧。

And I think, you know, in my conversation with ServiceNow CIO a couple months ago, I think it was a couple months ago now.

Speaker 5

我也不至于为此记一辈子,毕竟具体是啥时候聊的,我真记不清了。

Don't don't I I won't take that to my grave me because I can't remember exactly when we chatted.

Speaker 5

那是在他们于拉斯维加斯举办的年度客户大会期间。

It was during their annual customer conference in Vegas.

Speaker 5

她当时就说,真的很难,你给了员工这么多工具,总不能说收就收吧。

She was just saying, you know, it's really hard to like you give employees access to all these tools.

Speaker 5

你不可能突然把这些工具全撤掉。

You're not just gonna take them away.

Speaker 5

要是突然要控制成本,这对CIO来说真是个棘手的处境。

Like, that's a really hard position for a CIO to be in, you know, if all of a sudden you're trying to rein in costs.

Speaker 5

所以我觉得这个工具特别棒,它就是一个很好的例子,能让员工继续用AI,同时还能省钱,各种捷径都兼顾了。

So I think that this is a great tool, you know, that's an example of ways to like let employees continue to use AI as they're using AI, also cutting costs, all the different shortcuts.

Speaker 5

而且,路由器其实也是这个更大理念的一部分,我相信你比我更清楚怎么解释。

And I mean, routers are also part of this broader idea of harnesses, which I'm sure you can explain better than I can.

Speaker 5

你之前跟Martian的Yash聊过吧,我记得是。

But you know, there and you talked to Martian, I believe, Yash from

Speaker 0

Martian。

Martian.

Speaker 0

是的

Yeah.

Speaker 5

对

Yeah.

Speaker 5

他最近跟我聊的时候提到过,路由器只是这个问题中的一部分。

And, you know, that's one thing he said to me in in our own conversation recently is just that, like, routers are one piece of this conversation.

Speaker 5

有很多方法可以降低成本,更有效地使用AI。

There's so many different things that you can do to cut down costs and use AI more effectively.

Speaker 5

说实话,我认为从一开始,我们和所有公司都该这么做。

And frankly, it's something we should have done and companies should have done from the start, in my opinion.

Speaker 5

因为即使账单上看不到,数据中心的能耗、用水这些成本也是实实在在的,我们都该考虑进去。

Because there's, you know, even if it's not showing up in your bill, there are energy costs linked to, you know, data center, water, energy usage we should all be thinking about, I think.

Speaker 0

是的,更大的模型运行更慢,有时候聪明过头反而适得其反。

Yeah, and the bigger models are slower and sometimes they are too smart for their own good.

Speaker 0

有太多理由说明为什么需要一个路由器了。

There's a lot of reasons that it makes sense to have a router.

Speaker 0

我相信以后我们会听到更多关于它们的消息,它们也会逐渐成为行业的标配。

I expect that we'll be hearing more about them and they will increasingly become the norm in the industry.

Speaker 0

谢谢你参加节目,也感谢你一起做这份简报。

Thanks for being on the show and for working on this newsletter together.

Speaker 0

真的很开心。

Was really fun.

Speaker 5

特别开心。

Super fun.

Speaker 5

周四快乐。

Happy Thursday.

Speaker 0

周四快乐。

Happy Thursday.

Speaker 0

今天特别开心,因为明天是七月四号,我们要放长周末了。

And it's a really happy Thursday because we're off for the long weekend tomorrow on July 4.

Speaker 0

下周一再见,带来新的一期节目。

We'll be back on Monday with a new show.

Speaker 0

提醒一下,我们每周一到周五早上10点(太平洋时间)或下午1点(东部时间)直播。

As a reminder, we're on this stream Monday through Friday at 10AM Pacific or 1PM Eastern.

Speaker 0

如果错过直播,节目内容也可以在information.com、我们的YouTube频道,或者你常用的播客平台收听。

If you can't make it then, episodes are available on the information.com or our YouTube channel or wherever you get your podcasts.

Speaker 0

别忘了在X、Instagram和TikTok上关注我们。

Make sure to follow us on social media on X, Instagram, and TikTok.

Speaker 0

我已经开始期待下一期节目了,祝你剩下的周四和长周末过得愉快。

I'm already excited for our next show, so have a great rest of your Thursday and a long weekend.

Speaker 0

那我们先到这里,再见。

Goodbye for now.

关于 Bayt 播客

Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。

继续浏览更多播客