The a16z Show - 为智能体世界构建云 | AWS 首席执行官马特·加曼 封面

为智能体世界构建云 | AWS 首席执行官马特·加曼

Building the Cloud for an Agentic World | AWS CEO Matt Garman

本集简介

a16z 的 Raghu Raghuram 与 AWS CEO Matt Garman 对谈,探讨 AI 如何重塑云计算,从 AI 原生初创企业的需求到日益为智能体(agents)设计的基础设施。 Matt 解释了随着智能体编写代码和管理基础设施,AWS 正在如何调整;为何将稀缺的 GPU 算力预留给了初创企业;以及 Trainium 和 Graviton 等定制芯片在 AI 技术栈中的定位。 他们还讨论了亚马逊 2200 亿美元资本支出、基础设施建设中瓶颈的转变、企业需要哪些信任机制才能放心使用自主智能体,以及 AWS 自身团队如何利用智能体进行开发。 资源: 关注 Matt Garman 的 X(原 Twitter)账号:https://x.com/mattsgarman 关注 Matt Garman 的 LinkedIn 主页:https://www.linkedin.com/in/mattgarman 关注 Raghu Raghuram 的 X(原 Twitter)账号:https://x.com/RaghuRaghuram 了解更多关于 AWS 的信息:https://aws.amazon.com/ 保持关注: 在 YouTube 上找到 a16z:YouTube 在 X 上找到 a16z 在 LinkedIn 上找到 a16z 在 Spotify 上收听 a16z Show 在 Apple Podcasts 上收听 a16z Show 关注我们的主持人:https://twitter.com/eriktorenberg 请注意,此处内容仅供信息参考;不应被视为法律、商业、税务或投资建议,也不应用于评估任何投资或证券;且并非针对 a16z 旗下任何基金的投资者或潜在投资者。a16z 及其关联公司可能持有文中提及公司的投资。更多详情请参阅 a16z.com/disclosures。 由 Simplecast 制作,AdsWizz 旗下公司。有关我们收集和使用个人数据用于广告的信息,请访问 pcm.adswizz.com。

双语字幕

仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。

Speaker 0

智能体工作流在AWS上的表现往往比其他地方更好。

Agentic workflows tend to perform better on AWS than anywhere else.

Speaker 0

计算沙箱、网关、智能体权限,还有和人相关的权限。

Compute sandboxes, gateways, agent permissions versus people.

Speaker 0

其中很多都是我们已经构建、正在构建并且积极思考的东西。

A lot of those are things that we have built and are building and thinking actively about.

Speaker 1

顶尖的前沿实验室几乎把能用的GPU都抢光了。

The top frontier labs gobble up every available GPUs.

Speaker 1

与此同时,你也想扶持那些新兴公司,它们未来会成为行业巨头。

At the same time, you want to promote newer companies that are going to become the enterprises of tomorrow.

Speaker 1

你是怎么考虑平衡这两者的?

How are you thinking about balancing?

Speaker 0

从我们推出AWS一开始,初创企业就是我们业务的核心命脉。

From the very beginning of when we launched AWS, startups have been the lifeblood of the core of what we do.

Speaker 0

这些创新者站在技术前沿,了解什么是可能的。

These are the innovators that are at the edge of technology, understanding what's possible.

Speaker 0

我们非常有意为初创企业保留计算能力。

We're very intentional about keeping capacity available for the startups.

Speaker 0

我们最近宣布,未来几年将购买两百万块NVIDIA GPU。

We recently announced we're going to be buying two million NVIDIA GPUs over the next couple of years.

Speaker 1

你们今年的资本支出是多少,200亿左右?

Your CapEx this year is what, 200 or something?

Speaker 0

2026年是2200亿美元。

$220 billion for '26.

Speaker 0

而且我们预计短期内不会放缓,因为需求实在太大了。

And we don't anticipate slowing down anytime soon because the demand is just massive.

Speaker 1

围绕AI、扩展风险以及Hugging Face攻击的所有这些争论,CEO们都在问你些什么?

With all the debate around AI, extension risk, and the Hugging Face attack, what are CEOs asking you about all these things?

Speaker 0

亚马逊今年计划投入2200亿美元的资本,AWS首席执行官Matt Garman表示,他们预计短期内不会放缓。

Amazon plans to spend $220 billion in capital this year, and AWS CEO Matt Garman says they don't anticipate slowing down anytime soon.

Speaker 0

在本期节目中,a16z的Raghu Raghuram与Matt坐下来,探讨是什么推动了历史上最大规模的基础设施建设之一,以及AI如何改变云本身。

In this episode, a16z's Raghu Raghuram sits down with Matt to unpack what's driving one of the largest infrastructure build-outs in history and how AI is changing the cloud itself.

Speaker 0

他们讨论了AWS如何决定谁获得稀缺的GPU容量,瓶颈从电力和芯片转向内存和建设,以及公司对Trainium等定制芯片的押注。

They discuss how AWS decides who gets scarce GPU capacity, the shifting bottlenecks from power and chips to memory and construction, and the company's bet on custom silicon like Trainium.

Speaker 0

他们还谈到了当智能体越来越多地编写代码和管理基础设施时会发生什么变化。

They also get into what changes when agents increasingly write code and manage infrastructure.

Speaker 0

Matt还分享了AWS在其内部团队中看到的情况,现在智能体编写代码,工程师越来越多地管理智能体团队,加速了新产品的构建速度。

And Matt shares what AWS is seeing inside its own teams, where agents now write code and engineers increasingly manage teams of agents, accelerating how quickly new products can be built.

Speaker 1

欢迎来到播客,Matt。

Welcome to the pod, Matt.

Speaker 1

我们生活在多么激动人心的时代。

What a time we are living in.

Speaker 1

所以我有好多话题想跟你聊。

So I have a lot of topics to talk to you about.

Speaker 0

太好了。

Awesome.

Speaker 1

那么——

So-

Speaker 0

谢谢你的邀请。

Thanks for having me.

Speaker 0

我很期待。

I'm excited.

Speaker 1

对,当然。

Yeah, absolutely.

Speaker 1

那我们就从头开始聊吧。

So let's start actually right from the beginning.

Speaker 1

你是EC2的第一任总经理,

So you were the first GM for EC2-

Speaker 1

那是2006年,对吧?

... and that was 2006, right?

Speaker 1

现在你们营收大概有1600到1700亿美元了吧?

And today you guys are what, 160, 170 billion in revenue?

Speaker 0

对,差不多1690到1700亿。

Yeah, about 169, 170 billion.

Speaker 0

对。

Yep.

Speaker 1

增长35-

Growing 35-

Speaker 0

37%。

37%.

Speaker 0

对。

Yep.

Speaker 1

169亿的基数上还能增长37%。

That's 37% at 169.

Speaker 1

太疯狂了。

Crazy.

Speaker 0

从第一天开始想这件事很有意思——

It's interesting to think about it from day one-

Speaker 0

……赚到第一块钱的时候。

... the first dollar of revenue.

Speaker 0

有意思的是,我们还处在业务潜力和客户机会的早期阶段。

The interesting thing is we're still at the early stages of what the business can be and what the opportunity is for customers.

Speaker 0

大多数工作负载,现在还有大量的工作负载仍然在本地运行,而且人们每天进行的计算量比前一天还要多。

Most workloads, there's a huge amount of workloads still that live on-prem today, and the amount of compute that people are doing every single day is more than it was the day before.

Speaker 0

所以你能看到AI带来的顺风,也能看到向云端迁移的顺风,业务增长得非常快,能参与其中真的非常有趣。

And so you see the tailwind from AI, you see the tailwind from migration into the cloud, and the business has grown really fast, and it's been a super fun thing to be a part of.

Speaker 1

是的,确实如此。

Yeah, it is.

Speaker 1

我是说,他们以后会写关于这个的历史书和商业书,而且会写很久。

I mean, they'll be writing history books about this and business books about this for a long time to come.

Speaker 1

我想谈谈本地部署。

I want to touch on the on-prem.

Speaker 1

这让我有点难以置信。

That sort of boggles my mind.

Speaker 1

显然,我尽力让他们在本地待了很长时间。

I obviously did my best to keep them there for a long time.

Speaker 0

是的,你确实做到了。

You did.

Speaker 0

你当年在本地部署了很多东西。

You built a lot of stuff on-prem back in the day.

Speaker 0

没错。

That's true.

Speaker 0

我们现在正努力把这些都迁移到AWS上。

We're trying to now get all of that to move into AWS.

Speaker 1

这个我们可以稍后再聊。

So we can talk about that later.

Speaker 1

所以,如果你回想一下EC2早期的日子,你一开始主要是卖给初创公司,而今天AWS云服务已经发展成这样,回顾这段演变,你觉得最突出的是什么?

So if you think about EC2 in the early days, and you got your start with obviously selling to startups, and today the AWS cloud service, as you reflect on the evolution, what stands out?

Speaker 1

第一部分,然后第二部分,我们会聊聊你服务初创公司的方式是如何变化的。

Part one, and then part two, we'll talk about how this nature of how you serve startups has changed.

Speaker 0

好的。

Sure.

Speaker 0

嗯,就像你说的,其实挺有意思的。

Well, like you said, actually, it's funny.

Speaker 0

我2005年的时候在AWS实习,那时候它还是个内部项目。

So I actually interned for AWS in 2005 when we were first-- It was an internal project.

Speaker 0

那是我商学院实习的项目,我的任务就是分析AWS对谁最有吸引力,结果答案是初创公司。

It was my business school internship, and my project was actually to come up with an analysis of who we thought AWS would be most interesting to, and the answer was startups.

Speaker 0

挺意外的。

Surprisingly.

Speaker 0

所以从AWS刚推出的时候,初创公司就一直是我们业务的核心,原因有很多。

And so from the very beginning of when we launched AWS, startups have been the lifeblood of the core of what we do for a number of reasons.

Speaker 0

一个是价值主张对初创公司来说太有吸引力了——

One is the value proposition is just so attractive-

Speaker 1

对

Yep

Speaker 0

AWS为初创公司提供的服务,我们花了很多时间和精力确保自己是初创公司的好伙伴,不仅帮他们提供基础设施,还给他们建议,比如怎么把公司运转起来,怎么设计架构以便将来扩展,还有我们为初创公司做的很多事情。

... what AWS provides to startups, and we spend a lot of time and effort making sure that we're great partners to the startups, helping them not just provide infrastructure, but also advice on how to get your company up and running and how to think about your architecture so it'll scale eventually, and a whole bunch of things that we do for the startups.

Speaker 0

但我们也觉得,对我们来说,这本身就是一门好生意,因为——

But we also think that for us, it's just good business because-

Speaker 0

今天的初创企业就是明天的企业巨头。

... the startups today are the enterprises of tomorrow.

Speaker 0

虽然这个数字不太精确,但我们现在估计,AWS的收入中大概有30%到40%来自那些在AWS发展历程中曾经是初创公司的企业。

And it's an imprecise number, but today we estimate that maybe 30, 40% of AWS revenue comes from companies that was a one-time startup in AWS' lifetime.

Speaker 0

所以对我们来说,看着这些公司随着时间成长、变大,最终成为真正的企业,真的很有意思。

So it's fun to see, for us, to see the companies grow over time and to get bigger and become enterprises effectively.

Speaker 0

这就是为什么我们在初创企业上投入这么多,也是为什么我们特别关注那些刚起步、两个人挤在车库里创业的公司。

And so that's why we invest so much in startups and why we pay so much attention to the brand-new two-people-in-a-garage type startups.

Speaker 0

不仅仅是因为商业回报,还因为那是我们学习的对象。

And not just because of the business outcomes, but also because that's who we learn from.

Speaker 0

这些创新者站在技术前沿,他们了解什么是可能的,推动我们的服务,告诉我们他们还需要什么,什么能帮他们跑得更快,什么能帮他们达成目标。

These are the innovators that are at the edge of technology, understanding what's possible, pushing our services to say what they'd want more of, what could help them go faster, what could help them achieve their outcomes.

Speaker 0

很多时候,他们比银行、医疗公司或政府机构更能推动我们前进。

And a lot of times they're pushing more than the banks or the healthcare companies or the governments.

Speaker 0

初创公司才是那个不断突破边界的力量,这真的能帮我们做得更好,确保我们走在前面。因为银行五年后需要的能力,正是初创公司现在就在追求的。

The startups are the ones that are pushing that envelope, and it really helps us to be better and make sure that we're ahead of that wave where the banks are going to want some capability five years down the road that startups want today.

Speaker 1

跟那时候相比,现在的初创公司有什么变化?他们从你们这里想要什么?

And compared from then to now, how have the startups changed and what they want from you?

Speaker 1

当然-

Obviously-

Speaker 1

...他们都特别需要大量的GPU,我们可以聊聊这个。

... they all want a lot of GPUs, and we can talk about that.

Speaker 1

除此之外。

But besides that.

Speaker 0

嗯,有几件事确实发生了变化。

Well, I will say there's a couple of things that have changed.

Speaker 0

第一点就是现在的初创公司起步规模比我们要早的时候小得多,对吧?

One is startups started at a much smaller size than when we first started, right?

Speaker 0

他们可能融到了1000万美元的资金,手里拿着一个应用的想法,然后慢慢迭代完善。

They might have gotten $10 million of funding, and they had an app idea that they were kind of slowly iterating on.

Speaker 0

现在从第一天起,他们的估值就达到十亿美元。

Now it's from day one, they're valued at a billion dollars.

Speaker 0

他们有两亿美元的融资。

They have $200 million of funding.

Speaker 0

就是一个团队和一个想法,突然之间,他们就值十亿美元了。

It's a team and an idea, and all of a sudden, they're worth a billion dollars.

Speaker 1

事情从我们的办公室转移到了你们的办公室。

Things go from our offices to your offices.

Speaker 0

没错。

That's right.

Speaker 0

而且我认为,这些想法的规模、范围和雄心都需要更多的资金。

And the size and scale and ambition of the ideas, I think, requires more capital.

Speaker 0

他们一开始就更大。

They're bigger to start with.

Speaker 0

当然也更贵,对吧?

They're obviously more expensive too, right?

Speaker 0

去搞那种训练模型或者做现在很多人都在做的事情。

To go after kind of a training a model or doing something that a lot of the folks are doing today.

Speaker 0

所以这是第一点,就是他们起步的规模真的很大。

So that's number one, which is just the size that they start from is really big.

Speaker 0

第二点我想说的是,有些东西其实没变,对吧?

What I would say number two is some things haven't changed, right?

Speaker 0

他们其实还是在想,一旦规模上去了,架构该怎么设计。

They actually are still thinking about, okay, once I scale, how do I think about an architecture?

Speaker 0

安全怎么考虑?

How do I think about security?

Speaker 0

性能怎么考虑?

How do I think about performance?

Speaker 0

我需要的所有能力怎么具备?

How do I think about having all the capabilities that I need?

Speaker 0

我的IM系统怎么搭建,这样当员工超过三个人的时候,这套东西还能正常运转并且扩展?

How do I think about setting up my IM setup so that when I have more than three employees, this thing is going to work and scale?

Speaker 0

这也就是为什么很多时候他们更喜欢AWS,而不是直接去用Neocloud之类的。

Which is a lot of times why they like AWS as opposed to just going to a Neocloud or something like that.

Speaker 0

他们确实需要训练过程中附带的所有那些安全和其他功能。

They actually need all of those other security and capabilities that come around from training.

Speaker 0

所以我觉得这一点没有变,完全一样。

And so I think that's something that hasn't changed and is exactly the same.

Speaker 0

我觉得现在的起步规模确实和以前不一样了。

I think the scale at which the ramp-up is definitely different today.

Speaker 0

我还觉得,越来越多的团队希望有一个适合与智能体协作的云,而不仅仅是与人协作。

I also think increasingly we're seeing teams that want a cloud that is great to work with agents and not just with people.

Speaker 0

我觉得我们花了很多时间在这方面——

And I think that's where we've spent a lot of time is-

Speaker 1

对,这正是你的强项。

Yeah, that plays to your strengths, yeah

Speaker 0

……你怎么考虑,对,你怎么考虑大规模扩展?

... how do you think about, exactly, how do you think about broad scale?

Speaker 0

你怎么看待性能这个问题?

How do you think about performance?

Speaker 0

你怎么看待一个定义良好的API接口,让代理能够真正——

How do you think about an interface that is a well-defined API interface that agents can actually-

Speaker 0

——轻松地遍历和操作?

... easily traverse and work across?

Speaker 0

所以这也是我们天生就擅长的事情,但我们确实加倍努力,确保比如你能在三秒内启动一个数据库,真正获得代理们喜欢的一些功能。

And so that's also something that we both, I think we're naturally set up to do well, but that we've actually doubled down on to ensure things like how can you start a database in three seconds and really get to some capabilities that agents are excited about.

Speaker 1

你有没有推出一些专门针对代理或构建代理的人的新服务?

Have you introduced any specific new services that are explicitly targeted at agents or people building agents?

Speaker 0

我想说的是,我们优化了一些现有的服务,让它们既能服务于人,也能服务于代理。

I'd say what we've done is we've optimized some existing services so that they can both work for people and agents.

Speaker 0

所以答案是,我们确实有一些专门用于构建代理的服务。

And so the answer is we definitely have some services designed for building agents.

Speaker 0

我们有像——

And so we have things like-

Speaker 1

当然。

Of course

Speaker 0

比如 Agent Core 和 Bedrock 之类的。

... Agent Core and Bedrock and pieces like that.

Speaker 0

但当我们看像 S3 这样的底层组件时,绝大多数公司都把数据存在那里,

But when we look at just taking an underlying component like S3, which is where the vast majority of companies store-

Speaker 0

数据湖也在那里。结果发现,人和代理的很多用例其实很相似,但你需要有一个——我们现在正在预览或测试的一个功能,叫 AWS Context,它让你能构建一个上下文层,这样代理就能更容易地跨多个数据湖找到他们想要的所有数据。

... their data and have their data lakes, it turns out like a lot of the use cases for people and agents are similar, but you want to have, and one of the things that we have in preview right now or in beta, it's called AWS Context, that allows you to build a context layer so that agents can actually more easily find all of the data they want across your various data lakes.

Speaker 0

所以不管你的数据是存在 Aurora、S3,还是 AWS 的其他地方,你都可以构建这个上下文层。虽然人们不一定会用这种方式访问数据,但代理确实很乐意跨过这些不同的存储。

And so whether you have your data stored in Aurora or you have it in S3, or you have it in somewhere else in AWS, can build this context layer where when people aren't necessarily going to access data in that way, but agents actually are happy to go across-

Speaker 0

去访问各种不同的数据。

... lots of those different things.

Speaker 0

所以我们在构建一些这样的服务,但更重要的是,你还会关心延迟怎么样、吞吐量怎么样,以及如何确保底层引擎——

And so there are some services that we're building like that, but for the most part, you also care about what does latency look like, what does throughput look like, how do you make sure that the underlying-

Speaker 0

——真的又快又可扩展。

... engine is actually fast, scalable.

Speaker 0

他们其实非常在意尾部延迟,这点挺有意思的。

They actually care a lot about tail latencies, which is interesting.

Speaker 0

对于人来说,他们不一定总是关心S3的P999延迟,但智能体确实很在意——

Where people are, they don't always care about the P999 S3 latency, like agents do care-

Speaker 0

而且会被这个卡住。

... and get blocked by that.

Speaker 0

所以这是我们长期以来一直关注的问题,从性能角度来看,这是——

And so that's the thing that we've cared about for a long time, and from a performance perspective, it's one of the-

Speaker 0

真正突出的一个点,这也是为什么智能体工作流在AWS上比其他地方表现更好的原因。

... things that really pop, that's why agentic workflows tend to perform better on AWS than anywhere else.

Speaker 1

显然,我们看到很多公司刚开始的时候,最常见的说法当然是智能体在帮他们写所有代码,对吧?

Obviously, we see a lot of companies starting out, and the very common refrain, of course, is that agents are writing all the code for them, right?

Speaker 1

而且智能体还在选择数据库和——

And agents are selecting the databases and-

Speaker 1

邮件服务器以及你能想到的一切,对吧?

... the email servers and everything that you can name it, right?

Speaker 1

那么,有没有很多思考,而且显然他们读了文档,有没有很多关于AWS的思考,比如你们的,说起来有点奇怪,所谓的“传统”服务——

So has there been a lot of thinking that, and obviously they read the documentation, has there been a lot of thinking on the AWS, like your, feels funny to say it, quote unquote, "legacy" services-

Speaker 1

……那些已经存在了十年的服务——

... that have been around for a decade-

Speaker 1

……关于如何重新架构它们?

... on how do you rearchitect them?

Speaker 0

是的,有的。

So yes.

Speaker 0

我觉得我们确实考虑了一些事情。

I think there are some things that we've thought about.

Speaker 0

实际上,我认为核心的基础构建模块状态非常好。

Actually, the core underlying building blocks I think are in really good shape.

Speaker 0

我觉得我们正在考虑一个易用性层面,如何让它们更容易使用,我们称之为最简单的,就是你提到的那个场景,有人只是快速编写一个应用,然后他们要求——

I think there's a usability layer that we're thinking about of how we make easier to use for, we'll call it the very simplest, the use case you call out where somebody's just coding up an app really quickly, and they ask-

Speaker 0

……部署它。

... it to deploy.

Speaker 0

我们发现绝大多数客户都会去告诉他们的编程助手,不管是Kira、Claude还是Codex,他们会说:“我想在AWS上开发。

We find the vast majority of our customers will go and tell their coding agent, whether it's Kira, whether it's Claude, whether it's Codex, they'll say, "I want to build on AWS.

Speaker 0

这是我的凭证。

Here's my credentials.

Speaker 0

这是我的资料。

Here's my stuff.

Speaker 0

这是我想要的部署方式。”

This is how I want to deploy it."

Speaker 0

然后这些助手很厉害,它们就去做了。

And then the agents are great, and they go do it.

Speaker 0

不过也有一些情况,你还没上云,只是想试试,你说部署。

There are use cases, though, where you're already not on a cloud, you're just trying something, you say deploy.

Speaker 0

说实话,很多时候这会转到我们的一些合作伙伴那里,他们在上面有更易用的层。

And frankly, a lot of times that'll go to some of our partners that have an easier-to-use layer on top.

Speaker 0

我们也很喜欢这样,顺便说一句。

Which we love, by the way, too.

Speaker 0

在这些方面,我们也很喜欢我们的合作伙伴。

And we love our partners on those fronts, too.

Speaker 0

但我确实认为,我们正在做的一些事情,如果你是新手,还没有AWS账户,还没有设置好你的IM。

But I do think that there are some things that we're doing where if you're brand new, you don't already have an AWS, you already haven't set up your IM.

Speaker 0

几个月前,开设一个账户要困难得多。

A couple of months ago, it was much harder to start up an account.

Speaker 0

20年来一直如此,但你必须定义你的VPC,你必须定义——

It's been like this for 20 years, but you have to define your VPCs, you have to define-

Speaker 0

……你的IM角色,所有这些类似的事情,一旦你规模变大,这些其实都是非常重要的事情。

... your IM roles, all of these kind of things, which are actually super important things once you get to be large.

Speaker 0

我们从客户那里听到的是,这是一个艰难的取舍,因为他们知道几个月或几年后他们会需要这些,但现在,他们只想使用服务,不想担心这些。

And what we hear from customers is like, it was a hard trade-off because they know that they're going to want those in months or years down the line, but for now, they just want to use the services, not worry about that.

Speaker 0

所以我们实际上已经推出的是,如果你今天去创建一个新的AWS账户,我们正在逐步推出这个功能,我不知道现在是否已经完全全面推出。

And so what we've actually launched is if you go create a new AWS account today, and we're slowly rolling this out, I don't know if it's actually full all the way out yet now.

Speaker 0

但是,你不必做那些事情了。

But, you don't have to do those things.

Speaker 0

你不需要提供信用卡。

You don't have to give it a credit card.

Speaker 0

你可以用你的Gmail账号注册。

You can sign up with your Gmail account.

Speaker 0

所有这些事情都会在后台自动处理,不到30秒你就能启动并运行一个完整的AWS账户,对于这类系统来说,这更符合代理的需求,因为他们不想经历设置VPC和那些繁琐的步骤。

You get just all of those things are handled in default behind the scenes, and within less than 30 seconds, you're up and running and can be operating an AWS, full AWS account, which is for those type of systems, much more what the agents want to be able to do because they don't want to have to go through all of that setting up your VPCs and your-

Speaker 0

……

...

Speaker 0

以及类似的东西。

and pieces like that.

Speaker 0

所以我们在某些方面增加了易用性,对此我们非常兴奋,也收到了客户非常积极的反馈,未来我们会继续做更多类似的事情。

So there are some things where we're adding some ease of use to that, which we're quite excited about, and we've seen some really positive feedback from customers on, and we'll keep doing more things like that over time.

Speaker 0

不过,好的一点是,这并不意味着你只能得到一个简单的账户,然后还得迁移。

The great part about that, though, is it's not like a simplistic account, and then you have to migrate.

Speaker 0

如果你基本上说:“好吧,现在我真的想扩展到组织——我想开发一个组织。”

If you basically say, "Okay, now I actually do want to scale into the org-- I want to develop an organization.

Speaker 0

我想去微调一些东西。

I want to go and fine-tune some of the things."

Speaker 0

你可以轻松做到,因为你已经在一个真实的AWS账户里了,之后需要的时候再去处理那些事情就行。

You can easily, you're already in a real AWS account, and you can actually then go and do all of those things later when you need them.

Speaker 0

所以以后不需要迁移或搬家。

And so there's no migration or move later.

Speaker 0

这就是我们认真思考的部分工作,也就是如何让客户不用做选择,而是轻松进入我们知道的那些深度功能,客户和初创公司在开始扩展时都会需要这些功能。

And so that's part of the hard work that we really think about, which is how do we make it not a choice for the customer, but an easy on-ramp into the depth of features that we know customers, and startups are going to want when they start scaling.

Speaker 1

明白了。

Got it.

Speaker 1

那么,随着代理接管,最难适应的事情有哪些?

And, what has been some of the hardest things to accommodate as agents have taken over?

Speaker 1

你出了名。

You made a name.

Speaker 1

你们之所以成为现在的现象级存在,就是因为服务开发者。

This is the way you guys became the phenomenon that you became was serving developers.

Speaker 1

然后是基础设施团队。

And then infra teams.

Speaker 1

现在开发者被智能体取代了,很快基础设施团队也会被智能体取代。

Now developers are substituted by agents, and pretty soon infra teams are being substituted by agents.

Speaker 1

作为全球最大的服务提供商,你们在应对这一转变时遇到的最大挑战是什么?

What have been some of the hardest things for you as the largest service provider in the world to handle that transition?

Speaker 0

嗯,你看,我觉得,就像我说的,我们的大部分基础设施是——

Well, look, I think, like I said, much of our infrastructure was, is-

Speaker 1

对,核心构建模块是——

Yeah, the core building blocks are-

Speaker 0

……其实已经准备得很好了——

... is actually pretty well set up-

Speaker 0

……能够应对这种规模,这很好。

... to handle the scale, which is good.

Speaker 0

我觉得有几件事挺有意思的,可以说是思维模式上的转变。你可以说我们的一些系统,我不会说过度设计,但举个例子,很多智能体想创建一个数据库,做点工作,然后让数据库消失。

I think there's been a couple of things which are interesting, which are, I think interesting paradigm shifts where you could argue that some of our systems are, I wouldn't say over-engineered, but as an example, many agents want to create a database, do a little bit of work, and then have the database go away.

Speaker 0

你其实不需要那个数据库有五个九的持久性。

You don't really need that database to have five nines of durability.

Speaker 1

没错。

Exactly.

Speaker 0

所以我们在那里重新思考了一些事情,比如当你创建一个Aurora数据库,作为你的生产数据库时,你确实想要五个九的数据。

And so there's some things that we rethink there, where when you're creating an Aurora database, like as your production database, like you do want five-

Speaker 0

……多个九的数据。

... n nines of data.

Speaker 0

你想要——

You want-

Speaker 0

你需要持久性,你想要可用性,你想要所有这些,而对于代理的使用场景来说,这可以说是,或者也许不是可以说,对我们来说过度设计了。

... you need durability, you want availability, you want all of those things, and for the agent use case, that's arguably, or maybe not arguably, over-engineered for what we need.

Speaker 0

所以这很难。

And so it's hard.

Speaker 0

而且我们有点相信,我们真的不想要一个非持久性的选项——

And we kind of have this belief that we don't really want to have a non-durable option-

Speaker 0

……那也会带来问题。

... that's going to cause problems either.

Speaker 0

因为你永远不太确定创建的数据库是想长期保留还是短期使用。

Because you never really quite know if the database that's created wants to stay around for a long time or a short amount of time.

Speaker 0

所以我们正在努力思考如何同时实现这两点,既能快速创建并丢弃,又不会浪费太多资源。

And so we're trying to do the hard work to think about how do you accomplish both of those things, where you can create it quickly and throw it away, and you don't really waste a lot of resources.

Speaker 0

但如果你确实需要它,它可以持久化并长期存在,甚至能发展成一个大型生产数据库。

But if you do want it, and it can be durable and stay for a long time, it can actually grow into a big production database.

Speaker 0

所以这些是我们积极权衡的一些取舍,当我们思考传统的“这是我的生产系统”这类能力,如何与代理想要使用的更临时的基础设施特性相匹配时。

So those are some trade-offs that we think about actively as we think about how does the more traditional kind of, "This is going to be my production system" kind of capabilities match with some of the more transient nature of the infrastructure that agents want to use.

Speaker 0

所以这是其中一个,我想。

So that's one, I think.

Speaker 0

但还有很多。

But there's a bunch.

Speaker 0

我认为另一个有趣的点是,创建持久化资源的规模、速度和延迟。

I think the scale and speed and latency of creation of durable resources is another one that's interesting.

Speaker 0

我觉得我们还在积极思考的另一个问题是,有没有一些代理会需要的新构建模块,是我们以前根本不需要的?

I think the other one that we actively think about too is just are there new building blocks that agents are going to want that we just didn't really need before?

Speaker 1

没错。

Exactly.

Speaker 0

比如计算沙箱、网关、代理权限,而不是人或服务角色的权限。

And so compute sandboxes, gateways, agent permissions versus people or service role permissions.

Speaker 0

其中很多都是我们已经构建或正在构建,并且正在积极思考的东西,因为它们确实是全新的构建模块。

A lot of those are things that we have built and are building and thinking actively about because they are just brand-new building blocks.

Speaker 0

这不是以不同的方式使用现有的构建模块,而是全新的模块,很明显你需要为代理设置不同的权限。

It's not using the existing building blocks differently, but it's brand-new ones, where pretty clearly you want different permissions for agents.

Speaker 0

你不想直接把Raghu的权限给它——

You don't just want to give it Raghu's permissions-

Speaker 1

对,没错。

Yeah, exactly

Speaker 0

……然后让它去做你能做的任何事情。

... and let it go do whatever you can do.

Speaker 0

你其实想要的是非常有时限的短期权限,只用来完成一个任务。

You actually want very time boxed short-term permissions to just go do a task.

Speaker 0

你甚至可能根本不想给整个工具的权限。

You actually may not want to give permissions to a whole tool at all.

Speaker 0

你可能想要非常细粒度的权限——

You may want to get very fine-grained permissions-

Speaker 1

对

Exactly

Speaker 0

——关于代理在沙箱里能做什么。

... of what an agent's able to do from a sandbox.

Speaker 0

你其实想要一个沙箱,它——

You actually want a sandbox that-

Speaker 0

你想要——

... you want to-

Speaker 1

虚拟化也在发挥作用——

Virtualization is having its act too-

Speaker 0

对

That's right

Speaker 1

……和沙箱一起。

... with the sandbox.

Speaker 0

对。

That's right.

Speaker 0

没错。

Exactly.

Speaker 0

而且它们是不一样的。

And they're different.

Speaker 0

类似,是同一个思路,但……

It's similar, it's the same idea, but it's-

Speaker 0

……怎么做到轻量化,并且……

... how do you have that lightweight and-

Speaker 0

……并且考虑——幸运的是,我们在Firecracker,也就是我们的微型虚拟机方面做了很多工作。

... and think about-- And fortunately, we've done a lot of work with Firecracker, our kind of microVMs.

Speaker 1

实际上,很多沙盒公司和初创企业都在用 Firecracker。

In fact, a lot of the sandbox companies, startups use Firecracker.

Speaker 0

他们都在用 Fire——这是我们——

They all use Fire-- Which we-

Speaker 0

大概十年前发明的,

... invented ten years ago, maybe-

Speaker 0

差不多那时候。

... or something like that.

Speaker 0

它真的是专门为——不是专门为智能体设计的,但确实很适合智能体,因为你可以非常快速地启动它们。

And it's really purpose-built for-- It wasn't purpose-built for agents, but it's actually quite good for agents because you can spin them up really rapidly.

Speaker 0

它们有很好的安全边界,而且没有传统大型虚拟机那种虚拟化开销。

They have a great security boundary, and you don't have a lot of that virtualization overhead that you have from a traditional large VM.

Speaker 0

所以,我觉得这些是我们正在考虑的一些新构建模块,而且每天都有更多新的出现。

So, I think those are some new building blocks that we're thinking about, and more emerge every single day.

Speaker 0

是的。

And yeah.

Speaker 1

关于智能体,我已经聊得够多了。

So I've rat-holed enough into agents.

Speaker 1

我以后再回来聊这个,但是——

I'll come back to it later, but-

Speaker 1

这确实是个很有意思的话题。

... it's a fascinating topic.

Speaker 0

非常酷。

Super cool.

Speaker 1

不过我们换个话题吧,我想问一个每个初创公司都会遇到的问题——

But let me switch gears a little bit and ask about something that every one of our startups face-

Speaker 1

也是我们被问得最多的,就是怎么才能拿到GPU,对吧?

... and we get asked most frequently, which is how can we get GPUs, right?

Speaker 1

显然,你们在运营大规模的GPU集群——

Obviously, you guys are running massive GPU farms-

Speaker 1

而且每天都在扩大规模。

... and increasing it every day.

Speaker 1

但顶尖的前沿实验室把能用的GPU都抢光了,这也没办法。

But the top frontier labs gobble up every available GPUs, more power to them.

Speaker 1

你们内部怎么处理——同时,你们又想——

How do you deal with the internal-- At the same time, you want to-

Speaker 1

去扶持那些未来会成为明日之星的新公司,就像你刚才说的。

... promote newer companies that are going to become the enterprises of tomorrow, like you said.

Speaker 1

你们是怎么考虑平衡的——

How are you thinking about balancing-

Speaker 0

这个问题问得好。

It's a great question

Speaker 1

一方面是算力需求,另一方面是那些没什么信用记录的小公司,等等等等。

... the capacity needs and these small companies that don't have a lot of credit and so on and so on.

Speaker 0

对,确实。

Well, yeah.

Speaker 0

这个问题问得很好。

It's a great question.

Speaker 0

而且有几件事让这个挑战更大了。

And a couple of these things make it more challenging, too.

Speaker 0

一个是资本支出,要部署现在所有人需要的算力,这个投入是巨大的,对吧?

One is the CapEx expense needed to go deploy kind of all of the compute that everyone needs right now is massive, right?

Speaker 0

所以我们,我觉得——

And so we are, I think-

Speaker 1

那你今年的资本支出是多少,200多亿?

So your CapEx this year is what, 200 or something?

Speaker 0

2026年是2200亿美元。

$220 billion for '26.

Speaker 0

我一度看到这个数字,觉得这真是——这是我们历史上最大的一笔支出,可能也是任何公司单年最大的一笔。

At one point I saw that it's a pretty-- That is a larger expense than we've ever had, maybe any company has ever had in a single year.

Speaker 0

而且我们短期内不打算放慢,因为需求实在太大了。

And we don't anticipate slowing down anytime soon because the demand is just massive.

Speaker 0

所以到某个时候,你受限于建数据中心的速度、部署资本的速度、获取内存和芯片的速度,还有诸如此类的事情。

And so at some point, you're limited by how fast can you build data centers, how fast can you deploy capital, how fast can you get memory and chips, and all of those kind of things.

Speaker 0

所以这些都是不同阶段的制约因素,无论是电力、数据中心、资本、内存还是芯片,它们在不同时期都会成为瓶颈。

And so all of those are at different points, constraints that we're, whether it's power, data centers, capital, memory, chips, they're all kind of constraints at various times.

Speaker 0

那些盖楼的建设工人,比如——

Construction people that build buildings, like-

Speaker 0

……现在建设工人非常抢手。

... construction people are at a premium today.

Speaker 0

所以我们一直在努力确保所有这些都能落实。

And so all of those we've worked really hard to make sure happen.

Speaker 0

然后,对于我们能部署的算力——虽然量很大,但我们知道还不够——我们会非常认真地思考分配策略。

And then with the capacity that we are able to deploy, which is still a huge amount and not enough, we know, we really think intentionally about what is that allocation strategy.

Speaker 0

我们和大型前沿实验室,比如Anthropic、OpenAI、Meta以及其他大客户,都是很好的合作伙伴。

And so, we're great partners with the large frontier labs, the Anthropics and OpenAIs and Meta and other large customers.

Speaker 0

这些客户都是我们非常好的客户。

And so those folks are really good customers of ours.

Speaker 1

对。

Yep.

Speaker 0

所以我们希望确保在这些客户身上进行投资。

And we want to make sure that we invest in them.

Speaker 0

我们也有大型的企业客户,比如 Salesforce、摩根大通或者其他-

We have large enterprise customers, whether it's Salesforces or JPMCs or other-

Speaker 1

对。

Yep

Speaker 0

...那些对 GPU 或加速器需求量相对较少的各大公司。

... large companies that have demand for fewer numbers of GPUs or accelerators.

Speaker 0

有时候他们需要 Trainium,有时候则需要 NVIDIA 的 GPU。

Sometimes they want Trainium, sometimes they want NVIDIA GPUs.

Speaker 0

但我们也要确保能支持到他们。

But we want to make sure that we can support them as well.

Speaker 0

我们在为初创公司预留算力方面非常用心。

And we're very intentional about how we make sure that we have capacity for startups.

Speaker 0

所以我们实际的做法是进行专门分配,基本上我们会说:'好,我们要保留……'

And so what we do is we actually do allocate, and we basically say, "Okay, we're going to keep..."

Speaker 0

你说得对,我们确实可以把每一块GPU都卖掉……

You're right, we could sell every single GPU ...

Speaker 0

把每一块GPU或AI加速器都卖给那些大型前沿实验室,然后——

GPU or AI accelerator we had to probably just the big frontier labs and-

Speaker 0

……就完事了。

... call it a day.

Speaker 0

但我们不这么做,因为我们想继续发展整个生态系统。

We choose not to do that because we actually want to keep growing the full ecosystem.

Speaker 0

他们能拿到很多,但我们想继续支持更广泛的客户群体,因为我们觉得这样对整个生态系统来说会更健康。

They get a large number, but we want to keep supporting a broader set of customers because we actually think that both the whole ecosystem will be more healthy for us.

Speaker 0

这样也能分散风险,而且我们知道这些公司将来都会发展成大公司。

There's some diversification, but it's also just we know these are going to be big companies over time.

Speaker 0

所以我们尽量去支持他们。

And so we try to support them.

Speaker 0

我最近看到,我们最终会以某种形式答应大约60%的请求。

I saw recently that we say, yes, in some way, shape, or form, to something like 60% of the requests we eventually get.

Speaker 0

有时候会晚一点,有时候是在不同的地区,有时候配置跟客户想要的略有不同。

Sometimes it's a little bit later, sometimes it's in a different region, sometimes it's a slightly different configuration than the customers are looking for.

Speaker 0

但我们真的尽力去倾斜资源,尽可能多地分配。

But we really try to lean in and try to allocate as much as we can.

Speaker 0

而且你手下的每一个初创公司都想要更多。

And every single startup that you have wants more.

Speaker 1

对,没错。

Yeah, exactly.

Speaker 1

这毫无疑问。

There's no question about it.

Speaker 0

所以我们正在努力确保我们拥有所有这些资源。

And so we're working hard to try to make sure that we have all of those.

Speaker 0

但这很难。

But it's hard.

Speaker 0

就像很多人说的,这是个好问题。

As a lot of people say, it's a good problem to have.

Speaker 1

是的,确实如此。

Yes, it is.

Speaker 0

但不管怎么说,这仍然是个问题。

But it's a problem nonetheless.

Speaker 0

我们还在继续考虑——我们最近宣布,未来几年内将购买200万块英伟达GPU。

And we continue to look at-- We recently announced we're going to be buying 2 million NVIDIA GPUs over the next couple of years.

Speaker 0

我们正在部署一个巨大的——

We're landing a massive-

Speaker 1

对。

Yes

Speaker 0

……规模的算力,而且——

... amount of capacity and-

Speaker 1

200万块。

2 million.

Speaker 0

200万块。

2 million.

Speaker 1

是的。

Yes.

Speaker 0

所以,这个数量很大,而且是未来几年内的事情,谁知道够不够呢。

So, it's a lot, and it's over the next couple of years, and who knows if that's enough.

Speaker 0

我们其实也不太清楚,但说到底,我们还会受到其他组件的限制。

We kind of have no idea, but at some point, again, we're limited by other components as well.

Speaker 0

但确实是这样。

But it is.

Speaker 0

我们非常有意地保留一部分算力给初创公司。

We're very intentional about keeping capacity available for the startups.

Speaker 0

我知道算力不够用很痛苦,但我们一直在努力推进。

And I know it's painful to not have enough, but we keep pushing.

Speaker 1

你的资本支出是什么时候超过,纯AWS,亚马逊当时还是一家更大的公司——

When did your CapEx cross, pure AWS, Amazon was a bigger company-

Speaker 1

——超过,就算每年10亿或100亿美元吧?

... cross, let's call it even 1 billion or 10 billion a year?

Speaker 0

哦,我不太清楚。

Oh, I don't know.

Speaker 0

我得回去查一下。

I'd have to go back and look.

Speaker 0

这个我不太确定,但过去几年确实大幅增长了。

I'm not sure about that, but it's definitely scaled up over the last couple of years in a pretty meaningful way.

Speaker 1

所以情况就是这样。

So it's been like this.

Speaker 0

是的,AI建设确实大幅增加了我们的资本支出,所以我觉得过去三四年,我们的资本支出确实加速了不少。

Yeah, the AI build-out has definitely ramped our CapEx spending, and so I'd say over the last call three or four years, our CapEx has definitely accelerated pretty meaningfully.

Speaker 0

我不知道什么时候超过十亿的,但既然现在已经是220了,可能已经有一段时间了。

I don't know when we crossed a billion, but given we're at 220 now, it's probably been a while.

Speaker 0

我们一直在进行资本支出,公司在这方面也一直做得很好,显然AWS业务是我们喜欢投资的好业务。

We've been spending CapEx for a while, and the company has been really good about funding that, and obviously, the AWS business is a good one that we like to invest in.

Speaker 1

当然。

Of course.

Speaker 0

而且我觉得,其实很长一段时间,我们都是在需求还没起来之前就提前投入了,而且——

And I think we were, for the longest time actually, we were investing ahead of where the demand was, and-

Speaker 1

对,我记得那时候。

Yeah, I remember those days

Speaker 0

……

...

Speaker 0

我觉得最难受的一点是,随着GPU真正大规模上线,很多弹性空间不幸地消失了。

I think one of the most painful things is that with the real ramp of GPUs, a lot of the elasticity has unfortunately kind of gone away.

Speaker 1

没了。

Disappeared.

Speaker 0

所以希望我们能回到——在核心计算、存储这些方面,弹性还是有的,而且我们确实已经投入了很长时间,对现在的投入也很有信心。

And so hopefully we'll get back to-- And in our core compute and storage and things, that elasticity is still there and that, but so we've been spending for quite a bit of time, and we feel really good about the spend that we're making now.

Speaker 0

其实我经常被问到,你对这些投入怎么看,会不会担心——

Which is, I think I get lots of questions sometimes about how you feel about that spend and are you nervous about-

Speaker 0

……泡沫之类的事情。

... the bubble and other things like that.

Speaker 1

对。

Yep.

Speaker 0

我想说的是,基于我们目前的地位,我们采取的是多元化策略,因此我们的产能并不会全部集中在某一个客户身上。

And I will say, because of the position we have, one, we do take this diversified approach, and so not all of our capacity is bundled up in one customer.

Speaker 0

你去看看那些所谓的新型云服务商或者其他供应商,你会发现他们的客户集中度有时高达30%、40%、50%甚至60%。

And I think you go to some of these, whether they're NeoClouds or some of the other providers out there, and you'll see sometimes concentrations of 30, 40, 50, 60%-

Speaker 1

对。

Yep

Speaker 0

……只有一两个客户。

... with one or two customers.

Speaker 0

我们远没到那个程度。

We're nowhere near that.

Speaker 0

显然,最高也就个位数百分比,通常还更低。

Obviously, we're single-digit percentages at the highest, and usually it's less than that.

Speaker 0

首先,我觉得我们对单一客户的风险要小得多。

For one, I think we have a lot less risk on one particular customer.

展开剩余字幕(还有 480 条)
Speaker 0

而且因为我们有丰富的服务组合,AWS 正是人们真正来启动生产工作负载的地方。

But also because we have that rich set of services, AWS is where people really are coming to launch their production workloads.

Speaker 0

所以目前我们大部分的使用量,实际上要么是核心计算、存储,要么是推理,这些都是应用的一部分。

And so the majority of our usage today actually is either core compute and storage and inference, which is part of that application.

Speaker 0

这些工作负载,我觉得是不会消失的。

And so those are the workloads that I think just aren't going to go away.

Speaker 0

因为我们看到企业获得了正的投资回报。

Because we see enterprises getting positive ROI.

Speaker 0

你去跟客户聊,问他们:“以目前的能力和成本,你们看到对业务有正回报吗?”

You go talk to the customers, and you say, "At the capability today and the cost today, are you seeing positive returns to your business?"

Speaker 0

几乎每个人都会说:“哦,是的。”

And almost to a person, they'll say, "Oh, yeah."

Speaker 0

所以你就会想:“那这肯定不会消失。”

And so you're like, "Well, that's not going to go away."

Speaker 0

不存在他们会停止在这方面花钱的泡沫。

There's no bubble in which they stop spending on that.

Speaker 1

对。

Yep.

Speaker 0

你也知道,风投这个模式,是不是每个十亿美元的初创公司都能成功?

And you know this, the VC model, is every billion-dollar startup going to make it?

Speaker 0

不,它们不会。

No, they won't.

Speaker 0

但这就是游戏规则。

But that's kind of the game.

Speaker 1

这就是游戏规则。

That is the game.

Speaker 0

而且这个情况已经持续了50年。

And that's been true for 50 years.

Speaker 0

它们并不一直都是十亿美元的初创公司。

They haven't always been billion-dollar startups.

Speaker 1

数字变了,但原则没变。

The numbers have changed, but the principles haven't changed.

Speaker 0

但原则是一样的,对吧?

But the principles are the same, right?

Speaker 0

你投十个,只要有一个成功,就能把其他十个的损失都赚回来,或者差不多这个比例。

You bet on 10, and one makes it and pays for the other 10 or whatever the percentage is.

Speaker 0

希望成功率能高于十分之一。

Hopefully it's higher than one out of 10.

Speaker 1

这就是著名的幂律分布。

Famous power law.

Speaker 0

所以你在互联网时代也看到了这种情况,当时有泡沫,很多互联网公司没撑下来,但互联网本身依然存在。

And so you saw that with the internet where there was a bubble and a bunch of internet companies didn't make it, and the internet's still a thing.

Speaker 0

而且很多拥有可持续业务的公司——

And a lot of the companies that had durable businesses-

Speaker 0

像谷歌、亚马逊这些,它们都做得很好。

... the Google, the Amazons, the others, they did pretty well.

Speaker 0

所以对我们来说,我们对那笔投资以及未来的持续投资感到非常乐观。

And so for us, we feel really good about that investment and the continued investment going forward.

Speaker 1

你们对需求有独到的见解——

You guys have a view of the demand-

Speaker 1

——这是无与伦比的,对吧?

... that's unparalleled, right?

Speaker 1

因为你们能看到全球的情况,覆盖每一个细分市场,从企业到——

Because you're seeing across the globe, you're seeing across every segment, enterprise and-

Speaker 1

——大型实验室、AI原生公司等等。

... the big labs and the AI native companies and so on and so forth.

Speaker 1

如果谁能最先判断出来,那一定是你们。

If anybody should call it, you should be able to call it first.

Speaker 0

希望如此。

I would hope so.

Speaker 0

这正是我们的计划。

That's our plan.

Speaker 0

说实话,我们花了很多时间思考这个问题。

And honestly, we spend a lot of time thinking about it.

Speaker 0

我们在使用股东资金方面非常谨慎,而且我们认为我们正在做很棒的投资。

We're very intentional about how we spend our shareholder capital, and we think that we're making great investments.

Speaker 0

我们有很多好的保障措施,确保我们有意地投资这笔钱。

We have a lot of good protections of how we intentionally invest that money.

Speaker 0

但是,是的,我们非常看好,而且我觉得安迪也公开说过这一点。

But yeah, we're very bullish on, and I think Andy's been public about saying this.

Speaker 0

AWS的潜力真的非常大。

The potential for AWS is really, really large.

Speaker 0

在未来十年里,潜力是存在的。

And over the next decade, the potential is there.

Speaker 0

而且任何时候,只要机会这么大——

And anytime you have an opportunity that's that big-

Speaker 1

你就得投资

You just got to invest

Speaker 0

——你就想投资去抓住它。

... you want to invest to go after it.

Speaker 1

随着这些数字越来越大,对吧?

As the scale of these numbers go larger and larger, right?

Speaker 1

你们的规划和流程有没有发生巨大变化?比如你们不再写——

Has your planning and process dramatically changed in terms of-- You're not writing-

Speaker 1

……十亿美元的支票了。

... billion-dollar checks.

Speaker 1

你们现在写的是五百亿的支票,或者——

You're writing $50 billion checks or-

Speaker 1

……两百亿的支票,或者类似的规模。

... $20 billion checks or whatever it is.

Speaker 0

既是也不是。我觉得,很多时候我们仍然非常看好这些投资,并且积极进取,但流程上确实有很多东西完全变了。

Yes and no. I think, look, a lot of times we're still very bullish about the investments and lean forward, but the process, so there's a lot of things that have completely changed.

Speaker 1

你们怎么——

How do you even-

Speaker 0

如果我想想——

If I think about-

Speaker 1

怎么估算2028年或2029年的需求?

... estimate 2028 demand or '29 demand?

Speaker 0

嗯,现在有些问题是我们以前根本不用考虑的。

Well, and there's things that we have to think about now that we just never had to think about.

Speaker 0

所以,如果回到15年前,我们需要更多电力时,就找电力公司要——

And so if you go back 15 years, if we needed more power, we asked the power company to give us-

Speaker 1

对。

Yep

Speaker 0

几兆瓦或者什么的,对吧?

... couple of megawatts or whatever it was, right?

Speaker 0

几十兆瓦。

Tens of megawatts.

Speaker 0

他们就直接给我们,因为10兆瓦不算多。

And they would just give it to us, because 10 megawatts wasn't that much.

Speaker 0

而且那对我们来说足够继续发展了。

And that was plenty for us to keep growing.

Speaker 0

现在,我们自己带电力,所以我们为电力项目付钱,也为可再生能源项目付钱。

Now, we bring our own power, and so we pay for power projects, we pay for renewable projects.

Speaker 0

过去十年,我们每年都是最大的可再生能源购买方之一。

We're one of the biggest renewable power purchasers each year for the last 10 years.

Speaker 0

所以我们经常在启动新的太阳能项目、新的核能项目、新的——

And so we're regularly bringing on new solar projects, new nuclear projects, new-

Speaker 1

那你说的是在电表后面,还是说——

So are you talking about behind the meter, or are you talking about-

Speaker 0

两者都有。

Both

Speaker 1

……和运营商合作?

... working with the operator?

Speaker 0

我们两种都会做。

We'll do both.

Speaker 1

好的。

Okay.

Speaker 0

所以这两种方式都有。

And so both of those things.

Speaker 0

而且很多时候,我们上这些电力项目,会先投入资金,把项目建好,然后并入电网,之后我们就能获得相应的额度。

And so oftentimes with these power projects that we bring on, we'll pay the capital and pay for the project, and then it'll go into the grid, and then we'll get credit for that.

Speaker 1

明白了。

I see.

Speaker 1

好的。

Okay.

Speaker 0

所以我们会把这些项目做起来。

So we'll bring those on.

Speaker 0

有时候我们也会做表后项目。

Sometimes we'll do behind the meter, too.

Speaker 0

是混合的。

It's a mix.

Speaker 0

以我们目前的规模,这些方面都得考虑到。

At the scale that we're doing, you have to think about all of those things.

Speaker 0

但那是规划,你得考虑未来20年怎么处理电力、怎么处理输电、怎么处理那笔资金,这些是我们以前从没想过的事。

But that's planning where you're thinking 20 years out of how you're going to think about power, how you're going to think about transmission, how you're going to think about that capital, and that's stuff we'd never had to think about before.

Speaker 0

因为这种规划我们以前根本不用做。

Because that's planning we just never had to do.

Speaker 0

但另一方面,以前我们考虑服务器需求时,会有多个季度的需求计划,我们会和我们的——

But the other things is when we used to think about server demand that we needed, we'd have multiple quarter demand things, and we'd talk with our-

Speaker 0

……供应商那些人沟通。

... suppliers and things.

Speaker 0

现在我们要提前好几年规划,因为规模太大了,我们得考虑26年需要什么、27年需要什么、28年需要什么。

Now we work multiple years out, just because the size is so much that we have to think about what do we need for '26, what do we need for '27, what do we need for '28?

Speaker 0

但这也是我们给客户带来的价值之一,对吧?

But it's also one of the value that we bring to customers, right?

Speaker 0

这确实是客户自己做不到的事情。

That's a thing that legitimately customers can't do themselves.

Speaker 0

他们不是——

They're not-

Speaker 1

不是。

No

Speaker 0

……去做电力规划。

... going to do power planning.

Speaker 1

挺难的。

Pretty hard.

Speaker 0

他们不会去规划2028年的内存占用。

They're not going to plan their memory footprint in 2028.

Speaker 0

他们做不到。

They can't do that.

Speaker 0

所以,这正是我们为众多客户带来的真正价值之一——就是有一大堆事情你根本不用操心,而我们却花了大量时间去考虑。

And so that's one of the real values that we bring to our broad set of customers, is just that's just a whole set of things that you don't have to worry about, and that we spend a huge amount of time thinking about.

Speaker 1

你们一般来说,我想说,实际上是几乎所有服务器组件的最大买家,对吧?

You guys are generally, I think for the record, the largest buyers of practically every component of a server, correct?

Speaker 0

这个我不清楚。

I don't know that.

Speaker 0

我确定我们是市场上比较大的组件采购方之一,这是肯定的。

I am sure that we're one of the bigger purchasers of components out there, for sure.

Speaker 0

至于其他所有人,谁知道呢。

And who knows about everyone.

Speaker 0

这取决于你怎么看待他们,以及你怎么衡量。

And it kind of depends on how you think about them and how you measure.

Speaker 0

但是——

But-

Speaker 1

所以我想说的是,你觉得在哪些方面限制最严重,在——

So what I was leading to is where do you see the constraints being most severe in-

Speaker 1

……我们就说‘27年、‘28年吧,你觉得哪些方面的限制会缓解?

... let's call it '27, '28, and where do you see the constraints easing up?

Speaker 0

这挺有意思的。

It's funny.

Speaker 0

所以我用个迂回的方式来回答,我记得在大学本科的时候,我们其实……

So I'll answer this in a roundabout way, but I remember that in undergrad, we actually...

Speaker 0

这是很久以前的事了。

So this is a long time ago.

Speaker 0

我从没想过我读的这本书会这么有用。

And I never thought this would be a useful book that I read.

Speaker 0

但我们读了《目标》这本书。

But we read "The Goal."

Speaker 1

哦,当然。

Oh, of course.

Speaker 0

你读过《目标》,对吧?

You read "The Goal," right?

Speaker 0

结果发现,从来都不只有一个瓶颈。

And so it turns out there's never one constraint.

Speaker 0

总是只有最新的那个瓶颈。

There's always just the latest constraint.

Speaker 0

所以你得把所有瓶颈都考虑进去,而且一旦你解决了一个,又会出现另一个,对吧?

And so you have to think about all of them, and as soon as you hit one, there's another one, right?

Speaker 0

那么,20年和28年会出现什么瓶颈呢?

And so what is the constraint that's going to happen in '20 and '28?

Speaker 0

其实我觉得不会有一个单一的瓶颈。

I actually don't think there will be one.

Speaker 0

我觉得每个月都会有。

I think it's every month.

Speaker 0

对我们来说,就是电力够不够。

For us, it's do you have enough power?

Speaker 0

一旦电力不再是瓶颈,可能就轮到内存、台积电的产能、HBM,或者网络组件。

And then as soon as power is no longer the constraint, it might be memory, it might be TSMC capacity, it might be HBM, it might be networking components.

Speaker 0

也可能是供应链某个环节出问题,比如连接器之类的,对吧?

It could be there's a blip somewhere in the supply chain and connectors or whatever it is, right?

Speaker 0

到了某个阶段,你得把所有环节都考虑进去。

At some point, you have to think about all of those pieces.

Speaker 0

而且,这些瓶颈发生在哪里也很重要。

And it's not also the kind of where they happen matters, too.

Speaker 0

所以可能会是,嘿,我们在印度尼西亚有大量的电力。

So it may be like, "Hey, we have a ton of power in Indonesia-

Speaker 0

但我们在德国却不够用。

... but we don't have enough in Germany."

Speaker 0

所以你也得考虑你想把产能放在世界的哪个地方,因为事实证明,并不是所有东西都是完全可以互换的。

And so you think about where in the world you want that capacity, too, because it turns out that not everything is totally fungible.

Speaker 0

有些可以,有些不行。

Some is and some's not.

Speaker 0

但可能是硬盘,也可能是固态硬盘。

But it might be disk drives, it might be SSDs.

Speaker 0

我们会考虑每一个零部件,我们有成千上万个零部件,都在我们的跟踪和考虑范围内。

We think about every single component, and we have tens, hundreds of thousands of components all that we track and think about.

Speaker 0

有些我们依赖供应商来管理。

And some we rely on our suppliers to manage.

Speaker 0

大部分我们直接管理。

Much of it, we directly manage.

Speaker 0

是的,我们有一个专门的团队负责这个,他们做得非常出色。

And yeah, we have a whole team that does that, and they're fantastic.

Speaker 0

我觉得他们是行业领先的,大概十年前我们就预见到了这个问题,并且不只是考虑我们需要追踪多少台服务器,而是深入思考整个供应链,一直到第四层、第五层。

I think they're industry-leading, and we saw this problem coming probably a decade ago and really started not just thinking about, okay, how many servers do we need to track, but just thinking all the way through the supply chain, four tiers, five tiers down.

Speaker 0

哪些组件可能会给我们带来问题,并确保我们在这些组件上有稳定的供应保障。

What is the component that could cause an issue for us, and making sure that we had guaranteed supply on that.

Speaker 0

如果你还记得,天哪,我不记得这是什么时候的事了。

If you remember, gosh, I don't remember when this was.

Speaker 0

那是十多年前,泰国发生洪水的时候,

This was over a decade ago, when there was the floods in Thailand and-

Speaker 0

……大家都没有硬盘了。

... no one had disk drives anymore.

Speaker 1

对。

Yep.

Speaker 0

所以那就是……

And so that was-

Speaker 1

当时有硬盘危机——

There was disk drive crises-

Speaker 1

……然后又有内存危机。

... and then there was memory crisis.

Speaker 0

没错。

Exactly.

Speaker 0

所以我觉得我们把这些都考虑进去了,同时也在考虑制造业的多元化布局。

And so I think we think through all of those things, and so we also think about where is there diversification in manufacturing.

Speaker 0

所有这些方面我们都尽量去处理,虽然不可能做到完美,但总会有不同的供应瓶颈。

All of those kind of pieces we try to work through, and we're never going to be perfect on it, but there's always a different supply constraint.

Speaker 1

所以很明显,关于数据中心有很多广泛的讨论。

So obviously, there's a lot of wide-ranging debate about data centers.

Speaker 1

而且像我们这样的人立场很明确,但你觉得作为行业,我们是不是没有很好地解释——

And it's clear that folks like us, where we stand, but do you think as an industry, we have not done a good job-

Speaker 1

……为什么数据中心对美国有好处——

... of explaining why data centers are good for America-

Speaker 1

以及对整个世界来说,但是——

... and generally the world, but-

Speaker 1

那在内部讨论中——

... and what's the internal talk-

Speaker 1

安迪的团队是怎么讨论应对这个问题的?

... amongst Andy's team on how do we deal with this?

Speaker 0

嗯,你看,我觉得你之后会听到我们更多关于这方面的表态,我也同意,我们需要更积极发声,更坦诚一些。

Well, look, I think you'll hear more from us over this, and I agree, I think we need to be more vocal and be more upfront.

Speaker 0

因为我们确实做了很多非常有益的事情,无论是对我们运营所在的社区。

Because we actually do a ton that's really beneficial, both for the communities we operate in.

Speaker 0

我们花了很多心思思考如何为这些数据中心引入可再生能源。

We think a ton about how do we bring renewable energy to these data centers?

Speaker 0

我们如何做到水资源正效益?

How do we think about being water positive?

Speaker 0

实际上,我们的数据中心用水量非常非常少。

Actually, our data centers use a really, really small amount of water.

Speaker 0

我们主要用的是自然风冷却。

We mostly use free air cooling.

Speaker 0

我们怎么考虑成为所在社区的好成员,以及怎么为我们运营的社区带来高薪工作?

How do we think about being great participants in the communities where we are, and how do we bring high-paying jobs to the communities we operate in?

Speaker 0

并不是所有数据中心运营商都这么做。

And not all data center operators do that.

Speaker 0

我觉得有些——

I think there are some-

Speaker 1

而且你有一个相当——

And you have a pretty-

Speaker 0

有些其他公司的例子被广泛报道,他们在这方面做得不好,根本不重视法规。

There are some well-chronicled examples of others out there that are not great at that, and they just don't really pay attention to regulations.

Speaker 0

他们觉得规则不适用于自己,或者就是……不考虑这些就急着上线。

They think that the rules don't apply, or they just ... launch really quickly without thinking about those.

Speaker 0

我觉得这给整个行业带来了问题,因为大家都被归为一类了。

And I think that it causes a problem for the whole industry because everybody kind of gets lumped into that.

Speaker 0

所以你看,我觉得你说得对。

So look, I think you're right.

Speaker 0

我们确实需要更主动地自我批评,同时也要更积极地宣传我们带来的好处,并思考更多方式帮助社区了解我们为他们带来的价值,无论是他们使用的服务,对吧?

Vocally self-critical, we need to be more vocal about the benefits that we do bring, and think about additional ways that we can help communities understand the benefits that we bring to them, both for the services they use, right?

Speaker 0

如果你通常去一个社区说:"那你们不想用Netflix吗?"

If you usually go to a community and say, "Well, do you not want to use Netflix?"

Speaker 0

他们会说:"不不不,我还是想要Netflix。"

And they'll be like, "No, no, no. I still want Netflix."

Speaker 0

对我们来说,重要的是思考和强调我们带来的好处。我最近看到一份报告,在我们运营的一个社区,由于我们缴纳的税款,那个县的每个人都少交5000美元的税。

And it's important for us to think about and highlight the benefits that we bring where I recently saw a report where one of the communities that we operate in, everybody in that county pays $5,000 a year less in taxes because of the taxes that we-

Speaker 1

对

Yep

Speaker 0

……我们带来的。

... bring to that.

Speaker 0

但我们没有告诉他们。

And we don't tell them.

Speaker 0

他们甚至都不知道,对吧?

They don't even know it, right?

Speaker 1

对。

Yep.

Speaker 1

没错。

Exactly.

Speaker 0

这对他们来说完全是看不见的。

It's just invisible to them.

Speaker 0

所以我觉得我们需要把这些好处讲得更清楚一些。因为如果你告诉社区:顺便说一句,如果没有我们,你们的税款会多五千美元,他们可能就会对……

And so I think we just need to be more clear about those benefits that we bring, because I think if you told the communities, "By the way, your tax bill is $5,000 less than it would otherwise be if we weren't here," they might have a little bit of different thought about-

Speaker 0

……那边的建筑有些不同的看法。

... the building that's over there.

Speaker 0

但并不是每个人都这么做。

But not everyone does that.

Speaker 1

想必在……方面还需要更多的透明度。

Presumably there's more transparency that's needed on the part-

Speaker 0

我觉得数据中心行业里的大部分公司,不只是我们,其实都是挺守规矩的。

And I think much of the data center community, not just us, is actually pretty good actors.

Speaker 1

我完全同意。

I completely agree.

Speaker 0

就是有那么少数几家不太守规矩的,我觉得最近引起了一些不满,所以我们需要更好地宣传哪些是好的企业,哪些不是。

And there's just a few that aren't that kind of, I think, have caused some of the angst recently, and I think we just need to do a better job of highlighting who's being good citizens and who's not.

Speaker 1

在结束硬件话题之前,我想聊聊Trainium。

And before we leave the hardware topic, I want to touch upon Trainium.

Speaker 1

还有你们自己造芯片的整个历程,对吧?

And your whole history with building your own chips, right?

Speaker 1

我们是很早以前就用Nitro的第一批合作伙伴之一。

We were one of your first partners using Nitro a long time ago.

Speaker 1

从那以后,还有Graviton,你们取得了巨大的进步。

And since then, Graviton, and you made tremendous progress.

Speaker 1

那么,是什么想法让你们决定说‘我们要自己搞一套’呢?

So what was the thinking that led to saying, "Look, we're going to do our own thing"?

Speaker 1

那这个进展怎么样,你们现在到哪一步了——

And then how has that progress been, and where are you-

Speaker 1

——关于Trainium?

... with respect to Trainium?

Speaker 0

这其实是个很有意思的故事,我觉得它很好地体现了亚马逊AWS会不断创新、不断迭代,并且持续思考我们能做什么更大的事情,但我们会一步步证明自己,而不是……

It's actually a fascinating story, and I think it's a great example of where Amazon AWS will innovate and will iterate over time and continue to think bigger about what we can do, but kind of prove our way there as opposed to...

Speaker 0

就拿这个举个例子吧。

And so take this as an example.

Speaker 0

这大概是,我也说不准,10……

This is probably now, I don't know, 10...

Speaker 0

大概13、14年前吧。

It was probably about 13, 14 years ago.

Speaker 0

我们当时发现,虚拟化对整个资源数量来说,是一笔相当大的开销。

We were seeing that there was a pretty significant virtualization tax on the overall number of resources.

Speaker 0

我们当时在想怎么——客户跟我们说,“我要裸机性能”,他们在比较——

And we were kind of thinking about how do we-- Our customers were telling us, "I want bare metal performance," and they're comparing to-

Speaker 0

拥有服务器的全部资源。

... having all the resources of a server.

Speaker 0

所以我们做的第一件事,就是拿一块网络卸载卡,把所有的网络虚拟化都放到上面去,这样网络虚拟化就更接近裸机性能了。

And so the first thing that we did is that we took a network offload card and virtualized all of our network virtualization and pulled it off onto an offload card so that network virtualization got closer to bare metal performance.

Speaker 0

那时候,虽然还不是完全的裸机性能,但已经更接近了。

And back then, it was not quite bare metal, but it was closer.

Speaker 0

然后我们特别兴奋,就说:“好,那如果我们把存储虚拟化也移出去呢?”

And then we got really excited about that, and we said, "Okay, what if we could move storage virtualization off as well," right?

Speaker 0

但那些网络卸载卡都做不到这一点。

And none of the network offload cards could do that.

Speaker 0

后来我们找到了一家公司,他们的卸载卡上有一些Arm核心,他们做这个是为了其他用途。

And then we found this one company who had some Arm cores on an offload card, and they were doing it for other reasons.

Speaker 0

我不记得他们最初的目的了,但我们就问:“能不能用这些核心来做存储虚拟化,还有其他一些功能?”

I can't remember their original purpose, but we're like, "Could you use those to do storage virtualization and some of these other functions?"

Speaker 0

他们就说:“也许可以吧。”

And they're like, "Maybe."

Speaker 0

所以我们真的和他们反复磨合了很久。

And so we really iterated with them.

Speaker 0

这就是Annapurna团队。

This was the Annapurna team.

Speaker 1

对,就是Annapurna团队。

Yeah, this is the Annapurna team.

Speaker 0

我们非常喜欢那个团队。

And just loved that team.

Speaker 0

他们真的很有创新精神,也很有使命感——

Like really innovative, really mission-driven-

Speaker 1

非常棒的团队。

Fantastic team

Speaker 0

……真的很想解决问题。

... really wanting to solve problems.

Speaker 0

所以我们收购了他们,然后说:“你们能不能给我们造一个稍微大一点的卡,把所有的网络虚拟化都拿掉,基本上给我们一个没有虚拟化的裸机服务器,没有虚拟机虚拟化,所有东西都通过卡上的API来操作?”

And so we acquired them, and we said, "Look, could you build us a slightly bigger card that actually could take all the network virtualization off and basically give us a bare metal server that has no virtualization on it, no VM virtualization, everything is through APIs on the card?"

Speaker 0

因为我们当时认为,第一,性能会好很多,资源利用率也会更高。

Because we had this view that, one, performance would be much better, a resource utilization would be better.

Speaker 1

安全隔离。

The security isolation.

Speaker 0

而且安全隔离会好得多得多。

And security isolation would be much, much better.

Speaker 0

然后我们就可以理直气壮地告诉别人:“我们完全无法访问你们运行在那里的任何虚拟机。”

And we could then legitimately tell people, "We have no access to any of your VMs that are running there."

Speaker 0

这在过去十年里对我们来说是个巨大的优势,说实话,我们一直处于领先地位,而且——

And this has been a huge benefit for us for the last decade, where frankly, we've been leading and-

Speaker 0

……其他人在这方面动作比较慢,因为这不是一件人人都能做到的普遍事情。

... others have been kind of slow to do this because this is not a generalized thing that people can do.

Speaker 0

所以我们做到了那一步,然后基本上说:“看,我们在这里取得了很大的进展。

So we got to that, and we basically said, "Look, we're making a lot of progress here.

Speaker 0

如果我们把……”

What if we take..."

Speaker 0

而且那块卸载卡上有一堆Arm核心,

And there's a bunch of Arm cores that were on-

Speaker 0

然后我们说:“要是把它变成一台服务器会怎么样?”

... this offload card, and we said, "What if we turn that into a server?"

Speaker 0

我们最初用Graviton做到了这一点。

And we did that first with Graviton.

Speaker 0

我们推出的那台服务器性能很弱,体积也很小。

It was a very underpowered, very small server that we launched.

Speaker 0

但客户们都很兴奋。

And customers were excited.

Speaker 0

他们说:“哇,我太想要一台Arm服务器了。

They're like, "Ah, I'd love to have an Arm server.

Speaker 0

这太有意思了。”

This is super interesting."

Speaker 0

于是我们就沿着这条路走下去,Graviton……

And so we went down the path and Graviton...

Speaker 0

我们当时做的一部分工作就是观察,发现Arm核心的性能提升速度在加快。

And part of what we did is we looked and saw that there's the slope of Arm cores were getting faster.

Speaker 1

对。

Yep.

Speaker 0

而且你看那个功耗利用率的图表,就是那个……

And where you saw the power utilization and the graph where the...

Speaker 0

你知道这个架构在某个点上会变得非常适合某些应用,只是需要有人来推动生态系统,把一些环节落实到位。

And you knew the intercept was going to happen for where this architecture was going to be really good for parts, and they just needed somebody to drive the ecosystem and get some of the pieces in place.

Speaker 0

所以我们用Graviton做了这件事,而Graviton现在已经是爆款了。

So we did that with Graviton, and Graviton's been a runaway hit at this point.

Speaker 1

你们有没有公开过Graviton在你们整个服务器集群中的占比?

Have you been public about what percentage of your fleet is Graviton?

Speaker 0

我们每年部署的Graviton服务器比其他任何类型的都多。

We land more Graviton ships every year than any other type.

Speaker 0

所以它非常受欢迎。

So it's very popular.

Speaker 0

你看,它们便宜20%,性能还高出20%——

Look, they're 20% cheaper at a 20% better performance-

Speaker 0

而且过去五六年一直是这样。

... and have been like that for the last kind of five, six years.

Speaker 0

所以这个价值主张很容易理解,而且我认为绝大多数,大概超过90%的顶级客户,都以某种方式在他们的整个基础设施中使用了Graviton。

So it's an easy value proposition, and I think the vast majority, something like 90-plus percent of our top 100 customers all use Graviton in some way, shape, or form across their fleets.

Speaker 0

所以这对我们和客户来说都是一个巨大的成功。

And so that's been a huge win for us and for customers.

Speaker 0

客户降低账单最简单的方法就是迁移到Graviton。

The single easiest way that customers lower their bill is to move to Graviton.

Speaker 0

我们有过这样的例子,有些客户迁移了整个基础设施,服务器数量减少了一半。

We've had examples where people have moved their whole fleets and cut the number of servers they had in half.

Speaker 1

哇。

Wow.

Speaker 0

性能提升太明显了。

The performance is so much better.

Speaker 1

太厉害了。

It's amazing.

Speaker 0

所以服务器数量减半,每台服务器的成本也更低。

And so half as number of servers, each server costs less.

Speaker 0

这真是个巨大的胜利。

It's a big win.

Speaker 0

大概五六年前,我们看到了AI计算需求的兴起。

And so then about five or six years ago, we said we saw the rise of AI compute happening.

Speaker 0

虽然当时没预料到今天这么火爆,但还是……看到了它会成为重要的推动力。

Not nearly expecting what it was today, but still- ... saw it was going to be a big material mover.

Speaker 1

是的。

Yes.

Speaker 0

于是我们投入研发,推出了第一代Trainium芯片,现在第三代Trainium3已经上市,效果非常棒。

And so we went in, built our first chip in Trainium, and we're now in market with the third generation, Trainium3, and have seen fantastic results.

Speaker 0

所以我们的产能已经售罄,可能要到明年年底左右才能有新的供应。

So we're sold out For capacity through probably, maybe towards the end of next year or something like that.

Speaker 0

而且我们还在想办法节省一些算力,让初创公司也能用上一些,因为我们看到了很好的效果。

And again, we're trying to figure out how we can save some capacity and get startups to be able to use some of the capacity, because we see great results.

Speaker 0

所以Bedrock上的大部分流量都跑在Trainium上,我们和Anthropic、OpenAI都有很好的合作,让他们在Trainium上构建,还有一些较小的初创公司。

So most of the majority of traffic on Bedrock all runs on Trainium, and we have great deals with both Anthropic and OpenAI to build on top of Trainium, as well as a set of smaller startups.

Speaker 0

我觉得现在大概有六到十二家初创公司在Trainium上开发。

And I think we have half a dozen to a dozen startups that are building on top of Trainium now, too.

Speaker 0

而且——

And-

Speaker 1

所以从名字上看,这是一个训练芯片。

So now the name suggests it's a training chip.

Speaker 0

对,我们不太擅长——

Yeah, we're bad at-

Speaker 1

但大家也都用它来做推理。

But everybody's using it for inference, too.

Speaker 1

那在架构上,它的优势在哪里?

So where is the lean architecturally-

Speaker 1

……那它未来的发展方向是什么?

... and where is it going?

Speaker 0

这个问题问得好。

It's a good point.

Speaker 0

说实话,我们对自己挺苛刻的,我们起名字真的很差,这不是我们的强项。

Look, the vocally self-critical, we're terrible at naming, and so it's not our strength.

Speaker 0

最初,我们有一款芯片叫Inferentia,是用于推理的——

Originally, we had a chip called Inferentia for inference-

Speaker 0

……而Trainium是用于训练的。

... and Trainium for training.

Speaker 0

后来模型越来越大,结果发现你其实需要在这些超大型系统上运行推理,结果就是——

And then as the models got bigger and bigger, and it turns out you actually want to run the inference on these really large systems, it turns out that-

Speaker 1

而且训练也需要推理。

And training requires inference

Speaker 0

……Trainium现在可能是市场上最好的推理芯片了——

... Trainium is actually maybe the best inference chip on the market right now-

Speaker 0

……

...

Speaker 0

从绝对性能和性价比的角度来看。

from a absolute performance and cost performance point of view.

Speaker 0

所以——

And so-

Speaker 1

是内存更好,还是内存带宽更好?

Is it a better memory, memory bandwidth?

Speaker 1

优势在哪里?

Where is the wins coming from?

Speaker 0

有很多方面。

A bunch.

Speaker 0

只是架构有点不同——

It's just the architecture is a little bit different-

Speaker 1

好的

Okay

Speaker 0

比其他产品要好,而且便宜得多。

... than others, and it's much cheaper.

Speaker 0

所以从性价比和绝对性能的角度来看,Trainium 非常出色。

And so from a cost performance perspective and absolute performance perspective, Trainium is great.

Speaker 0

所以我们大量使用它进行推理,而且正如我所说,Bedrock 今天的很多推理都是由它驱动的。

And so we use it a ton for inference and as I said, Bedrock, it drives much of the Bedrock inference today.

Speaker 0

但它也是一个很好的训练芯片,我认为我们很多广泛的客户使用它并不是为了训练模型,而是为了使用它。

But it's also a good training chip too, and I think a lot of our broad set of customers' usage is not in training models, but is in using it.

Speaker 0

所以很多人是在幕后使用它,这也是我们对它感到兴奋的地方。

And so that's where a lot of people get to use it under the covers, and that's where we're excited about it.

Speaker 0

但很多大客户也对它用于训练集群感兴趣,尤其是随着我们发布的 Trainium 3 和 4。

But a lot of the big customers are interested in it for training clusters as well, and particularly as you get to Trainium 3 and 4, which we've announced.

Speaker 0

我们还没有推出 Trainium 4,但已经发布了。

We haven't launched Trainium 4 yet, but announced it.

Speaker 0

人们看了这个架构后说:'是的,这也是我希望我的训练集群未来所在的地方。'

Folks have kind of looked at that architecture and said, "Yeah, that's the future of where I want my training clusters to be as well."

Speaker 0

所以我们对未来非常兴奋,尤其是这些超大规模的训练集群。

So we're quite excited about the future, where that goes for these really broad scale-

Speaker 0

训练集群也是。

... training clusters also.

Speaker 0

对,两者都有。

But yeah, it's both.

Speaker 1

现在,我们回到智能体的话题,但从大型企业的角度来看。

Now, let's get back to talking about agents, but from a perspective of large enterprises-

Speaker 1

或者大型中型企业。

... or large medium enterprises.

Speaker 1

他们在采用方面处于什么阶段?

Where are they in their adoption?

Speaker 1

你已经看到他们获得了哪些好处?

And what sort of benefits are you seeing them reap already?

Speaker 1

从你的角度来看,他们的路线图是什么?

And what is the roadmap for them as far as you can tell from your vantage point?

Speaker 0

这个问题问得真好。

It's a really good question.

Speaker 0

我觉得这个问题我们花了很多时间思考。

I think it's one that we've spent a lot of time thinking about.

Speaker 0

而且我跟客户们聊天的时候,他们现在从已经做的事情里收获了很多价值。

And when I talk to customers all out there, today, they're getting a lot of value out of what they've done today.

Speaker 0

我想说,大多数企业构建的代理相对简单直接,他们开始考虑——而且这些代理大多不是自主的,对吧?

And I would say the agents that most enterprises have built are relatively simple and straightforward, and they're starting to think about-- And they're mostly non-autonomous, right?

Speaker 0

它们还是需要人在里面参与,可以这么说。

They're still kind of people in the loop, if you will.

Speaker 0

顺便说一句,客户现在仍然从中获得很多价值。

And by the way, customers are still getting lots of value out of that today.

Speaker 0

所以他们真正在思考的是,怎么让这些代理自主运行,但又要安全。

And so they're really thinking about, how do I have these be autonomous, but in a safe way?

Speaker 0

我觉得有两件事现在阻碍了客户继续扩大规模。

And I think there's two things that I think hold customers back today from just continuing to scale.

Speaker 0

现在这已经是一门不小的业务了,但我认为它还有巨大的机会,真正改变每一个客户和每一个工作流程,这确实值得深思。

And it's already a pretty big business today, but I think it has a massive opportunity to really change every single customer out there and every single workflow and really thinking about it.

Speaker 0

所以第一点就是怎么去思考这个问题。

And so number one is just how to think about it.

Speaker 0

我觉得我们最初看到的是,企业有一个工作流程,然后他们说:‘太好了,我可以让一个代理去执行同样的流程。’

I think what we originally saw was that enterprises had a workflow, and they're saying, "Great, I would have an agent go do the same workflow."

Speaker 0

而我们真正鼓励他们做的是,不要只是复制鲍勃做第一步、第二步、第三步、第四步、第五步,然后代理也做第一步到第五步,最后鲍勃再检查一遍。

And what we encourage them to really do is think, not just replicate Bob does step one, two, three, four, five, so agent is going to do step one, two, three, four, five, and then Bob's going to check it at the end.

Speaker 0

这其实不是你想要的模式。

That's not really the model you want.

Speaker 0

你应该退一步想:‘如果我想完成某件事,代理怎么能用不同的方式去做?’

You want to actually step back and say, "If I want to accomplish something, how can an agent do it differently?"

Speaker 0

它可以大规模并行处理。

It can do it in a massively parallelized way.

Speaker 0

它可以尝试50种不同的方法,然后达到目标。

It can try 50 different things and get to that.

Speaker 0

那你如何帮助它达到那个正确的结果,并且重新思考计算机解决问题的方式,而不是像人类那样解决问题呢?

And how do you help it get to that right outcome and rethink how a computer would solve a problem versus a human solving a problem?

Speaker 0

所以其中一件事就是我们帮助客户理解如何思考这个问题,真正地拥有那种空白画布,因为那才是你真正获得价值的地方——不是仅仅复制你目前在做的事情,而是从全新的角度思考如何以完全不同的方式解决问题。

And so one of the things is us just helping customers understand how to think about that and really kind of have that blank slate, because that's where you really get value, is not just replicating what you're doing today, but thinking from a greenfield approach about how you go solve a problem completely differently.

Speaker 0

我相信你们很多初创公司也是这么想的。

And I'm sure that's how many of your startups are thinking about this, too.

Speaker 0

你们如何帮助客户从零开始解决问题,而不是复制现有的流程?

How do you help customers greenfield solve a problem, not replicate the thing that happens today?

Speaker 0

所以这是第一点。

So that is number one.

Speaker 1

那些运营着大量代理和代理集群的人,不管你怎么称呼它们——

People running fleets of agents and swarms or whatever you want to call them-

Speaker 1

……现在非常普遍。

... very common these days.

Speaker 0

你只需要思考一下。

And you just want to think about it.

Speaker 0

所以企业其实没那么前卫,这又是一个从初创公司学习的地方,你得想办法把它应用到企业环境中,比如保险公司不一定那么前卫,但他们很想知道怎么优化审批流程之类的。

And so enterprises are not as, again, this is one where you learn from the startups and you try to, how do you apply that to an enterprise world where an insurance company is not necessarily as forward-leaning, but they would love to figure out how they can have a better approval workflow or something like that.

Speaker 0

这是第一点。

So that's number one.

Speaker 0

但第二点是,怎么把这些变成完全自动化的流程,以及怎么真正信任这些智能体。

But then the second one is this, how do you turn those into fully autonomous workflows, and how do you actually trust the agents?

Speaker 0

所以我们花了很多时间思考,怎么构建服务,让企业觉得他们的系统是安全的,能信任智能体做决策,有合适的护栏,对数据有正确的权限,不会删掉生产系统,不会犯灾难性的错误。

And so we're spending a lot of time thinking about how do we build services to help enterprises feel like their systems are secure, and that they can trust an agent to make a decision, that they can have the right guardrails, that it can have the right permissions on their data, that it's not going to delete production systems, that it's not going to make tragic mistakes.

Speaker 0

现在,我觉得这种担忧可能正在阻碍人们前进。

And right now, I think that nervousness is probably holding people back.

Speaker 1

对,这影响很大。

Yeah, it's huge.

Speaker 0

顺便说一句,这种担忧可能也是合理的,它阻止了企业直接说:“好吧,放手去干吧。”

Maybe appropriately, by the way, is holding enterprises back from just saying, "Okay, go nuts."

Speaker 0

你当然不希望智能体乱来,不小心删掉生产数据库。

You don't actually want an agent to just go crazy and accidentally delete a production database.

Speaker 0

那可就麻烦了。

That's going to be pretty bad.

Speaker 0

所以这就是我们目前和客户一起积极应对的方式,既要帮他们设计架构,坦白说也要发明新的技术和能力,来帮他们解决这个问题。

And so that's how we're kind of actively working through this with customers on how do we both help them architect and frankly invent new technologies and capabilities that are going to help them solve that problem.

Speaker 0

这也是我认为我们会持续创新的领域之一,我们一定能做到。

And so that is one of the areas where I think we'll continue to innovate, and we'll get there.

Speaker 0

我觉得我们有一些非常好的想法和技术正在酝酿中,真的能帮上忙。

I think we have some really good ideas and some good technologies brewing that I think can really help.

Speaker 1

那企业是不是也在学习怎么做评估系统之类的,来确保智能体不跑偏?

So are enterprises learning how to do eval systems and so on and so forth to keep the agents on the straight and narrow?

Speaker 0

他们需要帮助。

They need help.

Speaker 0

说实话,评估是一方面,怎么建立一个持续的测试循环?

Honestly, both evals, how do you have a constant loop of testing?

Speaker 0

怎么考虑目标导向——

How do you think about goal seeking-

Speaker 1

这是一个新的软件初创公司。

This is a new software startup

Speaker 0

……以一种合理的方式?

... in a reasonable way?

Speaker 0

你怎么给数据打标签,才能让评估系统真正合理地模拟你在生产环境中的操作?

How do you have your data labeled in such a way that it actually even makes sense that the eval can actually kind of approximate what you're going to be doing in production?

Speaker 0

你怎么在生产环境中进行测量和回测,以确保没有出现漂移?

How do you measure in production and back test it so you're not seeing drift?

Speaker 0

所有这些问题都是企业目前不知道如何解决的。

All of those things are problems that enterprise don't know how to solve today.

Speaker 0

实际上——

Actually-

Speaker 1

当然。

Sure

Speaker 0

……

...

Speaker 0

我不知道现在是不是真的有人能把这些事情做得很好。

I don't know if anyone really is great at solving these today.

Speaker 0

这就是为什么你会看到那么多FDE团队冒出来,AWS也是,我们的合作伙伴也在大力推动FDE,去帮助客户,而这是客户最需要帮助的领域。

It's why you've seen so many FDE teams kind of spin up, and AWS is, and our partners are really leaning into the FDE motion to go and help, and this is the single biggest area where customers need help.

Speaker 0

当我们考虑如何……

And when we think about how you...

Speaker 0

我的看法是,我们希望培训我们的客户,让他们能够自己去做这些事情。

And my view is we want to train our customers to be able to go and do this themselves.

Speaker 0

这不是传统的模式,不是那种靠人力驱动的业务,永远持续下去,你不停地付钱给顾问——

This is not the traditional motion where I want to have a people-driven business that goes on forever, where you just keep paying consultants-

Speaker 0

一次又一次地付钱。

... over and over and over again.

Speaker 0

我们对FDE应该怎么运作的看法是,我们希望进入一个准备好真正接受在项目结束后自己接手这些工作的客户,在45天内,我们教他们如何做评估,教他们如何以有标签的方式整理数据,和他们一起工作,然后在45天结束时,我们离开,那个客户已经准备好,训练有素,可以自己继续了。

Our view on how FDE should work and is, we want to go into a customer who's ready to really kind of accept owning this when we're done, and in 45 days, do work where we can teach them how to make an eval, teach them how to get their data in a labeled way, do work alongside with them, and then at the end of 45 days, you leave, and that customer is good and ready to go and trained up.

Speaker 0

而这就是我们的客户告诉我们的,他们想要的。

And that's what our customers tell us they want.

Speaker 0

他们不想在未来五年里依赖外部劳动力。

They don't want to be beholden to an external workforce for the next five years.

Speaker 0

但他们现在就需要帮助。

But they need help today.

Speaker 1

你在FDE上投入了巨资。

You've made a massive investment in FDEs.

Speaker 1

再进一步说,你的一些同行说过:“你看,你不能把所有数据都放进一个大型前沿模型里。

So taking that even one step further, some of your industry peers have said, "Look, you can't have all of your data going into a big frontier model.

Speaker 1

企业真正应该做的是采用开源模型,然后用自己的数据、工作流程和术语等进行后训练。”

What enterprises should really do is to take an open source model and then post train on your own data and workflows and phrases and whatnot."

Speaker 1

你对此怎么看?

Where do you stand on that?

Speaker 1

你看到客户真的在尝试这样做吗?

Are you seeing customers actually trying to do that?

Speaker 0

是的。

Yep.

Speaker 1

或者你们——

Or do you guys-

Speaker 0

嗯。

Well.

Speaker 1

你们怎么看这个问题?

How do you think about that?

Speaker 0

第一点,我完全同意。

The first point, I wholeheartedly agree on that first point.

Speaker 0

企业数据是他们最宝贵的资产。

Enterprise data is their most valuable asset.

Speaker 0

所以从一开始,我们就是这样构建Bedrock的。

And so from the very beginning, it's why we built Bedrock like we did.

Speaker 0

我们保证你的数据永远不会离开你的VPC。

We have a guarantee that your data never leaves your VPC.

Speaker 0

所以如果你在Bedrock内部运行,你的数据不会回到模型提供商那里。

And so if you're running inside of Bedrock, your data doesn't go back to the model providers.

Speaker 1

不会。

No.

Speaker 0

他们根本看不到你的提示词。

They never see your prompts.

Speaker 0

这些信息都保留在你自己的可信环境里。

That stays inside of your own trusted environment.

Speaker 0

所以企业才倾向于在 Bedrock 上运行,这也是为什么你看到它的业务增长得那么快,规模达到了数百甚至更多。

And so that is why enterprises kind of run, they prefer to run on top of Bedrock, and it's why you see that business growing massively, like hundreds and hundreds.

Speaker 0

每个月我们都能看到业务增长,几乎每周都能感受到业务在爆发式扩张。

Every month, we see that business, just every week, we see that business exploding.

Speaker 0

这也是为什么你会看到 OpenAI 的工作负载迁移到 Bedrock 上。

And it's why you see open AI workloads migrating to Bedrock.

Speaker 0

这也是 Anthropic 之所以能迅速崛起的原因。

It's why you see Anthropic really growing really rapidly.

Speaker 0

所以不管你是用开源模型还是闭源的前沿模型,据我们的客户反馈,Bedrock 都是一个很棒的解决方案。

And so whether you're using open models or closed frontier models, I think Bedrock is a great solution that our customers told us.

Speaker 0

顺便说一句,你还记得吗,三年前我承受了很多压力。

By the way, if you remember, three years ago, I got a lot of heat.

Speaker 1

说到名字不好听,不过这个名字其实挺好的。

Speaking of bad names, that's a good name, though.

Speaker 0

对,Bedrock是个好名字。

Yeah, Bedrock is a good name.

Speaker 0

确实不错。

That's good.

Speaker 0

但当时我们确实因为进入AI领域比较慢而受到了很多批评——

But we got a lot of heat, actually, for being slow to the AI world-

Speaker 1

是的

Yes

Speaker 0

……因为我们当时是在打基础,我们说:“听着,我们不会急着推出一个服务。

... because we actually built the foundations of this where we said, "Look, we're not just going to rush out a service.

Speaker 0

我们真的想好好考虑如何保护客户的数据,并且打造一个我们认为能够持久满足已知应用场景的服务。”

We really want to think about how do we make sure that we protect our customers' data and build a service that we think is going to be durable for the use cases that we knew about."

Speaker 0

你还记得吗,我们当时承受了很多压力,我们说:'我们要去构建正确的东西。'

And if you remember, we got a lot of heat, and we said, "Look, we're going to go build the right thing."

Speaker 0

现在,当人们从概念验证转向生产环境时,绝大多数都落在了AWS的Bedrock上。

And now, as people move from proof of concepts to production, vast majority of them are landing in AWS on Bedrock.

Speaker 0

其中一个原因就是这个。

One of the reasons is because of this.

Speaker 0

还有就是因为我们的服务组合。

It's also because of the set of services that we have.

Speaker 0

我们也提供开源模型。

We also offer open models.

Speaker 0

我们也提供专有模型。

We offer proprietary models.

Speaker 0

我们围绕这些模型提供了一整套能力。

We offer a whole set of capabilities around those.

Speaker 0

Agent core,我们构建了这些积木,这样你就可以更容易地用你想要的任何模型来构建代理,不管它们是在Bedrock内还是Bedrock外。

Agent core, we build these building blocks, so it's easier to build agents with any of the models that you want, whether they're in Bedrock or out of Bedrock-

Speaker 0

……就这一点来说。

... for that matter.

Speaker 0

你可以用Gemini或者其他工具来做这件事。

You can use Gemini or other things for it.

Speaker 0

但我觉得这对我们来说是一个差异化优势,而且这是一个非常重要的问题,因为如果数据回流到模型提供商那里,我认为那是一件危险的事情。

But I think it's a differentiating piece for us, and it's a super important thing to think about because having that data go back into the model provider, I think is a dangerous thing.

Speaker 0

不过你提到了开放权重模型。

You talk about open weights models, though.

Speaker 0

我确实认为有一个让我很兴奋的场景,那就是我们正在大力加强对开放权重模型的支持,努力打造一个良好的环境。

I do think that there's a scenario that I'm excited about, where we're really ramping up our support of open weights models and trying to build a good environment.

Speaker 0

而且说实话,现在很多客户都认为他们拥有重要的专有数据,如果他们……

And frankly, this is where today, and I think it's true, a lot of customers believe that they have meaningful proprietary data, that if they-

Speaker 0

……能够把这些数据混合进去,进行一些后训练,对开放权重模型进行微调,然后进行蒸馏,他们实际上可以获得性能更好、价格更低的模型。

... could mix in, do some post-training, do some fine-tuning to an open weights model that they could distill down, they can actually get a better performing model at a lower price.

Speaker 0

这里面有很多环节需要顺利推进。

There's a bunch of pieces in here that have to work out well.

Speaker 0

他们确实有很好的评估来证明这一点。

They actually have a good eval to actually prove that that's true.

Speaker 0

现在大多数人都在SageMaker上做这个。

Most people are doing that in SageMaker today.

Speaker 0

我觉得我们还可以做更多,让这个过程更简单。

I think there's more that we can do to make that easier.

Speaker 0

但如果你去看看人们在哪里做这个,他们现在确实是在AWS的SageMaker上做的。

But actually, if you go look at where are people doing that, they actually do it in SageMaker on AWS today.

Speaker 1

哦,真的吗?

Oh, really?

Speaker 1

好的。

Okay.

Speaker 0

而且他们实际上是通过SageMaker来托管推理的。

And they actually host the inference via SageMaker.

Speaker 1

SageMaker作为……正在获得新的生命力。

SageMaker is getting a new lease of life as a-

Speaker 0

它一直是个模型构建平台。

It was always kind of a model-building platform.

Speaker 0

现在,想想企业在做什么,他们基本上就是在构建自己的定制模型。

And now, if you think about what enterprises are doing in this world, that's what they're doing, is they're basically effectively building their own custom models.

Speaker 0

所以,这就是……

And so that is-

Speaker 0

……SageMaker 是个很好的地方来做这件事。

... SageMaker is a great place of doing that.

Speaker 0

我觉得我们还需要继续开发一些功能,让它变得越来越容易,并且能在不同的开放权重模型上进行测试,等等。

And I think there's some things that we need to keep building on to make that easier and easier to do, and to test across different open weights models, things like that.

Speaker 0

但这是一个不断发展的领域,我觉得非常有意思,我们想确保客户如果有合适的数据和专业知识,能够拥有所有必要的工具去走这条路。

But it's an evolving space, and I think it's a super interesting one, and it's one we want to make sure that we have all the right things for customers to be able to do if they have the right data and expertise to actually go down that path.

Speaker 1

而且,关于 AI 扩展风险的各种争论,还有安全问题……

And with all the debate around AI extension risks and this, that, and the other, and the security-

Speaker 1

……

...

Speaker 1

漏洞什么的,还有Hugging Face被攻击的事,企业高管们都在问你些什么?

vulnerabilities and so on and so forth, and the Hugging Face attack, how are enterprise, what are CEOs asking you about all these things?

Speaker 0

问的挺多的。

There's a bunch.

Speaker 0

你看,他们主要想说的是——

And look, they mostly want to say-

Speaker 1

当然,我该——

And of course, what should I-

Speaker 0

这又回到那个问题,比如我部署智能体的时候,怎么才能相信它们会按我的要求去做?

And it goes back to this, like when I launch agents, how can I trust that they're going to do what I want them to do?

Speaker 0

所以我们越来越——其实我们一直在做——

And so we're increasingly, we have been for a while.

Speaker 0

我们基本上在大力投资,开发一些功能,让人们能安全地把智能体部署到他们的环境里,并且考虑那些控制措施。

We're basically Heavily investing in building capabilities that allow people to deploy agents safely into their environment and think about those controls.

Speaker 0

其中一些就是,怎么确保智能体有正确的权限?

And some of those are, how do you make sure the agents have the right permissions?

Speaker 0

他们怎么才能有正确的沙箱环境?

How do they have the right sandboxing?

Speaker 0

你怎么确保有合适的防护措施?

How do you make sure that you have the right set of guardrails?

Speaker 0

你怎么真正有意识地思考你希望代理做什么、不做什么?

How do you really intentionally think about what you want the agents to do and not do?

Speaker 0

有没有人在流程中参与,还是完全自动化?

Is there a human in the loop or not?

Speaker 0

所以我们花了很多时间和客户一起思考,如何安全地部署代理,并随着时间不断改进,以及我们还需要开发哪些能力来帮助人们安全地在他们的环境中部署代理。

And so we spend a lot of time with our customers thinking about how do you think about safe agent deployment and get better over time and, what other capabilities do we need to go build to help people deploy agents safely into their environment?

Speaker 0

所以这方面有很多内容。

So there's a lot there.

Speaker 0

另一个很多人担心的角度是,这些非常强大的模型会不会成为攻击面,以及某种意义上的威胁领域。

The other angle on that, which a lot of people are worried about, which is just, are some of these really powerful models going to be, attack surfaces and kind of mythosphere.

Speaker 0

所以我的看法是——是的,我认为这对客户环境来说确实是一个风险,但也是一个真正的机会。

And so I kind of have a view on they're-- Yes, that is a real risk, I think, to customer environments, but it's also a real opportunity.

Speaker 0

所以我们最近推出了一项叫 Continuum 的服务,利用这些强大的模型来帮助客户保护他们的环境安全。

And so we recently launched a service called Continuum that uses these powerful models to help customers go secure their environment.

Speaker 0

我们会全面检查他们的环境,和他们一起寻找漏洞。

And so we'll look across their environment, look for vulnerabilities with them.

Speaker 0

我们会利用这些强大的模型,帮助客户发现他们之前没有发现的漏洞。

We'll use some of these powerful models and help customers find vulnerabilities they haven't found before.

Speaker 0

而且最重要的是,我们会帮他们确定哪些漏洞需要优先处理,因为我们了解他们环境的上下文,知道环境是怎么设置的,权限在哪里,以及哪些地方可能有补偿性控制措施,这些都会影响修复的难易程度。

And most importantly, by the way, prioritize which ones, because we know context about their environment, how it's set up, where their permissions are, where they may have compensating controls that make it harder or easier to do.

Speaker 0

所以 Continuum 在客户中非常受欢迎。

And so Continuum is incredibly popular with customers.

Speaker 0

实际上,我们对 AI 在安全领域的应用前景非常乐观。

Actually, we're really bullish about what's possible from AI to help with AI-powered security.

Speaker 0

因为你看,总有一天,客户需要的是机器速度的安全响应,而不是人类速度,也不是像警报那样——

Because look, at some point, customers are going to need security at machine speed, not at human speed, not at like an alarm-

Speaker 0

……有人进去查看一下。

... someone goes in, look at it.

Speaker 0

所以我们正在加紧努力,帮客户构建这样的解决方案,保护他们的环境。

And so that, we're running fast to go help build that for customers to help them protect their environments.

Speaker 0

而且我对Continuum团队在这方面的工作也感到非常兴奋。

And I'm very excited about what the Continuum team is building on that front too.

Speaker 1

那么在AWS内部——

So within AWS itself-

Speaker 1

……

...

Speaker 1

代理在更广泛的——

what's the state of usage of agents in the broader-

Speaker 1

……模型中,使用情况是怎样的?

... model?

Speaker 0

Continuum基本上就是我们尝试把内部的做法对外展示出来。

Continuum is basically us trying to expose what we do internally.

Speaker 1

好的。

Okay.

Speaker 0

所以我们广泛使用AI来保障我们自己的安全。

And so we use AI extensively for our own security.

Speaker 0

我们也广泛使用AI来辅助我们自己的软件开发。

We use AI extensively for our own software development.

Speaker 0

我们使用智能体。

We use agents.

Speaker 0

实际上,有一件非常酷的事情是,我们在整个业务中都使用了智能体。

Actually, one of the things that's really cool is we use agents across our entire business.

Speaker 0

我们把Amazon Quick推广给了每一位亚马逊员工,现在我看到人力资源团队在构建智能体,用来处理那些过去需要团队花几周才能完成的工作,现在一个人几小时就能搞定,比如团队规划和资源管理。

And so we rolled out Amazon Quick to every single Amazon employee, and now I see HR teams building agents to help drive what used to take teams of people weeks to do that a single person can now do in a couple of hours to think about team planning and-

Speaker 0

……以及资源管理。

... and resource management.

Speaker 0

我的财务团队也在构建智能体,用来从各处收集税务规则,确保我们在很多方面都合规。看到过去被软件开发人员卡住的事情,现在业务人员能够自己解决并更快地创新,这真的很棒。

I have finance teams that are building agents to go think about how do they go pull tax rules from everywhere and ensure that we have compliance on a bunch of different pieces and super cool to see that things that used to be blocked by software developers-

Speaker 0

……实际上,业务人员能够自己解决问题,更快地创新。

... actually the line of business folks are able to go and unblock themselves and innovate more quickly.

Speaker 0

所以Quick取得了巨大的成功。

And so Quick has been an enormous blow.

Speaker 0

而且它像野火一样迅速蔓延。

And that has grown like wildfire.

Speaker 0

我们看到从小型初创公司到全球最大的企业,都在使用它,并将其推广到整个客户群,以便能够访问所有企业数据,轻松应用代理和功能来加速工作。

We see customers like small startups using it all the way to the largest enterprises in the world, rolling it out to their entire customer base to get the benefit of kind of being able to access all of your enterprise data and easily apply agents and capabilities to help you accelerate your jobs.

Speaker 0

所以,就像我说的,我们在从软件开发到安全,再到人力资源政策等各个方面都在使用它。

And so, like I said, we use it across everything from software development to security to driving HR policies.

Speaker 1

你们以衡量一切而闻名,

You guys are notorious for measuring everything

Speaker 1

关于你们的运营。

... about your operation.

Speaker 1

你们在哪些方面看到了最大的收益?

Where have you seen the biggest gains?

Speaker 0

是的,这个——

Yeah, it's-

Speaker 1

显然,软件开发方面——

Obviously software development-

Speaker 0

你知道答案的,就是软件开发。

You know the answer, software development.

Speaker 0

真正的答案就是——

That's the real answer is-

Speaker 1

但只是它的衍生方面。

But just the derivatives of that.

Speaker 0

对,没错。

But yeah.

Speaker 0

软件开发的速度,实际上整个产品开发,不仅仅是编码,而是——

The speed of software development has been, and really product development as a whole, not just coding, but just-

Speaker 1

所以你看到了实际的——

So you've seen actual-

Speaker 0

当然。

Absolutely.

Speaker 1

新产品的推出速度是不是真的加快了?

... pick up in the velocity of new products?

Speaker 0

我们现在推出新产品的速度,跟过去相比,简直是天壤之别。

The pace at which we're deploying new products is massively different than it has been in the past.

Speaker 0

我觉得这一点从AWS就能看出来,它一直以快速推出新功能而闻名。

I think you can see this where AWS has always been known for rolling out features really quickly.

Speaker 1

对,那当然。

Yeah, of course.

Speaker 0

而且最近一年左右,我们更是加足了马力,因为我们组建了所谓的“前沿团队”,他们专注于智能体开发,而不是传统的开发方式。

And we've seen a turbo boost on that in the last year or so as we've get, we call them frontier teams, as they think about agentic development as opposed to kind of traditional development.

Speaker 0

这不只是代码补全。

And it's not code completion.

Speaker 0

这真的是智能体优先。

It really is agent first.

Speaker 0

所有代码都是由智能体来写的。

The agents write all of the code.

Speaker 0

你只需要管理一个代理团队,推动他们前进。

You're just managing a team of agents and driving that.

Speaker 0

看到为客户带来的创新速度如此之快,真是令人兴奋,而且必须如此,因为这就是——

And it's been fun to see the pace at which innovations for customers has been massive, and it has to be, because that's the-

Speaker 1

这就是承诺。

That's the promise

Speaker 0

我们的客户对新功能几乎有着无止境的渴望,而且——

... our customers out there have an almost insatiable appetite for new capabilities, and-

Speaker 0

这就是我们必须做到的。

... that's what we've got to do.

Speaker 1

那么从组织层面来看,你对组织应该如何变革有什么见解吗?

So organizationally, do you have any insights on how organizations should change and how-

Speaker 0

我没有。

I don't.

Speaker 0

我想说的是——

I'll say that-

Speaker 1

是智能体管人,还是人管智能体?

Should agents manage people, people manage agents?

Speaker 0

会有——

There's going to be-

Speaker 1

两种都有?

Both ways?

Speaker 0

在很长一段时间内,会有很多人参与其中。

... there's going to be lots of people for a long period of time.

Speaker 0

我确实认为组织会发生变化。

I do think organizations will change.

Speaker 0

我还没有找到完美的答案。

I don't know the magic answer yet.

Speaker 0

但我们正在积极思考这个问题。

But we're actively thinking about it.

Speaker 1

那你们内部是在尝试各种实验,还是怎么做的?

But inside you're just trying various experiments, or what are you doing?

关于 Bayt 播客

Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。

继续浏览更多播客