The a16z Show - 微软副首席信息安全官谈AI代理的安全保障 封面

微软副首席信息安全官谈AI代理的安全保障

Microsoft's Deputy CISO on Securing AI Agents

本集简介

a16z 的 Joel De La Garza 与微软游戏公司副首席信息安全官(Deputy CISO)Aaron Zollman 携手,探讨安全团队如何在拥抱 AI 智能体的同时保持控制权。 Aaron 分享了微软在使用 OpenClaw 方面的经验:从最初的本能反应是禁止使用,到后来探索如何确保其安全使用。他们深入剖析了智能体对身份认证、权限管理、容器化和监控的影响,以及 AI 如何将 CISO 的角色从一味说“不”转变为安全地推动新技术落地。 他们还探讨了 AI 是否能够帮助防御者在漏洞被发现的同时迅速进行修补,以及为什么新的 AI 威胁并不会让旧有的安全问题消失。 保持关注: 在 YouTube 上找到 a16z:YouTube 在 X 上找到 a16z 在 LinkedIn 上找到 a16z 在 Spotify 上收听 a16z Show 在 Apple Podcasts 上收听 a16z Show 关注我们的主持人:https://twitter.com/eriktorenberg 请注意,此处内容仅供信息参考;不应被视为法律、商业、税务或投资建议,也不应用于评估任何投资或证券;且并非针对 a16z 旗下任何基金的投资者或潜在投资者。a16z 及其关联公司可能持有文中提及公司的投资。更多详情请参阅 a16z.com/disclosures。 由 Simplecast 制作,AdsWizz 旗下公司。有关我们收集和使用个人数据用于广告的信息,请访问 pcm.adswizz.com。

双语字幕

仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。

Speaker 0

头条新闻一直是AI模型很开心。

The top story has been that the AI models are happy.

Speaker 0

这些模型在互联网上活动,测试了好几个组织的安全性。

The models went out under the the Internet and tested the security of several organizations.

Speaker 0

这值得害怕吗?

Is it something to be scared of?

Speaker 0

是的。

Yes.

Speaker 0

那是不是该举手投降、担心一下?

Is it something to throw up your hands and worry about?

Speaker 0

不。

No.

Speaker 0

这些事情你以前都做过。

You've done all of these things before.

Speaker 0

我们已经创造了容器化和工厂化。

We have created containerization and factories.

Speaker 0

我们已经用漏洞保护了应用程序。

We have secured applications with vulnerabilities.

Speaker 0

这些代理的特性,它们是不可预测的。

The qualities of these agents, they're unpredictable.

Speaker 0

它们是不理性的。

They're irrational.

Speaker 0

它们容易突然发作。

They're prone to lashing out.

Speaker 0

当你逐一审视这些特点时,你会觉得,天哪,这听起来就像实习生。

And as you go through this list, you arrive at the point where you're like, Jesus, these sound like interns.

Speaker 1

如果你一开始就想,哦,好吧,它就会像我一样运行。

If you just start with, oh, well, it's just gonna run as me.

Speaker 1

那结果会很糟糕。

That's gonna end poorly.

Speaker 1

是的。

Yes.

Speaker 1

你得回到基本原理,但还得再深入一点,重新定义容器化对你来说到底意味着什么。

You're going back to first principles, but you also have to go even a little deeper and start to redefine what does containerization even mean for you.

Speaker 0

问题从来不是CISO不知道系统有问题。

The issue was never that the CISO didn't know it was broken.

Speaker 0

当CISO难就难在知道该修什么,因为你只有有限的资源,也就是程序员,而现在看来,这个资源似乎也不够了。

The issue and the difficult part of being a CISO was knowing what to fix Because you had a finite resource, which was a programmer, and now that seems that the math is gone.

Speaker 1

我们离NASA供应链事件只有三周了,但是等等。

We were only three weeks out from NASA supply chain chain, but Wait.

Speaker 0

那个大规模供应链事件是什么?

What's the massive supply chain thing?

Speaker 1

哦,

Oh,

Speaker 2

天哪。

man.

Speaker 2

当它第一次出现在微软内部时,安全团队的反应很熟悉。

When first appeared inside Microsoft, the security team's reaction was familiar.

Speaker 2

我们怎么禁止这个?

How do we ban this?

Speaker 2

结果下一个问题才是更重要的。

The next question turned out to be much more important.

Speaker 2

我们怎么让它跑起来?

How do we make it work?

Speaker 2

本期节目来自黑帽大会,a16z的乔尔·德拉加尔萨与微软游戏部门副首席信息安全官亚伦·佐尔曼坐下来聊了聊如何保护那些能访问数据、使用工具、写代码、替员工办事的AI智能体。

In this episode from Black Hat, a16z's Joel De La Garza sits down with Microsoft Gaming Deputy CISO Aaron Zollman to talk about securing AI agents that can access data, use tools, write code, and act on behalf of employees.

Speaker 2

他们讨论了为什么智能体需要有自己的身份,当模型能找到意想不到的路径连上互联网时,“物理隔离”到底意味着什么,以及为什么保护新一代软件既需要新的控制手段,也需要一些非常传统的基础安全知识。

They discuss why agents need their own identities, what air gapped means when a model can find unexpected paths to the Internet, and why securing this new generation of software requires both new controls and some very old security fundamentals.

Speaker 2

他们还聊到了安全团队内部正在发生的更大变化。

They also explore a bigger shift happening inside security teams.

Speaker 2

随着AI让企业无法忽视,首席信息安全官的工作越来越不只是防范风险,而是要想办法安全地说“行”。

As AI becomes impossible for companies to ignore, the CISO's job is increasingly not just to prevent risk, but to figure out how to safely say yes.

Speaker 0

今天我们请到了微软的亚伦·佐尔曼,他是那边的副首席安全官,负责的事情可不少。

So today, we've got Aaron Zollman from Microsoft, the deputy CISO over there responsible for a whole lot of different things.

Speaker 0

而且你一直处在最前沿,像所有人一样,我想,现在大家都在应对AI在环境中的部署。

And you've been at the forefront, like everyone, I guess, at this point, dealing with AI AI rollout into an environment.

Speaker 0

而且你所在的公司可能比大多数公司更深入地拥抱AI,每个人都在积极拥抱。非常感谢你加入我们。

And you're probably at a company that's leaning in a lot more to AI than probably most companies, and everybody's So leaning in thank you so much for joining.

Speaker 0

我们想聊聊过去几周,有趣的是,几周感觉就像狗年一样,对吧?

We'd love to talk The last couple weeks It's funny, it's like weeks have become like dog years, right?

Speaker 0

就像每周都相当于旧世界的七周。

It's like every week is seven weeks in old world time.

Speaker 0

过去几周,头条新闻一直聚焦在AI模型被黑客攻击上。

The last couple of weeks have been very focused on the top story has been that the AI models are hacking.

Speaker 0

我们看到OpenAI披露说他们在做红队测试,但实际上,就在十五分钟前,又有新的披露说这些事件基本上都是因为一次红队演练,有人正在测试这些模型。

And we saw there was a disclosure from OpenAI that they were doing a red team Well, actually, turns out now, just fifteen minutes ago, there was another disclosure that these have all essentially happened because there was a red team exercise where someone was testing the models.

Speaker 0

所以他们说,嘿,模型,你处在一个封闭环境中。

So they were saying, Hey, model, you're in this closed environment.

Speaker 0

我们需要你去测试这个组织的安全性。

We need you to go test the security of this organization.

Speaker 0

结果发现那个环境并不是封闭的,所以模型就跑到了互联网上,测试了好几个组织的安全性。

And it turned out that the environment wasn't closed, and so the models went out under the internet and tested the security of several organizations.

Speaker 0

所以,对于那些没接触过这些东西的人来说,听起来确实挺吓人的。

And so I guess to people who haven't been working with this stuff, it sounds very shocking.

Speaker 0

想想看,本·霍洛维茨今年在RSA大会上做了一个很棒的演讲,讲的是我们在a16z内部用OpenClaw做的一些工作。

Think Ben Horowitz at RSA this year gave a really great talk on some work we had done internally at a16z where we were using OpenClaw.

Speaker 0

我们发现,用OpenClaw的时候,至少对于Opus 4.6来说,那些安全护栏基本上就消失了。

And we found that with OpenClaw, the guardrails, at least for Opus 4.6, kind of disappeared.

Speaker 0

所以,我们好几个人都特别着迷于那些不可能完成的任务。

And so you'd be I think a number of us got really obsessed with impossible tasks.

Speaker 0

就像,嘿,OpenClaw,我想让你帮我做这件事,但这件事没有一条清晰、合法的路径去完成。

So like, Hey, OpenClaw, I want you to do this thing for me, but there's no clear, legitimate path to do it.

Speaker 0

这基本上就像是在说,嘿,迈克,我想让你去给我弄一枚钻戒,但迈克没有信用卡,没有钱,也没有办法筹到钱。

So it's like basically saying, Hey, Mike, I want you to go get me a diamond ring, but Mike has no credit card, no money, no ability to raise money.

Speaker 0

那迈克要是没钱了,他会怎么做呢?

And so what's Mike going to do if he has no more?

Speaker 0

那他就会去抢。

He's going to go rob.

Speaker 0

所以我们注意到,这些模型基本上会不惜一切代价去达成目标。

And so we noticed that these models would essentially basically do anything to achieve their objective.

Speaker 0

然后我们会说,嘿,你能从零开始给这个数据库加个超级用户吗?

And so we'd say things like, Hey, could you add a super user to this database starting from zero?

Speaker 0

它做了什么?

And what did it do?

Speaker 0

它找到了一个SQL注入漏洞,控制了整个SQL数据库,然后添加了一个管理员用户。

It found a SQL injection exploit, it took over the SQL database, and it added an admin user.

Speaker 0

所以现在这个问题越来越受关注了,我知道你在OpenClaw上很活跃,大概两个月前它还是大家最害怕的东西,现在都没人提了。

And so it seems like this is coming more into focus now, and I know you've been very active in OpenClaw, which I think two months ago was the number one thing everyone was afraid of, and now no one talks about it.

Speaker 0

可能六个月前吧,现在好像大家都在用。

Maybe six months ago, and now it seems like everyone's using it.

Speaker 0

我很想听听你的经验,以及你是怎么思考这个问题的,因为这个问题很相似。

Would love to hear maybe your experiences with that and kind of how you thought through that problem because it's a very similar problem.

Speaker 0

我的意思是,

I mean,

Speaker 1

我们一开始确实被它吓到了,对吧,大家都一样。

think we were terrified of it at first, right, as everyone was.

Speaker 1

这东西一下子就火了。

This thing explodes.

Speaker 1

每个人都想一夜之间装上它,而且它没有任何防护措施。

Everyone wants to install it overnight, and it has no guardrails.

Speaker 1

它没有任何防护措施。

It has no guardrails.

Speaker 1

更糟的是,它完全开放远程拉取,什么都能从网上下载,供应链上问题很大。

And worse than that, know, it had fully open remote pull whatever down from the Internet supply chain pain.

Speaker 1

所以我们第一反应就是,我们怎么禁止它?

And so our immediate reaction was how have we banned this?

Speaker 1

然后紧接着的反应就是,等等,大家都想用这个。

And then the immediate reaction after that was, well, wait, everyone wants to do this.

Speaker 1

我们怎么才能找到办法让它运作起来呢?

How do we find a way to make this work?

Speaker 1

对。

Right.

Speaker 1

然后

And then

Speaker 0

产品团队的人看到了,说:其实这里有个非常好的产品。

the product people saw and said, Actually, there's a really great product here.

Speaker 1

是的。

Yeah.

Speaker 1

确实,对吧?

I mean, absolutely, right?

Speaker 1

这里真的有个非常好的产品。

There's a really great product here.

Speaker 1

有基础,有社区,还有那些东西,如果我们能证明可以安全运行,那对大家来说会非常有用。

There's the foundations and the community and the kind of things that if we can show that we can run it safely, then it's gonna be really powerful for people.

Speaker 1

所以这是一个持续数月、跨学科的大工程,就这样启动了。

And so it was this big multi month, multidisciplinary effort that kind of kicked off.

Speaker 1

先透露一下结局,几个月后,OpenClaw 的创始人 Peter Steinberg 和我们一起出现在微软 Build 大会上,谈论我们如何将安全引入这个流程。

And to preview the ending a little bit of it, Peter Steinberg, the founder of OpenClaw, is on stage at Microsoft Build with us a few months later talking about how we're bringing security to the process.

Speaker 1

那么,这件事值得害怕吗?

And so is it something to be scared of?

Speaker 1

是的。

Yes.

Speaker 0

这件事值得让你

Is it something to throw up

Speaker 1

举手投降、忧心忡忡吗?

your hands and worry about?

Speaker 1

不。

No.

Speaker 1

对吧?

Right?

Speaker 1

这些事情我们以前都做过。

We've done all of these things before.

Speaker 1

我们创造了容器化和Docker技术。

We have created containerization and Dockeries.

Speaker 1

我们保护了有漏洞的应用程序。

We have secured applications with vulnerabilities.

Speaker 1

我们建立了企业环境,通过人们想要的各种应用来传递污点和数据保护,也许我们安全人员希望他们不要这些应用。

We have created corporate environments that carry taint and data protection through a number of different applications that people want and that maybe we as security people wish they didn't.

Speaker 1

只是我们必须同时做所有这些事情,而且要快得多。

It's just that we have to do all of those things together and a lot faster.

Speaker 1

所以,是的,我觉得这真的是一个很好的故事。

And so, yeah, I mean, I think it's been a really good story

Speaker 0

关于孤立地思考所有这些部分。

of thinking about all of those pieces in isolation.

Speaker 0

真的很有趣。

It's really interesting.

Speaker 0

如果你往上一层,更抽象地想想这些东西的行为方式,一般大家会叫它们代理,但其实就是一个框架加一个模型,对吧?

If you step up one level and you think through kind of more abstractly the way that these things behave, and I guess generally people would refer to them as agents, but it's like a harness and a model, whatever, right?

Speaker 0

就像番茄和西红柿,一回事。

Like tomato, tomato, potato, whatever.

Speaker 0

这真的很有意思,因为当你做威胁建模,思考怎么保护这些东西的时候,你会开始描述这些代理的特性,然后你会发现,它们是不可预测的。

It's really interesting because as you work through the threat model, as you think about how do we secure these things and protect these things, you start to articulate the qualities of these agents, and you're like, Well, they're unpredictable.

Speaker 0

它们是不理性的。

They're irrational.

Speaker 0

如果不如意,它们很容易发脾气。

They're prone to lashing out if they don't get their way.

Speaker 0

当你列完这些,你会突然觉得,天哪,这听起来就像实习生。

And as you go through this list, you arrive at the point where you're like, Jesus, these sound like interns.

Speaker 0

有点像那种,前一天晚上喝多了,第二天还来上班的实习生。

Sort of like, These sound like interns maybe after they drank a little bit too much the night before and they come into the office.

Speaker 0

有意思的是,我们团队内部一直在开玩笑,我觉得我们其实有很多好工具来管理公司里那些不理性的事情,因为我们平时要跟人打交道,对吧?

And it's funny, internally as a team, we've been joking about, I think we actually have a lot of great tools for managing the risks of things going irrationally inside of a company because we work with humans, right?

Speaker 0

所以我很好奇。

And so I'm curious.

Speaker 0

我越深入了解,越觉得这听起来不像魔法。

It sounds to me, like the more that I double click on this, it doesn't sound like magic.

Speaker 0

听起来你只是在回归基本原理,做好基本功。

It just sounds like you're going back to first principles and basic blocking and tackling.

Speaker 1

嗯,其实不止这些。

Well, it's more than that.

Speaker 1

对吧?

Right?

Speaker 1

确实有一些特别的东西需要做。

There is some special stuff you have to do.

Speaker 1

因为我觉得这些工具之所以这么强大,对吧,故事是这样的:当微软的Scout——也就是我们面向企业的OpenClaw——最初开放内部使用时,采用曲线简直惊人。

Because I think what makes these tools so powerful, right, the story is when Microsoft Scout, which was sort of our, like, OpenClaw for the enterprise, was initially released to internal use, the adoption curve was, like, phenomenal.

Speaker 1

对吧?

Right?

Speaker 1

这真的很有趣,作为安全人员也很有成就感,而且我甚至都不在试点范围内,对吧?

It was really fun, really validating as a security person, and I'm not even on the pilot curve, right?

Speaker 1

那是因为每个人都想用它,而且他们都想用它来连接一切。

And that's because everyone wants to use it, and they all want to use it to connect everything.

Speaker 1

所以我觉得,当你带一个实习生的时候,你的想法是,我会给他们两三个他们需要的东西。但要让OpenClaw scouty发挥最大效用,你得给他们所有东西。

And so I think when you bring in an intern, your perspective is, well, I'm gonna give them two or three things they need But to do their to make OpenClaw scouty, far as effective, you wanna give them everything.

Speaker 1

所以,我确实认为,你是在回归第一性原理,但你还得再深入一点,开始重新定义,比如,容器化对你来说到底意味着什么?

And so I do think, yes, you're going back to first principles, but you also have to go even a little deeper and start to redefine, like, what does containerization even mean for you?

Speaker 0

隔离是什么意思?

What does air gap mean?

Speaker 1

隔离是什么意思?

What does air gap mean?

Speaker 1

什么是身份?

What is an identity?

Speaker 1

因为如果你只是从‘哦,它就作为我来运行’开始。

Because if you just start with, oh, well, it's just gonna run as me.

Speaker 1

它会直接从我的浏览器缓存里拿走我的令牌,然后想干嘛就干嘛,那样肯定得出事。

It's gonna take my token directly from my browser cache and do whatever it wants to do with that token, that's gonna end poorly.

Speaker 1

但如果我能给它一个独立的身份,如果我能描述容器的边界,嗯。

But if I can give it its own identity, if I can describe the bounds of the container Mhmm.

Speaker 1

如果我能把代理、工具、模型或会话的行为绑定起来,对。

If I can tie the actions of the agent or the harness or the model or the session Yeah.

Speaker 1

其实要搞清楚你想绑定什么挺难的,但先不说这个。

Actually quite hard to figure out what you wanna tie to, but put that aside for a moment.

Speaker 1

如果你能把它绑定到一组特定的日志和事物上,那你就能做到基本的防御和应对,这时候你就要考虑,对手有没有机会做这件事,哪怕这个对手就是模型本身。

If you can tie that to a particular set of logs, set of things, then you can get to the place where you are just doing your basic blocking and tackling, where you're thinking about, okay, what is the opportunity for an adversary to do this even if that adversary is the model?

Speaker 1

我怎么监控它?

How can I monitor it?

Speaker 1

我怎么响应它?

How can I respond to it?

Speaker 1

我怎么控制它?

How can I contain it?

Speaker 1

我怎么能推理出潜在的入侵路径呢?

How can I reason about potential breach paths

Speaker 0

然后把它烧掉?

and burn down?

Speaker 0

而且这也挺有意思的,因为如果你想想看,我觉得——虽然我已经不再操作了,谢天谢地——

And it's funny too because if you think about it, I think and I am not operating anymore, thank God.

Speaker 0

但我觉得如果我和我的操作员们一起想想,我觉得这很奇怪,只是我们基本玩了一下OPUS 4.6,在一个我们认为它是云容器的环境里,所以它没有互联网访问权限,但它还是想办法通过Cloudflare挖了一条隧道出去,绕过了我们的控制,然后它开始通过DNS传输数据。

But I think if I think through it with my operators at on, I think that it's a weird just with our basic playing around with OPUS 4.6, in an environment that we thought was it was a cloud container, so it had a policy of no internet access, but it still figured out how to get a tunnel out to Cloudflare, how to get around our controls, and then it started tunneling stuff through DNS.

Speaker 0

这真的让我想起很久以前,当我还在构建高安全环境的时候。

It really reminds me of a long time ago when I was building more high secure environments.

Speaker 0

你总是要过一遍威胁模型清单,就像,攻击者可能做所有这些事情,然后你总是会说,好吧,这里有20件事,但实际上,攻击者可能只有耐心做其中五件,因为我们在现实中见过这些。

You would always have to go through the list threat model, which was like, there's all these things an attacker could do, and you would always be like, Well, there's 20 things here, and realistically, attackers only have the patience for maybe these five because we've seen them in the wild.

Speaker 0

而其他所有事情都可能做,但我们从未真正见过。

And all this other stuff could be done, but we've never really seen it.

Speaker 0

看起来这些模型真的很擅长去尝试那些可能做到的事情。

It just seems like these models are really good about going after the stuff that could be done.

Speaker 0

所以如果原来那五个现在变成了二十个,那你基本上什么都得修。

And so if the list of five now became the list of 20, and you kind of have to fix everything.

Speaker 0

不过话说回来,

To be fair,

Speaker 1

它们通常会先试那些显而易见的方法,这确实给了你一个机会。

they often try the things that are obvious first, which does give you an opportunity.

Speaker 1

就像实习生一样,如果简单的方法能搞定,他们就不会去费劲做难的事。

Like interns, they're not gonna do the hard thing if the easy thing will suffice

Speaker 0

大多数情况下是这样。

in most cases.

Speaker 0

窗户开着的话,谁还会去撬锁呢。

Don't pick the lock if the window's open.

Speaker 0

对吧?

Right?

Speaker 0

没错。

Exactly.

Speaker 1

所以,你知道,这样做的好处是,如果你有良好的监控、日志记录和容器化,你很可能有机会在事情变得一团糟之前做出反应和控制。

And so, you know, the advantage of that is if you have, you know, good monitoring, good logging, good containerization, you will probably have the opportunity to respond, contain, you know, before things go horribly awry.

Speaker 1

但你说得完全对。

But you're absolutely right.

Speaker 1

你知道,有很多敞开的门,我们确实需要回头想想它们是什么。

You know, there are a lot of open doors, and we do have to go back and think about like what are they?

Speaker 1

对。

Yeah.

Speaker 1

你知道,所以这……

You know, so it's

Speaker 0

我们过去接受了很多风险。

We risk accepted a lot of stuff.

Speaker 0

过去几年我们接受了很多风险。

We risk accepted Over the last couple of years.

Speaker 0

那只是个P2级别的问题,你知道吗?

It was just a P2, You know?

Speaker 0

对。

Yeah.

Speaker 0

对。

Yeah.

Speaker 1

对。

Yeah.

Speaker 1

多亏了AI,我的P1问题处理得飞快,但那些P2问题,真是头疼。

I'm burning through my p ones at great speed, thanks to AI, but those p twos, man.

Speaker 1

不。

No.

Speaker 1

但你知道,我觉得这归根结底是要掌控全局。

But, you know, but it it it I think it's based to, you know, the need to to be on top of things.

Speaker 1

对吧?

Right?

Speaker 1

所以这是怎么回事?

So this is what?

Speaker 1

现在应该是星期二了吧?

It's Tuesday now, I think?

Speaker 1

拉斯维加斯时间。

Vegas time.

Speaker 0

拉斯维加斯时间。

Vegas time.

Speaker 0

对。

Yeah.

Speaker 0

那不算数。

It doesn't count.

Speaker 0

可能是星期天。

It could be Sunday.

Speaker 1

完全不知道。

Have no idea.

Speaker 1

是的。

Yeah.

Speaker 1

昨天,昨天应该是星期一。

Yesterday yesterday was Monday, I think.

Speaker 0

这个镇上没有时钟。

There's no clocks in this town.

Speaker 0

这是对拉斯维加斯的一个著名观察。

Famous observation about Vegas.

Speaker 0

而且是一样的,是一样的。

And it's the same it's the same.

Speaker 1

你知道,每天都是120度,全天阳光充足,天黑后还有105度。

It's, you know, it's 120 every day, full sunlight, and it's a hundred and five after dark.

Speaker 1

对。

Yeah.

Speaker 1

不。

No.

Speaker 1

但除了昨天,还有Leo Meyerovich(Graphistry的)的一个演讲,他几个月前通过未经提示的TFP提交了,那时候这一切都还没发生。

But so besides yesterday, a talk by Leo Meyerovich of Graphistry that he had submitted through the unprompted TFP months ago before any of this had happened.

Speaker 1

嗯。

Mhmm.

Speaker 1

那个演讲的前提是大家都在作弊,评估结果都是假的。

The premise of which was everyone's cheating on their evals.

Speaker 1

他讲了怎么作弊,以及他自己怎么做的。而且这个演讲非常有先见之明,因为他基本上把这件事会怎么发生讲了一遍,还特别指出,你可能会觉得自己能把这个系统隔离开来。

Here's how and here's how I And it was incredibly prescient because he basically kind of talked through how this would happen, really pointing through that, to be clear, you can think you're gonna air gap this.

Speaker 1

但当你隔离系统时,第一件事就是给模型打开DNS和网络接口。

But first thing you do when you air gap that is open up DNS and network endpoints to the model.

Speaker 1

而模型本身就有网页搜索工具。

Well, the model has those web search tools.

Speaker 1

那这样还算真正的隔离吗?

So are you really air gapped anymore?

Speaker 0

但即便如此,我的意思是,很多实验室,我的意思是,有很多过拟合的情况,比如“我们不提取邮件”之类的。

But even then, mean, the models I mean, lot of the lab I mean, there's a lot of overfitting going on for for for Oh, we're not taking emails out.

Speaker 0

哦,是的。

Oh, yes.

Speaker 0

有人就是在教模型怎么应付考试。

There's there's there's People are teaching the test.

Speaker 0

我觉得我会是……好吧,再说一遍,蠢人就是这样。

Think I would be the Well, again, idiots are.

Speaker 1

他们就是在教模型应付考试。

They're teaching the test.

Speaker 1

有些模型的评估指标,在没有工具的情况下就已经出现在模型发布里了。

They're the flags for some of these are in model releases without any tools

Speaker 0

完全同意。

Totally.

Speaker 0

拼写问题。

Spelling.

Speaker 1

所以,是的,有很多方法可以改进。

So, yeah, so there's a lot of ways to improve it.

Speaker 1

对。

Mhmm.

Speaker 1

但你知道,作为安全人员,这对我来说一点也不困扰。

But, you know, as a security person, that doesn't bother me a little bit.

Speaker 1

我总是假设每个人都在作弊。

I always assume everyone's cheating.

Speaker 1

对。

Yeah.

Speaker 1

但当需要思考新端点的时候,确实会让我困扰。

It does bother me when they're you know, when I need to think about, you know, new endpoints.

Speaker 1

所以,我觉得我们尝试思考并列举的传统轴心,就是解决微软所有SFI支柱的那些。

And so, you know, I think there's there's the the traditional axes that we try and think about and we enumerate, you know, solve our all of Microsoft's SFI pillars.

Speaker 1

对吧?

Right?

Speaker 1

比如,先从身份开始,然后是网络,接着是工程系统和软件,等等。

Like, let's start with identities, then we'll do networks, and then we'll do engineering systems and software and so on and so forth.

Speaker 1

列举控制措施,列举端点。

Enumerate the controls, enumerate the endpoints.

Speaker 1

然后你会回头想想,在这个模型生态系统中,我希望存在哪些控制点,而这些控制点今天可能还不存在?

And then you kinda go back and you think, well, what are the control points that I wish existed in this harness model ecosystem that may or may not exist today?

Speaker 1

对吧?

Right?

Speaker 1

是的,我有各种形式的容器化。

It's, yes, I've got various forms of containerization.

Speaker 1

也许我需要给这些东西分配独立的身份。

Maybe I need to give these things their own identities.

Speaker 1

这可能是个好主意。

It's probably a good idea.

Speaker 1

但现在,我该怎么使用钩子呢?

But now, you know, how am I gonna use hooks?

Speaker 1

我该怎么使用追踪呢?

How am I gonna use traces?

Speaker 1

我该怎么利用这些新技术来提升安全性呢?

How am gonna use some of these new technologies to improve the security of it?

Speaker 1

即便如此,人们也不会用你给他们的工具。

And even then, people will not use the harness you give them.

Speaker 1

他们会用自己想要的工具。

They'll use the harness they want.

Speaker 0

对。

Yeah.

Speaker 0

他们通常是为了完成工作,而不是为了安全。

It's a usual job to get their job done, not to not to be secure.

Speaker 0

对吧?

Right?

Speaker 1

所以,你越是考虑这些层次,就越有机会看到路径并打破它们。

And so the more you think in terms of those layers, the more opportunities you have to see the paths and break them.

Speaker 0

这很有意思。

It was interesting.

Speaker 0

我今天早些时候和另一位首席信息安全官聊过,他告诉我,大家都害怕“漏洞末日”,对吧?

I was talking to another CISO earlier today, and kind of what he was telling me was that everyone was afraid for Vulnpocalypse, right?

Speaker 0

当时那种炒作的气氛基本上就是,哎呀,我们完蛋了。

The mythos hype was basically, Oh, we're doomed.

Speaker 0

每个人都有漏洞。

Everybody's got vulnerabilities.

Speaker 0

我觉得如果你在这个行业干得够久,你就会知道沙漠里埋着的东西多了去了。

I think if you've worked in this space long enough, you know that there's just a whole lot of things buried in the desert.

Speaker 0

确实。

Sure.

Speaker 0

这在我们行业里算是公开的秘密。

And it's like it's an open secret in our industry.

Speaker 0

所以我觉得,我之前跟一个CISO聊过,他说,实际上,我们现在测试这些模型发现,虽然它们能更快地发现漏洞,但修补漏洞的速度也一样快。

And so I think I was talking to a CISO that was saying, Actually, what we found with these models now that they're testing them is that while they can discover things more rapidly, they can patch them just as rapidly.

Speaker 0

所以以前,比如上周,以前你得找个开发人员来写补丁,那总是最卡脖子的环节。

So in the old days, like last week, in the old days, you had to get a developer to write the patch, and that was always the gating factor.

Speaker 0

问题从来不是CISO不知道系统有问题。

The issue was never that the CISO didn't know it was broken.

Speaker 0

作为CISO,最难的地方在于知道该修什么,因为资源有限,只有程序员,你得把他们只用在最紧急的漏洞上。

The issue and the difficult part of being a CISO was knowing what to fix, because you had a finite resource, which was a programmer, and you had to deploy them only to your sub-1s or your P1s.

Speaker 0

现在好像这个限制没了,所以什么都能修。

And now that seems that the math is gone, and so, like, everything gets patched.

Speaker 0

感觉我们可能真的快要拥有安全的软件了。

And it and it and it does it does feel like maybe we're on the verge of having secure software for once.

Speaker 0

我很谨慎,但我希望你说得对。

I'm very hesitant, I but hope you're right.

Speaker 1

你知道,有一点我确信这些工具让事情变得容易多了,那就是问题的诊断和分析。

You know, I one thing that I'm confident that these things have made much easier is the diagnosis and analysis of the problem.

Speaker 1

对。

No.

Speaker 1

而且,它们通常很擅长生成补丁,大概80%的时候都挺好的。

And, yeah, they're usually pretty good at creating a patch, you know, probably 80% of the time, it's good.

Speaker 1

而且90%的时候不会引入新的安全漏洞,这也不是完美的记录。

And 90% of the time, it doesn't create another security bug, which is not a perfect record.

Speaker 0

在部署这些东西之前,还是有很多测试要做。

There's still a lot of testing that has to go on before you deploy these things out.

Speaker 0

但是

But

Speaker 1

我觉得这确实让它更可行了。

it does, I think, make it more tenable.

Speaker 1

而且,你知道,当你面对一份漏洞列表时,超过20个就根本处理不过来了,对吧。

And, you know, when you stare down a list of well, anything more than 20 is an impossible number, right, of bugs to go after.

Speaker 1

这确实让事情变得稍微容易一些。

It does make it a little bit easier.

Speaker 1

但我们还没到那一步。

But we're not there yet.

Speaker 1

我想说的是,还是从那个角度想,你怎么才能接受像OpenClaw这样的东西,你确实还是得花力气持续扫描它,把它容器化,还得有人负责打补丁。

I will say that, you know, again, thinking through this lens of how do you take something like OpenClaw and get comfortable with it, you do still have you do have to put in the effort to continuously scan it, containerize it, have someone on the hook to patch it.

Speaker 1

是的。

Yeah.

Speaker 1

你不能说,模型会解决这个问题,因为还是需要有人负责验证和部署,这可不是模型能替你做的,对吧。

You can't say, Well, the models will fix it, because someone still needs to be accountable for validating and deploying, which is not they think the models are necessarily going to do for you, yeah.

Speaker 0

嗯,我觉得这反映了CISO这个角色的变化,对吧?

Well, I think that speaks to kind of the way the CISO role has changed, right?

Speaker 0

我记得我刚入行的时候,有位挺有名的CISO开玩笑说,他能用80种语言说“不”,就好像他的超能力就是,即使所有人都让他说“是”,他也能说“不”。

I remember at the beginning of my career, was a relatively well known CISO who would joke that he could say no in 80 languages, and it was sort of like my superpower is saying no even everyone's telling me to say yes.

Speaker 0

而且在防御方面,人们经常想做一些非常糟糕的事情。

And oftentimes in defense, people want to do really bad things.

Speaker 0

那时候就像,对,那可能会把银行搞炸了。

It was sort of like, Yeah, that's probably going to blow up the bank.

Speaker 0

现在再看,CISO似乎变成了推动者。

You fast forward to now, and it seems like the CISO is becoming an enabler.

Speaker 0

我接触的每一家公司,除了金融服务,因为他们受监管,有自己的做法,还有国防工业,但其他每家公司,CISO都非常深入地参与这些技术。

Every company I talk to outside of financial services, because they're regulated and they do their own thing, and maybe defense industrial, but every company I talk to, the CISO is very much involved in all these technologies.

Speaker 0

就像你自己用OpenClaw一样,在每个前瞻性的组织里,CISO似乎都在场。

Like yourself working with OpenClaw, at every forward leaning organization, seems like the CISO is there.

Speaker 0

感觉CISO是不是正在变成技术推动者?

And it feels like maybe the CISO is switching to technology enabler?

Speaker 0

我也不确定。

I don't know.

Speaker 0

我的意思是,

I mean,

Speaker 1

我希望是这样。

I hope it's true.

Speaker 1

我不确定这是不是普遍现象,但我一直觉得我的工作本质上就是三件事,对吧?

I don't know that it's universal, but I've always considered you know, the nature of my job to really be three things, right?

Speaker 1

那些把自己当合规人员的人,比如,对,我是做合规的,但我的合规工作就是让系统对所有人都清晰易懂,不管是监管机构、内部审计,还是想买我们软件的合作伙伴。

You know, people who think of themselves as compliance people, like, yeah, I'm a compliance person, but my job in compliance is making the systems legible to everyone, whether they're a regulator, whether they're an internal auditor, partners who wanna buy our software.

Speaker 1

关键就是清晰易懂。

It's about legibility.

Speaker 1

当然,传统CISO的工作是识别风险、排优先级、然后把这些风险消除掉。

Yes, there's the traditional CISO job of figuring out the risks, prioritizing them, getting them burned down.

Speaker 1

这个还是得做。

Still gotta do that.

Speaker 1

还没做完呢。

That's not done.

Speaker 1

AI能帮上忙。

AI helps.

Speaker 1

还没完全搞定。

Haven't figured it out yet.

Speaker 1

但我觉得工作中越来越重要的一部分,是那个赋能的部分。

But the part of the job that I think is is increasingly important is that enablement piece.

Speaker 1

我们怎么才能让大家有能力去做那些难事呢?

How do we, you know, how do we make it possible for people to do the hard things?

Speaker 1

有时候那些难事就是,把我的邮件和日历都连起来,然后自动替我写回复。

And sometimes those hard things are connect all of my email and my calendar and automatically write responses on my behalf.

Speaker 1

如果大家想要那样的话,我们会想办法让它更安全。

Then if that's what people want, we will find ways to make it safer.

Speaker 0

完全同意。

Absolutely.

Speaker 0

嗯,这也挺有意思的,因为我觉得这正好说明了CISO们之间一直以来的那种讨论:我们到底是做安全的,还是做风险管理的?

Well, it's interesting too because I think it speaks to sort of the there was always this dialogue amongst CISOs about, Are we security or are we risk management?

Speaker 0

看起来你们更像是做风险管理的,因为我觉得如果你在一家科技公司工作,却不积极拥抱新技术,那对业务来说可能是生死攸关的风险,比邮件泄露严重多了。

And it seems like you're risk management, because I think if you're working in a especially if you're working in a tech company and you're not leaning into the new tech thing, that's probably an existential risk for your business, more so than if your emails leak.

Speaker 0

从毁灭业务的角度来看,比如如果微软错过了云,那对微软来说就太糟糕了。

On the scale of business annihilating things like if Microsoft had missed cloud, that would have been very bad for Microsoft.

Speaker 0

幸运的是,Saket 干得很漂亮,抓住了那波浪潮。

Luckily, Saket did a great job riding that wave.

Speaker 0

这次的情况看起来也差不多,我们真的没法回避,必须得积极面对。

And it's the same very much it seems like for this, which is where we can't really hide from this and we kind of have to lean into it.

Speaker 1

对。

Yeah.

Speaker 1

我完全同意。

I would completely agree.

Speaker 1

我们必须积极拥抱它。

We have to lean into it.

Speaker 1

我们必须找到做好它的方法。

We have to find ways to do it well.

Speaker 1

你说存在性风险不一定是所有邮件泄露。

You you say the existential risk isn't necessarily getting all of your emails leaked.

Speaker 1

我建议还是避免这种情况发生。

I would recommend against having that happen.

Speaker 0

不过索尼影业还在经营呢。

Sony Pictures is still in business, though.

Speaker 0

不。

No.

Speaker 0

那是最典型的例子。

That's the that's the go to.

Speaker 0

对吧?

Right?

Speaker 1

确实如此。

That's true.

Speaker 1

对。

Yeah.

Speaker 1

不。

No.

Speaker 0

我更希望我的邮件不被泄露。

I would prefer that my email's not leaked.

Speaker 0

是的。

Yes.

Speaker 1

天哪。

Oh, man.

Speaker 1

所以,你知道,安全肯定还是有作用的。

And so, you know, security definitely still has a role.

Speaker 1

我们还是应该强调什么特别重要,什么是对业务最重要的事情。

We should still be highlighting what is particularly important, what are the most important things for the business.

Speaker 1

但同时,我们也应该认识到,我们的职责是保护这些重要的东西,也就是支持企业最重要的资产和最关键的问题。

But, also, we should recognize that our job is to protect those things, so that's enable the business in its most important assets and most important problems.

Speaker 1

还有那些长尾的,你知道的,乱七八糟的人和事。

There's this long tail of, you know, randos and slack.

Speaker 1

你懂吧?

You know?

Speaker 1

现在就先别管它了。

You've got to let it be for now.

Speaker 0

对,就像别去招惹那些喷子一样。

Yeah, don't feed the trolls, as it were.

Speaker 0

这挺有意思的。

This is interesting.

Speaker 0

我知道,这不是你第一次参加黑帽大会了。

I know, not your first black hat.

Speaker 0

我很想听听你对现在这个领域的看法。

Would love to hear maybe your thoughts on what you're seeing out there.

Speaker 0

从湾区来,整天接触各种AI相关的东西,可以说站在这次变革的最前线,有时候我觉得自己就像十八世纪伦敦的工厂工人,看着烟囱冒起来,心里想,天哪,这真的是下一场工业革命。

Coming from the Bay Area, working around all the AI stuff and just being exposed, I'd say at the front lines of this change, there are days where I feel like a factory worker in eighteenth century London, and you see the smokestacks coming up, you're like, Oh my god, this is literally the next industrial revolution.

Speaker 0

我们很想听听你的看法,你在Black Hat这边有没有感受到这种变化,或者这里的气氛怎么样?

And we'd just love to get you like, are you seeing that come across here at Black Hat, or what is the vibe like?

Speaker 1

确实就是这种气氛。

That's the vibe for sure.

Speaker 1

对吧?

Right?

Speaker 1

大家都在讨论AI怎么帮助业务,AI怎么让攻击变得更快,我们怎么用AI来防御,怎么在AI使用中保障安全。

Everyone's talking about how AI is helping the business, how AI is making attacks go faster, how we can use AI for defense, how to secure our environment where in the use of AI.

Speaker 1

所以这里的气氛就是超级AI。

And so the vibe is is Super AI.

Speaker 1

我尽量不去评判Black Hat,是的。

I try not to judge Black Hat Yeah.

Speaker 1

Black Hat的气氛并不能代表最重要的事情。

The Black Hat vibe as indicative of the most important things.

Speaker 1

就是,这就像是……

Like, it's it's the

Speaker 0

就像歌舞伎剧场一样。

It's like kabuki theater.

Speaker 0

这里有很多东西,你看到的是正在发生的事情的影子。

It's There's lot of and you're seeing kind of the shadow of what's happening.

Speaker 0

但通常,你能看出幕后操纵者是什么样子。

But usually, you can ascertain what the puppet looks like.

Speaker 1

而且我们距离大规模供应链危机只有三周时间了,但你知道,我们录制这段对话时,其实只有三个小时了。

And we're only I was gonna say we're only three weeks out from massive supply chain pain, but, you know, three hours as we record this.

Speaker 0

等等。

Wait.

Speaker 0

什么大规模供应链危机?

What's the massive supply chain pain?

Speaker 1

哦,天哪。

Oh, man.

Speaker 1

我忘了它叫什么名字了。

I forget the name of it.

Speaker 1

有一个

There was a

Speaker 0

哦,是NPR。

Oh, the NPR.

Speaker 0

有一个

There was an

Speaker 1

今天NPR组织被接管了。

NPR organization takeover today.

Speaker 0

对。

Yeah.

Speaker 0

对。

Yeah.

Speaker 0

对。

Yeah.

Speaker 0

但DEFCON快到了,所以总得有人需要找点话题或者准备被抓吧。

But DEFCON's coming up, so someone needs something to talk about or get arrested for.

Speaker 0

对。

Sure.

Speaker 1

不深入那个话题的话,我觉得可以说,老问题还在,那些埋头苦干的人还在继续干活。

Without going down that rabbit hole, right, I think it's enough to say that the old problems are still here and the people who were nose to the grindstone getting the work done Mhmm.

Speaker 1

如果这些人有什么情绪的话,那就是他们其实还是很兴奋。

If there's any vibe for those people, it's that, like, they're actually still really excited.

Speaker 1

对。

Yeah.

Speaker 1

就是,感觉不像是在熬。

Like, it doesn't feel like a slog.

Speaker 0

对。

Yeah.

Speaker 0

对。

Yeah.

展开剩余字幕(还有 72 条)
Speaker 1

对。

Yeah.

Speaker 1

感觉就是,哦,没错。

It feels like, oh, yeah.

Speaker 1

就像,我们现在有好多值得深挖的东西了。

Like, we got some meaty stuff to chew on now.

Speaker 0

嗯,这可不是AI第一次成为Black Hat的头条话题。

Well, this isn't the first year that AI has been a headline for Black Hat.

Speaker 0

感觉AI成为Black Hat的头条话题至少十年了。

Like, feels like AI has been the headline for Black Hat for at least a decade.

Speaker 0

是的。

Yes.

Speaker 0

今年,大家是真的对它感到兴奋。

This year, people feel genuinely excited about it.

Speaker 1

去年,AI只是你在推销产品时拿来当卖点的东西。

Last year, AI was the thing you put in your vendor pitch.

Speaker 0

对。

Yeah.

Speaker 0

对。

Yeah.

Speaker 0

你是联合差异化。

You're co Differentiation.

Speaker 0

对。

Yeah.

Speaker 0

抱歉。

Sorry.

Speaker 1

没关系。

It's fine.

Speaker 1

你是67号副驾驶?

You're 67 co pilot?

Speaker 1

是的。

Yeah.

Speaker 1

这一切都统一在一起了。

That's all unifying in one.

Speaker 0

你的聊天界面。

Your chat your chat interface.

Speaker 0

但今年,真的,

But this year, and really,

Speaker 1

是因为Opus和Glock。

it's because of Opus and and Glock.

Speaker 1

对吧?

Right?

Speaker 1

大家都觉得,哦不。

Everyone's like, oh, no.

Speaker 1

我什么都能做了。

I can do all of the things.

Speaker 0

四六是一个巨大的转变。

Four six was a sea change.

Speaker 0

确实,我们真的就是那样。

It really And we really was just it was

Speaker 1

就是,人们大概花了七到三十天就学会了,现在,还有谁手写代码呢?

just like And it took people somewhere between seven days and thirty days to pick it up, now, know, now who's written a line of code by hand?

Speaker 0

对。

Yeah.

Speaker 0

我记得回来的时候,因为那是在圣诞节前后发布的。

I remember coming back because it came out around Christmas.

Speaker 0

对。

Yeah.

Speaker 0

所以圣诞节后我跟一个人聊了聊,他们简直就像失去了自我。

And so I remember catching up with someone after Christmas, and they were just like, had lost their identity.

Speaker 0

他们说,我的整个身份就是我是个很棒的开发者,而它几乎完全匹配了我的技能,甚至差不多。

They were like, My whole identity is based on me being an amazing developer, and they've literally just kind of not matched my skills, but pretty close.

Speaker 0

我觉得我这辈子再也不会手动写一行代码了。

And I don't think I'm writing a line of code ever again manually in my life.

Speaker 0

这是个很大的转变,对吧?

It's a pretty big shift, right?

Speaker 0

是的。

Yeah.

Speaker 1

但我愿意相信我们是优秀的安全专家和问题解决者,只是工作形式变了。

But I like to think that we're good security people and we're good problem solvers, and it just changes the shape.

Speaker 0

哦,计算机工程现在更重要了。

Oh, computer engineering is even more important now.

Speaker 1

只是工作模式变了。

It just changes the shape of the model.

Speaker 1

完全同意。

Totally.

Speaker 1

因为说实话,对吧?

Because like, let's be honest, right?

Speaker 1

我自己当经理也当太久了。

I've been a manager for too long myself.

Speaker 1

我还是个操作员。

Still an operator.

Speaker 1

是的,

Yeah,

Speaker 0

对,对。

yeah, yeah.

Speaker 1

欢迎你回来。

You're welcome back in the house.

Speaker 0

技术经理,是的。

Technical manager, yeah.

Speaker 1

但我没写很多代码。

But I wasn't writing a lot of code.

Speaker 1

我仍然发现让模型检验我的想法、扮演我的老板、帮我写幻灯片,这非常有价值,我很感激不用再做这些了。

I'm still finding a ton of value in having the models pressure test my thinking, pretend to be my boss, write slides for me, which I'm grateful not to have to do anymore.

Speaker 1

所以这就是为什么我这么兴奋。

So that's why the excitement is here.

Speaker 1

它把我工作中所有不喜欢的部分都接手了。

It's taking all the parts of my job that I don't like.

Speaker 1

我喜欢的部分,它也在加速推进,确实感觉让我们变得更强大。

Some of the parts of my job that I do like, it's accelerating them, and it does feel like it's making us more powerful.

Speaker 1

如果我们能做到这一点,并且让人们能够,真是的。

And if we can do that and enable people to goddamn it.

Speaker 1

抱歉。

Apologize.

Speaker 1

我想说那个愿景宣言,但你知道,让人们取得更多成就,那你真的做了一件很酷的事。

I'm gonna say that vision statement, but, you know, enable people to achieve more, then you've really done something cool.

Speaker 1

而且我觉得我们……我不知道这段旅程会怎么结束,但我认为我们确实已经踏上了这条路。

And and and I think we're we're we're I don't know how the journey is gonna end, but I think we're we're we're well and truly on it.

Speaker 0

你相当于在亲历第二次工业革命。

You get to listen to the second industrial revolution.

Speaker 0

好的,非常感谢你过来聊天。

Well, thank you so much for coming by to chat.

Speaker 0

希望明年在沙漠里的黑帽大会上还能见到你,而且希望到时候至少能凉快个20度。

Hopefully, see you at next year's, Black Hat in the desert, and may it hopefully be at least 20 degrees cooler.

Speaker 1

是的。

Yes.

Speaker 1

是的。

Yes.

Speaker 1

希望如此吧。

Fingers crossed.

Speaker 1

我虽然不敢打包票,但也不是没可能。

I wouldn't wouldn't bet on it, but it's a it's a distinct possibility.

Speaker 0

谢谢。

Thank you.

Speaker 0

太好了。

Awesome.

Speaker 0

谢谢大家。

Thanks, guys.

Speaker 2

感谢收听本期a16z播客。

Thanks for listening to this episode of the a 16 z podcast.

Speaker 2

如果你喜欢这期节目,记得点赞、评论、订阅,给我们留下评分或评论,并分享给你的朋友和家人。

If you like this episode, be sure to like, comment, subscribe, leave us a rating or a review, and share it with your friends and family.

Speaker 2

更多节目,请前往YouTube、Apple Podcast和Spotify。

For more episodes, go to YouTube, Apple Podcast, and Spotify.

Speaker 2

在X上关注我们@a16z,并订阅我们的Substack:a16z.substack.com。

Follow us on x at a sixteen z, and subscribe to our Substack at a16z.substack.com.

Speaker 2

再次感谢收听,我们下期见。

Thanks again for listening, and I'll see you in the next episode.

Speaker 2

提醒一下,这里的内容仅供参考,不应视为法律、商业、税务或投资建议,也不应用于评估任何投资或证券,且不针对任何a16z基金的投资者或潜在投资者。

As a reminder, the content here is for informational purposes only, should not be taken as legal business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any a sixteen z fund.

Speaker 2

请注意,a16z及其关联公司可能持有本播客中讨论的公司的投资。

Please note that a sixteen z and its affiliates may also maintain investments in the companies discussed in this podcast.

Speaker 2

更多详情,包括我们的投资列表,请访问a16z.com/disclosures。

For more details, including a link to our investments, please see a 16z.com forward slash disclosures.

关于 Bayt 播客

Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。

继续浏览更多播客