本集简介
双语字幕
仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。
欢迎各位收看《The Information TITV》。
Welcome everyone to The Information TITV.
就在刚才,《The Information》率先发布了这条消息。
The information was first to report just moments ago.
《The Information》独家报道了此事。
The information reported exclusively.
欢迎各位收看《The Information TITV》的特别节目。
Welcome everyone to this special edition of the Information TITV.
我是阿卡什·帕什里卡。
My name is Akash Pasricha.
今天是7月14日,星期二,我们从旧金山办公室为大家直播,今天正好是我们节目开播一周年,这一路真是跌宕起伏。
It is Tuesday, July 14, and we are coming to you from our San Francisco office where we are celebrating the one year anniversary of our show, and what a crazy year it has been.
我们刚做这个节目时,根本还没有什么Fable这个东西。
When we first started started the show, there was no such thing as fable.
那时候,几乎没人讨论TPU或者Tranium。
There was barely any conversation about TPUs or Tranium.
那时候,SpaceX、X 和 XAI 还都是各自独立的私营公司。
SpaceX and X and XAI were all still separate private companies.
根本没什么开放的爪子。
There was no open claw.
没人关心 AI 的利润率,轨道上的数据中心还完全是遥不可及的幻想。
No one cared about AI margins and orbital data centers were very much still a distant dream.
有些事情从来都没变过。
Some things never change.
这是我们第250期节目。
This is our two hundred and fiftieth episode.
今天,我们不回头盘点过去,而是展望未来,聊聊我们认为接下来250期节目会主导的那些大趋势。
And today, rather than looking back on it all, we're gonna look ahead to what we think will be the big themes that are going to dominate our next 250 shows.
我们先来聊聊,2030年的AI公司会是什么样子。
We're gonna start with a conversation about what the AI company of 2030 is gonna look like.
接着我们会深入技术本身,讨论开源,以及AI研究者至今还没解决的那些难题。
We're then gonna take a deep dive into the tech itself with a discussion on open source and also all the challenges that AI researchers still haven't solved.
我们还会聊聊物理AI和航天产业面临的大问题,最后再由两位主力编辑展开一场坦诚的辩论。
We're also gonna talk about the big questions facing physical AI and the space industry, and we're gonna end with some healthy debate with two of our top editors.
我们请到了几位非常棒的嘉宾。
We've got some great guests coming on.
Decagon的CEO会来和我们对话。
The CEO of Decagon is joining us.
一位顶尖的机器人创业者也会加入我们。
We've got a top robotics founder coming on.
Robinhood的联合创始人,现在正在打造Cowboy Space Corporation的人,稍后也会来。
The cofounder of Robinhood who is now building Cowboy Space Corporation is joining us in a bit.
但我先想从过去一年里我最欣赏的两位嘉宾开始。
But I wanna start with two of my favorite guests from the past year.
Jeanne Grosser是Vercel的首席运营官。
Jeanne Grosser is COO at Vercel.
她正身处AI编程狂潮的最前沿。
She is on the front lines of the AI coding craziness.
托马斯·通努兹是Theory Ventures的普通合伙人。
Tomasz Tunguz is a general partner at Theory Ventures.
他是我们节目里最常来的嘉宾之一。
He is one of the most frequent guests on our show.
欢迎你们两位。
Welcome to the both of you.
很高兴你们能来。
Is so great to have you here.
谢谢邀请我们。
Thanks for having us.
非常高兴能来到这里。
Thrilled to be here.
我想先问一下让娜,你觉得2030年的AI公司会是什么样子?
So I want to start, Jeanne, with a question about what the AI company of 2030 looks like.
你对这个问题有独特的视角,因为你曾在Stripe工作了将近十年。
And you have such an interesting perspective on this because you were at Stripe for nearly a decade.
是的。
Yep.
你在那边组建了一整支市场拓展团队,现在你又在打造一支原生AI的市场团队。
Built an entire go to market team over there, and now you're building an AI native go to market team.
那现在的团队是什么样子的?
So what does the team look like nowadays?
和Stripe相比,有什么不同?
How is it different from Stripe?
其实我们在很多地方都借助AI获得了很大效率,所以我觉得公司内部的角色构成正在发生变化。
I mean, there's a lot of places where we're getting a lot of leverage out of AI, so I would say the mix of roles within a company is shifting.
比如,我们当然还在持续扩招,毕竟是一家高速成长的公司。
As an example, we obviously are growing headcount still, high growth company.
但在市场拓展部门,今年年初各子职能的人员增长率相比往年有了明显差异。
But within go to market, the percent year on year growth in headcount by sub functions was meaningfully different at the start of this year.
举个例子,销售开发团队虽然也在扩张,但增速远低于客户经理团队。
So, an example, sales development that we grew but less than our account executives.
通常情况下,这些职能的增长会更同步一些。
Typically, those might grow more in tandem.
尽管我们的客户数量翻了一倍多,我们却反而减少了客服团队的人数。
We've actually been able to take our support headcount down year on year despite more than doubling the total number of customers that we have.
我们的上半年,也就是今年前六个月,将在本月底结束。
And actually, you know, our H1 first half of the year ends at the end of this month.
所以我们正在重新规划下半年的计划,毕竟才过了五个月,之前的规划现在看起来已经过时了。
And so we're sort of doing an H2 replanning because it's only been five months, but our plan already is kind of just feels like ancient history.
G 经常会提一个挑战:我们怎么也搞不定让公司人数超过 1024 人。
And one of the provocations G always has is like, we can't get this company to have more than 1,024.
G 就是 Guy。
G is the this is Guy on
对。
the Yeah.
Guillermo。
Guillermo.
Guillermo 是我的
Guillermo is my
创始人兼首席执行官。
Founder CEO.
但他一直强调,Vercel 的员工人数绝不能超过 1024 人,也就是 2 的 10 次方。
But his provocation is Vercel can never employ more than ten twenty four people, which is two to the tenth.
那现在公司一共有多少人?
And how many people does it employ right now?
差不多了。
Something.
我们快到了。
We're getting there.
我们快到了。
We're getting there.
所以我们得好好规划一下
So, we have we're to going to figure it
正在实现真正意义上的规模扩张,一方面人类自身的工作效率大幅提升,另一方面由于AI很多时候能稳定达到前1%的水平,整体产出也更好了。而如果你的销售开发团队只有30%的水平,那绩效分布肯定是个正态曲线。
getting meaningfully more scale, so both more productivity because the humans themselves can do things much more efficiently, and actually more productivity due to better outcomes because there are many ways in which we're now getting AI to sort of be a ninety ninth percentile performer 99% of the time, whereas if you have a 30% sales development function, you're gonna have a bell curve, if you will, on how they perform.
没错。
Right.
这确实很有趣。
It is really interesting.
这俩应该是AI最早落地的两个场景吧?
Those were the first two use cases of AI, right?
就是自动化销售和自动化客服。
Like automated sales and automated customer support.
所以现在你能明显看到它带来的成效。
So, you're really starting to see a lot of success from it.
当然。
Absolutely.
我们一开始就是挑那些更确定性强的职能入手,对吧?
Like, we started was pick functions that are more deterministic, right?
所以,如果是那种稍微复杂一点的‘如果-那么’场景,去年八月的时候,AI 已经能处理得不错了,尤其是结合了我们内部的上下文信息。
So, if it's a bit more if then how you would handle something that, you know, even August of last year, AI could do reasonably well, with a fair amount of our internal context around it.
而到了去年八月,我们 inbound 销售开发的自动化率已经达到了百分之九十。
And now, you know, as of August of last year, we had 90% automation of sales development for inbound.
我们自己开发的客服助手,现在能处理百分之九十一的全部客服请求。
And our support agent that we've home built handles 91% of all support cases.
你可以想象,Vercel 的客户问题都挺技术性的。
You can imagine, like Vercel's are technical.
不是那种‘为什么按钮是蓝色而不是绿色’之类的问题。
These are not, Why is the button blue not green?
对吧?
Right?
Tomasz,你们现在在招人吗?
Tomasz, are you recruiting?
我的意思是,你们招人的时候,会根据岗位不同调整招聘方式吗?
I mean, are you changing the way you hire now depending on what role you're hiring?
你在红点资本待了将近十五年吧。
You were at Redpoint for, what, nearly fifteen years.
那会儿的风险投资环境肯定跟现在全不一样。
That must have been a totally different time for venture capital.
确实完全不同了。
It is a very different time.
我们现在尽量把业务流程都自动化。
I think we are trying to automate as much of the business as we can.
公司里的工程师人数是投资人的两倍多。
We have more engineers on staff than we have investors by two to one.
这种趋势估计会一直持续下去。
I think that will continue for the life of the firm.
多亏了这些自动化工具,我们每年能深入分析的公司数量比以前多了三到四倍。
And I think we're I mean, we were able to analyze in much greater depth about three to four times the number of companies year on year as a result of some of these agents.
这跟销售开发那种流程可不一样,没那么死板。
It's not so deterministic as, you know, sales development.
我觉得当然需要更多判断,但还是有不少初步筛选的标准可以参考。
I think there's a lot more judgment, obviously, but there are a lot of first pass filters you can look at.
比如我们不投印度的公司,这点很容易过滤掉;或者我们可能也不投B2C、消费类企业。
For example, we don't invest in India, so very easy to filter out those kinds of companies, or we may not invest in b to c businesses, consumer companies.
这样一来,我们就能处理更多公司的信息。
And so we can we can parse through many more companies.
对。
Right.
还有就是投资机会的挖掘、市场地图的构建、播客文字稿的分析等等。
And then there's the all I mean, the generation of investment, creation of market maps, the analysis of podcast transcriptions.
是的。
Yeah.
涉及很多不同的工作环节。
Many, many different functions.
所以明白了。
So okay.
那我们来聊聊AI的实际效果吧,不过我想重点谈谈使用这项技术时更棘手的一些方面。
So let's get into then I mean, clearly, are results with AI, but I wanna talk about some of the more difficult parts of using the technology.
成本确实是其中一个因素。
I mean, cost is one component.
珍妮,我想先听听你的看法。
And Jeanne, I wanna start with you.
你不仅得考虑Vercel内部使用AI的开销,还要观察客户是怎么看待他们自己的成本的,毕竟这些模型真的很贵。
I mean, how are you handling not just the costs of using AI internally at Vercel, but how are you also seeing your customers think about their costs because, I mean, the models are expensive?
是的。
Yeah.
对我们来说,大致有两个方面。
So for us, sort of like twofold.
一方面,我们密切关注正在使用的模型,一旦有更便宜但性能相当的替代品,就会立刻切换。
One, obviously, we're paying attention to which models we're using and we'll switch them out as a less expensive model is more equally performant.
另一方面,我们所有内部开发的智能代理,都是基于Vercel的基础设施搭建的,整体使用成本其实很低。
But two, all the agents that we're building internally, we're building on Vercel's infrastructure, which is actually just very inexpensive to use overall.
所以,我们针对这类智能体工作流,专门优化了像弹性算力这样的资源。
So we've optimized things like fluid compute specifically for agentic type workflows.
我常遇到的一个情况是,当我跟别人介绍客服场景或者销售智能体场景时,发现这两类场景一年的基础设施费用其实只有几千块钱。
So one of the things I struggle with is I'll tell people about the support use case or the sales agent use case, and in both those cases, the total annual infrastructure bill is in the single digit thousands.
这是你们自己的账单吗?
Is it your bill?
这是我们内部使用的账单,如果 Vercel 是……
Our bill internally if Vercel were
在
to
Vercel 的基础设施上进行购买,任何人都可以使用。
purchase on Vercel's infrastructure that anyone can use.
所以,在我们所做的大部分工作中,比如我们的销售开发代理,投资回报率达到了 32 倍。
So that's in most cases, for the work we've done, like our sales development agent is a 32 x ROI.
所以,无论模型的成本有多高,这都是值得的。
So it's worth it no matter how much that model costs.
对于我们的客户,我们其实看到了一些非常有意思的现象。
For our customers, we're actually seeing really interesting things.
我们开发了一个AI网关,说白了就是一个模型切换和分发网络,让你能自由切换不同的模型。
So we built the AI gateway, which is like a token development or token delivery network is what we call it, but lets you switch between models.
我们收集到了一些特别有意思的数据。
And we see really interesting data.
比如,现在在生产环境中使用AI的用户,平均都在用32种不同的模型。
As an example, folks that are running AI in production are now on average using 32 different models.
他们不会只去找Anthropic,说‘给我Fable’就完事了。
So folks aren't just going to Anthropic and saying, give me Fable.
对吧?
Right?
他们会根据具体任务,选最合适的模型。
They're actually picking the right, model for the task.
这是出于成本考虑吗?
And is that because of cost?
我觉得这也是原因之一,因为现在开源模型的性能真的提升了很多。
I think that's part of it, because you're also seeing a very real rise in open weight models Yeah.
人们发现,这些模型的表现其实很不错。
That, people are now seeing, you know, good performance outcomes from.
所以你可以轻松切换,改一行代码就能运行,调试一下,成本直接降九成。
And so you'll switch those in, and you can do it with a, you know, single line of code change, run it, tweak it, and and, you know, reduce cost by 90%.
托马什,你们投资的公司呢?
Tomasz, what about your portfolio companies?
他们也在用三十二个不同的模型吗?
Are they using 32 different models as well?
没那么多。
Not that many.
我们内部用的模型种类确实挺多的。
We use a lot of different models internally.
明白了。
Okay.
我觉得各种大小和类型的模型都有。
I think of all different sizes and shapes.
比如八十亿参数、三百亿参数的模型,我们都会用Fable。
So by 8,000,000,000 parameters, 30,000,000,000 parameters, we use Fable.
所以我认为模型的多样化是必然的,这就像苹果iPhone 15的时刻。
And so I think the model diversity is inevitable, particularly we call it the iPhone 15 moment.
你选iPhone的时候,到了某个阶段,就不会再纠结于具体功能或者摄像头提升了多少,手机就是好用。
You can pick your iPhone where at some point you kinda stop paying attention to the features and how much better the camera was, the phone just kind of worked.
在很多实际业务中,这些模型即使参数差距很大,也基本可以互换,只要背后有合适的系统支持就行。
And from a lot of business work, many of these models are interchangeable even at radically different sizes, as long as you have the harness or the systems around it to get it to work.
那么,Tomasz,你对开源和闭源的争论怎么看?
So, Tomasz, where do you stand then on the open source, closed source debate?
开源会是未来的主流吗?
Is open source the future?
你个人觉得呢?
What do you think?
这是未来非常关键的一部分。
It's an incredibly important part of the future.
但它不会是全部。
It won't be everything.
看看开放路由的数据,目前有30%的模型使用量来自开源模型。
When you look at open router data, 3030% of model consumption today is is open source.
我觉得最终会占到总模型使用量的三到五成。
I think it'll be between 30 to 50% Of total model usage.
从总的token消耗来看,会是这样。
Of total tokens over time.
开源模型和闭源模型的成本比大概是九比一,用开源模型能省下九成费用。
There's a nine to one cost ratio, where you can save 90% by using an open source model.
没错。
Yeah.
我们还非常看好本地化部署。
And then we're big believers in local.
斯坦福发布了一项研究,我们内部也复现了结果:对于业务类、非编程类工作,用一台现代的 MacBook 就能完成 60% 到 80% 的任务。
So Stanford published a study, and we've replicated internally that for business functions, non coding functions, somewhere between 60 to 80% of your work can be completed on a modern MacBook.
在 Vercel 平台上,有多少工作是使用开源模型完成的?
What percent of the work that happens on Vercel's platform happens using open source models?
这是个好问题。
Oh, that's a good question.
我们发布的 AI 网关报告里正好有这个数据。
We actually have that in the AI gateway report that we published.
明白了。
Okay.
不过我没记在脑子里。
Just don't have it memorized.
没关系。
That's okay.
没问题。
That's fine.
但我知道这个趋势一直在快速上升。
But I do know it's been aggressively up into the right.
其实,吉列尔莫最近发过一条推文,展示了从一月到现在,Anthropic、Gemini 和开源模型在新版本发布时的演变趋势。
Actually, I think Guillermo had a tweet recently that showed a time series data of January through now of how Anthropic Gemini open weight models all were shifting as new ones were released.
开源确实在快速增长。
Definitely, open source is growing fast.
我想问问你们,关于所谓的 SaaSpocalypse,企业软件现在还有多强的粘性?对创业者来说,还有多少机会?
I want to ask you guys about the SaaSpocalypse and the extent to which enterprise software still remains sticky, useful, and an opportunity for people
去
to
打造产品。
build.
珍妮,我想问问你客户的情况。
Jeanne, I want to ask you about your customers.
你看,你完全可以用 Vercel 的平台来开发这些东西。
I mean, look, you can use Vercel's platform to build a lot of this stuff.
这非常
It's very
适合这么做。
good for that.
对。
Yep.
同时呢,还有个问题,我是不是想把所有时间都花在开发上?
At the same time, there's a question, do I want to spend all my time building?
我本来打算做客户关系管理。
I I was going to CRM.
客户关系管理看起来门槛低一些,但我是该给自己开发工具吗?
CRM seems like a lower lift, but do I want to create tools for myself?
确实。
Yeah.
你的客户们是怎么看待这个问题的?
How are your customers thinking about that?
我觉得我们现在看到的趋势是越来越多的人转向无头软件。
I think what we're seeing is a lot of a trend towards headless software.
最早转向无头架构的是电商领域,因为没人想要两个完全一样的网站,对吧?
So we think of this first place to go headless was ecom because no one wants two exact same sites, right?
但后端依然保持一致,这样才能让整个系统结构清晰。
But your back end is still the same to keep everything well structured.
我觉得这一点其实一直适用于CRM系统。
And I would argue that the same actually was always true for CRM.
你我的销售方式差别很大,但以前用Salesforce时,我们都被迫用同一个模型。
The way you sell and I sell is pretty darn different, but we were sort of forced into the same model using Salesforce.
所以我们在Vercel做的一件事,就是自己开发了一个Salesforce的前端界面。
So, one of the things we've done at Vercel is actually we built our own front end for Salesforce.
我们仍然把Salesforce当作后端使用。
We're still using Salesforce as a back end.
它现在是一个数据记录系统,但已经能按我们想要的方式处理工作流程了。
It's a system of record, but it now does the workflow we want it to do.
所以我们现在效率提升了很多,因为这结合了我们一直想要的界面,再加上智能代理来进一步提升效率。
And so we're getting a lot of productivity gains because it's a combination of the UI that we always wanted and then insert agents to make that productive as well.
我觉得很多公司都会走这条路,尤其是像CRM这样的系统。
So I think you're going to see a lot of companies go that path, particularly for things like CRM.
对于那些监管更严的领域,比如税务之类的事情,你可能并不想随便乱改。
Things that are more regulated, I don't know that you're necessarily going to want to like mess up your taxes or stuff like that.
这类功能还是留给完整的系统记录平台更稳妥。
Like you might leave that a bit more to a full fledged system of record.
随着软件进入下一个发展阶段,整体来看,未来的软件会越来越开箱即用、灵活自如。
And then I think also just as software as this next sort of era of software continues to mature, you'll probably see it be more flexible out of the box in general.
因此,像现在这样到处都强调自己从头开发的倾向也会减弱——或者说,只有当你处于顶尖水平时,自己开发才真正划算。
So there won't be quite as much of a bias in some places towards building as there is right now, or I think it pays if you're ninetieth percentile to be out there building.
payroll 就是个典型例子,大家都不会去买现成的 payroll 系统。
Payroll is the one example where everybody's I'm not gonna buy a
因为我要做一笔交易,所以干脆自己开发一个 payroll 应用。
payroll app because I'm gonna make a deal.
那你们投资组合里的公司呢?
So what about your portfolio companies?
它们还在向那些大型软件巨头采购吗?
Are they still buying from the big enterprise software giants?
它们很多都在做Jeanne说的那种无头架构。
A lot of them are doing what Jeanne described, which is headless.
底层有一套系统,然后在此基础上构建具有智能体特性的上层应用。
There's a back end system, and then they build systems on top that are agentic that-
所以当你提到无头架构的时候,我想确认一下我的理解,我之前从来没搭建过无头系统。
And so when when you say headless, just so I understand I mean, I've never built a headless system
对。
Yeah.
以前没有。
Before.
所以,我是说,你是会去买现成的产品吗?
So, yeah, I mean, do you buy some something?
买一个客户关系管理系统。
Buy a CRM.
明白了。
Okay.
然后你不再登录 login.crm.com,对吧?
And then instead of logging into login.crm.com Right.
而是你在 Vercel 上搞一个叫 Theory CRM 的东西。
You create maybe something on Vercel that is like Theory CRM.
这个用户界面是专门为风投公司定制的,但背后调用的还是 Salesforce。
And that UI, that user interface, is customized to a venture capital firm, but it ends up hitting or using the underlying Salesforce.
所以如果我没理解错的话,你买的不是应用层,而是底层的数据库。
So this is if I'm understanding correctly, this is less so buying the application layer, it's more buying The database.
underneath。
Underneath.
对。
Yeah.
没错。
Exactly.
说实话,现在大家还是得买应用层,因为大多数软件公司还没开始靠他们的MCP服务器赚钱。
I mean, today, wind up buying the application layer because most of these software companies have not started monetizing their MCP server.
所以,你本质上还是在买用户席位。
So, like, you're still buying seats.
我们用Salesforce就是这么干的。
That's what we're doing with Salesforce.
我们依然按席位付费,但实际用的只是他们的后端。
We still pay for seats, But we're just using their backend.
我们通过调用他们的API来存储和访问数据等等。
We'll hit their APIs to store, access data, etcetera.
销售看到的界面,其实是定制的Vercel前端。
And then what a salesperson would see is custom Vercel UI.
这才是我们希望你采用的方式。
That's how we want you working.
没错。
Right.
托马什,你和我聊这个,是因为我知道你们公司一直在深入研究企业客户,了解他们在想什么、有什么感受。
Tomasz, when you and I ask you this because I know that you at your firm do a lot of research into customers at enterprises and what they're talking about, how they're feeling.
他们最希望得到什么?
What do they want more of?
是更强大的模型吗?
Is it just a better model?
是更出色的智能代理吗?
Is it a better agent?
但要说AI推广就靠这些,未免太简单了。
I mean, that seems like too simple in terms of AI adoption.
到底要怎样才能真正推动普及?
What is it gonna take to increase adoption?
我觉得,他们其实并不担心普及的问题。
Oh, I think well, I don't think they're worried about adoption.
我接触的大多数CIO和CSO都感觉AI的普及已经像海啸一样来了。
Most of the CIOs and CSOs I speak to see a tsunami of adoption already.
他们真正担心的是成本问题。
They are worried about costs.
我们会因此错过业绩目标吗?
So will we miss earnings?
如果我们是上市公司,失控的成本会不会拖累每股收益?
If we're a publicly traded company, will we miss EPS as a result of uncontrolled costs?
这是第一个问题。
That's one.
第二个他们特别担心的是,像萨提亚·纳德拉和亚历克斯·卡普都提到过的,交易中使用的这些模型可能导致敏感信息泄露。
The second thing that they're really worried about, and Satya Nadella tweeted about it and so did Alex Karp talked about it, the loss of information going to some of these models that are being used for trading.
这是第二个问题。
That's another one.
第三个就是安全问题。
The third is just security.
没错。
Yep.
安全是最重要的,无论是数据外泄的问题。
Security is number one, whether it's like data exfiltration.
我们曾遭遇一次严重的供应链攻击,一个叫 Acxiom 的开源库被黑,影响了数亿个软件项目。
We saw a pretty significant supply chain attack when an open source library called Acxiom was hacked, it impacted the hundreds of millions of different software projects.
这三大优先事项大概就是成本、安全,还有
Those are probably the three biggest priorities, cost, security, and
我完全同意。
I couldn't agree more.
这种情况我天天都能看到。
See this all time.
我们最近专门开发了一套产品来应对这个问题,因为现在很多人用生成式工具写代码,接着又想连到他们的客户关系管理系统。
We actually just built a bunch of product for this in particular because you have a lot of folks vibe coding but then wanting to go connect to your CRM.
于是现在,那些原本只由 IT 或工程团队严格管控的密钥和 API 凭证,被大量人员随意访问,还擅自搭建了各种不该有的外部连接。
And so now you have all these secrets, API keys that used to be, you know, cordoned off in your IT or your engineering team that people are accessing in a lot of cases and setting up connectivity to places you wouldn't normally want people to do.
内部软件也一样,都得有身份验证机制。
Same thing, any sort of internal software needs an authentication layer.
所以大家随便写代码、随意访问,这可不是什么好主意。
So, you have everybody vibe coding off, not that great of an idea.
我们在Vercel也遇到过类似情况,因为我们一直走在内部开发的前沿,最后干脆推出了两款产品:Vercel Passport,它能为用户建立身份验证层,确保当你作为销售查询客户数据时,和我作为财务人员查询到的结果是不一样的。
So, we saw this actually at Vercel as well because we sort of been on the bleeding edge of internal build and basically ended up building two products for the market now in Vercel Passport, which basically gives folks an auth layer that can go and make sure if you're doing a query to access customer data and you're in sales and I'm in finance, like, we shouldn't get the same answer.
还有Vercel Connect,同样是解决这个问题——别让人长期持有访问Snowflake、Salesforce这些系统的API密钥。
And then Vercel Connect, which is the same thing around don't let people have long lived, API keys accessing Snowflake, Salesforce, etcetera.
应该让这些密钥权限最小化,而且有效期尽量短。
Have those be minimally scoped and short lived as well.
Tomasz,你提到萨提亚·纳德拉最近在X上发的帖子了。
Tomasz, you talked about Sante Nadella's latest post on X.
我也看到马克·贝尼奥夫在过去的24小时内发了一篇帖子,大力宣传他们公司的零数据保留政策。
And I saw Mark Benioff also had a post, I think, in the last twenty four hours talking he was really touting the zero data retention policy that they have.
萨提亚·纳德拉现在一直在说,我们鼓励大家自己掌控自己的AI系统。
Satya Nadella is out here talking about, we encourage you to take control of your own AI, basically.
这让我开始思考,现在的AI或者AI实验室,到底有多大的信任危机。
I mean, it all got me thinking about the extent to which AI or the AI labs right now have a trust problem.
你怎么看这个问题?
What do you think of that?
是的。
Yeah.
上周我跟两位首席信息安全官聊过,他们最关心的是一套叫ZDR的零数据留存机制。
I mean, chatting with two different CISOs last week, the first thing they care about is something called ZDR, zero data retention.
他们公司明文规定,员工不准使用任何会保留数据的模型。
They have enforced in their companies that no employee can use a model that retains any data.
即便如此,还是有人怀疑这是否真的能做到。
And even then, there is some level of skepticism as to whether that is the case.
就算他们这么说。
Even if they say.
对。
Yeah.
我的意思是,这种谨慎态度其实挺正常的,毕竟这些数据价值高得惊人,光看上周发布的模型就能看出来。
I mean, I think there's just a healthy level of skepticism because I mean, this data is unbelievably valuable, and we can look at it with the model releases even from last week.
用户份额的变化非常明显。
The share shifts meaningfully.
比如Fable一上线,很多人就转投别家了。
Like, Fable comes out, bunch of people move.
事实上,我们之前发布过一份分析报告。
In fact, we published some analysis.
斯坦福有一篇学术论文指出,模型的平均半衰期——你可以参考移动游戏、社交网络和软件公司的留存曲线。
There was a Stanford an academic paper that showed that the average half life of a model, you can look at retention curves for mobile games and social networks and, software companies.
我们今天刚发布了这项研究,结果显示,模型的半衰期介于社交网络和移动游戏之间。
We published this research today, and a model's half life is somewhere between a social network and a mobile game.
到第一个月末,你就会失去超过一半的用户。
You will lose more than 50% of your users by the end of month one.
真的吗。
Wow.
所以如果这些模型之间有这么大的用户流动,拥有明显更优模型的竞争力就变得极其重要。
And so if there's that much movement between these models, the competitive dynamic to have a significantly better model is incredibly important.
这能帮你更容易获得资金,也能让你更好地推广,真正抢占市场份额。
It provides you access to capital to raise, it provides you an ability to market, really move share.
但我得问一下,我想知道那个样本到底是谁?
But I have to ask, is that I'd love to know actually, who was the sample for that?
Open Router 的数据。
Open router data.
Open Router,明白了。
Open router, okay.
我还在想企业采用的问题。
I'm thinking also about, I'm thinking about enterprise adoption here.
企业要真正用上这些模型,花的时间可不短,对吧?
It takes a long time to even use any of these models, right?
所以我猜,如果这些数据来自技术前沿的用户,那……
And so I'm thinking about maybe if that data is the people on the bleeding edge, or
我不这么认为。
I don't think it is.
比如在 Cursor 里,你可以随时切换模型,告诉 Claude 换成 Opus 或者 Sonnet 都行。
I mean, you know, in Cursor, you can switch the model like this if any I mean, you can tell Claude, like, put Opus in there or put Sonnet in there.
而且,最先进的模型通常只能保持领先四十一天。
And then the other dynamic is a state of the art model only remains a state of the art for forty one days.
所以现在‘国王已死,国王万岁’这句话,简直成了每个月都要念一遍的口头禅。
And so so, you know, the expression, like, king is dead, long live the king is basically a monthly chant at this point.
这种局面一直在变。
And that that shifts.
如果你想当一名高效的软件工程师或 SDR,就必须紧跟最新的模型。
Like, the all you have to be on the latest one if you wanna be a really productive software engineer SDR.
你得去测试一下,用这个新模型是不是能提升百分之五到十的性能。
You wanna test, do I have five or 10 percentage points better performance using this new model or not?
所以我都会去试试。
So I will try it.
对。
Yep.
珍妮,AI实验室有没有信任问题?
Jeanne, do the AI labs have a trust problem?
我的意思是,任何快速增长、处理大量数据的大公司,这都是难免的。
I mean, I think any any large company that's growing this quickly and dealing with data, that's always gonna come right?
这一直是个普遍现象,而这些公司往往没有足够的时间去慢慢建立信任。
Like that's sort of been a truism and a lot of these companies have had less time to mature and gain trust to begin with.
不过我觉得萨提亚的观点很有道理,那就是,总体上采用更中立的方式与模型互动,从战略上讲,也让你能每41天就换一次。
But, you know, I thought Satya's points were solid, which is in general setting up a more agnostic approach to how you engage with models is going to also mean that strategically, you can switch every 41 days.
所以,我觉得我们在Vercel所关注的一些事情上,也看到了类似的情况。
So, you know, I think we sort of see the same thing with some of the stuff that Vercel has been focusing on.
我们推出了面向智能体的Eve框架,这是一个开源框架,帮助你灵活切换、自主管理上下文等等。
We launched the Eve Framework for Agents, which is an open source framework that's meant to enable you switching, having your own context, etcetera.
所以我同意萨提亚的一个观点,因为这正是我们的切身体会:上下文才是决定智能体输出成败的关键。
So I agree with one of Satya's points because it's been our own experience, which is your context is what makes or breaks the output of the agent.
以销售开发这个场景为例,市面上现在有十多款AI SDR产品,而我们的表现优于它们。
So you take the sales development use case, there are 10 or more AISDR offerings on the market right now, and we're outperforming them.
我认为这主要是因为,针对我们的具体场景,我们深入思考并完成了将这一能力整合到智能体中的最后一步。
And that really, I think, is because of how, for our context, how we've thought through and gone the last mile of getting that into our agent.
Tomasz,我想暂时换个话题,聊聊广告业务。
Tomasz, I want to switch briefly to advertising,
关于
which
这是你们投资过的领域。
is a space that you have invested in.
你们确实把投资组合里的公司请到了我们的节目里,
You've in fact brought portfolio companies on our show and talked
聊过这些话题。
about.
对。
Yeah.
在广告领域,结合人工智能和聊天机器人,什么样的用户体验才是合适的?
What is the right user experience for advertising as it relates to AI and and chatbots?
你是怎么看待这个问题的?
How do you think about that?
这一点还在不断被探索中。
It's also being discovered.
我觉得这里的潜力非常大。
I think the potential is enormous.
正如我们都知道的,谷歌每年每名用户能带来大约120美元的收入。
Google generates about a $120 per user per year, as we both know.
我们俩都是前谷歌员工。
We're both Zooglers.
你们两位都是。
Both of you.
是的。
Yeah.
你们之前认识吗?
Did you know each other?
不认识
Not know each other
一点都不知道
at all.
珍妮在公司里的职位比我高得多
Jeanne was much higher in
在公司里
the organization
比我高不少
than I was.
那你们当时分别在哪个团队?
What
你们当时在哪个团队?
what teams were you on?
我待过Gmail,后来在Google Cloud还没叫这个名字的时候就转过去了。
I was on Gmail, and then Google Cloud before it was called Google Cloud.
那Tomasz,你是在广告团队吗?
And, Tomasz, you were on the ads?
我在广告团队。
I was on the ads.
对。
Yeah.
我一开始在客户服务部门。
Started in customer support.
我也是从那儿开始的。
So did I, though.
那是很好的起点。
Great place to start.
我负责一个产品。
I'm on a product.
是的。
Yeah.
不过话说回来,我觉得这里面有巨大的潜力。
But, anyway, so I think there's a tremendous amount of potential.
我们的一种看法是,AI广告主要出现在购买漏斗的中后期。
One of the ways we think about it is AI ads really live in the middle to the bottom of the funnel.
它不只是像广告牌那样提升认知,而是真正帮助用户弄清楚哪款车适合自己,哪双鞋最合心意。
It's not just awareness, like a billboard might be, but it really drives users to understand what is the right car for them, what is the right shoe.
另一个情况是,现在当你访问信息页面时,可能会看到一则广告。
And the other dynamic is, like, today, when you visit the information, there might be an ad.
对吧?
Right?
而且这种广告形式对每个访问的用户都是一致的。
And that ad format is consistent across every user that visits.
可能会有一点点个性化调整。
It might be a little bit customized.
但在人工智能的世界里,广告可以根据每个用户的具体情况或搜索内容进行独特定制。
But within the world of AI, it can be uniquely customized because of the context of that particular user or that query.
所以我们认为,你看到的广告内容会随着用户的不同而变化,就像珍之前提到的电商那样,每个人看到的都不一样。
And so we think the ads to creatives or the advertisements that you see will change as a function of the user, very much like in e commerce the way that Jeanne was mentioning before, everybody's So
那你对OpenAI在2030年实现其广告收入目标持乐观态度吗?
so do you so are you bullish on OpenAI hitting its big advertising target in in 2030?
是吗?
Is that
是的。
Yes.
我觉得这对他们的业务成功至关重要,毕竟用户占比和...
I mean, think it's critical to the success of that business just given the fraction of consumers or
是的。
Yeah.
还有用户访问模式,同时这对抵消推理成本也很关键,就像Netflix和其他视频平台所做的那样。
You know, the visitation patterns, and then also important to offset the cost of inference just the way that net Netflix has done and others in video.
展开剩余字幕(还有 480 条)
所以我相信他们能做到,你看搜索广告市场有两千五百亿美元,社交广告去年底达到两千六百三十亿,AI广告我觉得肯定会跟上。
So I'm I'm confident that they will, and I think you look at search ads, $250,000,000,000 market, social ads, two sixty three at the end of last year, AI ads will be, I think Right.
会大得多。
Much bigger.
Jeanne,我知道你离开Stripe已经有一段时间了,现在又加入了Shopify的董事会,这真是个令人兴奋的新机会。
Jeanne, I know it's been a while since you were at Stripe, and you just joined the board of Shopify, which is an exciting new opportunity.
总的来说,如果你要预测一下明年AI对电商会带来什么最大变化,你觉得会是什么?
I mean, broadly speaking, just if you were to make a prediction about AI and commerce for the next year, what do you think is going to change the most?
我们最近观察到一个很有趣的现象,其实是让长尾商品得到了更多曝光。
One of the really interesting dynamics we've been seeing is actually that it's exposing more of the long tail, right?
你可以在AI里做非常精准的搜索,一下子就能找到那些卖你想要的那种日本风纽扣衬衫的小店。
So you can sort of do like a very specific search within AI, and all of a sudden, it's getting you access to, you know, the sort of torso and tail of shops that are selling your specific Japanese button down, you know, shirt that you wanted.
从电商角度看,这确实是个好事,让那些没有上亿美元广告预算的小商家也能被看到。
So near run, that's been positive from a commerce perspective, is just getting more exposure to the folks that don't have the $100,000,000 you know, advertising budget to show up.
我觉得有意思的是,未来人们会不会干脆把购物决策完全交给AI,让它直接下单——很多人其实低估了,其实很多人买东西,是因为享受这个过程。
I think like what'll be interesting is where people want to hand over the reins on commerce and actually let AI go complete the purchase versus I think people sometimes underestimate the degree to which people shop because they enjoy
这让我想到,Brian Chesky 曾经说过,他不确定聊天机器人是不是购物和电商的合适方式,你知道的。
it and It want to go look at reminds me of I mean, look, Brian Chesky has said that he's not sure if a chatbot is the right medium for shopping and commerce and, you know
举个例子,我这周末住了一家Airbnb,如果用AI来搜索,我找房子的方式会跟现在用的筛选功能完全不同。
There are a lot of like, if you take I just was at an Airbnb this weekend, and I would have searched for what I wanted fundamentally differently with AI than with the filtering method that you have now.
这样我能更快地找到那十套我真正想看的房源。
So I think there could get me much more rapidly to the 10 house homes I actually want to look at.
我觉得AI在发现新东西方面肯定会特别厉害。
So I think it'll be like incredible for discovery for sure.
然后就是,人们到底愿意让AI直接完成交易,还是更想自己慢慢挑这十套房源,或者那五件裙子之类的。
And then, you know, degree to which people again go off and say, okay, now complete that transaction versus I actually do want to peruse those 10 different homes or, you know, those five dresses, etcetera.
非常感谢你们两位来参加我们的节目。
Well, I want to thank you both for joining us.
今天的对话非常精彩。
It was a great conversation.
今天我们请到的是来自Vercel的Jeanne Grosser,以及Theory Ventures的Tomasz Tunguz,欢迎来到TITV。
That is Jeanne Grosser from Vercel and Tomasz Tunguz from Theory Ventures here on TITV.
不管是GPT、Sonnet、DeepSeek还是Fable,AI模型的优势都是当前大家普遍关注的核心话题,不管 Adoption 进展到哪一步。
Whether it's GPT or Sonnet or DeepSeek or Fable, the strength of AI models is one of the big topics everyone is tracking irrespective of where adoption is at.
当OpenAI和Anthropic这类闭源模型背后的公司激烈竞争时,它们也都正面临越来越多对开源模型的关注。
And while the companies behind closed source models like OpenAI and Anthropic are battling it out, they are both brushing up against a lot of recent interest in open source models.
为了理清这场竞赛的现状,我想请来Decagon的CEO杰西·张。
To unpack the current state of that race, I wanna bring on Jesse Zhang, the CEO of Decagon.
杰西,欢迎来到节目。
Jesse, welcome to the show.
很高兴你能来。
It's great to have you here.
谢谢你的邀请。
Thanks for having me.
你最近在X上写了好多有意思的内容,发了不少好帖子,其中有一篇最近的特别吸引我。
So you've been doing a lot of interesting writing on X, a lot of great posts, and one of your most recent posts really intrigued me.
那篇讲的是开源模型,你提到:‘大家对开源AI在企业中的应用都理解错了。’
It was about open source models, and you wrote that everyone is wrong about open source AI in the enterprise.
他们错在哪儿?
What are they wrong about?
是的,简单来说,现在有个很强的说法,认为开源已经全面胜出了。
Yeah, I would say to put it simply, there's a really strong narrative now that open source has taken over.
它的采用率正在大幅上升。
It's getting a lot more adoption.
从各种数据都能看出来,比如Hugging Face上的模型使用量、推理服务商的支出,全都飙升了。
You see this in ton of metrics, the usage of the models on Hugging Face, the spend on the inference providers, they're all ripping.
这一点确实没错。
So that is true.
开源确实在快速发展,但如果你仔细看研究数据,会发现开源模型相比闭源模型的占比其实正在下降。
Open source is happening more, but then actually, if you look at the research, a lot of the stats are saying that the share of open source compared to closed source is actually shrinking.
所以我们一直在想,为什么会这样?毕竟我们自己是开源的坚定支持者,目前我们90%以上都是开源的。
And so we were just thinking why that is, because we are a big proponent of open source, so we are pretty much 90 plus percent open source at this point.
真没想到。
Wow.
你们一直都是90%开源的吗?不是,不是的,
Have you always been 90 No, no,
我们刚开始的时候,全是闭源的,因为你得先搞清楚使用场景,对吧?
When we started, it was all closed source, because you're just trying to figure out the use case, right?
对的。
Yeah.
但我的观点是,为什么开源在增长,它的占比却在下降呢?
But my thesis was, Hey, why is it the case that open source is growing, but then the share is shrinking?
简单来说,开源特别适合那些结构清晰、已经明确的规模化生产场景,你知道你的代理或模型调用该怎么设计。
That, simply put, open source is great for scale production use cases where you know the structure of the use case and you know the structure of your agent or the model calls.
其他所有情况,闭源反而更合适。
Everything else, closed source makes more sense.
所以你看企业用户,大多数应用场景还处在实验阶段,或者还没完全落地、没规模化,这就是为什么闭源方案依然这么流行。
And so if you look at the enterprise, most of the use cases are still in that experimentation phase or still in that sort of not fully productionized, scaled out phase, and that's why Close Force is still so popular.
所以我从你的帖子里理解到的是,当你为AI设定一个任务时,你希望用最先进的模型。
So the point that I sort of read from your post was this idea that when you come up with a task for AI to do, you want the cutting edge model.
你需要前沿模型,因为你不确定完成这个任务到底需要多大的算力。
You want the frontier model because you don't know how much power essentially you're gonna need to complete the task.
我理解你的意思是,我们之前遇到过很多这样的场景。
The way I read what you were saying is that, you know, we had a a lot of these use cases.
人们会想,嘿,这个我好像也能做。
People thought about, hey, I think I could do this.
那为什么不直接用前沿模型呢?
Why not use a frontier model?
但现在大家开始觉得,嗯,也许没必要用那么强的模型了。
Now we're at the point though where they're saying, okay, well, maybe I don't need that.
用开源模型就够了。
I can use the open source models.
不过我想问你的是,这项技术的应用前景难道不会继续扩展吗?
The question I have for you though is won't the applications of the technology continue to keep going?
我们总会发现新的用途,所以前沿模型的使用场景理论上还是会持续下去,对吧?
We're going to keep finding new use cases, so frontier model use conceivably will still continue, right?
是的,这正是我想表达的核心观点。
Yeah, that's my main point.
所以
So
并不是说开源模型现在更聪明了,就能完全取代前沿模型。
it's not that, Hey, open source is going to take over and because they're smarter now, you don't need the frontier models.
我觉得总会不断出现新的应用场景。
I would say there's always going to be new use cases.
另外我提到过,要让开源模型达到前沿模型的水平,其实需要投入大量工作。
And the other thing I wrote about is that the effort to get open source to perform at the same level as Frontier, it actually does take effort.
这并不是说这些努力不值得。
And that's not to say that effort's not worth it.
我们确实投入了很多资源,而且完全值得,比如在做AI客服时,一旦这个场景稳定下来并且在生产环境中规模化了,用开源模型就特别合适,因为投入训练这些模型是划算的——尤其是那些小型模型,能带来很大的收益。
I mean, again, we put a lot of effort in and it's super worth it because once We do AI customer service, and so once that use case is solidified and you're already scaled in production, then open source makes a lot of sense because it makes sense to put in that effort to train those models because those open source models, especially the small ones, you get a lot of benefit out of them.
而且延迟更低,这正是我们最看重的一点。
You get better latency, which was the main reason for us.
成本也更低。
You get better cost as well.
这些模型开箱即用的话,根本达不到要求。
Out of the box, those models are just not good enough.
你得花大量功夫,才能让它们够用,能在某些场景下替代前沿模型。
So you have to put in a lot of work to make them good enough and make them be able to sub in for these frontier models in certain spots.
一旦投入了这些工作,结果就必须能证明这些投入是值得的。
And once you put in that work, now the results have to justify the work.
只有当你在生产环境中大规模部署时,这些投入才真正说得通。
And they only justify the work if you're deployed in production at scale.
正如你所说,大多数应用场景都不是这样的。
Most of the use cases, to your point, are not like that.
所以人们还是会继续用前沿模型来应对这些情况。
So people are just gonna continue using frontier models for that.
你们在开源模型方面具体在用哪一个?
Which model specifically are you guys using in the open source category?
是多种多样的。
It's a mix.
我们主要用的是Genma 4,这是美国的主要模型。
So we have Genma four is the main American one.
中国的很多模型也很不错,比如Quinn和GLM。
A lot of the Chinese ones are quite good, Quinn, GLM.
我们有自己的评估体系,来判断哪些模型在特定场景下表现更好。
And we have our own evals to decide which ones perform better in certain scenarios.
对。
Right.
你所说的这场开源模型竞赛,是指中国和北美地区开发的开源模型之间的竞争,对吧?
How do you mean, the race here, the open source race here, I guess, between open source models coming out of China and those developed here in North America.
以前大家对这场竞赛非常关注。
At one point, this was a race that people were paying a lot of attention to.
现在大家普遍认为,这些模型确实很出色。
Now it's accepted, I think, that you know, those models are great.
人们愿意使用它们。
People are willing to use them.
我的意思是,如果你要预测一下这场竞赛会怎么发展,你觉得现在这个问题是不是已经过去了,我们可以随便用任何模型了?
I mean, if you were to sort of make a prediction as to how you see that race playing out, do you think that the issue of it is kind of behind us now and now we can just sort of use whatever we want?
我觉得这完全取决于个人的选择。
I think it's really up to people's choices.
我们接触过一些企业,他们的管理层很坦率地表示:我们只用美国训练的模型,因为即使是中国的开源模型,也都是托管在美国的。
We've talked to enterprises where, super fairly, their leadership has made a decision, Hey, we only wanna use models that are trained in The US, because even the Chinese open source models, they're all hosted in The US.
你的数据并不会外流,所以这并不是问题,但问题是,这些模型里可能带有某种偏见。
Your data's not going anywhere, so that's not a concern, but it's, Hey, maybe there's some bias in those models.
我们不希望这些模型进入我们的系统。
We don't want those models in our system.
这取决于每一家企业自己的决定。
And so that's up to each enterprise.
还有一些企业则对使用开源模型非常放心。
Other ones are very comfortable using open source models.
我认为中国采取了非常支持开源的路线,因为这正是他们竞争的方式。
I think China has taken a very open source forward approach because I think that's how they compete.
在美国,很多顶尖实验室如果站在他们的立场上,把最好的模型保留为闭源是合情合理的,毕竟这样能赚更多钱。
In The US, a lot of the leading labs, I think just if you're in their shoes, it makes sense to put your best models not open source because you make more money that way.
所以现在也听到中国方面说,也许他们已经达到了某些领域的前沿水平,接下来可能想停止开源了。
So there is kind of that balance, you also hear from China now that, okay, maybe they want to kind of now that they've reached frontier level in certain cases, maybe they want to stop doing open source.
谁知道呢?
Who knows?
我们拭目以待,但我认为提供更多选择对大家都更好。
We'll see, but I think having a lot of choices is just better for everyone.
你觉得Meta的决定怎么样?
What do you think of Meta's decision?
Meta最初推出的Llama系列模型都是开源的。
Meta, initially, the LAMA family of models, and that was open source.
Muse的话,除非我搞错了,应该是个闭源模型。
Muse, unless I'm missing something, that is a closed source model.
所以目前来看,这是在向非开源方向转变,这是一种选择。
So this is a transition away from open source for the moment, which is a choice.
你觉得是什么因素促成了这个决定?
What do you think make up that decision?
我觉得这很合理。
Again, I think it makes sense.
如果你站在美国公司的立场上,这其实是常态。
If you're in their shoes in The US, that's the norm.
所有新模型都是闭源的,一旦闭源,就能保留更多优势,还能靠用户付费来赚更多钱。
All of the new models are closed source, and if they're closed source, you maintain more of your alpha, and you get to make more money because people are paying for the model.
这形成了一个自我强化的循环。
That's like a self reinforcing loop.
用这些收入来覆盖模型训练的成本,自然就说得通了。
You take that revenue, that helps cover the cost of training the model, and so that makes sense.
但如果中国也这么做,美国那边根本没人会用这些模型,大家担心数据会流向中国。
And again, in China, if they did that, no one in The US would use those models because people are afraid of their data going to China.
所以在那儿采取开源策略是有道理的,因为这能让人使用你的产品
So having open source strategy there makes sense because it gets people to use your
给咱们说说你们公司最近的情况。
Give us an update on your company.
我们差不多一年前就请过你上节目了,实际上,哦,
We had you on the show almost a year ago now, actually, Oh,
还没那么久呢。
it hasn't been that long.
已经那么久了。
It's been that long.
你之前说,我们录节目前,你们公司现在有五百人了?
You were telling me before we started taping, you're at 500 people now as the company?
是的。
Yeah.
公司发展得可真快。
Companies run very quickly.
我们总部就在旧金山,不远,不过现在我们——
We're based here in SF, not too far but now we're-
你们的产品线扩展了不少吧?
Your product suite has expanded quite a bit, right?
是的。
Yes.
我们第一次见面的时候,大概是一年前吧,那时候公司规模只有现在的十分之一,而且我们公司才成立两年多一点。
So when we first met, I think, I mean, a year ago, were maybe a tenth the size, and we only started the company two, two and a years ago.
是指收入吗?
In terms of revenue or?
不是,是员工人数。
No, people.
是员工人数。
People.
明白了。
Okay.
大概五十人左右。
Like 50 people maybe.
一开始我们做的是AI客服助手。
Early on, was AI customer service agent.
这么说最能理解我们是做什么的。
That's the easiest way to think about us.
我觉得这依然是我们的核心,不过我们稍微拓宽了方向——Decagon的目标是帮助任何企业最大化客户体验。
I would say very much that's still our core focus, but we've expanded the aperture a little bit to be, Hey, our goal as Decagon is to help any business maximize their customer experience.
让客户能轻松地与企业互动,随时都能有个对话助手可以交流。
So make it really easy for customers to interact with them, have a conversational agent that they can talk to at any point.
这可以用于客户服务。
And it could be for customer service.
也可以是主动发起的。
It could be proactive as well.
比如主动联系客户,提升参与度,或者防止他们流失之类的。
You could proactively ping someone to get them engaged or make sure they don't churn or whatever.
所以我们把这个概念称为管家式服务。
And so we call that concept like a concierge.
这相当于为企业提供了一种全新的用户体验。
It's like a new UX for the business.
没错。
Right.
现在公司的营收规模有多大?
How big is the company now in terms of revenue?
我们不公开谈论营收,但增长非常快。
We don't talk about revenue publicly, but we've been growing very quickly.
去年我们的营收大概是原来的五倍。
Last year, we were roughly 5X.
今年的目标也是差不多的增幅。
This year, probably want to do roughly the same.
真厉害。
Wow.
2025年增长五倍,没错。
5X in 2025 and Yes.
有一类我们在这里经常提到的产品,就是客户支持工单系统,用户能直接编写解决方案。
Top There's a category of products that we've been written around here, customer support tickets where they can actually code up solutions.
我们在通讯简报里也写过这个功能。
That's something that we've written about in our newsletters.
你们有没有关注过这个方向?有没有尝试过?
That seemed like some Have you guys expanded into that, looked into that at all?
是的。
Yeah.
核心想法是,有个智能代理在和客户对话,这就是代理的主要工作。
So the concept there is, hey, you have an agent that is talking with the customer, so that's what that agent does.
不管是语音代理还是其他形式,对话的最终结果可能是——我们需要修复某个问题。
Maybe it's a voice agent or whatever, and maybe the outcome of that conversation is, Hey, we actually need to fix something.
这时候,可以再让一个更慢但更聪明的代理在后台配合,帮助优化或解决问题。
So then you can have a slower, maybe smarter agent that's sitting behind it that it works with to get better or to fix things.
这其实是我们今年最重要的发布之一,我们叫它Duet,因为就像两个智能体在协同工作。
And so that was actually one of our biggest launches this year, and so we call it Duet because it's like two agents working together.
你这边是个快速响应的智能体。
So you're a fast agent.
OpenAI和Anthropic最近推出的新模型,比如Opus 4A、Fable这些大型思考型模型,其实不太适合用在语音智能体上,因为它们反应太慢了。
A lot of the new releases from OpenAI Anthropic, like Opus 4A, Fable, these big thinking models are not actually be that useful in your voice agent because they're way too slow.
它们可能要十秒钟才回复,但正适合做第二个智能体。
They could take ten seconds to reply, but they're actually really good for the second agent.
第二个智能体的任务是观察第一个智能体的行动,分析这些对话,发现问题——哦,原来我们在某个环节做得不够好。
And so the second agent's goal is to look at what the first agent is doing, look at these conversations, your point, identify that, oh, yeah, actually, there is this area that we're not doing super well.
这是改进的方法。
Here's how we'd fix it.
我们会更新你的文档,或者调整我们写的工具之类的。
We will update your documentation or we'll change this tool that we wrote, etcetera.
它的角色,其实就是为未来打造一个类似Cloud Code的后台辅助系统。
And its job is to just kind of almost be like a Cloud Code type thing for the future.
然后实际去完成任务,同时把问题修好。
And actually do the task, but fix the problem.
这一点在Duet里你们确实实现了。
That is something with Duet that you have implemented.
对。
Yeah.
那大家平时都用Duet来做什么呢?
So what do people use Duet for?
他们可能会过来说:我想搭建一些新的工作流程。
They could come in and just be like, Hey, I want to build these new workflows.
我们这方面的文档还不太完善,但这里有上万条之前的对话记录。
We don't really have good documentation for them, but here, here's 10,000 previous conversations.
你去帮我们把这些流程写出来。
You go and write these workflows for us.
他们会进入Decagon系统,编写这些文档,我们叫它‘智能体操作手册’,用来指导主智能体该怎么做。
And so they'll go inside Decagon, they'll write these documents, we call them agent operating procedures, to program the main agent what to do.
等你上线运行后,它会自动为你生成测试用例。
And then once you're out in production, it'll actually create tests for you.
它会读取所有对话记录,每一条新来的 transcripts 都不放过,这种事人类根本做不到,数量太多了。
It will read those conversations, every transcript as they come in, like no human will ever be able to do that, there's way too many.
它还会告诉你:这个部分运行得不错,但那个地方出问题了。
And it'll tell you, Okay, this is going well, but this thing is broken.
只要有人提到这个话题,我们就明显卡住了。
Time someone talks about this topic, we're struggling.
所以我仔细翻看了所有对话,终于发现:原来问题出在这儿,这才是提升的关键。
So I've gone in and read all those conversations and I've come up with, Oh, actually, how you get better.
现在,我不但找到了改进的方法,还亲自去做了调整。
And so now, not only have I identified how to get better, I've gone in and made the changes.
所以,该动手的时候就动手干。
So like do the work.
那你又是怎么决定要进行这些评估的呢?
How do you then determine the I'm going to evals here, really.
现在很多人都在关注智能体的评估问题。
Evals with agents is a topic that I think people are really focused on these days.
比如在客服场景里,其实标准挺明确的。
I mean, with customer service, I guess it's sort of binary.
你要么解决了客户的问题,要么没解决。
You either answered the inquiry or you didn't.
但像你刚才说的这种创建工作流的任务,效果到底好不好,就成了一个问题。
In a task like you just described, creating workflows, the effectiveness of those workflows becomes a question.
随着技术的发展,现在对智能体的评估是变难了,还是变简单了?
Are the evals with agents, are they getting harder or are they getting easier right now with the way the technology is going?
我觉得这得看具体领域。
I think it depends on the space.
在我们这个领域,评估标准其实比较清晰,因为一旦有人进来,我们心里就有数了——什么样的对话才算成功,就能据此设计评估标准。
I think in our space, evals are fairly clear because if someone comes in, have an idea of what is a successful conversation with, so you can set up evals against those.
所以我们产品里有个叫‘模拟’的功能,可以模拟各种类型的对话,在智能体上线前,就能先测试它表现如何。
And so we have a concept called simulations in our product where you can just simulate all sorts of different types of conversations, and even before you push an agent live, you can eval if it's working.
同样的,一旦上线了,你就可以对这些对话进行评估。
Same thing, once it's in production, you can evaluate those conversations.
所以这个还算简单。
So that's fairly simple.
有没有哪些方面变得越来越难了?
There any areas where it's getting more difficult?
现在评估这个话题确实很热门,可能在你们业务里不明显,但从我接触的人来看,大家现在都在为评估问题头疼。
I mean, eval is It's a topic right now that And it might not be in your business, but I guess from the people you talk to, I mean, evals, this is an area that people are really grappling with right now.
我觉得大家真正纠结的是如何评估底层模型本身。
I think the area that people are grappling with is more evalling the base models themselves.
比如,Fable 和 Muse Spark 哪个更好?这种问题很难说清楚。
It's like, Hey, is Fable better or is Muse Spark better or whatever?
真的很难下定论。
It's really hard to say.
所以大家才需要评估体系和基准测试,然后有人会说:其实这个基准并不靠谱,因为 XYZ 原因。
So that's why people have Eval's, they have benchmarks, and then people can come out and say, Actually, no, this benchmark's not good because of XYZ reason.
最难衡量的就是模型到底好不好,但在我们的场景里,目标非常明确。
That's the tough where it's really tough to measure if a model is good or not, but in our use case, it's so targeted.
就是一个代理,解决一个公司的一个具体问题,这家公司自己很清楚什么叫成功。
It's like one agent for one use case for one company, and so that company knows, Here's what success looks like.
所以在我们的场景里,评估起来简单多了,你懂吧。
So the evals are a lot simpler in our use case, if that makes sense.
如果现在平台上90%的工作都是基于开源模型做的,那你们用Fable和5.6具体是做什么任务?
So if 90% of the work that's happening on your platform right now is coming from open source models, What are the tasks then that you are using Fable for, 5.6 for?
你们到底拿这些模型来干什么?
What are you using those models for specifically?
Duet就是个很好的例子,对吧?
So Duet is a good example, right?
Duet是依赖前沿模型的。
So Duet relies on the frontier models.
那既然这样,我们当初为什么要大力推动用开源模型呢?
If rewind, why did we make a push to use open source in the first place?
因为在我们的语音助手或聊天助手里,延迟真的很重要。
It's because in our voice agent or our chat agent, latency does matter.
如果客户来找你,跟助手对话,助手能迅速响应、快速解决你的问题,体验就会好很多。
If you're a customer and you're coming in, you're talking to the agent, if it can be super snappy and just get to my problem faster, that's just a much better experience.
你可不想听到‘请稍等’,然后干等十秒钟。
You don't wanna be like, Okay, give me a second, and then it's just waiting for ten seconds.
所以我们转向了开源模型,因为它们体积更小,运行更快。
So that's why we moved to open source, because those are smaller models, they're faster.
这些模型刚出来时效果未必好,得经过微调和训练,才能完成我们要求的任务,但这么做是可行的——在语音助手的流程中,很多步骤其实不需要复杂模型,比如‘选择话题’这一步,根本用不着大模型。
Those models are not gonna be that good out of the box, and so you have to fine tune them, you have to train them so that they can perform the same tasks as you would need to, but it works because in this voice agent, most of the steps along the way, one of the steps could be choose the topic, that model doesn't need to be a big model.
做这个任务,不需要懂太多东西。
You don't need to know a lot to do that task.
你只需要特别擅长判断该选哪个话题就行。
All you have to do is be really good at choosing the topic.
没错。
Right.
所以开源在这里是行得通的。
So that's why open source works there.
但对于像 Duet 这种更通用的场景,你只是跟它说:‘帮我看看我所有的对话,做点事吧。’
But for things like Duet where it's much more general purpose, you're just asking it, Hey, go read all my conversations and do some work for me.
在这种情况下,用智能就没太大意义了。
Using the intelligence doesn't make sense there.
这就是其中的权衡。
So that's the trade off.
我想问你几个关于这里技术细节的问题。
I want to ask you about a couple of the more technical elements here.
持续学习、自我迭代改进,你们可是深陷这个领域啊。
So continual learning, recursive self improvement, I mean, you're deep in the space.
我们上周刚开完 ICML,所有研究者都在讨论这些话题。
We just had ICML last week, and all the researchers were talking all about these topics.
你对持续学习这个问题怎么看?实现它的机会有多大?到底在推动 AI 普及上,它有多关键?
I mean, what's your view on the continual learning problem here, the opportunity to get to there, the extent to which you actually need it to drive AI adoption?
你觉得呢?
What do you think?
我觉得这显然非常强大。
I think it's obviously very powerful.
毕竟,有大量证据表明它确实有效。
I mean, there's so much evidence that it works.
而且,如果你看看很多实验室的研究,就会发现他们其实面临数据不足的问题。
Also, if you look at the work that a lot of labs are doing, there is a bit of a data limitation problem.
我们已经用尽了所有能拿到的数据来预训练这些模型,那接下来该往哪儿走?
We've taken all the data that we can to pre train these models, well, where do you go from there?
持续学习就很棒,或者干脆直接根据模型的实际表现来学习。
Well, the continual learning is great, or just being able to kind of learn from actually the model's performance.
这样一来,你就打开了通往全新类型数据的大门。
Then you kind of open up your aperture to like a whole world of new type of data.
你甚至可以说,人类的学习方式也是这样的,对吧?
And you could argue that's how humans learn as well, right?
就像小时候,你总会有人告诉你该怎么开始,但之后这一生,你主要是靠自己的经历和错误来学习。
Like when you're little, you kind of get instruction of like, Okay, here's how you get started and whatever, but then from there, throughout life, you're kind of learning through your own experience and your own mistakes.
所以你可以说,这本来就是很自然的发展方式。
So you could argue that that's sort of naturally what should happen.
这是从模型层面来说的。
That's at the model level.
对我们来说,我们可能处在应用栈更高的一个层级,目标是整体提升智能代理的表现。
For us, we were maybe like one level higher in the app stack, where we are trying to improve the entire agent as a whole.
所以这种学习的重点,不在于改进模型本身。
And so the type of learning there is less about improving the models.
而在于,通过我们的智能代理为某个企业处理数百万次客户服务互动,从中发现哪些地方可以改进,怎样才能变得更好。
It's more about how can you, through our agent having millions of customer service interactions for a certain business, through those interactions, figure out what can be improved and how to get better.
对。
Right.
你觉得AI研究人员的工作,有多大程度能被自动化?
What's your view on the extent to which the role of AI researchers can be automated?
我觉得离那还远着呢。
I think we're kind of far from that.
特别远。
Far
远远达不到。
from it.
这才是让人焦虑的地方。
This is the anxiety.
这正是我担心的,我只是在跟你说说AI研究到底是怎么回事。
That's the kind of concern I have, it's just I'm telling you what the AI research is.
总有更多事情可以做。
I mean, there's always more to do.
我们现在有个相当庞大的研究团队,成本很高,但人都是顶尖的。原因很简单:如果我们不在这上面投入,不投资训练开源模型,我们的产品就不可能达到顶尖水平——延迟问题、各种性能瓶颈,只要我们能把数据收集好、训练到位,这些问题都能解决。
We have a pretty sizable research team at this point, and it's a very expensive team, but we have some great people, the reason is that, hey, we decided, unless we invest in these things, unless we invest in training open source models, our product is not gonna perform state of the art because we're gonna have latency issues, we're gonna have all these things that could be done better if we actually compile the data and train it.
所以我觉得,研究人员能发挥的空间还多得很。
So I think there's just gonna be so many use cases for researchers to help with.
我想问你个问题。
I wanna ask you a question.
Salesforce 收购了 Fin。
So Salesforce bought Fin.
你们收到过收购要约吗?
Have you guys gotten any acquisition offers?
我们也不谈这个,但目前真不是我们最关心的事。
We don't talk about those either, but it's not really top of mind for us.
我们才成立两年多。
We're only two and a years
老了。
old.
那融资呢?
What about fundraising?
有的。
Yeah.
融资方面,我们一直挺积极的。
Fundraising, we've been very active.
到目前为止,我们已经完成了五轮融资。
We've done five rounds so far.
第六轮是不是正在
Is there a sixth happening
进行中?
right now?
目前还没有,不过很快就会有。
Right now, no, but at some point soon.
我们刚完成上一轮融资,时间也不长。
We just did our last round not too long ago.
你们是怎么看待公司增长的?
How do you think about growth of the company?
你提到过要把产品系列扩展到客服代表之外。
You talked about expansion of the product suite beyond just the customer service agents.
三年后,Decagon的扩张会是什么样子?
Three years from now, where does Decagon What does expansion look like?
是进入新市场吗?
Is it new markets?
是推出横向产品吗?
Is it horizontal products?
你们最终的愿景是什么?
What's the ultimate ambition for you?
我们的目标,正如我之前说的,是打造一个或一组智能代理,彻底改变企业与客户互动的方式。
So ambition for us, as I mentioned, big vision here is can we produce an agent or a set of agents that can just improve how every business interacts with their customer.
我们关注的核心,就是这个互动层面。
So that interaction layer is what we care about.
你可以这样想,过去人们只有网站,后来手机出现了,大家都开始用手机。
And you can almost think of it as, Hey, in the past, people had websites and then phones came out and everyone was using them.
于是,移动应用就成了新的交互界面。
So then a new UI was created, which is the mobile app.
现在,紧随其后又出现了一种新的交互方式,那就是对话式智能代理。
Now there's almost a new UI after that, which is a conversational agent.
这是一种与企业互动的新途径。
It's a new way to interface with the business.
这并不意味着手机应用和网站会消失,但它确实提供了一种全新的互动方式,而这正是我们努力的方向。
That doesn't mean mobile apps and websites are going away, but it's a new way to interface with the business, and so that's the vision that we're building towards.
那这到底意味着什么呢?
So what does that mean?
首先,我们需要推出多种类型的对话场景,不只是被动的客户服务,对吧?
Well, one, we have to launch a lot of different types of conversations that an agent could have, not just inbound customer service, right?
目前我们的产品开发重心就在这里。
So that's where a lot of our product development is.
围绕提升互动体验、深入理解互动内容、实现自动学习这些方向,还有很多可以打造的产品,就像你刚才说的那样。
There's a lot of other products you can build in this theme of making that interaction better, being able to understand the interactions well, being able to auto learn, as you were saying, right?
我们和Duet合作推出的一个重要功能,就是Duet自动导航——它不需要你主动去查询,每天早上会自动为你生成一份报告。
One of our big launches with Duet was this concept of Duet autopilot where instead of you even having to go in and ask at things, it just prepares a report every morning.
你早上一醒,登录系统,Duet就会告诉你:昨天的所有对话我都看过了,这是整理好的情况报告。
You just wake up, you log in, and Duet tells you, Yeah, I read all the conversations from last day, and I put together this report of what's going on.
这些就是我们正在推出的功能,我们觉得这个愿景实在太宏大了,要做的事情多得是,短期内根本不用担心没东西可做。
So those are the things that we're launching, and we just think that that vision is just so large, and there's so much to do there that we're not gonna run out of things to build anytime soon.
杰西,非常感谢你今天来做客。
Well, Jesse, I want to thank you for coming on.
这位是Decagon的首席执行官杰西·张,欢迎来到TI TV。
That is Jesse Zhang, the CEO of Decagon here on TI TV.
顶尖研究人员之间的AI人才争夺战,未来几个月很可能仍是主流话题。
The AI talent wars over top researchers is likely to be another dominant story for many months to come.
根本原因在于,AI研究人员还有很多关键问题亟待解决。
The core reason, of course, is that there are still some meaty questions AI researchers still need to solve.
软件能降低推理成本吗?
Can software cut inference costs?
智能代理自我提升的速度能有多快?
How quickly can agents improve themselves?
递归式自我改进真能实现吗?
Will recursive self improvement become a reality?
接下来我想请我们的AI与机器人记者罗克特·德鲁来聊聊这些话题。
I wanna bring on our AI and robotics reporter, Rocket Drew, for a conversation about all of those topics.
罗克特,欢迎来到节目。
Rocket, welcome to the show.
很高兴你能来。
It's great to have you here.
非常感谢。
Thanks so much.
能亲自到场真的很棒。
It's great to be here in person.
太有意思了。
So fun.
我得说一句,其实我才是来访的客人。
I should say, I mean, I'm the visitor.
你这儿常驻。
You are based here.
没错。
That's true.
确实如此。
That's true.
你开麦了。
You're on
这是你的地盘。
my home turf.
好了。
There we go.
行。
Okay.
我们刚才跟张杰聊了开源模型的事。
So we just talked to Jesse Zhang about open source models.
明白吗?
Okay?
我们稍微聊了点关于递归自改进的内容。
We touched a little bit on recursive self improvement.
持续学习这个话题,我们节目一直想搞清楚它到底是什么。
This topic of continual learning is one that we've been trying to wrap our heads around on the show.
你能帮我们理清一下,持续学习具体包括哪些内容?目前研究进展到什么阶段了?
Can you help us understand what is included in continual learning, and where is the research at right now?
是的。
Yeah.
当然可以。
Absolutely.
那是个
That's a
很好的切入点,因为持续学习现在正是人工智能研究前沿的热门话题。
great place to start because continual learning is a super hot topic on the frontier of AI research right now.
基本想法是,如果你有一个能持续学习的AI,它就能在工作中学习。
The basic idea is that if you have an AI that can continually learn, then it learns on the job.
它会在执行任务的过程中,从经验里吸收新知识、新信息和新技能。
It picks up new knowledge, new information, new skills from experience just as it goes about working and completing tasks for you.
我们现在说的是模型,还是智能体?
And we're talking about the models or the agents right now?
这是个好问题。
Well, that's a good question.
我们就先说模型吧。
Let's say the models.
咱们假设自己是个纯粹派。
Let's say we're being kind of purists.
我们真正希望的是,模型能自己适应,灵活地获取新信息。
We really want the model to be able to adapt and flexibly pick up new information.
目前其实有一些变通方法,能让智能体实现持续学习,我稍后解释。
Now there are kind of workarounds right now to get your agent to sort of continually learn, and I'll explain that in a second.
但我觉得有些人可能会对这个想法有反应,比如:聊天机器人不是已经能持续学习了吗?
But I think some people might have a reaction to this idea that's like, well, can't chatbots already continually learn?
ChatGPT 不是用得越多就越了解我吗?
Doesn't ChatGPT learn more about me as I use it?
没错。
Right.
在某种程度上确实如此。
That's true to some extent.
但别忘了,现在AI模型的训练方式是:先经历一个大规模的训练阶段,这期间是独立的,之后就直接使用模型了。
But as a reminder, the way AI models are trained these days is you have one big phase of training, and that's kind of a discrete period, and then you just use the model.
在使用过程中,模型的参数——也就是它的‘大脑’——其实是被锁定的。
And basically the weights of the model, the brain of the model, are frozen while you're using it.
我觉得这就像第一阶段你打造工具,第二阶段你才开始用这个工具。
I think of it like in stage one, you're forging the tool, and in stage two, you're using the tool.
持续学习则重新思考了这种模式。
Continual learning reimagines this.
它说的是,如果这个工具在你使用的过程中能不断调整优化,变得越来越擅长手头的工作,那会怎么样?
It says, what if the tool could adapt and change as you use it to become better and better at the jobs?
现在确实有一些变通办法,但说实话,都挺粗糙的。
Now there are some workarounds, but they're very they're kinda janky, frankly.
我觉得这正是关键所在。
I think that's the way to
没错。
put it.
比如当ChatGPT随着时间越来越了解你时,它其实是在给自己留下一些备忘,方便以后参考。
Like when ChatGPT learns more about you over time, it's leaving little notes to itself that it can reference at a later date.
就像你提到的,一些智能代理也有类似的临时方案。
And like you mentioned, some of the agents have workarounds as well.
它们也能给自己留备忘记录。
They can leave notes to themselves
对。
Right.
为了提醒自己该怎么完成任务。
To remind themselves how to solve a task.
但这种方式一点都不优雅。
But it doesn't feel elegant.
这跟人类根据经验即时学习新东西的方式完全不一样。
It's not like the way humans pick up new knowledge on the fly and and from experience.
就像你雇了个实习生,他干了一天。
It's like you hired an intern, and the intern works for a day.
到下班时,他稍微熟练了一点,于是给自己留了张便条,结果第二天醒来却全忘了,像《土拨鼠之日》一样,重新到办公室,看别人留的笔记,努力回想之前该怎么做。
And by the end of the day, it's a little bit better at its job, but then it leaves a note to itself, and it wakes up the next day with amnesia, like Groundhog Day, and comes into the office and reads the notes that someone else left for it and tries to remember how to
工作,这根本算不上真正意义上的即时学习和灵活掌握新技能。
work, it doesn't really feel like the true solution to learning on the fly and flexibly incorporating new skills.
那我们现在关于持续学习的情况到底怎么样?
So where are we at then with continual learning?
我们至少还能留这些笔记。
We can leave these notes.
现在有没有什么应用已经实现了研究人员所期望的持续学习方式,还是说这仍然是我们正在努力的方向?
Are there applications today that incorporate continual learning the way researchers want, or is this something that we are working towards?
毫无疑问,我们还在朝着这个目标前进。
We're still working towards it for sure.
我觉得目前我们只是用一些临时的解决办法,而且这些办法会变得越来越好。
I think right now we have these little workarounds, and they will continue to get better and better.
有些人认为,我们真得从头再来,重新设计AI模型的架构和训练方式,才能从根本上提升它们持续学习的能力。
Some people think we really do need to go back to the drawing board and rethink the way AI models are designed and the ways that they're trained in order to really fundamentally improve their ability to continually learn.
我们确实有一些有希望的研究方向,但眼下所有尝试持续学习的方法都存在明显的局限性。
We have some some promising directions to explore, but there are big limitations right now with all of the ways that we try to do continual learning.
比如说,你可以收集AI为你完成任务时产生的大量数据,然后用这些数据来微调模型。
So for example, you could take a bunch of data from the AI doing jobs for you, and then you could fine tune on that data.
但这种方式实在是太粗暴了。
But this is a really blunt way to go about it.
你只是让AI去模仿它之前做过的一切,然后原封不动地复述出来。
You're just getting the AI to imitate everything that it's done, and just sort of regurgitate it.
而且你还面临
And you also run the
AI会忘记它以前知道的东西的风险。
risk of the AI forgetting things that it used to know.
你说的‘模仿’是什么意思?
When you say what do you mean by imitate?
就是简单地重复它以前做过的事情,而不是灵活地把新技能融入到它的运作方式中。
In just like repeat, the the things that it has done before, rather than, like, flexibly incorporate new skills into the way
它的工作方式。
it works.
比如,想象一下,这就像假装在持续学习。
So for example, think of It's like pretend pretend continual.
没错。
Exactly.
没错。
Exactly.
你可以这么想:我能把国际象棋特级大师的每一步都记下来,然后针对这些步法做微调,但这并不会让我自己变成特级大师。
Think about it as like, I can write down all of the moves that a chess grandmaster makes, and I can sort of fine tune on those moves, it's but not going to make me a chess grandmaster myself.
我得真正理解特级大师走每一步背后的原理和原因。
I have to learn the principles behind the moves that the chess grandmaster did and learn the reasons they took those moves.
这才是实现持续学习真正需要的东西。
That's what it would really take to have continual learning.
明白了。
Okay.
那我们现在回头看看递归式自我改进。
So now let's go back to recursive self improvement.
这算不算持续学习的一部分?
Is that a part of continual learning?
超级持续学习?它又该归到哪一类?
Is super continual Where does that fall into it?
我觉得咱们先把它俩分开来看。
I would think about them separately to start.
它们之间确实有联系,但我建议先分开来看。
There's ways that they're related, but I would think about them separately.
我的意思是,即使我们还没解决持续学习的问题,只要AI能从新经验中学习、从实践中成长,依然可以实现递归式自我改进——也就是让一个AI模型独立创造出下一代AI,全程无需人类干预。
What I mean by that is even if we don't solve continual learning, AI that can learn new experiences, learn from its experiences and learn on the job, you could still have recursive self improvement, which is the idea that you could have one AI model create its successor, so train the next generation of AI, without any humans involved.
整个过程完全不需要人类参与。
No humans in the loop at all.
整个研究循环都由AI自己完成。
The entire research loop is done just by AI.
在当前的框架下,你照样能做到这一点:依然是一轮训练,然后把AI模型部署到现实世界中。
You could do that under the current paradigm, where we still have one training phase, and then you put the AI models out into the world.
它们的关联在于,两者都是通向超级智能AI的路径。
The way that they're related is they're sort of both paths to creating a super intelligent AI.
你可以想象,与其依赖递归式自我改进,不如让大量AI模型分布在世界各地。
As in you can imagine that instead of recursive self improvement, you could have a bunch of AI models out there in the world.
它们各自服务于不同的领域。
They're working with different enterprises.
它们在不同的机构工作,不断掌握各种新技能。
They're working with different organizations, and they're picking up all sorts of new skills.
然后,这些知识 somehow 会被汇总起来,反馈给某个更中心的模型。
And then somehow they're accumulating that knowledge and feeding it back into some more central model.
即使人类还在某种程度上参与训练过程,这种方式也能让模型迅速变得非常强大。
That's a way that models could also get very good very quickly, even if humans are still involved in the loop of training them to some extent.
那我想问问你,关于持续学习和递归自我提升,这里有哪些权衡?我的意思是,我们昨天刚和斯蒂芬妮聊过。
So I want to ask you then about some of the trade offs here of having continuing learning, achieving recursive self improvement, because mean, look, we talked with Stephanie yesterday.
她刚参加完 ICML 回来,跟我们说 AI 研究人员现在开始紧张了——以前是程序员担心 AI 会取代他们,现在连研究人员自己也开始担心了。
She came back from ICML, and she was telling us about how AI researchers are getting nervous that, Hey, I mean, first it was AI coders that were coders that were nervous that AI could do their job.
他们说,也许 AI 也能做我的工作。
Now researchers are saying, Maybe they could do my job as well.
所以这里确实存在一些焦虑情绪。
So you have a bit of anxiety there.
但另一方面,大家也对 AI 的普及感到兴奋,觉得持续学习这类技术进步,或许能推动企业更广泛地采用 AI。
On the other hand, you have the issue of AI adoption and some excitement that, well, maybe there's an opportunity here for continual learning and stuff like that, these advancements, to improve adoption in the enterprise.
你觉得实现持续学习能在多大程度上推动AI的普及,又在多大程度上可能让AI研究人员失业?
To what extent do you think that achieving continual learning will help improve adoption, and to what extent do you think it might put AI researchers out of a job?
我的意思是,这两个问题都很有分量。
I mean, I think- Two meaty questions.
确实如此。
Definitely.
我觉得AI研究人员现在有点紧张是有道理的,毕竟他们的工作可能被自动化取代。
I think AI researchers are right to be a little bit nervous right now about being automated.
你说得对,写代码只是研究人员日常工作中的一小部分。
To your point, coding is just one piece of what a researcher does in their day.
他们还要设计实验。
They also design experiments.
提出假设。
They come up with hypotheses.
执行实验。
They run experiments.
他们还要解读结果。
They interpret the results.
他们提出新的假设。
They generate new hypotheses.
我的意思是,这正是科学方法的全过程。
I mean, that's the scientific method.
对吧?
Right?
目前,整个流程里最被自动化取代的部分就是写代码。
Coding is the piece of that that's most automated right now.
你看到Anthropic最近宣布了,Claude已经能写他们80%的代码了。
You saw Anthropic recently announced that Claude is writing 80% of their code.
OpenAI也刚说,他们内部用于研究的计算资源里,过去六个月花在写代码上的开销增长了整整一百倍。
OpenAI recently said that of their research budget, their the compute that goes to research internally, the amount spent on coding has increased a 100 times over the past six months.
天啊。
Wow.
所以编程绝对是当前的前沿,但人工智能正在越来越多地参与整个研究过程。
So coding is definitely the frontier here, but AI can do more and more of the whole research process.
我觉得人工智能研究人员有点紧张也是有道理的。
I think AI researchers are right to be a little bit nervous.
不过换个角度看,他们能完成的工作量会大得多。
Another way to think of this though is they'll be able to get a lot more done.
工作效率会比以往任何时候都高。
Be more productive than ever.
他们每花一小时工作,就能完成相当于过去一个人一千小时的研究量。
For every one hour of time that they spend at work, they're getting a thousand hours of research done, or what used to take a a person a thousand hours.
那企业里的应用情况呢?
What about what about adoption in the enterprise?
应用规模非常大。
Adoption is huge.
这才是关键问题。
This is the big question.
这确实是关键问题。
It is it is the big question.
我的意思是,持续学习带来的收益,会远远超过我们迄今为止看到的任何AI应用。
I mean, continual learning would be so insanely profitable compared to what we've seen for AI so far.
原因还得回到我之前打的那个实习生的比方。
The reason goes back to that analogy I gave you about an intern.
对吧?
Right?
想象一下,现在的AI就像个实习生。
Imagine AI right now is like an intern.
你也许能教会它做某一项具体任务,它也能基本做好。
Maybe you can teach it to do one specific task, and it kind of mostly does that task right.
但实习生的用处其实很有限。
But interns are not that useful.
对吧?
Right?
在公司里,实习生其实挺让人头疼的。
In in a company, interns are kind of annoying.
你雇实习生,
You hire interns
不是因为他们有多出色,你也没抱太大期望。
not because they're Rocket you're not being very
不好意思。
I'm sorry.
我以前也当过实习生。
I've been an intern.
我知道自己那时候是什么样子。
I I know what I was like.
你当时是个不错的实习生。
Just You were a good intern.
我是说真的。
I'm telling.
也许吧。
Maybe.
也许吧。
Maybe.
我当过好几次实习生。
I've been an intern a few times.
我觉得我那时候占了不少资源。
I think I I took a lot of work.
但你招实习生,是因为他们最终会变成正式员工。
But you hire interns because eventually they become employees.
他们慢慢熟悉了工作,以后就能派上用场了。
Eventually they learn the ropes, and they can be productive later on.
如果现在的AI就像实习生,那只有持续学习才能让他们有朝一日成为正式员工。
If AI right now is like an intern, it's continual learning that would let them become an employee someday.
如果没有持续学习,他们可能就永远困在实习生的状态里了。
Without continual learning, the thought is maybe they'll be just stuck in intern mode forever.
所以你可以自动化工作流程中的某些环节,但还是得有人在一旁帮忙、绕着它们干活。
So you can automate specific pieces of workflows, but you'll still have to have people hand holding them and working around them.
没错。
Right.
那我再问你一个问题。
So let me ask you one more question then.
我们一直在讨论前沿模型的优势,以及到底需要多大程度上依赖这些模型的全部能力。
We talk about the strength of frontier models and the extent to which you need the full power that these frontier models have.
但另一方面,其实只要模型能达到某个基本门槛就够了。
Then you have, well, we only need the models to hit a certain threshold, essentially.
这其实也牵涉到开源模型的整个讨论。
This is the whole conversation around open source models too.
我们真的需要前沿模型吗?
Do we need the frontier model?
我的问题是,如果看我们希望AI完成的全部工作量,我们是否真的需要持续学习才能应对所有这些任务?
My question is, if you look at the aggregate volume of work that we want AI to do, do we need continual learning to do all of these tasks?
实习生做的那些事,也没必要每个人都得是火箭专家才能在职场成功,对吧?
The intern tasks, it's not like everyone needs to be a rocket scientist to succeed in the workplace, right?
没错。
That's right.
我也是这么想的。
That's how I'd think about it too.
有些工作其实规模很小,完全可以交给AI模型来处理。
There are intern sized tasks that you could have AI models handle.
对于其中一些任务,其实现在连顶尖模型都不需要。
And for some of those, you don't even need the frontier models today.
用一个更小的开源模型,稍微微调一下,专门应对这个任务就够了。
You can make do with a smaller open source model that's maybe fine tuned to be better at that specific task.
但总觉得我们还能做得更好。
But it feels like we should be able to do better.
我觉得完全有可能让AI模型像员工一样灵活工作,独立完成长期任务,而且做得很好。
It feels like there should be room to have an AI model that acts like an employee flexibly and can work autonomously on long range tasks and perform them very well.
所以,这种观点可以归为一种自我安慰或乐观的看法,认为达到那个阶段并不需要持续学习。
So put this take in sort of the bucket of cope or hopeful takes that continual learning won't be necessary to get to that point.
意思是,实际上,大多数任务根本没那么需要高智商。
It's like, well, maybe in practice, most tasks just didn't require that much intelligence.
没错。
Right.
你可以把整个工作流程拆分成一个个独立的小任务,然后交给不同的模型去处理。
And you can basically carve up a workflow into these different discrete chunks and pass them off to different models.
另一个属于这种自我安慰类观点的是,认为单纯扩大规模就足够了。
Something else that's in this bucket of kind of cope like takes about continual learning, I think, is that scaling will just be enough.
到时候模型会足够聪明,每天上班时,哪怕它昨天的事全忘了,也不是实习生水平,而是员工水平。
That you'll get models that are smart enough in general that when it clocks in in the morning, even if it has amnesia, it's not intern level, it's employee level.
所以它记不住也没关系。
So it's okay that it's forgetting.
或者我们就把实习期间的所有经验全塞进上下文窗口里。
Or we'll just take all of the experiences of the internship, and we'll just cram them in a context window.
我们的上下文窗口会越来越长,所以它其实没必要更新权重。
We'll have a context window that's longer and longer, so it doesn't really need to update its weights.
它不需要改变自己的大脑。
It doesn't need to change its brain.
它只需要把过去所有操作的笔记都读一遍,靠硬生生地堆数据,就能足够胜任工作。
It will just be basically reading all of the notes from everything that it's done and just brute force it will know enough to be able to work effectively.
我觉得这些都不是持续学习的真正解决方案,但我们确实有办法绕开这个问题,根本不需要一个真正的解决办法。
I don't think any of these really feel like the solution to continual learning, but there are ways that we could get around that problem and not really need a true solution.
很好。
Great.
Rocket,非常感谢你今天来做客。
Well, Rocket, I wanna thank you for coming on.
这位是Rocket Drew,我们《The Information》的AI与机器人记者。
That is Rocket Drew, our AI and robotics reporter here at The Information.
目前,很多AI公司都在把增长重心放在物理AI上,不管是做世界模型的软件公司,还是想为预期中的机器人浪潮提供算力的芯片公司。
Physical AI is where a lot of AI companies are focused their growth efforts right now, whether it's software companies building world models or chip companies hoping to power the wave of robotics that everyone is anticipating.
阿德里安·麦克尼尔是机器人公司Foxglove的联合创始人兼首席执行官,他正处在这一故事的中心。
Adrian Macneil, the co founder and CEO of robotics company Foxglove sits at the center of that story.
我想请他来聊聊这个领域,以及当下正在发生什么。
I wanna bring him on for a conversation about that sector and what is going on in the current moment.
阿德里安,欢迎来到节目。
Adrian, welcome to the show.
很高兴你能亲自到场。
It's great to have you here in person.
谢谢。
Thank you.
感谢邀请我来。
Thanks for having me.
我昨天刚去过The Florist,看到了Foxglove。
I was at The Florist just yesterday, and I saw Fox glove.
你看到了啊。
You did.
是的。
Yes.
这是一种有毒的
It is a poisonous
花。
flower.
数字化。
Digitality.
没错。
Yeah.
毛地黄。
Digitalis.
花店老板告诉我的。
Florist told me.
我几乎可以肯定,公司名字就是这个。
Almost sure it was that as the company name.
我跟花店老板说我在采访你,你们公司叫Foxglove,她一听就说,哦,她 probably 是因为Digitalis才取这个名字的,毕竟那是一种毒花,结果你们居然做机器人公司。
And when I told The Florist that I was interviewing you and your company was was called Foxglove, she said, oh, she probably named it that and did a robotics company because it was called Digitalis.
是的。
Yeah.
对。
Yeah.
其实Digitalis这个名字更好,但域名被占了,只好改用Foxglove。
That would have been a better name, but the domain wasn't available, so we went with Foxglove.
就是这样。
There you go.
明白了。
Okay.
我对公司命名有个看法——名字不该直接绑定在你们做的产品上,因为公司做的事是会变的。
I have this thing with company names, right, where they should not be tied to what it is that you create, because what you create as a company evolves over time.
你们会调整方向,会转型,但名字可以自己创造,然后慢慢赋予它意义。
You pivot, you shift, but names that you can kind of create and you just give meaning to them.
对吧?
Right?
亚马逊到底是什么呢?
Like, what is what is Amazon?
苹果又是什么呢?
What is Apple?
这些名字本身跟业务没关系,但你反复说多了,自然就赋予了它意义。
These these names that you just start repeating so much, and you can you can give meaning to a name that is that is not directly related.
那你们公司的名字代表什么呢?
So what is the meaning of your company?
再跟我们说说吧。
Remind us.
你之前上过我们的节目。
We had you on the show before.
你们从贝塞默那里融了四千万美元。
You raised $40,000,000 from Bessemer.
简单说说重点就行。
Just give us the quick highlights.
这是给机器人用的软件。
So this is software for robots.
对,没错。
Yeah, Exactly.
我们打造了一个面向物理人工智能的数据平台和数据基础设施。
So we build a data platform, data infrastructure for physical AI.
它能帮你完成整个数据闭环:从现场机器人收集日志数据,传回来进行分析、理解、筛选出关键事件,排查问题、分类处理,最终训练出更优的机器人模型。
So this helps you with the whole data flywheel, your logging journey from robots that are out there in the production, bringing that data back, evaluating it, understanding it, sifting through that data and finding interesting relevant events, debugging, triaging, and then ultimately building better models for your robots.
那你们是自己开发模型,还是用别人的?
And and so you build your own models or whose models
模型是别人提供的。
are the models.
不是。
No.
关于 Bayt 播客
Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。