The a16z Show - 为创作者构建 AI | Luma & Phota Labs 封面

为创作者构建 AI | Luma & Phota Labs

Building AI for Creators | Luma & Phota Labs

本集简介

Yoko Li 与 Luma 应用研究负责人 Matt Tancik 以及 Phota Labs 联合创始人兼 CTO Zach Xia 探讨人工智能如何改变创造力、摄影以及人们用于创作艺术的工具。 本次对话探讨了艺术家与人工智能之间不断演变的联系,涵盖图像生成、个性化、创意工作流、可控性以及代理式设计工具。 他们讨论了个性化、摄影、创意软件、模型设计、评估,以及为何创意工具的未来可能更少依赖于内容生成,而更多在于帮助人们表达此前难以轻易实现的想法。在此过程中,他们还探讨了 AI 代理、界面,以及创作者如何以意想不到的方式使用这些工具。 资源: 在 LinkedIn 上关注 Matt:https://www.linkedin.com/in/matthewtancik/ 在 LinkedIn 上关注 Zach:https://www.linkedin.com/in/zhihao-zach-xia/ 在 X 上关注 Yoko Li:https://x.com/stuffyokodraws 保持更新: 在 YouTube 上关注 a16z:YouTube 在 X 上关注 a16z 在 LinkedIn 上关注 a16z 在 Spotify 上收听 a16z 节目 在 Apple Podcasts 上收听 a16z 节目 关注我们的主持人:https://twitter.com/eriktorenberg 请注意,此处内容仅供信息参考,不应被视为法律、商业、税务或投资建议,也不应用于评估任何投资或证券;且并非针对任何 a16z 基金的投资者或潜在投资者。a16z 及其关联公司可能持有文中提及公司的投资。如需了解更多详情,请访问 a16z.com/disclosures。 由 Simplecast 主持,Simplecast 是 AdsWizz 旗下公司。有关我们收集和使用个人数据用于广告的信息,请访问 pcm.adswizz.com。

双语字幕

仅展示文本字幕,不包含中文音频;想边听边看,请使用 Bayt 播客 App。

Speaker 0

我觉得,创造力就是讲一个故事。

I think that creativity is building a story.

Speaker 0

光有工具本身,并不能构成一个故事。

The tools alone aren't a story.

Speaker 0

得有人来引导它们。

Someone has to direct them.

Speaker 1

重点不在于掌握这些工具。

It's not about mastering those tools.

Speaker 1

而在于指挥一个能用这些工具实现你创意的助手。

It's about directing an agent who can use those tools to achieve your creativity.

Speaker 1

现在生成式AI已经变得太强大了。

Generated AI has become so good.

Speaker 1

你可以在真实捕捉当下瞬间的同时,加入一点创意发挥。

You can be sort of authentic to the moment while getting a little bit creative of stuff.

Speaker 1

所以我觉得,很多摄影师现在比以前更享受拍摄后的创作过程了。

So I I just think a lot of photographers are having more fun post capturing than before.

Speaker 0

你现在手头有这些工具,怎么才能做出独特的东西来?

How do you make something unique with the tools you have access to now?

Speaker 0

光靠文字是不够的,得有别的东西。

There has to something be more than just text.

Speaker 0

如果你去一家工作室,说‘给我做个十秒的视频,内容是狗在草地上跳’,他们根本不会接这种单。

If you go to, say, a studio and you say, make me a ten second video about a dog jumping in the grass, they're never gonna take that deal.

Speaker 0

他们想要更具体的要求,我觉得AI工具也是一样。

They're they're gonna want more specific, and I think AI tools are no different.

Speaker 2

今天早些时候我听人说,他们把AI当成懒汉。

Something I heard from someone today earlier was they assume AI to be sloth.

Speaker 2

关键还是得靠人去从中创造出点什么。

It's up to the humans to create something out of it.

Speaker 2

你怎么看?

What are your thoughts?

Speaker 1

我觉得这个问题真不好回答。

I I feel like that's such a hard question.

Speaker 3

创意工具一直都在改变人们创作艺术的方式。

Creative tools have always changed the way people make art.

Speaker 3

摄影的出现改变了绘画。

Photography changed painting.

Speaker 3

数字软件又改变了摄影。

Digital software changed photography.

Speaker 3

现在,AI正在改变图像、视频以及整个创意流程的整合方式。

And now AI is changing how images, videos, and entire creative workflows come together.

Speaker 3

这项技术进步得非常快,但创意工作中最重要的因素,可能根本不是模型本身。

The technology is improving at an incredible pace, but the most important ingredient in creative work may not be the model.

Speaker 3

真正关键的,还是背后的人。

It may still be the person behind it.

Speaker 3

在本期节目中,李阳子与Luma的马特·坦尼克和Phota Labs的夏哲探讨了AI生成图像、创意流程、个性化,以及他们为何相信未来属于那些驾驭工具的人,而非工具本身。

In this episode, Yoko Li speaks with Matt Tancik of Luma and Zach Xia of Phota Labs about AI generated imagery, creative workflows, personalization, and why they believe the future belongs not to the tools themselves, but to the people directing them.

Speaker 2

今天我们请到了Phota Labs的创始人兼首席技术官夏哲。

Today we have Zach Xia, who is the founder and CTO of Phota Labs.

Speaker 2

他专注于个性化AI和AI摄影。

He works on personalized AI and AI photography.

Speaker 2

我们还请到了Matt Tancik,他是Luma的应用研究负责人。

We also have Matt Tancik, who is the head of applied research at Luma.

Speaker 2

他研究智能代理系统和基础研究,同时也是NERF的联合创始人。

He works on agentic systems, fundamental research, and he was also the co creator of NERF.

Speaker 2

感谢你们来参加这个播客。

Thanks for coming on the pod.

Speaker 2

那我先问一个问题吧。

So maybe let me start with this question.

Speaker 2

Matt,几年前——大概三年前——你做过一场关于NERF的线上分享。

Matt, many years ago, maybe three years ago, you had this online talk about NERF.

Speaker 2

你那场分享一开始提出了一个特别有意思的问题:艺术家的角色是什么?技术的角色又是什么?

And how you started this online talk was you posed a really interesting question, which is what is the role of the artist and what is the role of technology?

Speaker 2

现在三年过去了,这在AI领域简直像过了一个世纪。

Now fast forward three years, which is a lifetime in AI.

Speaker 2

那现在你的答案是什么?和当时一样吗?

What is your answer then and what's your answer now?

Speaker 2

有变化吗?

Has it changed?

Speaker 0

是的。

Yeah.

Speaker 0

如果我没记错,那时候我的想法是,AI技术的核心作用是帮助艺术家更高效地实现他们的创意构想。

So if I recall correctly, my answer at that point was that really the point of this AI technology is to act as a tool for artists to better execute on the creative vision that they have.

Speaker 0

当时,NERF 让人们能轻松创建三维资产,不再需要耗费大量人工操作。

And at the time, NERF was providing an ability for people to create three d assets in a way that didn't require tons and tons of manual effort.

Speaker 0

对。

Right.

Speaker 0

因为做三维场景时,真正创造性的部分并不在制作这些资产上。

Because when you're creating three d scenes, creating those assets isn't really where the creative part is.

Speaker 0

而在于你怎么把它们组合在一起。

It's how do you put them all together?

Speaker 0

那你怎么围绕它来讲故事呢?

How do you build a story around it?

Speaker 0

那时候这些工具就帮上了忙。

And that's where those tools were helpful.

Speaker 2

没错。

Right.

Speaker 0

我觉得现在有太多工具了,不仅能用在三维创作上,还能用在视频和图片制作上。

I think now there's just so many more tools that just allow you to do that, not just in three d, but also in video, in images.

Speaker 0

我觉得这个观点——AI技术可以作为工具来使用——比过去任何时候都更成立。

And I think this, yeah, thesis that these AI technologies can be used as tools is even more so than it was in the past.

Speaker 2

是的。

Yeah.

Speaker 2

挺有意思的。

Interesting.

Speaker 2

扎克,我知道你在Adobe工作,之前还做了很多研究,后来这些研究就用在了Lightroom里。

And, Zach, I know you work at Adobe, and then you did a lot of research that later, you know, went into Lightroom Mhmm.

Speaker 2

这本身也是个创作工具,没错。

Which is also a creator tool Yes.

Speaker 2

创作者们一直在使用。

Creators have been using.

Speaker 2

你对这个怎么看?

What's your view of this?

Speaker 1

对。

Yeah.

Speaker 1

我觉得艺术家真正专注的是他们的创意本身。

I think artists really are where their creative minds are.

Speaker 1

他们很有创造力,而技术只是帮助他们表达这种创造力的一种方式。

They have a lot of creativity, and technology is sort of a way to help them express that kind of creativity.

Speaker 1

我觉得在过去几年里,像艺术家这样的创作者花了很多时间去掌握工作流程和工具。

I think maybe in the past few years, people like, artists were also spending a lot of time trying to master in the workflows, the tools.

Speaker 1

但那未必是他们创造力的核心所在。

I don't think that's necessarily where their creativities are.

Speaker 1

现在他们的工具变得更简单、更富有表现力了。

So now their tools have become easier to use, more expressive than before.

Speaker 1

他们表达创意变得容易多了。

It's just so much easier for them to express their creativity.

Speaker 1

但我还是觉得,技术现在没法取代人的创造力。

But I still think technology cannot replace their creativity minds today.

Speaker 2

有意思。

Interesting.

Speaker 2

你所说的创意具体指的是什么?

What would you define as creativity here?

Speaker 2

模型生成的东西算不上创意,真正算创意的是用户把这些元素组合起来的过程,对吧?

Because what the models are creating, not creativity, and is what user kinda composing together, that's what we call creativity?

Speaker 0

我觉得创意就是讲一个故事,而讲故事的方式有无数种。

I think that creativity is building a story, and there's so many different ways to build a story.

Speaker 0

工具只是帮助你构建这个故事的手段。

And you use tools to help construct that.

Speaker 0

是的

Yeah.

Speaker 0

光有工具本身并不能构成一个故事。

And the tools alone aren't a story.

Speaker 2

对。

Right.

Speaker 0

得有人来主导和引导。

Someone has to direct them.

Speaker 1

是的

Yeah.

Speaker 1

我真的觉得这个主导的思维特别关键。

I really think that this directive mind is just so important.

Speaker 1

工具人人都能用,但用这些工具做出的东西却千差万别。

Like, tools everybody can use the tools, but the stuff that gets created from these tools are very different.

Speaker 1

作品之间的差异,才真正体现了创造力。

And the difference of the things that are created, that's where the creativities are.

Speaker 1

每个人的想法都不一样,故事也不同,哪怕只是创作一个很简单的东西,背后未必有什么深刻的故事,但他们用工具的方式却和别人不一样。

People have different thoughts, different stories, or even just a simple thing they create, which doesn't necessarily have a very strong story behind it, but they use a tool differently than others to create that thing.

Speaker 1

我觉得创造力就体现在这儿。

I think that's where creativity is.

Speaker 2

对。

Yeah.

Speaker 2

之前我和马特聊过这个话题。

So Matt and I, we had this discussion earlier.

Speaker 2

马特平时也是摄影师和画家,拍很多照片。

So Matt is also a photographer and painter in his spare time, so he takes a lot of pictures.

Speaker 2

这让我忍不住想,现在的AI在摄影方面算不算有创造力呢?

It makes me wonder what is like AI creativity when it comes to photography nowadays, right?

Speaker 2

有一种观点认为,你在现实中拍下的画面就是最终成果,我并不想改动任何像素。

There's one school of thought where whatever you capture in the real world is the end result and I don't want to go change the pixels.

Speaker 2

另一种看法是,相机只不过是一种呈现现实的方式而已。

There's the other view, which is like camera is just one way to produce the reality.

Speaker 2

其他方式,比如在相机出现之前,人们用绘画来表达。

Other ways, it might be painting, like before the cameras came around.

Speaker 2

也可能用玩具枪。

It might be Nerf.

Speaker 2

等等。

Wait.

Speaker 2

如果你想要一个三维的东西,然后扫描所有实物,那可能就是模型。

If you want something three d and then go scan all the objects, it might be a model.

Speaker 2

那你怎么看?你的看法有变化吗?

So what is your view here, and how has the view changed?

Speaker 1

是的。

Yeah.

Speaker 1

我可以稍微谈一下摄影。

I can maybe say a little bit about photography.

Speaker 1

我觉得摄影一直以来都是一个很有创造力的过程。

I feel like photography has always been a very creative process.

Speaker 1

我觉得在AI兴起之前,摄影的创意主要体现在拍摄环节。

I'd say a lot of the creativity on photography was more on the capturing side before this AI boom.

Speaker 1

对。

Mhmm.

Speaker 1

那时候人们都在努力捕捉重要的瞬间,寻找优美的风景,挑选合适的角度和构图,用对设备,还要等上很久才能拍下那一张照片。

And that people were just trying to find the important moments, find the good landscape views, and find the right angle, composition, use the right tool, wait for a very long time to take that photo.

Speaker 1

真正的创意和摄影师的贡献,就体现在这些地方。

That's where the creativity and the photographers are really part of that.

Speaker 2

他们一遍又一遍地等待着

They wait and wait for

Speaker 1

那个时刻的到来。

that moment to arrive.

Speaker 1

没错。

Exactly.

Speaker 1

没错。

Exactly.

Speaker 1

但我认为,过去大部分创意都集中在拍摄瞬间,是因为一旦那个决定性时刻过去,之后能做的改动其实很有限。

But I think the reason that most of the creativity was at capturing time is because the decisive moment once that happened, afterwards, there are not so much you can do to it.

Speaker 1

我觉得过去三年里,这种情况发生了很大变化。

I feel like that part has changed a lot in the past three years.

Speaker 1

是的。

Yeah.

Speaker 1

生成式AI现在已经变得非常强大了。

Genetic AI have become so good.

Speaker 1

你既能保留那一刻的真实感,又能加入一些创意调整。

You can be sort of authentic to that moment while getting a little bit creative of stuff.

Speaker 1

所以我觉得,现在很多摄影师在拍摄后反而比以前更享受后期处理的过程。

So I just think a lot of photographers are having more fun post capturing than before.

Speaker 2

有意思。

Interesting.

Speaker 2

对。

Yeah.

Speaker 2

太有意思了。

Super interesting.

Speaker 2

我知道你们两位都是从博士做起,做了很多深入的研究。

So I also know both of you start off your career doing PhD and doing a lot of very in-depth research.

Speaker 2

后来进入行业后,你们开始做大量面向用户的工作,开发产品、上线产品,从用户那里学习。

And then since you went into an industry, there's a lot of user facing work on building the actual product, shipping the product, learning from the users.

Speaker 2

在我们看来,研究圈的人更关注的是评测和优化这部分。

From our perspective, it seems like the research community, they care more about the benchmarking optimization part of it.

Speaker 2

而产品打造则是一门艺术。

And then there's art of building the product.

Speaker 2

你们从研究转向做产品时,感觉怎么样?

How has it been like for both of you when it comes to transitioning from research to a product builder?

Speaker 2

你们需要学些什么?你们觉得最大的差距在哪里?

What did you have to learn and where do you think the gap is?

Speaker 2

要不我们先从这个问题开始?

Maybe we can start with that.

Speaker 0

作为研究人员,你的目标总是推动技术边界。

As a researcher, your goal is always to push the technology.

Speaker 0

所以只要技术上有缺口,你就去填补它。

And so wherever there's the hole in the technology, you push it.

Speaker 0

但这和客户或最终用户真正感兴趣的东西并不总是一致的。

That doesn't necessarily align with what, say, a customer or end user would actually be interested in.

Speaker 0

因此,这两种方向经常会出现分歧。

And so quite often you see these things diverge.

Speaker 0

比如在图像生成领域,艺术家其实并不关心生成大段密密麻麻的文字,或者用一些冷门字体。

For example, in image generation, a artist probably doesn't care about generating paragraphs long, a really dense text, and some esoteric font.

Speaker 0

是的。

Right.

Speaker 0

可能有人在乎,但大多数人并不在意。

Maybe some do, but most don't.

Speaker 0

但从研究的角度来看,这个问题却非常有意思。

But as a research question, that's extremely interesting.

Speaker 0

所以你得做出选择:是继续在某些方向上推进研究,还是适时退一步,去推动创意方面的工作?

So you do have to decide, do you wanna keep pushing the research in certain directions, and when do you take a step back and push the creative side?

Speaker 0

对。

Yeah.

Speaker 0

因为在很多情况下,艺术家或创作者真正需要的其实非常简单,现成的工具早就有了。

Because in many cases, what an artist or creative would want is actually very simplistic, and the tools already exist out there.

Speaker 0

关键只是怎么把这些工具恰当地组合起来。

And it's just a matter of piecing together in the right way.

Speaker 2

是的。

Yeah.

Speaker 2

比如,去掉背景这种事,对大多数研究者来说可能都挺无聊的。

Like removing background itself is a boring task for most researchers, I guess.

Speaker 0

对。

Yeah.

Speaker 0

对。

Yeah.

Speaker 2

但这对所有创作者来说都非常有用。

But it's extremely useful for any creators out there.

Speaker 0

甚至只是调整一下图片的光线。

Or even just fixing up lighting of an image.

Speaker 0

这事儿也没有一个明确的解决方法,所以研究者很难找一个具体的指标来优化。

It's something that also doesn't have a very concrete solution, so it's hard for, say, a researcher to optimize a metric against.

Speaker 0

但说到创意类的工作,它就特别有用。

But when it comes to a creative task, it's extremely useful.

Speaker 2

是的。

Yeah.

Speaker 2

那摄影呢?

And what about photography?

Speaker 2

我很好奇,你在这一块有什么发现?

I guess, like, curious, what's your learning there?

Speaker 1

对。

Yeah.

Speaker 1

是的。

Yeah.

Speaker 1

我学到的,而且还在继续学的是,这其中的平衡非常微妙。

What I've learned and I'm still learning is that there's such a fine balance.

Speaker 1

比如研究人员,

Like, researchers,

Speaker 0

他们对新技术总是充满热情,

they get excited about new technology,

Speaker 1

所以就像马特说的,他们只想不断推进它。

so they just as Matt said, they just wanna push it forward.

Speaker 1

而用户呢,他们只想让你解决刚遇到的那个具体问题。

Users, they want you to solve their specific problem they just ran into.

Speaker 1

所以我们得在这两者之间找到平衡。

Now there's some balance that we need to do there.

Speaker 1

我们不能只顾着解决用户每天遇到的那些小问题。

We can't just solve the day to day problem the user are creating.

Speaker 1

我们还希望技术能稍微领先用户一步,这样或许能帮他们重新设计工作流程。

We also want to be technology needs to be ahead of users a little bit so that maybe you can reimagine their workflow.

Speaker 1

没错。

Right.

Speaker 1

对吧?

Right?

Speaker 1

但与此同时,你也得保持平衡。

But at the same time, you want to make it balanced.

Speaker 1

你依然在解决他们的问题。

You're still solving their problems.

Speaker 1

你不是在开发一个没人会用的产品。

You're not just producing a product that no one is gonna use.

Speaker 1

在摄影这方面,这种平衡特别讲究。

So that's such a fine art with photography.

Speaker 1

就是这么个道理。

There's something like that.

Speaker 1

我觉得在AI时代的初期,我们遇到了不少抵触情绪。

I think the beginning of this AI era, we get a lot of pushback.

Speaker 1

摄影师们只想拍照,不想后期处理。

Photographers, I just wanna capture.

Speaker 1

我根本不想修图。

I don't wanna edit.

Speaker 1

现在他们慢慢接受了,比如去掉图片里一些干扰的杂物也没什么大不了。

Now they're slowly getting him to, oh, it's fine to remove some distracting object in that image.

Speaker 1

这对我来说无所谓,这依然是我的创意部分。

It doesn't matter to me, and that's still my creativity part.

Speaker 1

所以人们也在慢慢转变。

So people are transitioning as well.

Speaker 1

技术得稍微领先于这个变化的节奏。

Technology needs to stay a little bit ahead of that spectrum.

Speaker 2

这一点特别关键。

That's such a big point.

Speaker 2

这真是个先有鸡还是先有蛋的问题。

It is a chicken and egg problem.

Speaker 2

你不可能完全满足用户的每一个需求。

You can't implement a 100% of what users ask.

Speaker 2

一个经验丰富的 Photoshop 用户可能会让你重新设计套索工具。

A seasoned Photoshop user may ask you to reinvent a lasso tool.

Speaker 1

是的。

Yeah.

Speaker 1

没错。

Exactly.

Speaker 2

关键在于,你真想这么做吗?

And the question is, do you want to do that?

Speaker 2

你希望你的模型具备这样的思维模式吗?

Is that the mental model you want your model to have there?

Speaker 2

也许下一个抽象层次,根本就不再需要套索工具了。

Like, maybe the next abstraction is there's no lasso tool.

Speaker 2

我们并不是在复刻旧版 Photoshop 的那个世界。

Like, we're not implementing the world in the the old Photoshop world.

Speaker 2

没错。

Yes.

Speaker 2

所以当你和创作者们密切合作、从他们身上学习时,他们的工作流程里有什么让你感到意外的地方吗?

So I guess, like, when you work closely with the creators out there and as you're learning from them, what is the surprising thing about their workflow?

Speaker 2

有没有哪项功能你推出时根本没打算主打,结果用户却用得特别多,让你特别惊喜?

Anything that you push your product out there but wasn't designed for but had a lot of adoption that you were pleasantly surprised by?

Speaker 0

是的。

Yeah.

Speaker 0

我第一个想到的是,人们通常以为艺术家或创作者心里都有个明确的目标。

I think one of the first things that comes to mind is that you tend to think that like an artist or creative has a end goal in mind.

Speaker 0

觉得他们很清楚自己想要什么,但现实往往不是这样。

Like, they know exactly in their head what they want, but in reality, that's not true.

Speaker 0

创作的一部分,恰恰就是不断迭代。

Part of art is that iteration.

Speaker 2

对。

Yeah.

Speaker 0

所以确保工具能够支持这种程度的反复修改,至关重要。

And so making sure the tools are able to handle that level of iteration ends up being extremely important.

Speaker 0

对。

Yeah.

Speaker 0

这也让评估这些工具变得特别困难,因为创作者的灵感并不是一开始就清晰明确的。

And this also makes it very hard to, like, benchmark these things because their opt in isn't that ground shooting in their head.

Speaker 1

对。

Yeah.

Speaker 1

对我们来说,这跟Phota的使用场景关系比较密切。

For us, it's a little bit specific to Phota.

Speaker 1

我们主要关注身份的保留和一致性。

So, like, we do a lot of identity preservation, identity consistency.

Speaker 1

我们做这个功能时,目标是帮助用户编辑真实照片,同时保留照片中人物的原有特征。

When we set out to do it, we're more targeting at image editing of real photos that people want to preserve the identity in the image.

Speaker 1

让我没想到的是,人们其实非常愿意用Phota的技术生成新图像,把人物放到不同环境中,制作AI头像甚至AI视频。

What surprised me is that people are actually very willing to generate a new image, put them in different environments, generating AI headshot, generating AI video of themselves using Phota's technology.

Speaker 1

这一点让我有点惊讶,而且人们在这上面玩出了很多创意。

So that kind of surprised me a little bit, and people are getting very creative with that.

Speaker 0

所以这个

So The

Speaker 2

视频应用场景其实挺让人意外的。

video use case is actually a surprising one.

Speaker 2

你能再详细说说吗?

Do you want to explain it further?

Speaker 1

好的。

Yes.

Speaker 1

对。

Yes.

Speaker 1

是的。

Yeah.

Speaker 1

我们现在主要还是用在图片上,但人们已经开始玩出各种花样了。

So we start we right now, our technology mostly just work on images, and but people are getting creative.

Speaker 1

有人说,视频模型在保持人物身份特征方面实在太差了。

People are like, oh, the video models are so good are so bad at identity preservation.

Speaker 1

我的做法是用Phota生成每一帧画面,再用视频模型把这些帧合成视频,这样人物特征就能保留得很好——这事儿我们一开始根本没想到。

What I can do is I I'm gonna use Phota to generate frames of those videos, and then I'm gonna use a video model to take those frames into a video so that identity is good, something that we didn't think of at the beginning.

Speaker 1

没错。

Right.

Speaker 1

用户自己想出了办法,真是有创意。

They figured it out, so creators.

Speaker 1

对。

Yes.

Speaker 2

确实。

Yeah.

Speaker 2

挺有意思的。

Interesting.

Speaker 1

我觉得有一件事是

I I think one thing

Speaker 0

我想补充一下,我已经多次看到有人用各种意想不到的方式组合工具,不只是用我们的工具,而是把我们的工具和其他工具混着用,本来根本不可能奏效的。

to chime in on that, I I've seen it multiple times now where people find very interesting ways to use tools, not just our tools, but our tools in addition to other tools that you never expect it to work.

Speaker 0

按理说这些方法根本行不通,但人们总能找到特别古怪的办法让它们生效。

And for every reason, it shouldn't work, but people find crazy ways to get these things to work.

Speaker 2

你有具体的例子吗?

Do you have an example?

Speaker 0

例子太多了。

There's so many.

Speaker 0

我得再想想挑一个更典型的。

I I would have to pick a little bit more.

Speaker 2

明白。

Yeah.

Speaker 2

我回头再聊一下提示零的问题。

I'll come back to prompt zero.

Speaker 2

所以说到工具抽象这一块,我觉得终端用户更像是需要使用工具的智能体。

So I guess when it comes to the tool abstraction, what kind of tool like, I almost see the end user as type of agents who need to use tools.

Speaker 2

你只需要提供这些工具就行。

It's just you provide the tools.

Speaker 2

有时候他们会借助自己的AI助手,来调用这些工具。

And sometimes they will use the agent like their AI agent to kinda leverage the, you know, tool calls as well.

Speaker 2

也就是说,工具既面向人类,也面向智能体。

So there's a tools for humans and a tools for agents.

Speaker 2

在你看来,这两者之间有什么区别?

How do you see those differ in your, like, worlds?

Speaker 0

对。

Yeah.

Speaker 0

我觉得值得思考一下,传统上创意类工具是怎么发展的。

I I think it's interesting to look at how creative tools have existed traditionally.

Speaker 0

比如Photoshop、Illustrator,还有Blender这些软件。

You look at your Photoshops, your Illustrators, you look at your Blenders.

Speaker 0

不管你对哪种创作形式感兴趣,只要一进去这些软件,就会发现它们特别复杂。

What whatever modality you're interested in, if you hop into those programs, they're extremely complex.

Speaker 0

对吧?

Right?

Speaker 0

光是把它们的方方面面都学会,就足以支撑一个人干一辈子了。

You can literally have a whole career learning the ins and outs of these programs.

Speaker 0

没错。

Right.

Speaker 0

这对有时间、有经验去深入学习的人来说当然很好,但AI代理的出现,让工具能根据用户需求自动调整,这就改变了游戏规则。

And so that's great for people who've had that time and that experience to invest in it, where agents come along and the ability to, like, have agents work with tools is then the ability to tune the tool to the user.

Speaker 0

是的。

Yeah.

Speaker 0

有些用户就只想简单地重打光、去掉背景而已。

Some users, all they care about is, you know, relighting an image, removing a background.

Speaker 0

但也有人需要极致的控制权。

Some want extreme levels of control.

Speaker 0

那问题就来了,你怎么跟代理或者你用的任何AI工具互动,让它帮你选择最适合你的抽象层级?

So then the question is, how do you interact with an agent or whatever AI tool that you're working with that can choose that level of abstraction that makes sense for you?

Speaker 1

对。

Yeah.

Speaker 1

我觉得,就像我们开头说的,创意本质上是引导某种东西,来实现你的想象力。

I feel like, as we said at the beginning, creativity is about, like, directing something to achieve your creativity, your creative mind.

Speaker 1

我觉得这种引导特别关键。

I think this directing thing is so important.

Speaker 1

我觉得这就是代理发挥作用的地方。

I think that's where sort of agent comes into place.

Speaker 1

重点不在于你得精通这些工具。

Like, it's not about mastering those tools.

Speaker 1

而在于你去引导一个代理,让它用这些工具帮你实现创意。

It's about directing an agent who can use those tools to achieve your creativity.

Speaker 1

这真的太重要了。

That's just so important.

Speaker 1

我们从摄影中学到的另一点是,很多人会修图。

Another thing that I feel like is some lesson that we learned in photography is that, you know, a lot of people edit photos.

Speaker 1

但也有很多人根本不想修图。

A lot of people just don't want to edit photos at all.

Speaker 1

他们心里是有创意的。

They have creativity in mind.

Speaker 1

他们不是不想做后期,就是太忙了没时间做,但创意还是有的。

They're just they don't want to do their work, or they they're too busy to do that, but they still have a creative mind.

Speaker 1

如果你能有个助手,能理解你的创意,不用你费太多劲就能帮你把创意表达出来,我觉得这就更棒了。

So if you have some kind of agent that can understand your creativity and can express your creativity without, very low effort from you to help you achieve that, I feel like that's even better

Speaker 2

是的。

Yeah.

Speaker 1

就像那种在后台自动运行的智能助手。

Like this kind of automatic or passive agents that run-in the background.

Speaker 1

我

I

Speaker 2

就这一点来说,我目前的观察是,一开始我们只有很简单的工具,用户进去输入个提示,就能出一张图,就完事了,一次搞定。

guess just on this point, my observation so far has been, at first, we have simplistic tools where users can go in and prompt and they get an image and that's it, one shot.

Speaker 2

后来开始出现一些特别复杂的流程,简直让人看都看不懂。

And later we start to get crazy notes on like, concrete workflow and it's like, can't even like understand it as a human.

Speaker 2

再后来出现了画布,但那不是那种你能轻松理清的流程图。

And then we start to have Canvas and it's more, you know, it's not, you know, like a graph that you can easily map out.

Speaker 2

它更像是偶尔能并行处理的一组任务。

It's more like a set of things you can parallelize once in a while.

Speaker 2

那你觉得,未来面向代理和人类的界面应该是什么样子?

So how do you think about the next interface for both like, agents and humans?

Speaker 2

是让代理去用Adobe Photoshop,而人类根本不用学怎么操作,只管问代理就行?还是说,会完全出现一种新界面?

Like, would the agents be, on the camp of using Adobe Photoshop and humans just don't need to learn how to use it anymore and just ask the agent how to do it, or would it be a different interface altogether?

Speaker 0

我觉得,不能假设每个用户都想要同样的东西。

I I I think it's false to assume that every user is gonna want the same thing.

Speaker 0

没错。

Exactly.

Speaker 0

你看电影导演,有些导演会特别较真,连每个杯子摆的位置都要精确到位。

You look at directors of movies, and some directors are go super deep into the weeds of making sure that, you know, every glass is in the right place.

Speaker 0

但另一些导演根本不在乎这些细节。

Whereas other directors, they don't care about any of that.

Speaker 0

他们只关心演员有没有把台词演对了。

All they care about is, like, oh, is the actor doing the line in the right way?

Speaker 0

我明白了。

I see.

Speaker 0

我觉得在这些创意工具里,情况也是一样的。

And I think all that is true in these sorts of creative tools too.

Speaker 0

所以你得设计一个能适应不同导演的助手。

And so you have to create an agent that can work with these different directors.

Speaker 0

有的需要能深入细节、精准操控的,有的则更偏向创作型,只想轻松对话、互动,看看能冒出什么创意。

The one that has that ability and that control to go in and manipulate these things at very fine grain levels, or the ones that maybe are more on the, like, I don't know, the literary side or whatever it might be and just wants to talk and, like, interact and have fun with the the tool and see what comes out of it.

Speaker 0

是的。

Yeah.

Speaker 1

这里的个性化至关重要。

Personalization is absolutely key here.

Speaker 1

不同人对工具复杂性的接受程度不同,偏好和品味也各不相同。

Different people have different levels of acceptance of, like, complexity of tools, and they also have different kind of preference and taste.

Speaker 1

所以,你得根据每个人的特点来调整。

So, yeah, you have to be personalized to them.

Speaker 1

我觉得马特说的是,这个助手得真正了解用户,能灵活应对。

And I think Matt is speaking about, like, the agent needs to understand the user really well, be flexible about that.

Speaker 1

我觉得助手还得有很好的记忆力。

I also think the agent needs to have really good memory.

Speaker 1

比如我跟你说过一次,以后就别再重复问了。

So, like, if I tell you once, shouldn't need to tell you again in the future.

Speaker 1

我觉得这一点也特别重要。

So, like, I think that's also just really important.

Speaker 2

对。

Yeah.

Speaker 2

我再深入一点说,如果把抽象层级一直往下推,理论上用 C 语言和编译器确实能做出任何东西。

I guess just to push on that point a little bit, obviously, if you travel down the abstraction layers far down enough, you can build anything or everything with c and compiler.

Speaker 2

但要是觉得智能体每次都要重新帮你搭建创意工具,那就太奇怪了。

But it would be weird to assume that agents are gonna rebuild your creative tools for yourself every time.

Speaker 2

所以,我们得在某个层级上划一条线,明确就在这层上做操作。

So there has to be somewhere in the layer you take, like, draw a line in the sand and decide that this is the layer we're gonna operate on.

Speaker 2

你们觉得,这个合适的层级应该定在哪里?

How do you think about what that layer is for each of you?

Speaker 0

我没法给出一个明确的答案,因为我觉得这个标准一直在变。

I don't know if I have a concrete answer because I think it's constantly changing.

Speaker 0

关于底层表达方式,各种说法都有它的道理。

There's a lot of arguments for different sort of underlying representations.

Speaker 0

没错。

Right.

Speaker 0

有些观点确实说得通。

And some make sense.

Speaker 0

有时候,不同的情况需要不同的方法。

In some cases, others masons than others.

Speaker 0

比如,你是在建一个三维世界吗?

Everything from, you know, is it a three d world that you're trying to model?

Speaker 0

还是在处理图像?

Is it images that you're trying to model?

Speaker 1

你是不是想把图像

Are you trying to break

Speaker 0

拆分成多个图层?

up the images into layers?

Speaker 0

我觉得整个行业还没搞清楚哪种表示方式才是对的。

And I'm not sure we really hit on as an industry what the right representation is.

Speaker 1

对。

Yeah.

Speaker 1

没错。

Yeah.

Speaker 1

我觉得我们得先理清什么是模型,什么是工具之间的区别。

And I think there's a abstraction of what's a model, what's a tool.

Speaker 1

对吧?

Right?

Speaker 1

工具的范围其实可以比模型更广。

Like, a tool can be a little bit more than a model.

Speaker 1

模型能做的事情可多了。

A model can do a lot of things.

Speaker 1

对吧?

Right?

Speaker 1

很多工作以前得靠一大堆传统工具才能完成。

A lot you need a lot of tools traditional tools to do.

Speaker 1

所以我觉得接下来我们会看到这些功能是怎么逐步展开的。

So I think that's we're we're gonna see how that sort of roll out.

Speaker 1

我个人觉得,模型正在取代很多以前用于非精准控制的旧工具。

I personally think model is replacing a lot of the old tools for not so precise control.

Speaker 1

对。

Mhmm.

Speaker 1

但我觉得与此同时,又在把更精确的控制权交还给模型。

But I feel like also at the same time, are putting more precise control in back to the model.

Speaker 1

所以这是一个来回调整的过程。

So it's a back and forth process.

Speaker 1

你懂的。

You know?

Speaker 2

你们两位都一直在做模型和应用的协同设计,还自己训练了模型,用来支持你们开发的应用。

Both of you have been doing a lot of model and app co design and then, you know, your own like in house trained model on the app you also built.

Speaker 2

问题是,你们怎么定义什么是‘好’的生成效果?因为评判标准实在太多了。

The question is, how do you think about what good looks like when it comes to the generation that because there are so many different ways to judge that.

Speaker 2

这到底算软件问题,模型问题,还是别的什么?

And is it a software, is it a model, or is it something else?

Speaker 1

是的。

Yeah.

Speaker 0

作为研究人员,我们总在想怎么把好的东西转化成可衡量的指标,这样代理和研究团队才能据此优化。

Being a researcher, there's always a focus of how do we convert good into a metric that you can measure because then the agents and the research teams can optimize against it.

Speaker 0

对。

Mhmm.

Speaker 0

但光靠这些指标,永远没法讲完整个故事。

However, there's no way that that'll ever tell the full story.

Speaker 0

所以在开发过程中,必须让人参与进来。

And so you do have to involve humans in the loop during development.

Speaker 0

关键是怎么让有创意的人、那些你想要模仿其品味的人,能参与进来提供建议。

It's how do you bring in creatives and peoples whose taste that you're trying to mimic can come in and help advise in that way.

Speaker 0

但也不能只靠个人,因为一个人做的视频,和另一个人的愿景肯定不一样,这时候个性化就变得至关重要了。

But that also isn't can't be the full story because one person creating one video is gonna have a different vision than someone And so this is where the personalization really becomes key.

Speaker 0

问题是,怎么在用户使用应用的过程中,或者根据他们提供的额外信息、过去创作的内容,去了解他们真正关心的是什么。

And the question is how do you learn those what the user cares about maybe as they're using the app, maybe as they've provided additional context out to the type of stuff they're building, or based on the history of the stuff they've built in the past.

Speaker 2

你能衡量品味吗?

Can you measure taste?

Speaker 2

我想,当这些品味引领者使用这个工具时,他们的作品风格会各不相同。

I guess when you have the taste makers come using the tool, they'll have different workbills.

Speaker 2

当然,你可以为每个人分别做优化。

Of course, you can optimize for every one of them.

Speaker 2

但有没有办法衡量某个工具本身的品味标准呢?

But is there some way to measure what taste is for a particular tool?

Speaker 0

我觉得在一定条件下,比如针对某个群体,是可以衡量这个群体的品味的,同时也能衡量单个用户的品味。

I think you can measure taste given some constraint, like given a population, can maybe measure the taste of that population, but then you can also measure the taste of an individual user.

Speaker 0

所以,你衡量的粒度越粗,结果就越模糊。

And so depending on how coarse you get in that measurement, it just becomes a bit more muddled.

Speaker 2

明白了。

I see.

Speaker 1

对。

Yeah.

Speaker 1

对我们来说,评估分两种:一种是在发布前做评估,另一种是发布后持续跟踪评估。

I think for for us, evaluation there is evaluation before you ship something, and there is evaluation after you ship something.

Speaker 1

所以在产品上线前做评估时,很多时候我也不确定。

So when evaluation before you ship something, a lot of times I don't know.

Speaker 1

对我们来说,我们更关注自身的补偿机制。

For us, we're specific for our compensation.

Speaker 1

所以我们特别在意每个测试对象或用户是否对结果感到满意。

So we really care care about having each each individual test or user to say, are they happy with the result?

Speaker 1

要为像品味、偏好这样高度主观的东西,甚至像身份这样个人化的内容,找出一个通用标准,实在太难了。

It's very hard for us to come up with, like, a universal thing for especially for very subjective things like taste, preference, and even for very personal thing like identity.

Speaker 1

我们总是让本人来评估自己的身份,或者让亲近的人来评估他们生活中重要人物的身份。

We always ask the person to evaluate their own identity or the person to evaluate very close ones in their life the identity of them.

Speaker 1

然后还有产品上线后的评估。

And then there's evaluation after you ship the product.

Speaker 1

我觉得对于这种高度主观的内容,上线后的评估对个性化至关重要,因为个性化技术会针对不同用户产生不同效果。

I think especially for very subjective things, that's so important for personalization because the personalization technology is gonna be applied to different users differently.

Speaker 1

我们有没有让用户感到开心?

Have we made the user happy?

展开剩余字幕(还有 440 条)
Speaker 1

用户对得到的结果满意吗?

Are they are they user satisfied with the result they're getting?

Speaker 1

以一种自然、不打扰的方式收集这种反馈,真的特别重要。

And can you collect that kind of feedback in an ambient way that's just like, nonintrusive way is just so important.

Speaker 2

这个观点太有意思了。

This is such an interesting fact.

Speaker 2

我之前刚和一个人聊过他们的Phota结果。

I was actually talking to someone earlier about their Phota result.

Speaker 2

他认为幸福和追求是两回事。

His view was happiness and just seeking are two different things.

Speaker 2

当他看到结果时,说:这简直就是我。

When he saw the result, and he was like, this is exactly me.

Speaker 2

这简直是最佳的模型输出。

It's like the best model output.

Speaker 2

相似度达到了百分之百。

The likeness is a 100%.

Speaker 2

他白天拍的照片太胖了。

Phyla too fat in the day.

Speaker 2

所以他对结果并不满意。

So he's not happy with the results.

Speaker 2

这就涉及到某种筛选机制——能让用户开心的,未必符合评估标准。

So there is some kind of like, you know, filtering, like something that makes the user happy may not be the benchmark Mhmm.

Speaker 2

你 guys 是怎么解决这个问题的?

Thing that, you know, like, you might be straight how are you guys solving that?

Speaker 1

归根结底,我们认为用户才是最终说了算的人。

Well, like, at the end of the day, we think, you know, user is the one who is control controlling things.

Speaker 1

对吧?

You know?

Speaker 1

如果他们希望照片里的自己看起来什么样,我觉得这完全是他们的选择,我们得支持他们这么做。

If they want them to look in a certain way in the in the photo, I think that's that's their choice, and we need to empower them to do that.

Speaker 1

而且,这本来就是一件非常主观的事。

And, again, this is a very subjective thing.

Speaker 1

美化这个问题,其实已经争论很久了,涉及的范围非常广。

Beautification is has been a long, long time debate of the, like, the spectrum of of it.

Speaker 1

每个人都有自己不同的审美。

Everyone has their own taste.

Speaker 1

是的。

Yeah.

Speaker 1

个性化才是关键。

Personalization is key here.

Speaker 0

对。

Yeah.

Speaker 0

你懂的。

You know?

Speaker 2

我觉得个性化更多是个范围问题,而不是让每个人都能在画布上随意操作。

I imagine personalization is more of a scope problem compared to having empower everyone, everything to do things on the canvas.

Speaker 2

面对画布上可能存在的无数种操作方式,你觉得该怎么评估呢?

How do you think about evaluation when it comes to there are so many unlimited workflows one can do on the canvas?

Speaker 0

是的。

Yeah.

Speaker 0

我觉得差不多。

I I think somewhat similar.

Speaker 0

你得看看人们最终是怎么使用这个工具的。

You have to look at how people ultimately use the tool.

Speaker 0

我们不可能在发布前猜出所有评估方式,但归根结底,得看上线之后有没有人用。

We can't come up with as many guesses on how to evaluate before we release it, but at the end of the day, you have to see once it's out there, are people using it?

Speaker 0

人们都在哪儿用它?

Where are people using it?

Speaker 0

人们在哪儿感到挫败?

Where are people getting frustrated?

Speaker 0

他们在哪儿觉得控制够用,哪儿又觉得不够用?

Where are they feeling like the level of control is sufficient and where is it not sufficient?

Speaker 0

尽量从人们使用这个工具的不同场景中收集各种反馈信号。

And trying to gather as many of the signals as possible across the different domains that people use the tool.

Speaker 2

有意思。

Interesting.

Speaker 2

这么说完全说得通。

So this totally makes sense.

Speaker 2

我觉得这个工具的用途其实很广,使用场景分布很广。

I think of a very, I guess, like a broad tool as there's a distribution of use cases.

Speaker 2

刚推出的时候,那些明显的主要用法你肯定都测试过了。

When you launch the tool, there's obvious ones that you probably would have tested before launching.

Speaker 2

但分布的尾部可能很长,也可能不长。

And there may or may not be a fat tail on the distribution.

Speaker 2

关键问题是,你有没有想把某些使用场景从尾部推到头部?

The question is, are there specific use cases you want to move from the fat tail to the head?

Speaker 2

你遇到过这样的情况吗?

Have you ever run into use cases like that?

Speaker 0

有。

Yeah.

Speaker 0

我觉得其中一个挺有意思的是,看到品牌们是怎么统一使用自家品牌规范的。

I think one interesting one was seeing how brands would bring in same brand guidelines.

Speaker 0

这一点我们之前其实没怎么考虑过。

It's not something we really considered very much.

Speaker 0

确实如此。

Yeah.

Speaker 0

但一旦他们把这些规范用起来,你就发现这其实是了解用户兴趣的非常有用的线索。

But then once they brought them in, you realized this was a extremely useful source of information for really getting to what a user is interested in.

Speaker 0

所以这里就引出一些问题:不仅要让这些品牌或其他公司能把这些信息接入进来,还要考虑怎么让他们顺利实现这个流程。

And so there's some questions there of not just how do you enable that pipeline for these, say, brands or other companies to include that information Yeah.

Speaker 0

但更重要的是,怎么让那些不熟悉这类流程的人也提供这类信息?

But how do you also get that type of information from others who aren't used to working with those sorts of pipelines?

Speaker 2

没错。

Yeah.

Speaker 2

我得说一句。

I should say.

Speaker 1

是的。

Yeah.

Speaker 1

对我们来说,有些用户试图使用我们的当前API,但它只支持人类和宠物的身份识别。

For us, there was some users who are trying to our current API only supports human and pets for identity.

Speaker 1

有些用户在尝试绕过系统,想用它来做产品摄影的个性化处理。

There's some user who are trying to hack our system so they can use it for personalization for product photography.

Speaker 2

哦,有意思。

Oh, interesting.

Speaker 1

他们说:‘我们就是需要这个功能’,所以现在这已经列入我们的开发计划了。

And they're like, we we want this, and so that now that's on our road map.

Speaker 1

你知道,我们确实想做,我的意思是,这很合理,但这类使用场景我们当初根本没想到。

You know, we want we want I mean, it makes sense, but so that's kind of an example where, like, we didn't see that kind of use case.

Speaker 1

我们刚上线时,发现市场反馈后,就决定优先提升这方面的支持。

We first launched it, and there's market pool, and then we just want to increase our priority on on those.

Speaker 1

是的。

Yeah.

Speaker 2

你觉得人的相似度和产品的相似度之间有什么区别?

How do you see the difference between, I guess, human likeness and product likeness?

Speaker 2

我们的大脑在识别人脸时会参与其中,所以我猜这其中的容错空间应该很小。

I mean, our brain is involved to recognize human faces, so I imagine there's Yeah.

Speaker 2

容错空间更小。

Lower margin for error.

Speaker 2

没错。

Right.

Speaker 2

那产品呢?

But what about product?

Speaker 2

这方面能学到什么?

What what's the learning there?

Speaker 1

是的。

Yeah.

Speaker 1

首先,这两者之间有很多相似之处。

I mean, so first of all, there are a lot of similarities between these two.

Speaker 1

首先,大家都说通用基础模型在识别身份方面已经很好了,但当你试着生成自己的照片时,问题就来了。

First is, like, everybody say, oh, the general foundation model is already very good at identity until you try to use it to generate image of yourself.

Speaker 1

产品摄影也是同样的道理。

Same thing with product photography.

Speaker 1

它生成特定产品看起来挺不错,可一旦你是产品负责人,想生成这个具体产品的照片,就不行了。

Oh, it's pretty good at generating this specific product until you are the product owner and you're trying to generate photo of that particular product.

Speaker 1

模型直接就失效了。

It just stops working.

Speaker 1

对。

Yeah.

Speaker 1

这其实是个不太明显的问题。

So that's a non obvious one.

Speaker 1

区别在于,身份这个东西更主观、更动态一些。

The difference is, like, identity is a little bit more, I would say, subjective and dynamic.

Speaker 1

真的很难用语言说清楚,到底什么才是身份。

It's really, really hard to put into words what is identity.

Speaker 1

对吧?

Right?

Speaker 1

至于产品摄影,你得把文字、形状这些细节都做到位才行。

Like, product on the other hand, you know, you need to get the text right, you need to get the shape of the product right, to get all of those right.

Speaker 1

所以这方面的情况不太一样。

So it's a little bit different there.

Speaker 1

两者各自都有独特的挑战。

And there are unique challenges in both.

Speaker 1

比如,文字渲染在产品摄影里特别关键,但在身份保留上就没那么重要。

For example, text rendering is so important in product photography, not so much in identity preservation.

Speaker 2

我猜问题就变成了:你是希望模型全包了,还是让后续流程来接手模型能做的部分?

I imagine the question becomes, do you want the model to do it all or do you want the subsequent workflow to take some of the things that a new model gonna do?

Speaker 2

我想听听你们俩的看法,遇到什么任务时,你觉得应该由模型来解决,什么任务你愿意交给流程处理?

Just curious about both of your opinions on what kind of tasks when you run into it, you feel like it's something a model should solve and what kind of tasks you're okay with having the workflow solving it.

Speaker 0

我们看到语言模型出现了一个趋势,就是开始采用‘思考模式’。

We've seen a trend in language models where they've transitioned to thinking modes.

Speaker 0

对吧?

Right?

Speaker 0

现在要是用ChatGPT这类模型时不加思考,根本感觉不到它有多聪明。

If you use ChatGPT or one of these models nowadays without thinking, it just doesn't feel smart.

Speaker 0

没错。

Right.

Speaker 0

我觉得这属于一种中间状态——表面上是工作流,但底层还是靠核心模型驱动。

And I view that as kind of this in between of it's like a workflow, but it's still using the core model.

Speaker 0

我觉得创意工具也可以朝这个方向发展,确实如此。

And I think creative tools can go in that direction too Yeah.

Speaker 0

你可以先生成内容,然后评估它、在此基础上继续完善。

Where you you generate stuff, but you can evaluate it, you can build off of it.

Speaker 0

可能是用户参与其中,也可能是智能代理在帮忙,但这样能帮你更好地达成最终结果。

Maybe the user's involved in that, maybe an agent's involved in that, but it helps you get to the final result.

Speaker 0

明白了。

Got it.

Speaker 1

是的。

Yeah.

Speaker 1

我觉得模型和工具之间是有区别的。

I think there's a separation of model versus technology.

Speaker 1

比如在个性化方面,其实并不重要。

Like, you in terms of personalization, it doesn't matter.

Speaker 1

它就是一个通用模型,能解决大家的问题。

It's like a a general model that solves everyone's problem.

Speaker 1

只要技术一样,我们就能把同样的技术用在不同用户身上。

As long as the technology is the same, we can apply the same technology to different to different users.

Speaker 1

但关键是,你要把这个工具或者模型设计得能激发人的创造力,让人自己找到最佳的工作流程,去解决一些你根本没想到的问题。

But, again, you want to make that tool that or the model so that you can unlock the creativity in people so they can figure out the best workflows to solve a particular problem that you haven't even thought about before.

Speaker 2

对。

Yeah.

Speaker 2

你如何看待可控性?

How do you see controllability?

Speaker 2

我的意思是,AI的第一阶段是生成内容,然后我们不断重提提示,直到得到想要的结果。

I mean, phase one in AI is we generate things, and we just keep re prompting the model for the thing we want.

Speaker 2

这简直像在抽彩票。

It's almost like a lottery.

Speaker 2

第二阶段是我们通过模型层面或系统层面增加更多控制,让结果更稳定。

Phase two is that we put more control either on the model level or on the systems level to make that work.

Speaker 2

对于AI创作工具来说,更好的可控性到底意味着什么?

What does it mean for a AI created creativity tool to have, like, better controllability?

Speaker 0

是的。

Yeah.

Speaker 0

我觉得这还是个开放性问题,实现控制的方式有很多种。

I think it's an open question, and there's different ways you can add control.

Speaker 0

但简短的回答是,你必须加入控制机制。

But the short answer is you definitely need to add control.

Speaker 0

对。

Mhmm.

Speaker 0

我觉得,任何真正想用这些工具来做专业创作,或者想替代现有创意流程的人,最常抱怨的就是:你不想靠打字来操作。

I think that was the number one complaint from anyone who's actually trying to use these tools for any sort of professional or or to replace any part of their existing creative workflow is that you don't wanna operate with text.

Speaker 0

光靠文字肯定不够。

There has to be something more than just text.

Speaker 0

没错。

Right.

Speaker 0

如果非得用文字,那你就得有更高的控制精度,而文字在这方面很难做到。

Or if it is text, you need that level of control, which can be very difficult in text.

Speaker 0

所以我们做了很多尝试。

And so we've experimented a lot.

Speaker 0

最近,我们主要在做视频转视频的研究,因为觉得这是在时间维度上实现精准控制的好方向。

Most recently, we've been doing a lot of work in the video to video space because we think that's, like, a very good way to start incorporating pretty precise controls, in the time dimension.

Speaker 2

对。

Right.

Speaker 0

在空间维度上,有很多有趣的可能性,比如涂鸦、点击特定区域,把这些控制方式一层层加到模型上,让用户能直接操作,同时也把这些功能开放给智能代理,让代理能按指令完成这类创作任务。

In the spatial dimension, I think there's a lot of interesting things with being able to scribble, being able to, like, point to certain regions, and so adding more and more of these controls on top of the model so that the user can do, while also opening up these controls for an agent so that you can instruct an agent to do these sorts of ads.

Speaker 1

是的

Yeah.

Speaker 1

我觉得这还关乎帮用户表达出他们真正想要的东西。

I think it's also about helping the user to say what they want.

Speaker 1

很多时候,模型并没有完全做到你期望的效果。

I think a lot of the time, the model doesn't do exactly what you want.

Speaker 1

这是因为用户的提示本身有点模糊。

It's because of, like, the user's prompt or whatever is a little bit ambiguous.

Speaker 1

除了你得告诉模型你要做什么,我觉得还有一个被忽视的研究方向:模型能不能主动告诉你,它需要什么样的输入才能做好。

And it's also so other than the you need to tell the model what you do, I feel like this is the underexploited research direction is if the model can tell you what it needs to get your inputs Mhmm.

Speaker 1

就是在执行之前,先主动向你确认需求。

To act acting asking for your inputs before it does something.

Speaker 1

我觉得这一点也特别重要。

I I feel like that's also really important.

Speaker 1

因为当你作为一个新手和创意专业人士合作时,他们经常会问你问题,你就能把自己的想法和偏好告诉他们,他们再据此调整出你想要的效果。

Because, like, when you when you are working with a creative professional, as an amateur, a lot of the times, they ask you questions, and you can you can tell them your opinions, your preferences, and they sort of achieve their preferences and opinions.

Speaker 1

我觉得,现在基本上就是单向的。

I feel like that mostly, today, it's almost a one way street.

Speaker 1

用户告诉模型该做什么。

It's like the user tell the model what to do.

Speaker 0

这个观点确实很到位。

I think that's a really good point.

Speaker 0

如果你去一家工作室,说‘给我做个十秒的视频,内容是狗在草地上跳’,他们肯定不会照单全收。

If you go to, say, a studio, and you say, make me a ten second video about a dog jumping in the grass, they're never gonna take that deal.

Speaker 0

他们会要求更具体一些。

They're they're gonna want more specific.

Speaker 0

没错。

Right.

Speaker 0

是的。

Yeah.

Speaker 0

你得想想怎么把这种思路用在人工智能上。

You have to figure out how to apply that in AI.

Speaker 0

对。

Yeah.

Speaker 2

有意思。

Interesting.

Speaker 2

你觉得在模型和应用协同设计方面,是否有助于提升可控性?

Do you think model app co design has benefits when it comes to introducing more controllability?

Speaker 2

你对此怎么看?

What's your view there?

Speaker 0

我觉得是的。

I think so.

Speaker 0

如果能让用户在你的应用里互动、完成他们的工作流程,你就能看出他们真正关心哪些地方。

I think being able to have the users interact in your app and work through their workflow in your app, you learn which things a user actually cares about.

Speaker 0

你会明白哪些步骤他们必须反复重做,以及他们为什么最终选择了某个特定步骤。

You learn which steps do they have to redo multiple times and why maybe they chose the step that they ended up choosing.

Speaker 0

对。

Yeah.

Speaker 0

这能大大帮助模型的设计。

And that can help a lot with model design.

Speaker 2

没错。

Right.

Speaker 1

对。

Yeah.

Speaker 1

我觉得另一个方向也同样重要,那就是你的产品还能帮助用户理解,怎样才是使用模型的最佳方式。

I think the other direction is also really important is, like, your product can also help educate the user what's the best way to sort of use their model.

Speaker 1

我觉得以前这些事全都是靠写代码来完成的。

I feel like we're seeing that all of that was, like, coding and stuff.

Speaker 1

对吧?

Right?

Speaker 1

人们早就习惯了用 VS Code 之类的工具来做所有事情。

Like, you know, people are used to, like, to do everything like Versus Code or whatever.

Speaker 1

现在呢,你直接在终端里敲几行命令,就能完成这些操作了。

And now, like, call code just in the terminal, you can you can do do that code.

Speaker 1

这才是使用模型的最佳方式,因为你避开了很多其他麻烦。

And it's the best way is to sort of use that model because you cut cut through a a lot of other things.

Speaker 1

我还是觉得,应用和模型的设计也有它的优势。

I still feel like app and model code design has advantage too.

Speaker 2

对。

Yeah.

Speaker 2

说到AI创意工具,我首先想到的就是它们非常直观,一目了然。

When we think about AI creative tools, the first thing that comes to mind, at least for me, is it's very visual, just being clear.

Speaker 2

特别依赖视觉呈现。

Very visual animals.

Speaker 2

现在我们已经习惯了和智能代理打交道。

And now we're used to working with agents.

Speaker 2

感觉这些代理就像外星人,它们感知世界的方式跟我们完全不同。

It feels like almost like agents are aliens who don't perceive the world the same way that we did or we do.

Speaker 2

所以我很好奇,会不会出现一种情况,创意工具主要变成后台运行的?

So I'm curious, like, is there a world where creative tools become primarily headless?

Speaker 2

如果你想要利用这种代理循环,那会是什么样子?

What would that look like if you, you know, leverage want to leverage agent type loops?

Speaker 0

对。

Yeah.

Speaker 0

我觉得,再说回到工作室的场景,你其实是在和一个代理沟通。

I I think, again, going back to like if you were to work with a studio, you are talking to an agent.

Speaker 0

对吧?

Right?

Speaker 0

你在和一个与你协作的人交流,但他们不会用文字回复你。

You're talking to someone who is working with you, but they're not talking back to you in text.

Speaker 0

他们会给你展示例子。

They're showing you examples.

Speaker 0

他们会带你过一遍,说:

They're walking through, hey.

Speaker 0

你觉得这些点子怎么样?

Do you like these ideas?

Speaker 0

你喜欢这些想法吗?

Do you like these ideas?

Speaker 0

我觉得这就是AI创意工具未来的发展方向。

And I think that's the direction you'll see these AI creative tools go.

Speaker 2

是的。

Yeah.

Speaker 1

对。

Yeah.

Speaker 1

比如我 brainstorm 的时候,想写个代码生成一个展示图表的网页,其实我只需要一个草图就行。

Like, when I when I try to brainstorm something and, you know, you try to write a code to to, like, generate HTML page showing me the graph graphics of it, I want just a sketch out of it.

Speaker 1

对吧?

Right?

Speaker 1

这大概是最有效的迭代方式。

Like, that that's probably the best way to iterate.

Speaker 1

对吧?

Right?

Speaker 1

一张图胜过千言万语。

Like, sort of an image is more than a thousand words.

Speaker 1

对吧?

Right?

Speaker 1

没错。

Like Sure.

Speaker 1

是的。

Yeah.

Speaker 1

这真的特别重要。

So that's that's just so important.

Speaker 1

另一方面,我觉得人们还没找到最好的方式,把信息有效地传递给模型。

On the other hand, I feel like people haven't figured out a way what's the best way to feed the viewer information to a model.

Speaker 1

我觉得现在的模型还是有点‘看不见’。

I still feel like model today is a little bit blind.

Speaker 1

我的意思是,它确实在变好,没错。

I mean, it's getting better Right.

Speaker 1

通过具备高层次的语义理解能力。

By having high level semantic understanding.

Speaker 1

但视觉信息其实挺冗余的,我觉得是这样。

But visual is just such a, I would say, redundant information.

Speaker 1

像素之间重复太多,跟语言完全不一样。

There's, like, pixels that are very redundant, so unlike languages.

Speaker 1

那该怎么把这种信息传递给模型,让它不再‘瞎’呢?

So how do you sort of give the model that kind of information so the model is not blind anymore?

Speaker 1

这太关键了。

That's so important.

Speaker 1

我觉得我们还没找到解决办法。

I I don't think we have figured out that yet.

Speaker 2

这真有意思。

That is so interesting.

Speaker 2

这让我想到,在创意工具里,选择合适的表达方式有多重要。

It does remind me of like the importance of having the right representation in a creative tool.

Speaker 2

我是说,马特,你之前做过神经辐射场,以前大家用的是拉丝法,现在神经辐射场的表示方式已经形成了一整套效率谱系——高斯滑块细节表现很棒,但用起来特别麻烦,因为它不像一个优美的数学函数。

I mean, Matt, you worked on NERF and before that people were on Lashes and now there's a spectrum on how efficient a representation is on NERF and, you know, like Gaussian slide is great in details, but it's really hard to work with because it's not like a beautiful mathematic function.

Speaker 2

你是怎么看待不同表示方式的?在你想要打造的设计工具里,未来的功能迭代需要什么样的表示形式?

How do you think about representation or different kinds of representations for, you know, the feature iteration of the design tools you want to make?

Speaker 1

我我我

I I I

Speaker 0

我觉得表示方式的问题,归根结底还是控制权的问题。

think the representation question ultimately comes down to the control question too.

Speaker 0

你将来希望对它做出哪些修改?

It's what do you want to be able to modify it in the future?

Speaker 2

对。

Yeah.

Speaker 0

如果你在设计一张海报,知道以后要改文字,那你就该选一种不是基于像素的表示方式,不然改文字会特别麻烦。

If you're designing a poster and you know you're gonna be changing the text on it, you probably want a representation that's not pixel level or changing that text.

Speaker 0

没错。

Yeah.

Speaker 0

对。

Right.

Speaker 0

如果你只是在调整图片,那用像素来处理是合理的。

If you're just modifying pictures, then pixels make sense.

Speaker 0

如果你是在浏览三维场景,比如拍电影,那可能更需要一个三维的表达方式。

If you're navigating three d scenes, then for for, say, say, movies, you may want a three d representation.

Speaker 0

所以我觉得并没有一个放之四海而皆准的答案。

So I don't think there's necessarily one answer.

Speaker 0

关键要看你想要什么样的控制粒度。

It's whatever makes sense with a given level of control.

Speaker 0

我

I

Speaker 1

觉得这一点特别重要。

think that's so important.

Speaker 1

我觉得现在很多人更关注模型用哪种表达效果最好。

I think right now, a lot of people are more focusing on what's the best reputation for the model.

Speaker 1

但正如马特所说,我认为这些声誉的使用者不只是模型,还有人类。

But as Matt said, I think the consumer of those reputation is not just the model, it's also the human.

Speaker 1

所以,你能不能以一种人类能理解的方式呈现它,然后让他们能够控制这种呈现,对它进行操作?

So, like, can you represent it in a way that human can understand and then be able to control that representation, do stuff to it?

Speaker 1

对,没错。

Like yeah.

Speaker 2

我很好奇,你们两位作为前研究人员,是怎么培养出为创作者设计产品的直觉的?

One thing I am curious about for both of you is how do you develop the intuition for building for the creators as former researchers?

Speaker 2

马特,我知道你本身也是艺术家。

But Matt, I know you are also artists in your own right.

Speaker 2

那么,这对你做研究或推出的产品类型有什么影响?

So like, how does that affect what kind of research or what kind of product you ship?

Speaker 0

我觉得这让你对控制层面有了一些独特的理解。

I think it sorta gives you some insight in the control aspect.

Speaker 0

我记得小时候上美术课时,老师最先强调的就是‘空白画布’的问题。

Like, one of the first things I remember being drilled in during sort of art classes when I was younger is the blank canvas problem.

Speaker 0

是的。

Yeah.

Speaker 0

很多人容易卡在那儿,但只要开始一点点来,仔细地一个部分一个部分推进,就好了。

There's a tendency of wanting to well, getting stuck by that, but then once starting very meticulously, like, doing one section at a time.

Speaker 0

对。

Right.

Speaker 0

但其实更好的做法是直接动手试试,别想太多。

But in reality, it's better to just sort of go at it, just try things out Yeah.

Speaker 0

多折腾几遍,直到找到让你最满意的结果。

Mess with it until you get to the thing that you're ultimately happy with.

Speaker 0

对。

Right.

Speaker 0

我觉得AI工具也是一样。

And I think AI tools are no different.

Speaker 0

迭代速度很快,但关键是要不断迭代。

The iteration cycle's quite fast, but you really want to iterate.

Speaker 0

不是只输入一个提示,就能直接得到最终结果。

It's not just put in a single prompt to get a final answer out.

Speaker 0

你需要在此基础上不断调整和优化。

You wanna iterate on top of that.

Speaker 0

这确实会影响我们设计工具时的思路。

So that definitely impacts how to think about building the tools.

Speaker 0

另外,我觉得还要搞清楚该怎么描述工具中哪些地方有效、哪些无效,这对评估非常重要。

And then I think another aspect is figuring out what language to describe what works or doesn't work in the tool because this can be very important for evaluation

Speaker 2

对。

Right.

Speaker 0

过去这么多年,艺术领域的人早就发展出了一套描述方法,比如构图、光影之类的。

Where, I mean, throughout arts over the in the past however many years, like, people have built out these ways to describe Right.

Speaker 0

构图、光影之类的。

Composition, lighting, etcetera.

Speaker 0

把这些经验吸收进来,融入模型的设计,我觉得会很有帮助。

So having that knowledge and and incorporating it into the design of the models, I think, can be very helpful.

Speaker 0

是的

Yeah.

Speaker 1

就是聊天啊。

Talking yeah.

Speaker 1

和用户交流非常重要。

Talking to users is really important.

Speaker 1

我们会和用户沟通。

We talk to our users.

Speaker 1

我们觉得,确实能感受到那种空白画布的问题。

We feel like, oh, we we definitely recognize the black blank canvas problem.

Speaker 1

比如,你问用户:‘你希望怎么改进这张照片?’

Like, when you when you ask the user, how do you want to improve this photo?

Speaker 1

他们也不知道。

They don't know.

Speaker 1

但当你对照片做了些调整后,他们就开始有意见了,比如喜不喜欢你的修改。

When you make some edit to that photo, now they have opinions on, like, whether they like your edits or not.

Speaker 2

这就是他们不喜欢的地方吗?

Is that what they don't like?

Speaker 1

他们知道自己不喜欢什么。

They they know what they don't like.

Speaker 1

没错。

Exactly.

Speaker 1

所以啊,和用户交流真的非常重要。

So, you know, talking to users is is really, really important.

Speaker 1

而且我觉得,对技术有深入的理解也很关键,这样才能在保持略微领先于用户的同时找到平衡点——这种直觉,不仅要从用户角度出发,也要从技术角度来培养。

And I also think having a very good understanding of the technology so that you can make this fine balance of, you know, staying ahead of a little bit ahead of the users, I I think is also really important to build that kind of intuition, not just from the user perspective, but also from the technology perspective.

Speaker 2

你怎么看待过程和最终成果之间的关系?

How do you see the process versus end results?

Speaker 2

因为在艺术创作中,如果是人来创作,很多心血都投入在创作过程中,而最终成果就是当你觉得过程已经达到满意点的时候。

Just because in art, if your human is creating art, a lot of it goes into the process of creating it, and then final result is when you decide the process come to a point of your satisfaction.

Speaker 2

那你怎么看待智能体创作艺术的方式和这个有什么不同?

How do you compare that with how agents create art?

Speaker 0

我觉得在很多方面,其实挺相似的。

I think in many ways, it can be quite similar.

Speaker 0

我觉得就算是AI生成艺术,背后也还是有人参与的,因为这个创作过程本身,对艺术家来说才是最有趣的部分。

And I think even when agents create art, there's still this human involved in that process because that process is the part that's fun, I think, for artists.

Speaker 0

你看那些特效的分解视频,就能发现最终画面背后有多少层、多少步骤的功夫。

You look at, like, breakdowns, VFX breakdowns, and you you see how many different steps and layers went into the final pixels.

Speaker 0

是的。

Yeah.

Speaker 0

而且这过程特别有意思。

And it's fun.

Speaker 0

我觉得做这类工作的人,都很享受去拆解整个创作流程,看看每一步是怎么拼起来的。

And I think people who do that kind of work find it very exciting to kinda see how everything breaks down.

Speaker 0

未来有了AI工具,分解的方式可能会大不一样,但这种分解的过程依然会存在。

I think the way things break down in the future with AI tools will look very different, but it'll still exist.

Speaker 0

所以将来会是AI和人类分工协作:AI负责一部分,最后还是得靠人来把所有部分整合起来。

And so it'll be this kind of back and forth between agents doing some parts of the work, but then humans also ultimately tying it all together.

Speaker 0

是的。

Yeah.

Speaker 0

对。

Yeah.

Speaker 1

这可能没直接回答你的问题,但一直有个争论,就是我们在做AI摄影的时候。

And this may not direct answer your question, but there's always this debate of like, okay, we're working on AI photography.

Speaker 1

摄影会消失吗?

Is photography gonna die?

Speaker 1

未来的普通摄影会消失吗?

Regular photography gonna die in the future?

Speaker 1

我不这么认为。

I don't think so.

Speaker 1

很多人拍照片,不只是因为喜欢最终的效果。

There are a lot of people who are doing photography not just because they enjoy the result.

Speaker 1

他们特别享受这个过程。

They enjoy the process so much.

Speaker 1

对吧?

Right?

Speaker 1

现在的数码相机已经做得这么好了。

Like, even digital cameras have become so good nowadays.

Speaker 1

还是有很多人坚持拍胶片。

A lot of people are still taking films.

Speaker 1

是的。

Mhmm.

Speaker 1

胶片摄影的过程特别有意思。

Film is such a interesting process.

Speaker 1

对吧?

Right?

Speaker 1

你得抓住那个瞬间,不然就错过了,而且拍完也不能马上看到效果。

Like, it has this this unique thing of you have to capture that moment, otherwise, And you don't see the result right away.

Speaker 1

你得把胶片冲出来才行。

You have developed the film.

Speaker 1

所以这其中有很多地方都很有意思。

So a lot a lot of it is interesting.

Speaker 1

我觉得很多人依然享受这些过程。

So I think people are still enjoying those processes.

Speaker 1

但与此同时,也有人只想快速看到结果,那我们怎么用AI创作工具帮他们简化流程,激发他们的创造力呢?

But at the same time, there are people who would just want the results And, you know, how do we empower them with the AI creative tools to make that easy for them, to unlock their creativity?

Speaker 1

我觉得这也是我对AI创作工具感到兴奋的地方。

I think that's also where I'm excited about the AI tooling for creators.

Speaker 2

确实存在大量潜在需求。

Definitely a lot of latent demand.

Speaker 2

那些买不起高端相机、也从来没上过胶片冲洗课的人,现在找到了属于自己的表达方式。

So the people who did not have the money to buy a very fancy camera to go out there and take pictures, and they also never took a film developing class ever, like they found their medium.

Speaker 2

我们来看一看这段历史。

Here's how we see the history too.

Speaker 2

传统创作工具一直都在,但新进入者一上市,瞄准的就是那些从未使用过传统工具的用户。

Like the traditional, you know, creative tools, they were all there, but new entrants, you know, they come on the market, they targeted users who were not users of our traditional tool.

Speaker 2

他们当然想学,但现在有更简单的方法能直接拿到结果。

They will want to learn, but there's an easier way for them to get there and get the results.

Speaker 2

你有没有注意到这种潜在需求是从哪儿来的?

How have you observed where that latent demand come from?

Speaker 2

比如在摄影方面,那些买不起相机的人,明明没接受过专业训练,却还是想要拍出好看的照片。

Like in photography, who are the people who are, you know, I don't have money to buy a camera, but yet I want some sort of results from Phota.

Speaker 1

是的。

Yeah.

Speaker 1

对。

Yeah.

Speaker 1

我觉得摄影不只是艺术。

I think photography is such a it's not just art.

Speaker 1

它更是记录我们人生重要时刻的凭证。

It's also a document of our record of your important moments in life.

Speaker 1

这完全不一样。

So that's very different.

Speaker 1

很多人希望把自己的生活瞬间好好记录下来。

And a lot of people, they want a good recording of their moments, their lives.

Speaker 1

但他们不一定有拍出好照片的技巧。

They may not necessarily have the skills to take that photo.

Speaker 1

也可能没有合适的设备来拍出这样的照片。

They may not have the equipment to take that photo.

Speaker 1

过去,他们只能试着买一部更高端的iPhone,比如最新款,指望相机性能能好一点,可他们根本不会后期处理。

And for them, they can only in the past, they try to buy a fancier iPhone, maybe the latest generation iPhone, they hopefully, they get a better camera out of it, but they don't have the skills to do editing.

Speaker 1

这些就是我们想要解决的潜在需求。

Those are the latent demand that we try to address.

Speaker 1

我们真心觉得,不管是AI模型还是AI助手,只要能开发出一些创意工具,帮他们轻松完成拍摄,甚至直接替他们搞定,让他们能留下人生重要时刻的精彩照片,这就是我们的目标。

You know, we really feel like whether it's AI model or AI agents, creative tools that we can develop to make that easy for them, or even do the job for them so that they can get these good photos of their important moments in their life, that's what we want to do.

Speaker 2

是的,我们公司以前做过职业肖像拍摄服务。

Yeah, so one thing we had in a firm, which is like, we had photo shoots for people's head shots.

Speaker 2

那种是高端服务,你会请摄影师,用专业影棚、灯光和化妆团队。

And those are like, you're premium and you you invite a photographer and then the whole studio and lighting and makeup.

Speaker 2

最近我发现,越来越多的人虽然没法参加线下拍摄,但会用Phota来生成照片,这其实是个很有趣的市场细分——你总得有个实体对象才能拍照,不管是产品、人,还是别的什么。

And recently I found that there's more and more folks who are gorgeous like, I couldn't make it to the photo shoot this way, but I'm going to generate it on Phota, which, you know, it's like a very interesting segment of market where you need a physical presence to take a photo, either that's a product or a human or something else.

Speaker 1

对的。

Mhmm.

Speaker 2

你有没有注意到,新用Phota的用户也是这样?

Have you seen that too, like, on the new Phota users?

Speaker 1

有。

Yes.

Speaker 1

确实有。

Yes.

Speaker 1

我觉得,Photoshop这类工具,本质上其实也是一种布景环境。

I think and also, like, photo Photoshop is if you think about it, it's a setup environment anyway.

Speaker 1

对吧?

Right?

Speaker 1

你得自己安排灯光。

Like, you are setting up the lighting.

Speaker 1

你得亲自去那里拍照片。

You're you you go there and you sort of take the photos.

Speaker 1

但很多时候,你没法完全掌控所有细节,毕竟受物理条件限制。

And and most of the time, you don't have all control of everything just because of the physical limit.

Speaker 1

没错。

Yeah.

Speaker 1

但如果是用生成技术来做,能做的就太多了。

When you're doing it in a generation ways, there's so much thing so many things that you can do.

Speaker 1

灯光想怎么调就怎么调。

You can change the lighting the way you want.

Speaker 1

角度也能随便改。

You can change the angle.

Speaker 1

连妆容不满意了都能重新调整。

You can even change your makeup if you want.

Speaker 1

这些便利性我觉得特别重要,确实越来越多人都在发现这些应用场景。

All of this, I think, is just so important and people are finding those use cases for sure.

Speaker 2

是的。

Yeah.

Speaker 2

我也很想听听真正摄影师的看法,因为马特,你拍很多照片。

I would love to hear from actual photographers' point of view too, because Matt, you take a lot of photos.

Speaker 2

所以我想知道,你怎么看待传统摄影和AI摄影这两种方式的差异?

So I guess, like, how do you think about this old versus new world of AI photography?

Speaker 0

对。

Yeah.

Speaker 0

我觉得挺有意思的。

I it's fun.

Speaker 0

我觉得这两者确实有重叠的地方,可以结合起来用,但也很有意思的是,它们本质上是两种完全不同的创作媒介。

I almost viewed there's definitely, like, the overlap where you can do them together, but then there's also this very interesting where you're, like, treated in a very different medium.

Speaker 0

没错。

Mhmm.

Speaker 0

当你开始完全在AI的世界里创作时,你就可以想象,一张照片如果出现在世界另一端,或者在某种你根本不可能实地拍摄的灯光环境下,会是什么样子。

When you start doing things that are purely in the AI world, you can start thinking about what would an image look like maybe halfway across the world or in specific studio lightings, situations that you would never actually be able to do Yeah.

Speaker 0

但你觉得这个想法或者画面挺酷的吧。

But you think it's like a cool idea or image.

Speaker 0

我有时候看到一些很棒的画面,就会琢磨怎么用AI把它复现出来。

I find myself sometimes going and, like, seeing a cool image out there and trying to think how would I actually replicate this in AI?

Speaker 0

到底该用哪些关键词才对呢?

What are the right, yeah, terms to use?

Speaker 0

然后一不小心就陷进去了,一路深挖下去。

And and you kinda go through a rabbit hole to get to that point.

Speaker 0

它打开了一个我以前从来没机会探索的新领域。

So it unlocks like a new area that I haven't been able to explore before.

Speaker 2

是的。

Yeah.

Speaker 2

你觉得在AI创意工具的新时代里,传统工具还扮演什么角色?

How do you think about the role of traditional tools in the new world of AI creative tools?

Speaker 2

传统工具会不会变成底层基础设施,一直都在那儿,我们只需要训练AI去调用它们完成某些特定任务?

Are the traditional tools becoming infrastructure where, you know, they're always gonna be here and now we just train agents to know how to use them for, you know, bits and pieces?

Speaker 2

还是说它们正在被重新构建?

Or are they getting rebuilt?

Speaker 0

归根结底,这些东西都只是工具。

I think at the end of the day, all these things are just tools.

Speaker 0

关键还是看谁有想法,想实现这个想法,用哪个工具最合适。

And so it really just comes down to whomever has some vision and they wanna execute on that vision, what tool is right for them.

Speaker 0

对有些人来说, Photoshop 永远是首选。

For some people, it'll always be Photoshop.

Speaker 0

对的。

Mhmm.

Speaker 0

对新一代来说,可能就不是了。

For probably a newer generation, it won't be.

Speaker 0

这最终还是得看个人。

And so it'll just be kind of dependent on the person.

Speaker 0

对的。

Mhmm.

Speaker 0

正如你提到的,也许将来会是智能代理在使用这些工具。

And as you mentioned, maybe it'll be agents that'll be interacting with these tools.

Speaker 0

所以我觉得很难下定论。

So I think it's hard to say.

Speaker 0

我觉得这些工具在某种程度上总会存在,但不同用户会赋予它们不同的用途。

I think these things will always exist to some extent, but it'll find different uses by different users.

Speaker 2

是的。

Yeah.

Speaker 1

对。

Yeah.

Speaker 1

我很喜欢这种说法。

I really like this framing.

Speaker 1

这并不是说我们遇到了一个全新的问题——比如新工具和老工具的对立。

It's it's not like we're having this new problem of, like, oh, very new tools, very old tools.

Speaker 1

我觉得工具一直以来都在不断迭代。

I feel like the tools have already always be iterating in the past.

Speaker 1

总会有新工具冒出来,不管是不是基于AI的。

Like, there's always new tools come out, whether it's AI based or not AI based.

Speaker 1

新工具一直都在不断出现。

There's always new tools come out.

Speaker 1

我们现在可能正处在一个工具迭代速度特别快的阶段。

Just we're probably at a stage where the tools are iterating so fast.

Speaker 1

所以我觉得,有些工具将来可能真的用不着了。

So I I do think some some tools, you may not need them in the future anymore.

Speaker 1

它们会被取代,但很多工具还是会留下来。

They're gonna be replaced, but a lot of tools will still exist.

Speaker 1

就连我们现在用的AI模型,未来也会被新的模型取代,这本来就是一个不断迭代的过程。

And even the AI models that we have today, they're gonna be replaced as well, like new models come out, so just an iterative process.

Speaker 2

把自家的模型整合到你开发的工具里,有什么好处呢?

What is the benefit benefit of having your own model as part of what you put in the toolings that you build?

Speaker 2

开源一个模型,有什么优势吗?

Like and is there a benefit in open sourcing a model?

Speaker 0

我觉得拥有自己的模型最大的好处之一,就是能基于它继续开发。

So I think one of the biggest benefits of having your own model is the ability to build off of it.

Speaker 0

对。

Mhmm.

Speaker 0

归根结底,你的产品有一群特定用户,你得为他们做到最好,而最好的方式就是定制化,做一些调整。

At the end of the day, your product has a certain set of users and you wanna do the best thing you can for those users, the best way to do that is by customizing it, maybe making adjustments

Speaker 1

到

to

Speaker 0

那些对通用开源模型来说没必要、但对你产品来说非常关键的改动。

the model that don't make sense for, say, a general open source model, but makes sense for your product.

Speaker 0

没错。

Right.

Speaker 0

这一点在现有模型基础上往往很难实现,只有你自己开发的模型才能提供这种专属的优化。

And that's one thing that is not always easy to do on top of existing models and may require some specialization that only you can provide in your own models.

Speaker 0

没错。

Right.

Speaker 1

是的。

Yeah.

Speaker 1

对我们来说,有点不一样。

For us, a little bit different.

Speaker 1

我们并不直接做基础模型。

We we don't we don't directly do foundation model.

Speaker 1

我们主要做个性化服务。

We mostly work on personalization.

Speaker 1

原因是现在有很多很棒的公司,比如 Luma。

The reason is because there are so many cool companies out there like Luma.

Speaker 1

我们觉得个性化应该是用户自己掌控的。

We really think personalization is something that user should own.

Speaker 1

那是用户自己的模型。

Like, that's the user's model.

Speaker 1

对用户来说,那是他们的模型,但最终他们是在使用这个模型。

It'd be the user's model for them, but at the end of the day, they're using that model.

Speaker 1

他们完全掌控这个模型。

They have full control of that.

Speaker 1

所以,针对这一点,我们想开发一种技术,帮他们实现这个功能,但模型的所有权属于用户。

So, like, for for that particular thing, like, we want to build a technology to enable them to do that, but they own their model.

Speaker 1

对。

Mhmm.

Speaker 1

我们还希望他们能把自己的模型和任何喜欢的基础模型结合起来使用。

And we want them to be able to combine that with any foundation model they they like to use.

Speaker 1

对吧?

Right?

Speaker 1

比如,他们可能需要一个专门针对某个特定场景的模型。

It could be a specialized model that they must specifically be for for, like, a particular use case, for example.

Speaker 1

对吧?

Right?

Speaker 1

所以,真正把个性化和基础模型区分开来,正是我们的目标。

So and to to really disentangle this personalization versus foundation is sort of the goal that we have.

Speaker 2

随着AI工具的发展,你觉得在未来几年里,顶尖艺术家和其他人最大的区别会是什么?

With the advancement of AI tools, what do you think will separate the best artists from everyone else in the next couple years?

Speaker 0

从我自己的经验来看,已经很明显了,能看出一个人是不是用了我们的工具,甚至用的是任何AI工具。

I can say from my experience already, it's very obvious when when people use our tools or not even our tools, any of the AI tools.

Speaker 0

你很快就能分辨出,谁只是随便丢个提示词就等着出结果,谁是真正思考过整个创作故事的。

You can tell pretty quickly someone who has who who's just throwing in a prompt and getting a result out versus someone who has thought more about, like, the whole holistic story.

Speaker 0

我总是对那些有创意的艺术家能用这些工具做出什么感到惊讶。

I always get amazed at what very creative artists can do with these tools.

Speaker 0

很多时候,你会看到一些作品,根本不像这些工具能做出来的,但艺术家们就是找到了办法让它成为可能。

Many times, you see things that just don't seem like they would have been possible given the tools capabilities, but artists have figured out how to make it possible.

Speaker 0

所以我觉得,这才是真正的关键所在。

And so I think that's really the thing that separates it.

Speaker 0

关键在于,你怎么用现在能接触到的工具,做出独一无二的东西?

It's how do you make something unique with the tools you have access to now?

Speaker 1

对。

Yeah.

Speaker 1

我觉得很难说谁是好艺术家、谁是差艺术家,但大概可以分成优秀艺术家和普通艺术家吧。

I I think I mean, it's it's hard to say there's good artists and bad artists, but, like, they're probably good artists and, like, average artists.

Speaker 1

我觉得AI工具确实拉高了底线,让你我这样的人也能用这些工具做出挺不错的作品。

I feel like with AI tools, they're definitely raising the lower lower bar of just just so that, you know, even someone like like me can create something pretty, pretty good with the AI tools.

Speaker 1

对。

Yeah.

Speaker 1

但我认为,顶尖艺术家和普通艺术家之间的差距会变得更大。

But I also think that the gap between the very best artist and average artist is gonna be even bigger.

Speaker 1

就像马特说的,那些清楚自己想要什么、怎么去实现的人,现在能更容易地表达创意,再借助这些强大的工具达成目标。

Exactly because what Matt said, you know, like, they're so so much easier for people to express their creativity when they have a very good understanding of what they want to get, how they wanna get there, and they can use these powerful tools to do that.

Speaker 1

他们能做出以前根本做不到的东西,所以这个差距只会越来越大。

They can achieve something they wouldn't be able to achieve before, so the gap is gonna just get bigger.

Speaker 1

当然,他们还得真正掌握这些新的AI工具。

And, of course, they also need to have very good understanding, mastering all these new AI tools as well.

Speaker 0

我想再补充一点。

I think maybe one final point.

Speaker 0

你肯定见过那些生成得不好的AI作品。

You've seen AI generations that are bad.

Speaker 0

对吧?

Right?

Speaker 0

我觉得我们都见过不少差劲的AI生成内容。

I think we've all seen them that are bad.

Speaker 0

我敢说,那些产生糟糕作品的工具,也同样能生成让你惊叹的效果。

I can guarantee the same tools that made those bad generations, they've also made generations that you would think are amazing.

Speaker 0

没错。

Exactly.

Speaker 2

是的。

Yeah.

Speaker 2

对。

Yeah.

Speaker 2

今天早些时候,我听人说,他们觉得AI生成的都是垃圾。

Something I heard from someone today earlier was they assume AI to be slop.

Speaker 2

好像只要是AI生成的东西,都是垃圾。

Like, anything AI models have would be slop.

Speaker 2

能不能做出好东西,还得靠人来加工。

It's up to the humans to create something out of it.

Speaker 2

比如你只是说,我要一张咖啡的图片,就普通一杯咖啡那样。

Just because if you just like say, I want a picture of a coffee as a like a cup of coffee.

Speaker 2

第一次生成的结果通常都很普通。

The first generation is just mediocre.

Speaker 2

这种图在任何图库网站都能找到。

You can have it in any stock image website.

Speaker 2

没什么特别的,也谈不上个人风格。

It's nothing unique or it's nothing personal.

Speaker 2

对。

Right.

Speaker 2

所以最终能不能做出属于自己的东西,关键还是看使用者怎么去打磨,加入自己的风格。

So it really is up to the user to kinda make it like theirs to kinda put their mark and style on there.

Speaker 2

你对个人风格怎么看?特别是从个性化这个角度来说?

What are your thoughts on personal styles, like, in in terms of personalization?

Speaker 2

比如说,风格到底指的是什么?

Like, what comes to the style?

Speaker 2

对用户而言,什么才算真正的个性化?

What constitute personalization for the users?

Speaker 1

我觉得这个问题真的很难回答。

I feel like that's such a hard question.

Speaker 1

说真的,我几乎觉得除了从数据中去学习,根本没法给它下一个准确的定义。

Like, it's almost like it's I almost feel like there's no good way to define it other than you can learn that from data.

Speaker 1

这不光是看用户过去的数据那么简单。

So and it's not just like, okay, the user's existing data.

Speaker 1

还得看用户使用时的反应,他们喜欢还是不喜欢。

It's also like when the user use it, what's their reaction to it?

Speaker 1

他们对它是什么感觉?

How do they like it or not?

Speaker 1

因为就算你问用户他们自己的风格是什么,他们填的那些关键词也可能不完整。

Because even if you ask the user what's their own style, I mean, they can put some keywords there that's not complete.

Speaker 1

我觉得,如果解决问题的方式是先明确他们的风格,再建模,那我可能不会这么干。

So I feel like, you know, if the way to solve the problem is you really to kind of define their style and then model their style, that's probably not the approach I would take.

Speaker 1

从研究的角度来看,我觉得你应该直接看数据,从数据里找出那些潜在的模式,这样反而能更自然地发现他们的风格。

Even from a research perspective, I feel like you look at the data, you find the attribution that the the data shows you, and then you probably have figured out that style.

Speaker 1

而且即便到了这一步,这种风格依然是隐性的,因为它已经融入模型本身了。

And even at that time, it's still implicit because it's part of the model.

Speaker 2

是的。

Yeah.

Speaker 2

我明白了。

I see.

Speaker 2

有意思。

Interesting.

Speaker 0

我觉得这东西还会随着时间变化。

I think it's also something that changes over time.

Speaker 0

是的。

Yes.

Speaker 0

就像一个人也会随着时间变化。

Both as as a person changes.

Speaker 0

我知道五年前我觉得有趣的东西,和现在完全不一样。

Like, I know the stuff that I thought was interesting five years ago versus now is very different.

Speaker 0

而且有时候,这周我在做一个项目,下周又换另一个项目,自然就需要不同的风格。

But then also, you know, I'm working on one project one week and another project another week, and I inevitably need a different style.

Speaker 0

所以也许我们可以这样定义:针对具体任务的风格,和用户整体偏好的个性化风格。

And so maybe that's how you define, like, the styles for specific tasks and maybe personalization, sort of the holistic, like, what you as a user tend to like.

Speaker 0

对。

Mhmm.

Speaker 0

不过,我觉得这两者有点混在一起了。

But, yeah, I think it's it's a bit mix.

Speaker 2

太棒了。

Awesome.

Speaker 2

那今天就到这里,非常感谢你来参加这个播客。

And with that, well, thank you so much for coming on the pod.

Speaker 2

这次对话真是太有趣了。

This is such a fun discussion.

Speaker 2

是的。

Yeah.

Speaker 2

真的很感谢你。

I really appreciate it.

Speaker 1

对。

Yeah.

Speaker 1

没错。

Yeah.

Speaker 1

谢谢你。

Thank you

Speaker 0

感谢你邀请我们。

for having us.

Speaker 3

感谢收听这期的a16z播客。

Thanks for listening to this episode of the a 16 z podcast.

Speaker 3

如果你喜欢这期节目,别忘了点赞、评论、订阅,给我们打分或写评价,也推荐给你的朋友和家人。

If you like this episode, be sure to like, comment, subscribe, leave us a rating or a review, and share it with your friends and family.

Speaker 3

想听更多节目,欢迎前往YouTube、Apple Podcast和Spotify。

For more episodes, go to YouTube, Apple Podcast, and Spotify.

Speaker 3

在X上关注我们@a16z,并在a16z.substack.com订阅我们的Substack频道。

Follow us on x at a sixteen z, and subscribe to our Substack at a16z.substack.com.

Speaker 3

再次感谢收听,我们下期节目再见。

Thanks again for listening, and I'll see you in the next episode.

Speaker 3

提醒一下,本节目内容仅供参考,不构成任何法律、商业、税务或投资建议,也不应用于评估任何投资或证券,且不针对任何a16z基金的投资者或潜在投资者。

As a reminder, the content here is for informational purposes only, should not be taken as legal business, tax, or investment advice, or be used to evaluate any investment or security and is not directed at any investors or potential investors in any a sixteen z fund.

Speaker 3

请注意,a16z及其关联方可能持有本节目讨论的公司的投资。

Please note that a sixteen z and its affiliates may also maintain investments in the companies discussed in this podcast.

Speaker 3

如需更多详情,包括我们的投资组合链接,请访问a16z.com/disclosures。

For more details, including a link to our investments, please see a 16z.com forward slash disclosures.

关于 Bayt 播客

Bayt 提供中文+原文双语音频和字幕,帮助你打破语言障碍,轻松听懂全球优质播客。

继续浏览更多播客