Chris Anderson Sam,欢迎你来TED。 太感谢你能来了。 Sam, welcome to TED. Thank you so much for coming. ¶
Sam Altman 谢谢,这是我的荣幸。 Thank you. It's an honor. ¶
CA 你们公司一直在发布 疯狂得离谱的新模型, 感觉几乎每隔一周 就来一次。 我试玩过其中几个。 我想给你看看 我都在玩些什么。 这是 Sora,就是那个图像 和视频生成器。 我问了 Sora 这么一句: 当你在TED上分享 一些惊人爆料的时候会是什么样? 你想看看 它是怎么想象的,对吧? (笑声) 我是说,还不错吧? 你会给它打几分? 两只手十根手指全给它——满分。 Your company has been releasing crazy insane new models pretty much every other week it feels like. I've been playing with a couple of them. I'd like to show you what I've been playing. So, Sora, this is the image and video generator. I asked Sora this: What will it look like when you share some shocking revelations here at TED? You want to see how it imagined it, you know? (Laughter) I mean, not bad, right? How would you grade that? Five fingers on all hands. ¶
SA 跟我身上穿的衣服很像, 你知道,挺好的。 Very close to what I'm wearing, you know, it's good. ¶
CA 我从没见过你 那么手舞足蹈的样子。 I've never seen you quite that animated. ¶
SA 不,我不是那么夸张的人。 No, I'm not that animated of a person. ¶
CA 那也许给个 B+ 吧。 但这一个真的让我惊呆了。 我让它构思一张图, 用来展示 智力与意识之间的区别。 你想,那该怎么画? 这是它画出来的。 我是说,这么简单, 但又难以置信。 这是什么样的过程 才能做到—— 这显然不只是 图像生成。 它接入了核心智能, 你们整体模型所具备的那些智能。 So maybe a B-plus. But this one genuinely astounded me. When I asked it to come up with a diagram that shows the difference between intelligence and consciousness. Like how would you do that? This is what it did. I mean, this is so simple, but it's incredible. What is the kind of process that would allow -- like this is clearly not just image generation. It's linking into the core intelligences that your overall model has. ¶
SA 是的,新的图像 生成模型是 GPT-4o 的一部分, 所以那里面装着它全部的 智能。 我觉得那也是原因之一, 它才能做出这些 人们真正喜爱的东西。 Yeah, the new image generation model is part of GPT-4o, so it's got all of the intelligence in there. And I think that's one of the reasons it's been able to do these things that people really love. ¶
CA 我是说,如果我是个管理咨询师, 在玩这些东西的时候, 我就会想,哎呀, 我的未来会怎么样? I mean, if I'm a management consultant and I'm playing with some of this stuff, I'm thinking, uh oh, what does my future look like? ¶
SA 我是说,我认为你大概可以 抱着两种态度来看。 你可以说,天哪, 它把我做的每件事都做了。 那我怎么办? 或者你也可以说, 就像以往所有 技术革命一样, 好,现在有了这个新工具。 我能做更多事了。 我将能够做到什么? 没错,期望确实在变: 我们对某个岗位上 从业者的要求会不断提高, 但能力 会提升得如此巨大, 我认为人们会很容易 跟上这个节奏。 I mean, I think there are sort of two views you can take. You can say, oh, man, it's doing everything I do. What's going to happen to me? Or you can say, like through every other technological revolution in history, OK, now there's this new tool. I can do a lot more. What am I going to be able to do? It is true that the expectation of what we’ll have for someone in a particular job increases, but the capabilities will increase so dramatically that I think it will be easy to rise to that occasion. ¶
CA 这个也让我印象深刻。 我让它想象查理·布朗 把自己当作一个AI时的所思所想。 它给出了这个。 我觉得这其实 相当有深意。 你怎么看? (笑) 我是说,一些新模型的 写作质量, 不只是这里,细节上也是, 真的到了全新的水准。 So this impressed me too. I asked it to imagine Charlie Brown as thinking of himself as an AI. It came up with this. I thought this was actually rather profound. What do you think? (Laughs) I mean, the writing quality of some of the new models, not just here, but in detail, is really going to a new level. ¶
SA 我是说,这是个 绝妙的"元回答", 但真的没办法知道 它是真的在这样想, 还是它只是在训练集里 见过太多次。 当然了,如果说 你分辨不出两者的区别, 那你又会在意多少呢? I mean, this is an incredible meta answer, but there's really no way to know if it is thinking that or it just saw that a lot of times in the training set. And of course like if you can’t tell the difference, how much do you care? ¶
CA 这真的很有意思。 我们不知道。 不过难道不存在…… 比如说乍一看 这像是侵犯知识产权。 比如你们跟《花生漫画》的遗产管理方 并没有协议,对吧? (掌声) 你们尽管为这个鼓掌, 尽情鼓掌吧。 (笑声和低语声) 我要说的是,我认为 人类的创造精神 是极其重要的东西, 我们想打造 能把这种精神托举起来的工具, 让新人也能创作出 更好的艺术、 更好的内容, 写出我们大家都爱读的更好的小说。 我深信,人类 会处于这一切的中心。 我也相信,我们大概 确实需要搞清楚 围绕创造性产出的经济学 的某种新模式。 我想,人们一直站在 他人的创造力之上 进行创作,已经很久了。 人们彼此获取灵感也已经很久了。 但当接触创造力的途径 变得极其大众化, 而且人们不断在彼此的想法上 构建新东西的时候, 我认为会有令人惊叹的 新商业模式, 我们和其他人都很期待去探索。 具体会长成什么样, 我并不确定。 显然,有些界线是清清楚楚的, 比如你不能抄袭别人的作品。 但你能借用多少灵感呢? 如果你说,我要生成 这七个人风格的艺术作品, 而他们全都同意这样做, 你怎么去分账, 每个人拿多少钱? 这些都是大问题。 但纵观历史,每一次 我们把更好、 更强大的技术 交到创作者手中, 我认为我们整体的 创造性产出 就会更好,人们就能做出更了不起的东西。 更大的一个问题是 他们并没有同意的时候。 在我们的开幕场次里, Carole Cadwalladr 展示了,你知道, "ChatGPT,用 Carole Cadwalladr 的风格做一场演讲" 果不其然,它做了一场演讲, 虽然没有她本人讲得 那么好, 但相当令人印象深刻。 而她说:"好吧,这很棒, 但我并没有同意这样做。" 我们打算怎么走这条路? 比如,难道没有办法吗—— 是不是只该用那些同意的人? 还是说不该有某种模型, 以某种方式规定:提示词里 点名的任何个人, 如果其作品被使用了, 他们就该从中得到一些回报? So that's really interesting. We don't know. Isn't there though ... like at first glance this looks like IP theft. Like you guys don’t have a deal with the “Peanuts” estate? (Applause) You can clap about that all you want, enjoy. (Laughter and murmuring) I will say that I think the creative spirit of humanity is an incredibly important thing, and we want to build tools that lift that up, that make it so that new people can create better art, better content, write better novels that we all enjoy. I believe very deeply that humans will be at the center of that. I also believe that we probably do need to figure out some sort of new model around the economics of creative output. I think people have been building on the creativity of others for a long time. People take inspiration for a long time. But as the access to creativity gets incredibly democratized and people are building off of each other's ideas all the time, I think there are incredible new business models that we and others are excited to explore. Exactly what that's going to look like, I'm not sure. Clearly, there’s some cut and dry stuff, like you can’t copy someone else’s work. But how much inspiration can you take? If you say, I want to generate art in the style of these seven people, all of whom have consented to that, how do you, like divvy up how much money goes to each one? These are like big questions. But every time throughout history we have put better and more powerful technology in the hands of creators. I think we collectively get better creative output and people do just more amazing stuff. An even bigger question is when they haven't consented to it. In our opening session, Carole Cadwalladr, showed, you know, "ChatGPT give a talk in the style of Carole Cadwalladr" and sure enough, it gave a talk that wasn't quite as good as the talk she gave, but it was pretty impressive. And she said, "OK, it's great, but I did not consent to this." How are we going to navigate this? Like isn’t there a way, should it just be people who’ve consented? Or shouldn’t there be a model that somehow says that any named individual in a prompt whose work is then used, they should get something for that? ¶
SA 所以现在,如果你用 我们的图像生成工具并说, 我想要一件在世的某位 艺术家风格的作品, 它是不会做的。 但如果你说,我想要某种 特定的、类似那种感觉的, 或者某个工作室、某个艺术流派 之类的,它会做。 显然,如果你说,你知道, 输出一首跟某首歌一模一样 的歌,它不会做。 问题在于,这条界线 应该画在哪里, 以及人们怎么说 "这太过分了", 我们以前靠版权法 解决过这个问题, 还有合理使用大概是什么样子。 同样,我认为在 AI 的世界里, 会有一个新的模式, 我们会把它弄明白。 So right now, if you use our image-gen thing and say, I want something in the style of a living artist, it won't do that. But if you say I want it in the style of this particular like kind of vibe, or this studio or this art movement or whatever, it will. And obviously if you’re like, you know, output a song that is like a copy of a song, it won't do that. The question of like where that line should be and how people say like, this is too much, we sorted that out before with copyright law and kind of what fair use looks like. Again, I think in the world of AI, there will be a new model that we figure out. ¶
CA 从……的角度来说,我是说, 创意人群现在是 最愤怒的一群人之一, 或者是对 AI 最恐惧的一群人。 觉得自己的作品 正在被人偷走、 自己的未来正在被偷走, 和觉得自己的作品正在被放大、 能够被放大, 这两种感受天差地别。 如果我们能扭转 到第二种感受上去, 我认为那真的会改变 整个人类社会拥抱这一切的程度。 From the point of view, I mean, creative people are some of the angriest people right now or the most scared people about AI. And the difference between feeling your work is being stolen from you and your future is being stolen from you, and feeling your work is being amplified and can be amplified, those are such different feelings. And if we could shift to the other one, to the second one, I think that really changes how much humanity as a whole embraces all this. ¶
SA 嗯,同样,我要说, 有些创意人非常恼火。 但有些创意人觉得, "这是有史以来最棒的工具, 我正在做出了不起的新作品。" 但你知道, 这确实是一场变化。 我对那些只是说 "我希望这场变化别发生, 我喜欢事情原来的样子"的人, 怀有深深的共情。 Well, again, I would say some creative people are very upset. Some creatives are like, "This is the most amazing tool ever, I'm doing incredible new work." But you know like it’s definitely a change. And I have a lot of like empathy to people who are just like, "I wish this change weren't happening. I liked the way things were before." ¶
CA 但原则上,你可以从任何一个提示词 计算出其中有多少…… 应该会有某种办法 能够计算出 一笔订阅费、营收 或者其他什么收入里, 有多大比例该归到每一个回答头上。 原则上,这应该是可行的, 只要其余的规则 也能被理清。 这显然很复杂。 你可以计算出某种 收入分成,不是吗? But in principle, you can calculate from any given prompt how much ... there should be some way of being able to calculate what percentage of a subscription, revenue or whatever goes towards each answer. In principle, it should be possible if one could get the rest of the rules figured out. It's obviously complicated. You could calculate some kind of revenue share, no? ¶
SA 如果你是个音乐人,你把整个人生、 整个童年都用来 听音乐, 然后你有了一个想法,去创作 一首歌, 它的灵感来自你以前 听过的东西, 但又是一个新的方向, 那你很难说清楚,比如说 这部分来自这首歌—— 是我11岁时听到的那首。 If you're a musician and you spend your whole life, your whole childhood, listening to music, and then you get an idea and you go compose a song that is inspired by what you've heard before, but a new direction, it'd be very hard for you to say like, this much was from this song I heard when I was 11. ¶
CA 没错。 但我们这里说的是这种情况: 有人在提示词里 专门点名了某个人。 That's right. But we're talking here about the situation where someone specifically in a prompt names someone. ¶
SA 嗯,同样, 现在如果你想要 用某种点名的风格生成图像, 我们只看那位艺术家 是否在世,在世就不做。 但我觉得,很酷的事会是 弄清楚一种新模式: 如果你说, 我想用某位艺术家的名字来做, 而本人选择了加入, 那里就存在一种营收模式。 我认为那是值得探索的好事。 Well, again, right now, if you try to like, go generate an image in a named style, we just say that artist is living, we don't do it. But I think it would be cool to figure out a new model where if you say, I want to do it in the name of this artist and they opt in, there's a revenue model there. I think that's a good thing to explore. ¶
CA 所以,我认为世界应该帮你 快速把那个模式想明白。 而我认为这实际会带来 巨大的不同。 我想赶紧换个话题。 (掌声) 你们的模型 与开源之间的较量。 DeepSeek 的出现, 有多让你们震动? So, I think the world should help you figure out that model quickly. And I think it will make a huge difference actually. I want to switch topics quickly. (Applause) The battle between your model and open source. How much were you shaken up by the arrival of DeepSeek? ¶
SA 我认为开源 有重要的位置。 实际上,就在昨晚, 我们主持了第一场社区会议, 来敲定我们开源模型的 各项参数, 以及我们想把它塑造成什么样。 我们会做一个非常 强大的开源模型。 我认为这很重要。 我想,我们会做出接近 前沿(frontier model)水平的东西, 比目前市面上任何 开源模型都强。 这不会是一切—— 会有人用这份模型 做出这间屋子里一些人, 也许包括你或我不喜欢的方式来。 但开源模型 会有一个重要的位置, 作为这片星群里的一员。 而且,你知道,我觉得 我们在这个行动上慢了, 但现在我们会把它做得非常好。 I think open source has an important place. We actually, just last night, hosted our first community session to kind of decide the parameters of our open-source model and how we want to shape it. We're going to do a very powerful open-source model. I think this is important. We're going to do something near the frontier, I think, better than any current open-source model out there. This will not be all -- there will be people who will use this in ways that some people in this room, maybe you or I, don’t like. But there is going to be an important place for open-source models as part of the constellation here. And, you know, I think we were late to act on that, but we're going to do it really well now. ¶
CA 我是说,你们花的钱,看起来 高出一个数量级、 甚至几个数量级于 DeepSeek 据称花的钱, 尽管我知道这个数字 有争议。 你们有信心真正更好的 模型会被认出来吗? 还是说你们其实也在想, 这在某种意义上难道不危及 这样一个论断的根基吗—— 靠超大体量、 数百亿美元级的投入, 我们能保持一个惊人的领先。 I mean, you're spending it seems, like an order, or even orders of magnitude more than DeepSeek allegedly spent, although I know there's controversy around that. Are you confident that the actual better model is going to be recognized? Or are you actually like, isn't this in some ways life-threatening to the notion that, yeah, by going to massive scale, tens of billions of dollars of investment, we can maintain an incredible lead. ¶
SA 我整天给别人打电话, 求他们把 GPU 交给我们用。 我们被卡得太厉害了。 我们的增长是这么走的。 DeepSeek 发布了, 看起来也没对它造成影响。 其他一些事情也在发生。 All day long, I call people and beg them to give us their GPUs. We are so incredibly constrained. Our growth is going like this. DeepSeek launched, and it didn’t seem to impact it. There's other stuff that's happening. ¶
CA 其实跟我们讲讲增长吧。 刚才在后台你给了我一个惊人的 数字。 Tell us about the growth, actually. You gave me a shocking number backstage there. ¶
SA 我从来没见过哪家公司 有这样的增长, 不管是我参与过的还是没参与过的公司, 像 ChatGPT 这样的增长。 真的很有意思。 我感觉很棒,深感荣幸。 但身处其中也挺疯狂的, 我们的团队筋疲力尽、压力巨大。 而我们努力维持住这一切。 I have never seen growth in any company, one that I've been involved with or not, like this, like the growth of ChatGPT. It's really fun. I feel like great, deeply honored. But it is crazy to live through, and our teams are exhausted and stressed. And we’re trying to keep things up. ¶
CA 你们现在有多少用户? How many users do you have now? ¶
SA 我记得上次我们公布的数字 是 5 亿周活跃用户, 而且增速非常快。 I think the last time we said was 500 million weekly actives, and it is growing very rapidly. ¶
CA 我是说,你跟我说那几乎 在短短几周内翻了一倍。 是指算力(compute)方面, 还是说……方面 I mean, you told me that like doubled in just a few weeks. Like in terms of compute or in terms of ... ¶
SA 那是私下跟你说的,不过我想…… I said that privately, but I guess ... ¶
CA 哦。 (笑声) 是我记错了,Sam,抱歉。 我们可以把那段从片子里剪掉, 如果你真想这样的话。 而且在场没人会把它发推。 Oh. (Laughter) I misremembered, Sam, I'm sorry. We can edit that out of the thing if you really want to. And no one here would tweet it. ¶
SA 增长非常快。 (笑声) It's growing very fast. (Laughter) ¶
CA 所以你们有信心, 你们看着它增长, 像火箭一样起飞, 你们一直在发布了不起的 新模型。 在你们最好的内部模型里,现在 都看到了些什么, 还没跟世界分享、 但很想在这个舞台上讲的? So you're confident, you're seeing it grow, take off like a rocket ship, you're releasing incredible new models all the time. What are you seeing in your best internal models right now that you haven't yet shared with the world but you would love to here on this stage? ¶
SA 首先,你问过我们 是否担心这个模型 或那个模型? 世界上会有非常多 智能的模型。 非常聪明的模型会 在一定程度上被商品化。 我想我们会拥有最好的, 某些用途你会想要最好的那个。 但说实话, 现在的模型已经聪明到, 对大多数人想做的 大部分事情来说, 它们已经够好了。 我希望随着时间推移这会改变, 因为人们的期望 会不断提高。 但如果你是 以普通用户的身份使用 ChatGPT, 模型能力已经非常聪明了。 但我们必须做出伟大的产品, 而不只是伟大的模型。 所以会有很多人 拿着很棒的模型, 而我们会努力做出最好的产品。 人们想要他们的图像生成, 你知道,刚才你也看了 一些 Sora 的视频示例。 他们想把它跟自己 所有的东西整合起来。 我们刚上线一个新功能, 它仍然叫 Memory(记忆功能), 但比之前的 Memory 好太多了, 这个模型会在你的一生中 逐渐了解你。 我们还有更多东西 即将到来,去构建 这样一个伟大的一体化产品。 而且,我觉得 人们会认准它的。 所以会有很多模型, 但我认为我们会——我希望—— 继续专注于打造这个领域里最好的、 定义性的产品。 So first of all, you asked about, are we worried about this model or that model? There will be a lot of intelligent models in the world. Very smart models will be commoditized to some degree. I think we’ll have the best, and for some use you'll want that. But like, honestly, the models are now so smart that for most of the things most people want to do, they're good enough. I hope that'll change over time because people will raise their expectations. But like, if you're kind of using ChatGPT as a standard user, the model capability is very smart. But we have to build a great product, not just a great model. And so there will be a lot of people with great models, and we will try to build the best product. And people want their image-gen, you know, you saw some Sora examples for video earlier. They want to integrate it with all their stuff. We just launched a new feature, it's still called Memory, but it's way better than the Memory before, where this model will get to know you over the course of your lifetime. And we have a lot more stuff to come to build like this great integrated product. And, you know, I think people will stick with that. So there will be many models, but I think we will, I hope, continue to focus on building the best defining product in this space. ¶
CA 我是说,昨天我看了 你们的公告之后—— ChatGPT 会知道你所有的 查询历史—— 我输入了:"跟我说说我自己吧, ChatGPT,就凭你所知道的一切。" 我惊得下巴都掉了,Sam,太震撼了。 它知道我是谁, 还有形形色色的兴趣, 但愿其中绝大多数 还算得体、可以分享。 但那真的令人震惊。 我感觉到一种真正的兴奋, 有点发怵, 但主要还是兴奋,真的, 兴奋于这能让它 变得对我有用得多。 I mean after I saw your announcement yesterday that ChatGPT will know all of your query history, I entered, "Tell me about me, ChatGPT, from all you know." And my jaw dropped, Sam, it was shocking. It knew who I was and all these sort of interests that hopefully mostly were pretty much appropriate and shareable. But it was astonishing. And I felt the sense of real excitement, a little bit queasy, but mainly excitement, actually, at how much more that would allow it to be useful to me. ¶
SA 我们的一位研究员 发推说,你知道, 大概是昨天或今天早晨, 上传是一点一点发生的。 不是你知道的那样,某天 把你的大脑插上去。 而是你会与 ChatGPT 交谈, 在你的一生之中, 有朝一日,也许如果你愿意, 它会全天候听着你, 一整天都在听, 看着你在做什么, 它会了解你, 它会成为你自身的 一种延伸、一个伙伴, 一个只是一心想要 帮你做到最好的东西, 让你竭尽所能。 One of our researchers tweeted, you know, kind of like yesterday or this morning, that the upload happens bit by bit. It’s not you know, that you plug your brain in one day. But you will talk to ChatGPT over the course of your life and some day, maybe if you want, it'll be listening to you throughout the day and sort of observing what you're doing, and it'll get to know you and it'll become this extension of yourself, this companion, this thing that just tries to, like, help you be the best, do the best you can. ¶
CA 在电影《她》里, AI 基本上宣布 她读完了他所有的邮件, 断定他是个了不起的作家, 然后你知道,她说服 一家出版商出版他的书。 那一天可能来得 比我们想象的更早。 In the movie "Her," the AI basically announces that she's read all of his emails and decided he's a great writer and you know, persuades a publisher to publish him. That might be coming sooner than we think. ¶
SA 我觉得不会完全那样发生, 但没错,是的, 我认为会有某种 朝着 AI 那个方向的东西—— 你不必只是 去 ChatGPT 什么的, 说"我有个问题, 给我个答案"。 而是会有东西主动推给你, 帮助你的东西, 让你变得更好的东西,诸如此类。 这看来确实不远了。 I don't think it will happen exactly like that, but yeah, I think something in the direction where AI -- you don’t have to just, like, go to ChatGPT or whatever and say, I have a question, give me an answer. But you're getting like, proactively pushed things that help you, that make you better or whatever. That does seem like it's soon. ¶
CA 那么你们都看到了什么—— 内部即将出现的, 你们认为什么 会颠覆人们的想象? 至少给我们一点提示, 下一个令人瞠目的大事件是什么。 So what have you seen that's coming up, internally, that you think is going to blow people's minds? Give us at least a hint of what the next big jaw dropper is. ¶
SA 就我个人而言,最让我兴奋的 是当下的 AI for science(人工智能驱动的科学研究)。 我坚信 世界上最重要的 驱动力—— 让人们的生活 越来越好——是新的科学发现。 我们能以更少的投入做更多的事, 把可能性的 边界向外推。 我们开始 频繁听到科学家说, 用我们最新的模型, 他们确实变得比以前更高效了, ——比以前更高。 这已经切实开始影响 他们所能发现的成果。 The thing that I'm personally most excited about is AI for science at this point. I am a big believer that the most important driver of the world and people's lives getting better and better is new scientific discovery. We can do more things with less, we sort of push back the frontier of what's possible. We're starting to hear a lot from scientists with our latest models that they're actually just more productive than they were before. That's actually mattering to what they can discover. ¶
CA 近期可信的发现会是什么? 比如室温—— What’s the plausible near-term discovery, like, room temperature -- ¶
SA 超导体? Superconductors? ¶
CA 超导,对。 这可能吗? Superconducting, yeah. Is that possible? ¶
SA 我不认为物理学 定律禁止它。 所以它应该是可能的。 但我们不能确定。 我认为你们会开始看到一些…… 在对抗疾病方面, 借助 AI 辅助工具取得的有意义进展。 物理学也许 会慢一些, 但我对此抱有希望。 这是其中一个方向。 另一个我认为很大的方向, 很快就会开始, 就在未来几个月。 软件开发 已经经历了相当大的变革。 如今创造软件的过程 与两年前相比判若两样, 这相当惊人。 但我预计还会有一次 同样量级的跃迁,就在未来几个月, 因为 agentic(自主智能体式)软件工程 真正开始发生。 I don't think that's prevented by the laws of physics. So it should be possible. But we don't know for sure. I think you'll start to see some ... meaningful progress against disease with AI-assisted tools. You know, physics maybe takes a little bit longer, but I hope for it. So that's like, one direction. Another that I think is big is starting pretty soon, like in the coming months. Software development has already been pretty transformed. Like it’s quite amazing how different the process of creating software is now than it was two years ago. But I expect like another move that big in the coming months as agentic software engineering really starts to happen. ¶
CA 我听过工程师说, 他们有过 近乎宗教体验般的时刻—— 面对一些新模型, 突然间,他们一个下午 就能完成 过去要两年的工作。 I've heard engineers say that they've had almost like religious-like moments with some of the new models where suddenly, they can do in an afternoon what would have taken them two years. ¶
SA 是啊,那真是令人脑洞大开—— 那真的可以说是 我最强烈的「感受 AGI(通用人工智能)」时刻之一。 Yeah, it's like mind -- it really like, that’s been one of my big “feel the AGI” moments. ¶
CA 但说说你见过的 最可怕的事情是什么。 因为在外界, 很多人会想象你们: 你们能接触到这些东西。 我们不断听到从 AI 圈 传出的各种传闻, 什么「天哪, 他们看见了意识」, 或者「他们看见了 AGI」, 或者「他们预见了 某种末日将至」。 你们见到过吗? 有没有过某个可怕的瞬间—— 你在内部看到 某样东西,心想 「糟糕,我们得认真对待这个」? But talk about what is the scariest thing that you've seen. Because like, outside, a lot of people picture you as, you know, you have access to this stuff. And we hear all these rumors coming out of AI, and it's like, "Oh my God, they've seen consciousness," or "They've seen AGI," or "They've seen some kind of apocalypse coming." Have you seen, has there been a scary moment when you've seen something internally and thought, "Uh oh, we need to pay attention to this?" ¶
SA 敬畏的时刻是有的。 而伴随敬畏的永远是: 这东西会走多远? 它会变成什么? 但没有什么—— 我们并没有偷偷 藏着一个 有意识的模型, 或者一个能自我改进 或诸如此类的东西。 你知道,我…… 人们对 AI 大风险 究竟是什么,看法很不一致。 我自己对这些风险 会出现在哪里的看法 也在不断演化。 我继续相信,会出现 非常强大的模型, 被人以重大方式滥用。 人们谈论很多 新型生物恐怖的可能, 谈论能构成 真正网络安全挑战的模型, 谈论能够 自我改进、 并以某种方式 导致失控的模型。 所以我认为那里存在大风险。 然后还有很多其他事情—— 坦白说,那才是我理解的 很多人真正所指的东西: 人们谈论虚假信息, 或者模型说了 他们不爱听的话之类。 There have been like moments of awe. And I think with that is always like, how far is this going to go? What is this going to be? But there's no like, we don't secretly have, we're not secretly sitting on a conscious model or something that's capable of self-improvement or anything like that. You know, I ... people have very different views of what the big AI risks are going to be. And I myself have like evolved on thinking about where we're going to see those. I continue to believe there will come very powerful models that people can misuse in big ways. People talk a lot about the potential for new kinds of bioterror, models that can present like a real cybersecurity challenge, models that are capable of self-improvement in a way that leads to some sort of loss of control. So I think there are big risks there. And then there's a lot of other stuff, which honestly is kind of what I think, many people mean, where people talk about disinformation or models saying things that they don't like or things like that. ¶
CA 还拿第一类来说, 你们在发布前 内部会检查那些吗? Sticking with the first of those, do you check for that internally before release? ¶
SA 当然会。 我们有这套 preparedness framework(防备框架), 写明了我们怎么做。 Of course, yeah. So we have this preparedness framework that outlines how we do that. ¶
CA 我是说,你们的安全团队 出走了一些人。 走了多少人? 他们为什么离开? I mean, you've had some departures from your safety team. How many people have departed, why have they left? ¶
SA 我说不准 具体数字, 但在 AI 安全体系上 显然存在不同观点。 我更愿意让大家看我们的实际记录。 总会有人 说各种各样的话。 大概百分之十的世界人口 现在在大量使用我们的系统。 我们对 安全记录非常自豪。 We have, I don't know the exact number, but there are clearly different views about AI safety systems. I would really point to our track record. There are people who will say all sorts of things. You know, something like 10 percent of the world uses our systems now a lot. And we are very proud of the safety track record. ¶
CA 但在某种意义上, 记录并不是问题的关键—— But track record isn't the issue in a way -- ¶
SA 不,它恰恰是关键。 No, it kind of is. ¶
CA 因为我们谈论的 是指数增长的力量, 我们害怕某天醒来, 世界就终结了。 所以关键真的不是记录, 而是能否有说服力地说: 一旦我们看见危险, 迅速关停的机制 已经到位。 Because we're talking about an exponentially growing power where we fear that we may wake up one day and the world is ending. So it's really not about track record, it's about plausibly saying that the pieces are in place to shut things down quickly if we see a danger. ¶
SA 是,当然, 那当然重要。 你不会某天醒来才说: 「嘿,我们此前 根本没有什么安全流程。 现在我们觉得模型真聪明, 所以现在才开始在乎安全。」 你必须在这条指数曲线的 每一段都在乎它。 赌注当然会越来越高, 挑战也很大。 但我们学会 构建安全系统的方式, 就是这个 迭代过程:把它们部署到世界中, 获得反馈—— 趁赌注还相对低的时候, 了解到 「这是我们必须要解决的问题」。 我认为随着我们进入 这些智能体系统, 会出现一整大类 我们尚未学会应对的新问题。 Yeah, no, of course, of course that's important. You don't, like, wake up one day and say, "Hey, we didn't have any safety process in place. Now we think the model is really smart. So now we have to care about safety." You have to care about it all along this exponential curve. Of course the stakes increase, and there are big challenges. But the way we learn how to build safe systems is this iterative process of deploying them to the world, getting feedback, while the stakes are relatively low, learning about like, this is something we have to address. And I think as we move into these agentic systems, there's a whole big category of new things we have to learn to address. ¶
CA 那么来聊聊 agentic systems(智能体系统), 以及它和 AGI(通用人工智能)之间的关系。 我觉得外界有很多困惑, 我自己也很困惑。 那么说到通用人工智能, 感觉 ChatGPT 已经 是一种通用智能了。 我可以问它任何问题, 它总能给出 一个聪明的回答。 为什么这还不算 AGI? So let's talk about agentic systems and the relationship between that and AGI. I think there's confusion out there, I'm confused. So artificial general intelligence, it feels like ChatGPT is already a general intelligence. I can ask it about anything, and it comes back with an intelligent answer. Why isn't that AGI? ¶
SA 它并没有…… 首先,你并不能真的问它任何问题。 你这么说我很高兴, 但有很多事情 它依然做得差得令人尴尬。 但就算我们把这些都解决了, 希望我们真能做到, 它也不会持续地学习和进步。 它没法主动去提升某件事, 哪怕那是它当前的弱项。 它没法去发现新的科学、 更新自己的认知并做到这些。 而且它某种程度上也没法, 哪怕我们把标准放低, 它也没法随手完成 任何知识型工作、 只要是你在电脑前能做的那种。 说实话,即便没有 那种 在尚未掌握的事情上 变得更好的能力, 我也许都会把它 当作 AGI 的一个定义。 但现在的系统, 你不能说,嘿, 去帮我的工作做这个任务, 然后它就自己出发、在互联网上 四处点击, 给某人打电话、翻看 你的文件,把事办成。 而做不到这些, 我感觉它显然还够不上那个标准。 It doesn't ... First of all, you can't ask it anything. That's very nice of you to say, but there's a lot of things that it's still embarrassingly bad at. But even if we fixed those, which hopefully we will, it doesn't continuously learn and improve. It can't go get better at something that it's currently weak at. It can't go discover new science and update its understanding and do that. And it also kind of can't, even if we lower the bar, it can't just sort of do any knowledge work you could do in front of a computer. I actually, even without the sort of ability to get better at something it doesn't know yet, I might accept that as a definition of AGI. But the current systems, you can't say like, hey, go do this task for my job, and it goes off and clicks around the internet and calls someone and looks at your files and does it. And without that, it feels definitely short of it. ¶
CA 我的意思是,你们内部 对 AGI 到底是什么有清晰的定义吗? 你们觉得我们什么时候 可能到达那里? I mean, do you guys have internally a clear definition of what AGI is, and when do you think that we may be there? ¶
SA 就像那个笑话说的, 如果把 10 个 OpenAI 研究员放在一个房间里 让他们定义 AGI, 你会得到 14 个定义。 It's like the joke, if you’ve got 10 OpenAI researchers in a room and ask to define AGI, you’d get 14 definitions. ¶
CA 可这挺令人担忧的,不是吗? 因为这一直是 最初的使命—— "我们要成为 第一个抵达 AGI 的公司。 我们要安全地做到。 但我们并没有一个清晰的 定义,说得清它到底是什么。" That's worrying, though, isn't it? Because that has been the mission initially, “We’re going to be the first to get to AGI. We'll do so safely. But we don't have a clear definition of what it is." ¶
SA 我正要回答完那一个问题。 I was going to finish the answer. ¶
CA 抱歉。 Sorry. ¶
SA 但我认为真正重要的、 也是人们想知道的, 并不是那个 所谓的魔法时刻在哪里——"我们完成了"。 而是鉴于看上去 将会发生的事情: 模型只会变得越来越 聪明、越来越能干, 再聪明、再能干, 沿着这条漫长的指数曲线, 不同的人会在不同的节点 把它称作 AGI。 但我们都同意,它会远远 越过那个界限。 直到抵达那些随你们 想怎么称呼的系统—— 那些比我们强得多的系统。 真正重要的是,我们如何谈论这样一个系统: 它在所有 这些阶段乃至更远的未来 都保持安全, 随着系统变得 比我们更能干, 随着系统能做到 一些我们并不完全理解的事情。 我认为比"AGI 何时到来" 以及"它的定义是什么" 更重要的, 是认识到我们正身处 这条不可思议的指数曲线上。 你可以,你知道, 说我觉得 AGI 是这个位置。 你也可以说你觉得 AGI 是那个位置。 还有人可以说 超级智能在更远的地方, 但我们都将不得不与之共处, 并从这些 不可思议的系统中收获美妙的益处。 所以我认为,我们应当 转移讨论的焦点, 从"AGI 是哪个时刻" 转向一种认识: 这东西不会停下来, 它会远远超出 我们任何人愿意称作 AGI 的范畴。 我们必须构建一个社会, 去收获它带来的巨大红利, 并弄清楚如何让它保持安全。 What I think matters though, and what people want to know is not where is this one, you know, magic moment of, “We finished.” But given that what looks like is going to happen is that the models are just going to get smarter and more capable and smarter and more capable, on this long exponential, different people will call it AGI at different points. But we all agree it’s going to go way, way past that. You know, to whatever you want to call these systems that get much more capable than we are. The thing that matters is how do we talk about a system that is safe through all of these steps and beyond, as the system gets more capable than we are, as the system can do things that we don't totally understand. And I think more important than when is AGI coming and what's the definition of it, it's recognizing that we are in this unbelievable exponential curve. And you can, you know, say this is what I think AGI is. You can say you think this is what you think AGI is. Someone else can say superintelligence is out here, but we're going to have to contend and get wonderful benefits from this incredible system. And so I think we should shift the conversation away from what's the AGI moment to a recognition that, like, this thing is not going to stop, it's going to go way beyond what any of us would call AGI. And we have to build a society to get the tremendous benefits of this and figure out how to make it safe. ¶
CA 嗯,本周有一场讨论谈到, 真正的变革时刻 在于—— 我是说,AGI 是个模糊的概念, 但清晰的是 agentic AI—— 当 AI 被放开手脚, 独自去推进项目、 把各个部分拼合起来—— 你们其实已经, 有了叫作 Operator 的产品, 它已经开始这么做了。 我试用过它。 我想订一家餐厅, 那感觉有点不可思议。 它基本上能直接把事情办成, 但它当时是这么说的。 那过程很耐人寻味。 它说"把你的信用卡 给我"之类的, 而这一次我拒绝了继续下去。 但我想,这正是人们 将要面对的挑战。 这有点像, 一种不可思议的超能力。 也有点吓人。 Yoshua Bengio 之前在这里演讲时 说过,agentic AI 才是那个 值得关注的东西。 一切可能出问题,恰恰是在我们 把权力交给 AI、 让它上网去自行做事的时候。 我是说,连入互联网, 在科幻故事里一直是那个 时刻,你知道的, 逃脱发生了,而潜在的—— 事情可能变得极其糟糕。 你们如何既释放 agentic AI, 又设好护栏, 让它不至于走得太远? Well, one of the conversations this week has been that the real change moment is -- I mean, AGI is a fuzzy thing, but what is clear is agentic AI -- when AI is set free to pursue projects on its own and to put the pieces together -- you’ve actually, you've got a thing called Operator which starts to do this. And I tried it out. You know, I wanted to book a restaurant, and it's kind of incredible. It kind of can go ahead and do it, but this is what it said. You know, it was an intriguing process. And, you know, “Give me your credit card” and everything else, and I declined on this case to go forward. But I think this is the challenge that people are going to have. It's kind of like, it's an incredible superpower. It's a little bit scary. And Yoshua Bengio, when he spoke here, said that agentic AI is the thing to pay attention to. This is when everything could go wrong as we give power to AI to go out onto the internet to do stuff. I mean, going out onto the internet was always, in the sci-fi stories, the moment where, you know, escape happened and potential -- things could go horribly wrong. How do you both release agentic AI and have guardrails in place that it doesn't go too far? ¶
SA 首先,显然你 可以选择不这么做,然后说, 我不想用这个。我要 给那家餐厅打电话, 在电话里把我的信用卡号 念给他们听。 First of all, obviously you can choose not to do this and say, I don't want this. I'm going to call the restaurant and read them my credit card over the phone. ¶
CA 我可以这么选, 但别人可能会说, “哦,去吧,ChatGPT, 到广阔的互联网上去, 把互联网重写一遍,让它 对人类更美好,”之类的。 I could choose, but someone else might say, “Oh, go out, ChatGPT onto the internet at large and rewrite the internet to make it better for humans,” or whatever. ¶
SA 我本来想说的重点 只是,任何新技术, 人们都需要一段时间 才能用得安心。 我记得以前我绝不肯 在网上使用我的信用卡, 因为我父母让我相信 会有人偷读你的卡号, 你得填好表格 然后再打电话给他们。 后来我们大家基本上都同意, 好吧,我们来建反欺诈系统, 这样我们就能放心使用了。 我觉得人们接受起来会很慢, 对 agentic AI 放心起来 在很多方面都是这样。 但我也真的同意 你刚才说的, 即便有些人 已经适应而有些人还没有, 我们都将会有 AI 系统 在互联网上到处点击操作。 而这,我认为, 是我们迄今面临的最有趣、影响最深远的 安全挑战。 因为你把访问权限交给你的系统、 你的信息、 你在电脑上 点击操作的能力的 AI, 现在,这些,你知道, 当 AI 犯错时, 代价要大得多。 它是——的门槛。 我们之前谈过 安全与能力。 我有点觉得它们越来越 变成同一个维度了。 好产品就是安全的产品。 你不会使用我们的 agent, 如果你不信任 它们不会想要 清空你的银行账户, 或删除你的数据, 或天知道还会干什么。 所以人们想用的 agent 是自己真正能信任的、 真正安全的。 我认为我们的上限取决于 我们推进的能力,取决于 我们做到这一点的能力。 但它是产品 的根本组成部分。 The point I was going to make is just with any new technology, it takes a while for people to get comfortable. I remember when I wouldn't put my credit card on the internet because my parents had convinced me someone was going to read the number, and you had to fill out the form and then call them. And then we kind of all said, OK, we’ll build anti-fraud systems, and we can get comfortable with this. I think people are going to be slow to get comfortable with agentic AI in many ways. But I also really agree with what you said, which is that even if some people are comfortable with it and some aren't, we are going to have AI systems clicking around the internet. And this is, I think, the most interesting and consequential safety challenge we have yet faced. Because AI that you give access to your systems, your information, your ability to click around on your computer, now, those, you know, when AI makes a mistake, it's much higher stakes. It is the gate on -- so we talked earlier about safety and capability. I kind of think they're increasingly becoming one-dimensional. Like a good product is a safe product. You will not use our agents if you do not trust that they’re not going to like empty your bank account or delete your data or who knows what else. And so people want to use agents that they can really trust, that are really safe. And I think we are gated on our ability to make progress on our ability to do that. But it's a fundamental part of the product. ¶
CA 在一个 agent 能动性已经存在于外界的世界里, 就是说,你知道, 也许开放模型 被广泛分发, 然后有人说, “好,AGI, 我要你到互联网上去, 你知道, 想尽一切办法传播一个梗,说 X 那群人是邪恶的,” 或者诸如此类的东西。 这不一定非得是 个人的选择。 一个人就可能放那个 agent 到外面去,而那个 agent 可能决定, “好吧,为了执行 那个指令, 我得把自己复制到每一个角落,” 还有,你知道的, 你们内部有没有划出过 清清楚楚的红线, 让你们清楚哪些是 危险时刻, 知道我们不能发布 可能越过这条线的东西? In a world where agency is out there and say that, you know, maybe it’s open models are widely distributed and someone says, "OK, AGI, I want you to go out onto the internet and, you know, spread a meme however you can that X people are evil,” or whatever it is. It doesn't have to be an individual choice. A single person could let that agent out there, and the agent could decide, "Well, in order to execute on that function, I've got to copy myself everywhere," and, you know. Are there red lines that you have clearly drawn internally, where you know what the danger moments are, and that we cannot put out something that could go beyond this? ¶
SA 是的,这正是我们的 preparedness framework 的目的所在。 我们会随着时间不断更新它。 但我们试着勾勒出自己认为 最重要的危险时刻是什么、 或者风险类别有哪些、 我们怎么衡量它们、 以及在发布之前我们会用什么方式 去缓解某个东西的风险。 从刚才的对话里我听出来, 你并不是很喜欢 AI。 Yeah, so this is the purpose of our preparedness framework. And we'll update that over time. But we’ve tried to outline where we think the most important danger moments are, or what the categories are, how we measure that, and how we would mitigate something before releasing it. I can tell from the conversation you're not a big AI fan. ¶
CA 恰恰相反, 我每天都在用它。 我对它心存敬畏。 我觉得这是活着 最不可思议的时代。 换任何其他时代我都不想活, 我迫不及待想看看它会走向哪里。 我们一直同时持有…… 我觉得关键是同时持有…… 就像我们不能把人分成 那两个阵营一样。 你必须怀抱一种炽热的 对可能性的信念, 但又不能被它过度蛊惑, 因为事情可能糟糕透顶。 (掌声) Actually, on the contrary, I use it every day. I'm awed by it. I think this is an incredible time to be alive. I wouldn't be alive any other time, and I cannot wait to see where it goes. We've been holding ... I think it's essential to hold ... like we can’t divide people into those camps. You have to hold a passionate belief in the possibility, but not be overseduced by it because things could go horribly wrong. (Applause) ¶
SA 我刚才想说的是, 我完全理解这种感受。 我完全理解,看着这一切 然后说这是一场难以置信的 即将席卷世界的变革。 而且,你知道,也许我并不想要它, 又或者我只爱它的某几部分。 也许我爱和 ChatGPT 聊天, 但我担心艺术接下来 会发生什么, 我担心变化的速度, 我也担心这些 agent 在互联网上到处点击。 也许,综合权衡下来, 我真希望这些没有发生。 又也许我希望它 发生得再慢一点。 又或者我希望它发生的方式是 让我能挑挑拣拣,决定进步的 哪些部分会发生。 而我认为,这种恐惧是完全理性的。 某种程度上,这种焦虑也是完全理性的。 我们自己其实也一样充满焦虑。 但是…… A,会有巨大的收益。 显然,你知道, 你每天都在用它,你喜欢它。 B …… 我真的相信社会终会 随着时间摸索出来, 尽管路上会犯一些大错, 怎样把技术搞对。 还有 C,这是必然要发生的。 这就像一项 基础物理学的发现, 而全世界现在已经知道了。 它将成为我们世界的一部分。 而且我觉得这场对话 真的非常重要。 我觉得谈论这些 危险领域 【确实】非常值得谈。 新的经济模式也至关重要。 但我们必须去拥抱这一切, 带着审慎、而不是恐惧, 否则我们就会被其他 用 AI 把事做得更好的人碾过去【译注:原文 "get run by with" 疑为 "run over by"(被碾过)之转写笔误】。 What I was going to say is I totally understand that. I totally understand looking at this and saying this is an unbelievable change coming to the world. And, you know, maybe I don't want this, or maybe I love parts of it. Maybe I love talking to ChatGPT, but I worry about what's going to happen to art, and I worry about the pace of change, and I worry about these agents clicking around the internet. And maybe, on balance, I wish this weren't happening. Or maybe I wish it were happening a little slower. Or maybe I wish it were happening in a way where I could pick and choose what parts of progress were going to happen. And I think, the fear is totally rational. Sort of, the anxiety is totally rational. We all have a lot of it, too. But ... A, there will be tremendous upside. Obviously, you know, you use it every day, you like it. B ... I really believe that society figures out, over time, with some big mistakes along the way, how to get technology right. And C, this is going to happen. This is like a discovery of fundamental physics that the world now knows about. And it's going to be part of our world. And I think this conversation is really important. I think talking about these areas of danger [is] really important to talk about. New economic models are really important. But we have to embrace this with like, caution but not fear, or we will get run by with other people that use AI to do better. ¶
CA 你其实一直是最 有口才的安全倡导者之一。 你还曾在参议院作证。 我记得你基本上是说 我们应该成立一个新的安全机构 对任何努力实施许可管理, 也就是说,它会拒绝 给某些努力发放许可。 你现在还相信 这个政策主张吗? You've actually been one of the most eloquent proponents of safety. You testified in the Senate. I think you said basically that we should form a new safety agency that licenses any effort, ie. it will refuse to license certain efforts. Do you still believe in that policy proposal? ¶
SA 我学到了更多 关于政府如何运作的知识。 我觉得这并不完全 是恰当的政策主张。 I have learned more about how the government works. I don't think this is quite the right policy proposal. ¶
CA 那恰当的政策主张是什么? What is the right policy proposal? ¶
SA 不过,我确实认同这样一个想法: 随着这些系统变得越来越先进, 并且产生实实在在的全球影响时, 我们需要某种方式,你知道, 也许由这些公司自己 搭建出合适的框架 或者合适的模式来做这件事, 但我们需要某种机制, 让非常先进的模型 接受外部安全测试。 并且当我们接近 某些危险区域时能够有所认知。 这一点我依然非常坚信。 But, I do think the idea that as these systems get more advanced and have legitimate global impact, we need some way, you know, maybe the companies themselves put together the right framework or the right sort of model for this, but we need some way that very advanced models have external safety testing. And we understand when we get close to some of these danger zones. I very much still believe in that. ¶
CA 这让我觉得挺讽刺: 一个安全机构 也许恰恰是我们想要的, 而 agency 本身【译注:agency 一词双关,既指"(安全)机构",也指 AI 的"自主能动性"】 恰恰才是不安全的那个东西。 这种措辞总有点奇怪 的意味,不过算了。 Struck me as ironic that a safety agency might be what we want, and yet agency is the very thing that is unsafe. There's something odd about the language there, but anyway. ¶
SA 关于这点我能再说一句吗? 我确实认同这个理念: 我们需要为模型定义 一套严格的测试, 搞清楚哪些威胁 是我们——作为一个社会整体—— 最想要着力应对的, 并确保随着模型 能力变得越来越强, 我们有一套让所有人都能 了解和看懂的体系: 世界上正在发布些什么。 我认为这非常重要。 而且我认为,要不了多久 我们就会迎来那样的模型,它们将 在这个意义上受到公众的高度关注。 Can I say one more thing on that? I do think this concept of we need to define rigorous testing for models, understand what the threats that we, collectively, society, most want to focus on, and make sure that as models are getting more capable, we have a system where we all get to understand what's being released in the world. I think this is really important. And I think we’re not far away from models that are going to be of great public interest in that sense. ¶
CA 那么 Sam,我问了 你的 o1-pro 推理模型, 它非常—— So Sam, I asked your o1-pro reasoning model, which is incredibly -- ¶
SA 多谢你出的那 200 美元。 Thank you for the 200 dollars. ¶
CA (笑)是每月 200 美元。 按这个价格算真是超值了。 我说,我要问你的最 一针见血的问题是什么? 它想了两分钟。 两分钟。 你想看看这个问题吗? (Laughs) 200 dollars a month. It's a bargain at the price. I said, what is the single most penetrating question I could ask you? It thought about it for two minutes. Two minutes. You want to see the question? ¶
SA 想。 I do. ¶
CA "Sam,鉴于你正在 参与创造一种技术, 它可能重塑我们 整个物种的命运, 是谁授予了你(或任何人) 这样做的道德权威?" (笑声) "而如果你错了,你个人 又该如何承担责任?" "Sam, given that you're helping create technology that could reshape the destiny of our entire species, who granted you (or anyone) the moral authority to do that?” (Laughter) "And how are you personally accountable if you're wrong?" ¶
SA 不,这个问题问得好。 No, it was good. ¶
CA 那挺让人印象深刻的。 That was impressive. ¶
SA 过去半小时里,你一直在 用这个问题的各种版本问我。 你说呢? (笑声与掌声) You've been asking me versions of this for the last half hour. What do you think? (Laughter and applause) ¶
CA 我想说的是这一点。 这就是我对那个问题的改写。 What I would say is this. Here's my version of that question. ¶
SA 但没有答案? But no answer? ¶
CA 你问我的那个问题是什么来着? What was your question to me? ¶
SA 你会怎么回答那一个? How would you answer that one? ¶
CA 站在你的立场? In your shoes? ¶
SA 或者以局外人的身份。 Or as an outsider. ¶
CA 我不知道。 我对你感到困惑。 也有点对你心生敬畏。 因为你打造了世上最 不可思议的事物之一。 外界流传着两种 关于你的叙事。 一种是,你知道,你是一个非凡的 远见者,做到了不可能之事, 你震惊了世界。 凭借远比 Google 少得多的人力, 你们就做出了某种 那要强大得多, 超过当时任何在做的东西。 我是说,你们打造的东西令人惊叹。 但另一种叙事是, 你们改变了立场, 你们从那个OpenAI, 那个开放的组织, 转向了打造 某种超强事物的诱惑。 而且你知道,你们失去了 一些关键人才。 外界确实有这种说法。 有些人认为,在这个领域 你们并不值得信任。 我很想知道你是谁。 你对自己的叙事是什么? Sam,你的核心价值观是什么, 能让我们、让世界有信心, 相信一个手握如此多 权力的人配得上它? I don't know. I am puzzled by you. I’m kind of awed by you. Because you’ve built one of the most astonishing things out there. There are two narratives about you out there. One is, you know, you are this incredible visionary who's done the impossible, and you shocked the world. With far fewer people than Google, you came out with something that was much more powerful than anything being done. I mean, it is amazing what you've built. But the other narrative is that you have shifted ground, that you've shifted from being OpenAI, this open thing, to the allure of building something super powerful. And you know, you’ve lost some of your key people. There's a narrative out there. Some people believe that you're not to be trusted in this space. I would love to know who you are. What is your narrative about yourself? What are your core values, Sam, that can give us, the world, confidence that someone with so much power here is entitled to it? ¶
SA 你看,我想我和任何人一样, 都是一个多面的个体, 很难被简单地 归结为一个维度。 你知道,也许一些 好评是真的, 也许一些 批评也是真的。 就OpenAI而言, 我们的目标是做出AGI并把它分发出去, 确保它安全,为了全人类的 广泛福祉。 我认为从各方面看, 我们在这方面已经做了很多。 显然,我们的策略 随时间有所调整。 我想我们当初并不真正清楚 我们"长大"后会成为 什么样子。 我们没想过要围绕这件事 建一家公司。 我们学到了很多,关于事情如何推进, 以及这些系统现实上 需要投入多少资本。 但我认为,说到把 能力极强的AI 以高度的安全 交到很多人手中, 并给他们工具,让他们能 去做他们要做的各种 了不起的事情, 我想很难在这一点上 给我们打差评。 我确实认为,说我们应该 更多地开源,这话公允。 我认为那是合理的, 基于你前面问到的 所有那些原因, 当时我们还不确定这些系统 会带来什么影响, 以及如何确保它们安全, 所以我们谨慎行事。 我想你之前的很多问题 至少透露出一些理解, 理解我们一直以来的这种运作方式。 但现在我认为,我们整个世界的 认识都更深了, 是时候把非常强大的 开放系统推向世界了。 如果明年你再邀请我回来, 你可能会冲我嚷嚷, 因为有人滥用了 这些开源系统, 然后说:"你们为什么要那样做?" 就是说:"你们真不该 回到你们开放的初心。" 但你知道,我们做的每件事 都有取舍。 我们只是这场AI革命中的 一个玩家、一种声音, 尽力做到最好, 尝试以负责任的方式 引导这项技术进入世界。 我们肯定犯过错, 未来肯定还会犯更多错。 总体来说,我认为在过去 将近十年里—— 已经很长时间了—— 你知道,我们大体上做到了 我们出发时立志要做的事。 我们面前还有很长的路。 未来我们的策略还会更多调整, 但对这一使命的坚守, 对我们想做的事的执着, 我认为非常坚定。 (掌声) Look, I think like anyone else, I'm a nuanced character that doesn't reduce well to one dimension here. You know, probably some of the good things are true and probably some of the criticism is true. In terms of OpenAI, our goal is to make AGI and distribute it, make it safe, for the broad benefit of humanity. I think by all accounts, we have done a lot in that direction. Clearly our tactics have shifted over time. I think we didn't really know what we were going to be when we grew up. We didn't think we would have to build a company around this. We learned a lot about how it goes and the realities of what these systems were going to take from capital. But I think we've been, in terms of putting incredibly capable AI with a high degree of safety in the hands of a lot of people, and giving them tools to sort of do whatever amazing things they're going to do, I think it'd be hard to give us a bad grade on that. I do think it's fair that we should be open sourcing more. I think it was reasonable for all of the reasons that you asked earlier, as we weren't sure about the impact these systems were going to have and how to make them safe, that we acted with precaution. I think a lot of your questions earlier would suggest at least some sympathy to the fact that we've operated that way. But now I think we have a better understanding, as a world, and it is time for us to put very capable open systems out into the world. If you invite me back next year, you will probably yell at me for somebody who has misused these open-source systems, and say, "Why did you do that?" You know, "You should have not gone back to your open roots." But, you know, there's trade offs in everything we do. And we are one player, one voice, in this AI revolution, trying to do the best we can and kind of steward this technology into the world in a responsible way. We've definitely made mistakes, we'll definitely make more in the future. On the whole, I think we have, over the last almost decade, it’s been a long time now, you know, we have mostly done the thing we’ve set out to do. We have a long way to go in front of us. Our tactics will shift more in the future, but adherence to this sort of mission and what we're trying to do, I think very strong. (Applause) ¶
CA 你发布过这个—— 好吧,那么,这就是那枚魔戒 来自《指环王》。 我说是你的对手, ——此刻算不上你最好的朋友, 埃隆·马斯克声称,你看, 他认为你已经被魔戒腐蚀了。 被那枚权力魔戒。 顺便说一句,这个指控—— (笑声) You posted this -- Well, OK, so here's the Ring of Power from "Lord of the rings." Your rival, I will say, not your best friend at the moment, Elon Musk, claimed that, you know, he thought that you'd been corrupted by the Ring of Power. An allegation that, by the way -- (Laughter) ¶
SA 嗨,史蒂夫。【译注:疑似向场下打招呼,原文如此】 Hi, Steve. ¶
CA 这个指控其实也可以 原样用在埃隆身上, 公平地说。 但我很好奇,人们,你们—— An allegation that could be applied to Elon as well, you know, to be fair. But I'm curious, people, you have -- ¶
SA 我也许会回应。 我正在考虑。 我可能会说点什么。 (笑声) I might respond. I'm thinking about it. I might say something. (Laughter) ¶
CA 这个问题萦绕在每个人心头, 当我们看着科技公司的 CEO 们 权力越来越大, 越来越富, 他们能否驾驭得住? 还是它终将不可抗拒? 权力和财富会不会 使之变得不可能—— 有时做到正确的事, 而你只能死死 攥紧那枚戒指? 你怎么看? 我是说,你有时能感觉到那枚戒指吗? It's in everyone's mind, as we see technology CEOs get more powerful, get richer, is can they handle it, or does it become irresistible? Does the power and the wealth make it impossible to sometimes do the right thing and you just have to cling tightly to that ring? What do you think? I mean, do you feel that ring sometimes? ¶
SA 你觉得我做得如何? 相对其他获得了大量权力的 CEO, 那些获得大量权力、 改变了行为方式、 或在世上做了许多事的, 你觉得我如何? (掌声) How do you think I'm doing, relative to other CEOs, that have gotten a lot of power and changed how they act or done a bunch of stuff in the world, like how do you think? (Applause) ¶
CA 你有一种优雅的…… 你不是一个粗鲁、愤怒的人, 不会跳出来 对别人说出咄咄逼人的话。 You have a beautiful ... you are not a rude, angry person who comes out and says aggressive things to other people. ¶
SA 有时候我会那样。 那是我唯一的缺点,知道吗? (笑声) Sometimes I do that. That's my single vice, you know? (Laughter) ¶
CA 不,我觉得就 你个人的处世方式而言, 是令人印象深刻的。 我是说,有些人会问: 这是真实的你吗?还是—— 背后另有其情? No, I think in the way that you personally conduct yourself, it's impressive. I mean, the question some people ask is, is that the real you or, you know, is there something else going on? ¶
SA 不,我收下这个反馈。 你们把索伦的魔戒放上去了, 或者管那东西叫什么。 所以我收下这个反馈。 有没有哪件我做过的事, 让你觉得 我被权力腐蚀了? No, I'll take the feedback. You put up the Sauron Ring of Power or whatever that thing is. So I'll take the feedback. What is like something I have done where you think I've been corrupted by power? ¶
CA 我认为人们的担忧在于 仅仅是 OpenAI 向营利模式的转型, 就有人会说: 看吧。 你被腐蚀了—— 被对财富的渴望。 要知道,曾经有一段时间 里面是不设股权的。 它会让你富可敌国。 顺便说一句,我个人不认为 那是你的动机。 我觉得你想造的东西 酷到疯狂。 而我担心的 是那种竞争的感觉—— 你看到别人都在这么做, 就让人没办法 按正确的节奏发展。 但你告诉我,如果你没有 那种感觉,那…… 这世上几乎没有谁拥有那种 能力与潜能,我们不知道 那是什么感觉。 那到底是什么感觉? I think the fear is that just the transition of OpenAI to a for-profit model, is, you know, some people say, well, there you go. You got corrupted by the desire for wealth. You know, at one point there was going to be no equity in it. It will make you fabulously wealthy. By the way, I don't think that is your motivation, personally. I think you want to build stuff that is insanely cool. And what I worry about is the competitive feeling that you see other people doing it, and it makes it impossible to develop at the right pace. But you tell me, if you don't feel that, like, what ... so few people in the world have the kind of capability and potential you have, we don't know what it feels like. What does it feel like? ¶
SA 令人惊讶的是,和从前一模一样。 我觉得任何事 你都能一步步习惯。 我想,如果我像是被传送, 从十年前 一下子来到现在, 那会让人极度眩晕。 但任何事终将变成 某种新常态, 所以并没有什么不同感。 坐在这里 谈论这一切很奇怪, 但我是说,你知道, 日常生活的单调—— 我用最褒义的方式说—— 感觉和从前完全一样。 Shockingly, the same as before. I think you can get used to anything step by step. I think if I were like transported from 10 years ago to right now, all at once, it would feel very disorienting. But anything does become sort of the new normal, so it doesn't feel any different. And it's strange to be sitting here talking about this, but like, you know, the monotony of day-to-day life, which I mean in the best possible way, feels exactly the same. ¶
CA 你还是同一个人。 You're the same person. ¶
SA 我肯定 在很多方面已不是了, 但我自己没觉得不同。 I mean, I'm sure I'm not in all sorts of ways, but I don't feel any different. ¶
CA 你发的那条关于 你儿子的内容,非常动人。 你最后那句, 「我从未感受过这样的爱」—— 我想在场每位父母 都太熟悉那种感觉: 那种原始的、生物性的、 人类拥有而 AI 永远不会有的感觉—— 你怀抱着自己的孩子。 我在想,这是否改变了你的思考, 比如面对这样的抉择: 你知道,打个比方, 这儿有个红盒子, 里面是个黑盒子, 上面有个红色按钮。 你按下那个按钮, 就能给你儿子 大概率难以置信的精彩人生, 但也注入百分之十的概率 让他被毁灭。 你按不按那个按钮? This was a beautiful thing you posted, your son. I mean, that last thing you said there, "I've never felt love like this," I think any parent in the room so knows that feeling, that wild biological feeling that humans have and AIs never will, of you’re holding your kid. And I'm wondering whether that's changed how you think about things like if, you know, say, here's a red box, here's a black box with the red button on it, you can press that button and you give your son likely the most unbelievable life, but also you inject a 10 percent chance that he gets destroyed. Do you press that button? ¶
SA 按字面情形,不按。 如果问题是:我是否觉得 我的工作就像在按这个按钮—— 答案是, 我也没有那种感觉。 有了孩子改变了很多事。 那是我此生经历的 最了不起的事,远超其他一切, 大家说的那些全都是真的。 我的联合创始人 Ilya 说过一句话,原句我记不清了。 这是我的转述,大意是: 「我不知道生命的意义是什么, 但它肯定 和婴儿脱不开关系。」 而这句话准得令人难以置信。 改变了我愿意 在某些事上投入的时间分量, 而缺席我孩子的成长 所付出的代价, 高得离谱。 而我…… 但我是说,很久以前我就真的在乎 不去毁灭这个世界。 现在我真的在乎这件事。 这一条不需要孩子我也如此。 (掌声) 我确实 更多地去想 未来会是什么样子—— 尤其对他的未来而言, 但我觉得有一份责任 为我们所有人的未来 尽力做到最好。 In the literal case, no. If the question is, do I feel like I'm doing that with my work, the answer is, I also don't feel like that. Having a kid changed a lot of things. And by far the most amazing thing that has ever happened to me, like everything everybody says is true. A thing my cofounder Ilya said once is, I don’t know. This is a paraphrase, something like, "I don't know what the meaning of life is, but for sure it has something to do with babies." And it's like, unbelievably accurate. It changed how much I’m willing to like spend time on certain things and like the kind of cost of not being with my kid is just like crazily high. And I ... But, you know, I really cared about like not destroying the world before. I really care about it now. I didn't need a kid for that part. (Applause) I mean, I definitely think more about like what the future will be like for him in particular, but I feel a responsibility to do the best thing I can for the future of everybody. ¶
CA Tristan Harris 本周在这里 做了一场非常有力的演讲, 他说,其中的关键 问题——在他看来—— 是你和你这些同行们—— 在这些其他模型(公司)里的—— 基本上都觉得, 先进 AI 的发展 是不可避免的, 竞赛已经开始, 而且别无选择, 只能尽力赢得这场竞赛, 并尽可能负责任地去做。 也许存在这样一种情形: 你们的超级智能 AI 可以充当其他人的刹车, 之类的。 但恰恰是“每个人都 相信它是不可避免的”这一事实, 就是一条 通向下行风险和动荡的路径。 你觉得你和你这些同行们确实 觉得这是不可避免的吗? 你能看到走出这种境况的任何路径吗—— 我们能否共同同意 稍微放慢脚步, 让整个社会 都参与进来,表态说: 不,你知道,我们不想让这件事 发生得这么快。 它的颠覆性太强了。 Tristan Harris gave a very powerful talk here this week in which he said that the key problem, in his view, was that you and your peers in these other models all feel basically, that the development of advanced AI is inevitable, that the race is on, and that there is no choice but to try and win that race and to do so as responsibly as you can. And maybe there’s a scenario where your superintelligent AI can act as a brake on everyone else's or something like that. But that the very fact that everyone believes it is inevitable, that is a pathway to serious risk and instability. Do you think that you and your peers do feel that it's inevitable, and can you see any pathway out of that where we could collectively agree to just slow things down a bit, have society as a whole weigh in a bit and say, no, you know, we don't want this to happen quite as fast. It's too disruptive. ¶
SA 首先, 我认为人们一直在 放慢速度, 因为技术还没准备好, 因为某些东西不够安全, 因为某些东西行不通。 我认为存在着各种各样的努力: 对某些东西按兵不动、暂停、 推迟, 不发布某些能力。 所以我认为这种情况是真实存在的。 而且,这也正是我认为 过往记录重要的地方。 如果我们是在匆忙出货, 而且出现了各种问题—— 要么产品没有 达到人们期望的效果, 要么确实存在安全问题 或其他问题。 稍后我会回到我们做出的一项改变, 我认为那种做法是可行的。 这些努力之间大多存在 沟通交流,只有一个例外。 我认为所有团队 都非常重视 AI 安全。 而且我认为—— First of all, I think people slow things down all the time because the technology is not ready, because something's not safe enough, because something doesn't work. There are, I think, all of the efforts hold on things, pause on things, delay on things, don't release certain capabilities. So I think this happens. And again, this is where I think the track record does matter. If we were rushing things out and there were all sorts of problems, either the product didn’t work as people wanted it to or there were real safety issues or other things there. And I will come back to a change we made, I think you could do that. There is communication between most of the efforts, with one exception. I think all of the efforts care a lot about AI safety. And I think that -- ¶
CA 例外是谁? Who's the exception? ¶
SA 我不会说。 而且我认为,确实存在 把这件事做对的深切用心。 我认为,把这件事简单描绘成 一场疯狂的 竞赛或冲刺之类的, 忽略了其中的微妙之处:人们是在努力 快速推出模型、 为人们打造优秀的产品。 但人们如此强烈地 感受到这件事的影响,以至于…… 你知道,我认为如果你能 去 OpenAI 旁听一次会议, 或其他公司,你会觉得: 哦,这些人其实 真的很在意这件事。 最近我们确实做出了一项改变, 关于我们如何看待某一个方面, 这个方面传统上 被理解为“安全”。 那就是,借助我们的新图像模型, 我们给了用户多得多的自由, 在传统上我们会视为 言论伤害的领域。 你知道,如果你想 让模型冒犯你, 模型会让你被冒犯吗? 过去,我们曾有严格得多的 防护栏。 但我认为,模型对齐(alignment,即让模型与人类意图和价值观保持一致)的一部分, 就是遵循使用者 想让它做的事, 在非常宽泛的边界之内—— 这个边界由社会决定。 所以,如果你让模型去描绘一堆 暴力内容之类的, 或者去强化某种刻板印象, 那就有一个它 该不该这么做的问题。 我们正在采取一种宽容 得多的立场。 在某个地方,它会开始 与现实世界的伤害产生交集, 那条线怎么划, 我们得想清楚, 但是,你知道,我认为会出现这样的情形: 一家公司说,好, 我们听到了来自社会的反馈。 人们真的不希望模型 审查自己, 以他们认为不合理的方式。 这是一次正当的安全协商。 I'm not going to say. And I think that there's really deep care to get this right. I think the caricature of this as just like this crazy race or sprint or whatever, misses the nuance of people are trying to put out models quickly and make great products for people. But people feel the impact of this so incredibly that ... you know, I think if you could go sit in a meeting in OpenAI or other companies, you'd be like, oh, these people are really kind of caring about this. Now we did make a change recently to how we think about one part of what's traditionally been understood as safety. Which is, with our new image model, we've given users much more freedom on what we would traditionally think about as speech harms. You know, if you try to get offended by the model, will the model let you be offended? And in the past, we've had much tighter guardrails on this. But I think part of model alignment is following what the user of a model wants it to do within the very broad bounds of what society decides. So if you ask the model to depict a bunch of violence or something like that or to sort of reinforce some stereotype, there's a question of whether or not it should do that. And we're taking a much more permissive stance. There's a place where that starts to interact with real-world harms that we have to figure out how to draw the line for, but, you know, I think there will be cases where a company says, OK, we've heard the feedback from society. People really don't want models to censor them in ways that they don't think make sense. That's a fair safety negotiation. ¶
CA 但只要这在某种程度上是一个 集体性的问题—— 一个集体信念的问题, 这类 问题的解法就是让人们走到一起, 聚到同一个点上, 达成一个不同的约定。 如果有一群人,比如说, 在这里或世界上某个地方, 愿意主办一场峰会—— 召集最优秀的伦理学家、技术专家, 但人数不要太多,小而精—— 你和你这些同行们, 去尝试破解:全世界可以共同认可的 安全红线能有哪些, 你愿意参加吗? 你会敦促你的同行们前来吗? But to the extent that this is a collective, a problem of collective belief, the solution to those kinds of problems is to bring people together and meet at one point and make a different agreement. If there was a group of people, say, here or out there in the world who were willing to host a summit of the best ethicists, technologists, but not too many people, small, and you and your peers to try to crack what agreed safety lines could be across the world, would you be willing to attend? Would you urge your colleagues to come? ¶
SA 当然愿意, 但我更感兴趣的, 是我们那数亿用户 整体上想要什么。 我认为,很多回旋的余地 历来都是在 小型精英峰会上被决定的。 AI 令人兴奋的新事物之一, 就是我们的 AI 可以和地球上每个人对话, 我们可以了解集体性的 价值偏好——所有人想要什么, 而不是让一群 所谓被社会眷顾的人 坐在房间里做这些决定, 我觉得这非常棒。 (掌声) 我认为,你们会看到我们 朝那个方向做得更多。 而当我们做错的时候—— 因为房间里的精英们 持有不同的看法, 关于人们想要什么样的 图像生成防护栏, 而人们实际想要的并非如此, 我们又指不出任何现实世界的伤害, 所以我们做出了那次改变。 我为此感到自豪。 (掌声) Of course, but I'm much more interested in what our hundreds of millions of users want as a whole. I think a lot of the room has historically been decided in small elite summits. One of the cool new things about AI is our AI can talk to everybody on Earth, and we can learn the collective value preference of what everybody wants, rather than have a bunch of people who are, like, blessed by society to sit in a room and make these decisions, I think that's very cool. (Applause) And I think you will see us do more in that direction. And when we have gotten things wrong, because the elites in the room had a different opinion about what people wanted for the guardrails on image-gen than what people actually wanted, and we couldn't point to real-world harm, so we made that change. I'm proud of that. (Applause) ¶
CA 这样的事情有长期的记录: 意想不到的后果, 不断产生于 数亿人的行动之中。 There is a long track record of unintended consequences coming out of the actions of hundreds of millions of people. ¶
SA 同样,还有100个人 关起门来做出的决定。 Also 100 people in a room making a decision. ¶
CA 而那数亿人 对此无法控制, 他们也未必看得见 下一步会通向什么。 And the hundreds of millions of people don't have control over, they don't necessarily see what the next step could lead to. ¶
SA 我希望—— 这一点完全准确, 也完全正确—— 我希望AI能帮助我们更智慧, 做出更好的决定, 能和我们对话,如果我们说, 嘿,我想要X, 你知道,与其让 人群把它煽动起来, AI可以说,嘿,我完全 理解这就是你想要的。 如果在这场对话结束时, 你仍然想要这个, 你做主,你来选。 但你有没有从 这个人的视角考虑过, 或者它会对此造成的影响? 我认为AI能帮助我们更智慧, 并在集体治理上做出 比以前更好的决定。 I am hopeful that -- that is totally accurate and totally right -- I am hopeful that AI can help us be wiser, make better decisions, can talk to us, and if we say, hey, I want thing X, you know, rather than like, the crowds spin that up, AI can say, hey, totally understand that's what you want. If that's what you want at the end of this conversation, you're in control, you pick. But have you considered it from this person's perspective or the impact it will have on this? I think AI can help us be wiser and make better collective governance decisions than we could before. ¶
CA 我们的时间到了。 Sam,最后的话留给你。 你认为, 综合所有因素, 你儿子将会在一个怎样的世界里长大? We're out of time. Sam, I'll give you the last word. What kind of world do you believe, all things considered, your son will grow up into? ¶
SA 我记得——现在已经太久了, 我不知道第一台iPad是什么时候推出的。 是15年左右,差不多那样吗? 我记得当时看过 一个YouTube视频, 视频里一个蹒跚学步的幼儿 坐在医生办公室的 候诊室之类的地方, 那儿有一本杂志, 就是那种陈年的、 你知道的,光面封皮的杂志, 幼儿把手放在上面 像这样划,还挺生气。 而在那个幼儿看来, 它就像一台坏掉的iPad。 他,或者说她,从未想过 一个没有、你知道的, 触摸屏的世界。 而在所有观看的大人看来, 这是件了不起的事, 因为它就像是 太新了,太神奇了, 是个奇迹。 当然,你知道,杂志 就是世界运转的方式。 我的孩子,希望我的孩子们, 永远不会比AI更聪明。 他们不会成长在一个 产品和服务并非极其聪明、 并非极其强大的 世界里。 他们不会成长在一个 电脑对你只是 一知半解的世界里。 而且能去做,你知道,以某种意义来讲的 任何你能想象的事, 一切你能想象的事。 那将是一个有着惊人 物质丰裕的世界。 那是一个 变化速度快得惊人的世界, 不断有惊人的新事物发生。 而且那也将是一个, 比如个人的…… 能力、影响力,什么的, 远远超出 今天一个人所能达到的境界的世界。 我希望我的孩子和你们所有人的孩子, 回望我们时会带着一点 怜悯与怀旧, 会说:"他们过的 生活真糟糕。 他们是那么受限。 那时的世界糟透了。" 我觉得那很好。 (掌声) I remember -- it's so long ago now, I don't know when the first iPad came out. Is it like 15 years, something like that? I remember watching a YouTube video at the time, of like a little toddler sitting in a doctor's office waiting room or something, and there was a magazine, like one of those old, you know, glossy-cover magazines, and the toddler had his hand on it and was going like this and kind of angry. And to that toddler, it was like a broken iPad. And he never, she never thought of a world that didn't have, you know, touch screens in them. And to all the adults watching this, it was this amazing thing because it was like it's so new, it's so amazing, it's a miracle. Of course, you know, magazines are the way the world works. My kid, my kids hopefully, will never be smarter than AI. They will never grow up in a world where products and services are not incredibly smart, incredibly capable. They will never grow up in a world where computers don't just kind of understand you. And do, you know, for some definition of whatever you can imagine, whatever you can imagine. It'll be a world of incredible material abundance. It'll be a world where the rate of change is incredibly fast and amazing new things are happening. And it’ll be a world where, like individual ... ability, impact, whatever, is just so far beyond what a person can do today. I hope that my kids and all of your kids will look back at us with some like pity and nostalgia and be like, "They lived such horrible lives. They were so limited. The world sucked so much." I think that's great. (Applause) ¶
CA 你所创造的一切令人难以置信。 真的是,难以置信。 我想在未来几年里, 你将迎来 一些最大的机遇、 最大的道德挑战, 和最重大的抉择—— 或许是历史上任何一个人 所曾面对的。 你应该知道,这里的每个人 都会为你加油, 支持你做正确的事。 It's incredible what you've built. It really is, it's unbelievable. I think over the next few years, you're going to have some of the biggest opportunities, the biggest moral challenges, the biggest decisions to make of perhaps any human in history, pretty much. You should know that everyone here will be cheering you on to do the right thing. ¶
SA 我们会竭尽全力, 非常感谢。 We will do our best, thank you very much. ¶
CA 感谢你来到TED。 (掌声) 谢谢。 Thank you for coming to TED. (Applause) Thank you. ¶
SA 非常感谢。 Thank you very much. ¶