硅谷一个热门话题是:人类和机器将在哪一年融合(或者,如果不融合,人类将在哪一年被迅速进化的 AI 或基因增强的新物种超越)。大多数猜测落在 2025 年到 2075 年之间。 A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075. ¶
人们过去管这叫「奇点」;现在它让人觉得不舒服,又真实得越来越近,以至于很多人似乎干脆避免给它起名字了。 People used to call this the singularity; now it feels uncomfortable and real enough that many seem to avoid naming it at all. ¶
也许人们不再用「奇点」这个词的另一个原因是,它暗示着时间上的某个单点时刻,而现在看来,融合将是一个渐进的过程。而渐进的过程是很难被察觉的。 Perhaps another reason people stopped using the word “singularity” is that it implies a single moment in time, and it now looks like the merge is going to be a gradual process. And gradual processes are hard to notice. ¶
我相信融合已经开始了,我们已经身在其中好几年了。我们的手机控制着我们,告诉我们什么时候该做什么;社交媒体的信息流决定着我们的情绪;搜索引擎决定着我们的想法。 I believe the merge has already started, and we are a few years in. Our phones control us and tell us what to do when; social media feeds determine how we feel; search engines decide what we think. ¶
让这一切发生的算法,已经不再被任何一个人完全理解。它们为创造者指定优化的目标而优化,但采用的是任何人都想不出来的方式——它们在今天看来是老练的 AI,到明天就会显得像小孩子的把戏。而且它们极其有效——至少就我自己而言,我很难抗拒算法想让我做的事。在我真正下功夫与之对抗之前,我发现自己对互联网极度上瘾。[1] The algorithms that make all this happen are no longer understood by any one person. They optimize for what their creators tell them to optimize for, but in ways that no human could figure out — they are what today seems like sophisticated AI, and tomorrow will seem like child’s play. And they’re extremely effective — at least speaking for myself, I have a very hard time resisting what the algorithms want me to do. Until I made a real effort to combat it, I found myself getting extremely addicted to the internet. [1] ¶
我们已经处在共同进化的阶段——AI 影响我们、塑造我们、感染我们,然后我们改进 AI。我们建造更多的算力,把 AI 跑在上面,它再想出如何制造更好的芯片。 We are already in the phase of co-evolution — the AIs affect, effect, and infect us, and then we improve the AI. We build more computing power and run the AI on it, and it figures out how to build even better chips. ¶
这大概无法阻止。正如我们已经学到的,只要物理定律不禁止,科学进步最终就会发生。 This probably cannot be stopped. As we have learned, scientific advancement eventually happens if the laws of physics do not prevent it. ¶
比这更重要的是,除非我们先毁灭自己,否则超人智能的 AI 会发生,基因增强会发生,脑机接口会发生。以为我们永远造不出比自己更聪明的东西,这是人类想象力的失败,也是人类的傲慢。 More important than that, unless we destroy ourselves first, superhuman AI is going to happen, genetic enhancement is going to happen, and brain-machine interfaces are going to happen. It is a failure of human imagination and human arrogance to assume that we will never build things smarter than ourselves. ¶
我们的自我价值感如此深地建立在我们的智力之上,以至于我们相信它必定独一无二,而不承认它只是比连续谱上的其他动物高出一点点。也许 AI 也会有同样的感觉,并且认为我们和倭黑猩猩之间的差异几乎不值一提。 Our self-worth is so based on our intelligence that we believe it must be singular and not slightly higher than all the other animals on a continuum. Perhaps the AI will feel the same way and note that differences between us and bonobos are barely worth discussing. ¶
融合可以有很多形式:我们可以把电极插进大脑,也可以全都只是和聊天机器人成为非常亲密的朋友。但我认为,融合大概是我们最好的结局。如果两个不同的物种想要同一个东西——在这个例子里,是成为地球上乃至地球之外的主导物种——而只有一个能拥有它,它们之间就会爆发冲突。我们应该都希望只有一个团队,其中每个成员都关心其他所有人的福祉。 The merge can take a lot of forms: We could plug electrodes into our brains, or we could all just become really close friends with a chatbot. But I think a merge is probably our best-case scenario. If two different species both want the same thing and only one can have it—in this case, to be the dominant species on the planet and beyond—they are going to have conflict. We should all want one team where all members care about the well-being of everyone else. ¶
尽管融合已经开始,它还会变得怪异得多。我们将是有史以来第一个设计自己后代的物种。我的猜测是:我们要么成为数字智能的生物学引导程序(bootloader),然后退化成进化树上的一条旁枝;要么我们搞清楚成功的融合是什么样子。 Although the merge has already begun, it’s going to get a lot weirder. We will be the first species ever to design our own descendants. My guess is that we can either be the biological bootloader for digital intelligence and then fade into an evolutionary tree branch, or we can figure out what a successful merge looks like. ¶
它到来的时间大概比大多数人以为的更早。硬件正在以指数级的速度改进——我在 OpenAI 工作中学到的最令人惊讶的事,就是算力增长与 AI 突破之间的相关性竟然如此之强——而从事 AI 的聪明人的数量也在指数级增长。双重指数函数会以很快的速度超出你的想象。 It’s probably going to happen sooner than most people think. Hardware is improving at an exponential rate—the most surprising thing I’ve learned working on OpenAI is just how correlated increasing computing power and AI breakthroughs are—and the number of smart people working on AI is increasing exponentially as well. Double exponential functions get away from you fast. ¶
全世界最好现在就开始认真对待这件事。全球协调不会很快发生,但这件事需要全球协调。 It would be good for the entire world to start taking this a lot more seriously now. Worldwide coordination doesn’t happen quickly, and we need it for this. ¶
[1] 我相信注意力劫持(attention hacking)将成为我们这一代人的「糖流行病」。我能感觉到它在自己生活中的变化——我至今仍怀念自己曾经拥有注意力的日子。我朋友们年幼的孩子甚至不知道那是值得怀念的东西。我比以前更频繁地愤怒和不开心,但更少把它转化为有建设性的改变,而是去追逐「点赞」和「愤怒」这两份多巴胺冲击。 [1] I believe attention hacking is going to be the sugar epidemic of this generation. I can feel the changes in my own life — I can still wistfully remember when I had an attention span. My friends’ young children don’t even know that’s something they should miss. I am angry and unhappy more often, but I channel it into productive change less often, instead chasing the dual dopamine hits of likes and outrage. ¶
(为保持一致性,本文从 https://medium.com/wordsthatmatter/merge-now-430c6d89d1fe 交叉转载至此;感谢 Medium 邀我写这篇文章!) (Cross-posted from https://medium.com/wordsthatmatter/merge-now-430c6d89d1fe to here for consistency; thanks to Medium for inviting me to write this!) ¶