近年来 AI 进步得惊人;ChatGPT 能做出我们早已习以为常的神奇之事。这本是应该的,也正是人类进步的故事。但在那个闪烁的小圆圈背后、被漂亮地抽象掉的地方,藏着我有生以来所见的最伟大的人类智慧故事。许许多多人为之付出了难以置信的努力,去发现如何造出那个大多数专家认为在此时间尺度上不可能造出的东西,并建立起一家能以巨大规模交付产品、让众人从中受益的公司。大多数使用 ChatGPT 的人永远不会去想那些为之倾注如此多心血的人,这完全没关系,但请容我占用你一分钟…… AI has gotten remarkably better in recent years; ChatGPT can do amazing things that we take for granted. This is as it should be, and is the story of human progress. But behind the blinking circle, nicely abstracted away, is the greatest story of human ingenuity I have ever seen. A lot of people have worked unbelievably hard to discover how to build something that most experts thought was impossible on this timeframe, and to build a company to deliver products at massive scale to let people benefit from it. Most people who use ChatGPT will never think about the people that put so much work into it, which is totally ok, but just to take a minute of your time… ¶
有两个人我想在此提及——没有他们,OpenAI 就不会是今天的 OpenAI:Jakub Pachocki 和 Szymon Sidor。他们一次又一次地把研究与工程结合起来,解决看似不可能的问题。他们没有获得足够的公众赞誉:当主流共识认为强化学习(RL)无法规模化时,他们决定把 RL 扩大规模当作基线方法,去看它会在哪里失效,这直接带来了我们的 Dota 成果;他们构建了支撑我们大量科学发现的大部分基础设施;他们领导了 GPT-4 的预训练;他们与 Ilya 和 Lukasz 一起推动了后来带来推理突破的初始想法;并且在探索新范式方面取得了重大进展。Jakub 是我们的首席科学家。他曾经用「不知疲倦」(indefatigable)来形容 Szymon——那是我听过的对这个词最完美的一次使用。OpenAI 还没有抛出过他们解决不了的问题;我听说过从前的一些研究实验室里存在那种两人互补到极致的传奇搭档,但能亲眼看着这样的搭档关系在多年间徐徐展开,是非常特别的体验。 There are two people I'd like to mention that OpenAI would not be OpenAI without: Jakub Pachocki and Szymon Sidor. Time and again, they combine research and engineering to solve impossible problems. They have not gotten enough public credit, but they decided to scale up RL as a baseline to see where it broke when the conventional wisdom was that it didn't scale which led to our Dota result, built much of the infrastructure that enabled a lot of our scientific discoveries, led GPT-4 pretraining, drove together with Ilya and Lukasz the initial ideas that led to the reasoning breakthrough, and have made significant progress exploring new paradigms.Jakub is our chief scientist. He once described Szymon as “indefatigable”, which is as perfect of a use of that word as I have ever heard. OpenAI has not yet thrown a problem at them they have not been able to solve; I have heard about partnerships like there is research labs of the past where two people are able to complement each other so well, but it is very special to get to watch it unfold over the years. ¶