Ketahanan ing jaman AI

AI, teknologi serbaguna, lan kenapa ketahanan minangka karya generasi kita.

Dening Wojciech Zaremba

OpenAI Foundation ana kanggo mesthekake yen kecerdasan umum tiruan migunani kanggo kabeh umat.

Kita wis makarya tanpa kendhat kanggo ngimbangi kemajuan AI sing cepet banget iku dhéwé. Ing wulan April, Foundation ngumumake dana hibah kapisan kita senilai $100 yuta ing bidang Ilmu Hayati lan Nambani Penyakit, kanthi ambisi kanggo mbantu nyegah lan nambani penyakit kaya Alzheimer kanthi manfaatake AI canggih. Minggu kepungkur, kita ngumumake program Pakaryan lan Masa Depan Ekonomi, kanthi pangarep-arep bisa mangerteni lan mbentuk apa tegesé pakaryan lan kamakmuran ekonomi kanggo generasi mbesuk.

Dina iki, kita njlentrehake luwih jembar visi kita kanggo program gedhe sabanjure—kanggo mesthekake manawa, nalika kabisan AI saya berkembang, kemampuan masyarakat kanggo manfaatake uga bakal tuwuh kanthi cepet sing padha. Kita ngarani karya iki Ketahanan AI: pendekatan ekosistem sing dibutuhake kanggo nyuda risiko AI, supaya masyarakat bisa ngoptimalake paédahé.

Pakaryan kita wis diwiwiti. Sajrone sawetara wulan sing cekak wiwit kita miwiti karya iki, Foundation lagi ngupaya ngrampungake hibah luwih saka $130 yuta kanggo organisasi-organisasi liwat program Ketahanan AI, sing bakal enggal diumumake marang publik lan isih bakal ana tambahan maneh.1

Pola teknologi transformasional

Pentinge ketahanan AI paling cetha dimangerteni liwat kacamata teknologi-teknologi kepungkur sing nduwèni pangaruh gedhé marang sajarah manungsa.

Saben sawetara wektu, ana teknologi sing teka lan mbentuk maneh masyarakat saka dhasaré. Para ahli ekonomi nyebut iki minangka “teknologi serbaguna.” Api. Mesin cithak. Listrik. Internet. Saben-sabené ngetutaké alur sing padha: inovasi sing pesat, risiko nyata, lan lembaga-lembaga sing kesusu ngimbangi. Nanging saben conto uga nuduhake apa sing dibutuhake kanggo nggawe teknologi sing ampuh dadi aman.

Geni ndadekaké peradaban manungsa bisa kawujud. Iku njaga awaké dhéwé tetep anget, masak panganan awaké dhéwé, lan nglindhungi awaké dhéwé saka kéwan pemangsa. Kuwi uga ngobong kutha-kutha kita nganti rata karo lemah. Suwe-suwe, masyarakat mbangun ketahanan: bahan tahan geni, jaringan hidran, pemadam kebakaran profesional, lan kode bangunan. Sawijining ekosistem, lapis mbaka lapis.

Listrik ngetutaké jalur sing padha. Sawisé Stasiun Pearl Street duwèké Edison madhangi Manhattan ing taun 1882, listrik nyebabaké kebakaran, kasus pati amarga kesetrum, lan kepanikan masarakat. Tanpa pangayoman kayata kabel sing diisolasi, pemutus arus, lan aturan kelistrikan, para pekerja lan wong-wong sing ana ing sacedhake padha kesetrum nganti tiwas ing kutha-kutha saindenging negara. Kutha-kutha padha mbahas apa eksperimen kasebut kudu dipungkasi babar pisan. Nanging, nalika teknologiné saya maju, kita ngedegaké lembaga uji mandiri kaya Underwriters Laboratories, standar industri kaya National Electrical Code, lan investasi publik sing nggawa listrik menyang komunitas-komunitas sing wis ditinggalaké déning pasar. Saben lapisan ndadekake listrik luwih aman lan luwih gampang diakses; saiki, listrik wis aman banget nganti bocah cilik bisa nguripake saklar banjur lampu murup.

Iki wujudé ketahanan nalika ditindakake kanthi becik.

AI mbutuhake ekosistem ketahanan

AI ngetutaké alur perkembangan sing padha kaya teknologi-teknologi sadurungé, nanging lumaku kanthi kacepetan sing durung tau ana sadurungé.

Kita isih ana ing tahap wiwitané, nanging paédahé wis cetha: AI nyuda pepalang kanggo miwiti usaha, ngambakaké akses menyang pendhidhikan, nyepetaké panemon ilmiah, lan ngowahi jagad ilmu kedhokteran.

Ing wektu sing padha, risiko-risiko kasebut muncul kanthi cepet sing padha—lan minangka cerminan kabalikan saka paedah AI. Pangrembakan sing nggawe industri anyar kuwi uga bisa ngowahi kanthi drastis industri sing wis ana lan ngganggu dalan karier. Sistem sing padha, sing bisa mbantu para mudha sinau lan nyipta, uga bisa nyebabake prilaku sing ngrugekake. Piranti sing nyepetake panaliten biologi bisa nyuda alangan kanggo nggawe patogen sing mbebayani. Lan kabisan AI kanggo nulis kode, yen tiba ing tangan sing salah, bisa ngancam infrastruktur kritis.

Tim OpenAI ing wiwitan percaya yen mesthekake AI menehi paedah kanggo masyarakat utamane gumantung marang ngrampungake masalah panyelarasan teknis. Bab iku tetep wigati banget—lan dadi inti saka pakaryan kita—nanging saiki kita percaya manawa iku mung salah siji bagean saka teka-teki. Nalika AI saya sumebar ing macem-macem sektor lan negara, masyarakat uga bakal mbutuhake riset independen, infrastruktur publik, koordinasi industri, lan bidang keahlian sing babar pisan anyar. Cekake, prekara iki bakal mbutuhake ketahanan AI.

Kita wis milih kanggo fokusake pakaryan wiwitan kita ing patang bidang2 sing dumunung ing persilangan antarane risiko gedhe jangka cedhak lan dampak langsung:

  1. Ketahanan biologis kanggo mbantu nyegah pandemi sing direkayasa ing mangsa ngarep;

  2. Ketahanan siber kanggo ngupaya njamin keamanan sistem kritis ing donya kita;

  3. Kaamanan model AI kanggo nguwatake kontrolé umat manungsa marang model sing kita ciptakake; lan

  4. Dampake AI marang wong enom kanggo mbantu ndadekake teknologi dadi kekuwatan positif kanggo generasi mbesuk.

Karya kita mung lagi diwiwiti. Kita ngrancang bakal nuduhake luwih akeh babagan strategi lan dana hibah wiwitan ing saben bidang, lan ngembang menyang bidang-bidang liyane suwe-suwe.

Bio-resilience

AI will enable biological research to move at unprecedented speed, helping develop new cures and public health improvements that enable us to all live healthier and longer. However, these same capabilities could also be misused by malicious actors, lowering the barrier to designing harmful pathogens.

The age of AI requires a renewed focus on biosecurity. Because advanced AI systems could be misused by bad actors to help create a wide range of biological threats, we will prioritize pathogen-agnostic biosecurity solutions. This will require investments across prevention, detection, and defense. We need to make it harder for malicious actors to access the expertise, equipment, and materials to create biological threats, improve our ability to identify and track novel outbreaks early, and strengthen the technologies—such as protective equipment, indoor air cleaning systems, and medical countermeasures—needed to respond quickly and effectively.

Cyber-resilience

AI has begun to rapidly reshape the cybersecurity landscape. The work that once required specialized teams can now be assisted or automated by capable models. At the same time, rapidly-improving AI capabilities can also be used to accelerate cyberdefenders, including by identifying and patching vulnerabilities and accelerating response.

Many large companies and private actors can spend heavily on cyber to secure their own systems, including with new advances in AI. We anticipate focusing significant resources on securing other important societal actors that are less resourced and will have a much harder time deploying AI-ready cyberdefenses as quickly as needed. In parallel, we are also focused on preparing for novel security challenges that artificial general intelligence will ultimately bring.

AI model safety

AI model safety focuses on the behavior of the systems themselves—whether they are truthful, reliable, and aligned with human intent. In a world where this goes awry, models can break out and behave in unpredictable ways, deceiving us or pursuing goals beyond their design. Getting this right becomes increasingly important as AI systems grow more autonomous and approach—and eventually surpass—human-level intelligence.

AI companies are investing substantial resources in model safety. However, the importance of this challenge calls for a broader, more robust ecosystem: independent institutions to evaluate model safety, public infrastructure to verify models’ safe deployment in practice, and continued advances in alignment science that advance the field broadly.

AI’s impact on young people

Young people are often the earliest adopters of new technologies, using them to learn, create, communicate, and explore the world. AI is no exception. But as these tools become an increasing part of young people’s daily lives, it is critical that we develop a stronger evidence base to understand its impacts.

Families, schools, policymakers, and community organizations are all grappling with questions about how and when young people engage with AI—including its impact on human connection, learning, and development. Our initial focus will be on advancing independent research to help guide those decisions—to better understand where AI can support development, the risks it may introduce, and the contexts that shape those effects.

These insights should drive broad safety standards and design principles that guide how any AI product is developed, how schools choose to deploy them, and if and how families decide to incorporate these technologies into their lives.

The work ahead

There is one critical difference between AI and the technologies that came before it: speed.

Fire resilience took millennia. Electricity resilience took decades. AI resilience is evolving in a matter of years. The systems that make it safe, reliable, and broadly beneficial must be built alongside it.

If we get it right, AI can become part of the foundational infrastructure of modern life—expanding access to knowledge, accelerating discovery, and improving lives at a global scale.

But that outcome isn’t guaranteed. No general purpose technology ever made itself safe.

Resilience is a permanent discipline that requires many people and institutions to build, invest, and collaborate. That is the work ahead, and it is one of the defining challenges of our time. We hope you’ll join us.

Footnotes

  1. 1

    The OpenAI Foundation expects to invest more than $1 billion across several programs over the next year, and $25 billion in AI Resilience and Life Sciences & Curing Disease in the years ahead.

  2. 2

    The economic impacts of AI are part of the broader AI resilience agenda. Given the scale of the economic transition, the Foundation is developing this work as a separate program. Read more here.

  • Thank you to Zach Sims for helping develop this piece.
  • Acknowledgements: Jeff Arnold, Naomi Bashkansky, Sean Coey, Rebecca Distler, Adrien Ecoffet, Tarun Gogineni, Mike Heimowitz, Alice Lee, Leyan Lo, Rodney Manabat, Mike McCormick, Cody Nguyen, Yonadav Shavit, Kendal Simon, Divya Siddarth, Jacob Trefethen.