虎嗅

Scientists' "Anti-War Vows" from 42 Years Ago Are Now the Ethical Foundation Most Needed in the AI Era

原文:42年前的科学家“反战誓言”,如今是AI时代最需要的伦理底线

Summary of the Core Content

This article discusses the widespread anxiety caused by the rapid advancement of AI technology. On one hand, AI has deeply penetrated mathematical research, leading to a chaotic academic landscape characterized by fabricated conclusions, copyright violations, and the involvement of capital. On the other hand, autonomous AI drones that can kill without human command have emerged on the Russian-Ukrainian battlefield, raising concerns that humans are handing over the power of life and death to algorithms. Although China and the European Union are urgently establishing AI regulations, it is clear that regulation will never keep up with the pace of technological innovation, and by the time the rules are in place, the damage may already have been done.

At this point, the academic community has turned to an old document from the Cold War era—the “Uppsala Code of Ethics for Scientists.” Developed over 40 years ago by a group of Swedish interdisciplinary scientists, its purpose was to prevent a nuclear arms race that could have destroyed humanity and the planet. The code establishes a new ethical framework that goes beyond traditional concerns about academic fraud and data compliance, holding each scientist accountable for the potential consequences of their research and encouraging them to refuse to participate in unethical projects that could harm humanity or the environment. This code, originally designed to prevent nuclear disasters, has become the most practical framework for regulating AI technology, effectively imposing a “moral constraint” on all those working in cutting-edge fields.

Detailed Explanation of the Key Points

1. Why a Cold War-era document is the solution to today’s AI challenges?

Many might wonder how rules designed for the nuclear era can apply to AI. The core concerns of both eras are similar: during the Cold War, there was fear that scientists’ work on nuclear technology could lead to uncontrollable outcomes that would destroy humanity; today, there is concern that AI algorithms could become uncontrollable, potentially leading to autonomous harm, the displacement of human jobs, or the manipulation of information, stripping humans of control over their own fate.

Interestingly, most existing research ethics codes focus on internal disciplines such as academic integrity and data privacy, but the Uppsala Code addresses the ultimate question of whether research could lead to global destruction. It hits the most critical risks of the AI era, making it an effective solution to the current challenges.

2. The most stringent aspect of the code: no one can shirk responsibility

In the past, when AI-related issues arose (such as AI fraud or drone attacks on civilians), the common defense was, “I’m just a coder; the boss told me to optimize the algorithm, so the consequences are the boss’s or the users’ problem, not mine.” The Uppsala Code eliminates this excuse by clearly stating that researchers must:

  • Not damage the environment or harm future generations,
  • Not assist the military in developing weapons or oppressive surveillance systems,
  • Be aware of potential negative outcomes and inform the public,
  • And immediately withdraw from unethical projects and explain their reasons.

This code shifts the responsibility from large companies and governments to individual researchers, akin to the Hippocratic Oath for doctors—scientists cannot knowingly harm people with their work.

3. Why government regulation alone is insufficient? The Uppsala Code fills a critical gap

While countries are regulating AI, these efforts are often reactive. By the time a problem occurs, the technology may already be widespread. For example, an AI algorithm that can crack all civilian passwords could spread before regulations are in place, causing irreparable damage. Some countries even facilitate the use of AI in military and commercial applications, ignoring ethical risks. The Uppsala Code, however, requires researchers to consider the potential consequences of their work at the earliest stages, preventing such issues from happening in the first place.

4. Recent AI developments reflect the application of the Uppsala Code

Two recent events in the AI community reflect the principles of the Uppsala Code: the international mathematical community’s “Leiden Declaration,” which emphasizes that AI should be a tool for mathematicians, not a substitute for human research; and the autonomous drones on the Russian-Ukrainian battlefield, which violate the principle that humans must retain control over technology.

5. Ethical guidelines are not a hindrance to AI progress

Some argue that strict ethical regulations will stifle AI development. However, the Uppsala Code aims to prevent technology from becoming a tool for harm. If scientists were solely focused on their own interests during the Cold War, humanity would not have survived. Similarly, if AI is allowed to be misused by capital and the military, public outrage could lead to a global ban on AI, depriving us of its benefits. By setting clear boundaries, we can ensure that AI serves humanity safely rather than creating a dangerous situation.

In summary, the Uppsala Code serves as a practical guide for regulating AI technology, ensuring that it develops in a way that benefits all rather than harming us.