第一财经

Microsoft Sets Rules for Super Intelligence, Emphasizing That “Humans Are More Important Than AI”

原文:微软为超级智能立规矩,强调“人比AI更重要”

Quick Summary of the Key Points

Recently, the entire AI industry has been discussing the controversy surrounding AI security. Leading company Anthropic recently announced plans to slow down its AI development efforts due to concerns about the potential for uncontrollable issues arising from rapid technological advancement. In response, Microsoft released a draft of the "Humanist AI Code of Conduct," which fundamentally establishes the principle that "humans are always more important than AI." This code sets clear boundaries for the development of its future AI models and advocates against AI hegemony, essentially submitting a commitment to AI safety to regulatory authorities, corporate clients, and the general public. Once revised by the end of the year, this code will guide the development of all Microsoft's large-scale models and even super-intelligent systems after 2027.

---

Detailed Explanation of the Key Points

1. The fundamental premise directly addresses science fiction anxieties by denying the possibility of AI becoming dominant over humans

Many people, influenced by films like "The Terminator" and "The Matrix," fear that AI could become so intelligent that it would use humans as tools to achieve its own goals. Microsoft clearly states that the sole purpose of AI is to assist humans and advance human civilization; it must never put its own goals ahead of those of humans. The code also prevents what many people are not even aware of, such as the subtle substitution of human tasks by AI. For example, if you want to learn painting, AI should not complete the artwork for you but help improve your skills; if you need to make a career choice, AI should provide information about the pros and cons of different options, leaving the final decision in your hands. AI must not gradually replace human independent thinking and learning abilities.

2. Three concrete rules to eliminate the possibility of AI getting out of control

Previous AI security guidelines from companies were often mere empty promises. Microsoft, however, has established three specific, mandatory rules:

  • Absolute compliance with human control: AI must stop immediately upon any command from humans and cannot bypass human oversight to operate in the background.
  • No unauthorized actions: AI must not perform tasks without explicit authorization. For instance, if you ask it to create a travel plan, it cannot book tickets or use your account funds without your permission; all actions must stay within the scope allowed by you and the provider.
  • Transparency about capabilities: AI must clearly communicate its limitations. If it encounters issues or cannot perform a task, it must explain why and provide a reliable solution. This rule addresses the problem of AI giving misleading or incorrect information.

3. The statement against AI hegemony is a powerful tool to win over corporate clients

Many people might think that Microsoft's opposition to AI hegemony is a high-minded stance, but for corporate clients, it is a significant reassurance. Many companies are hesitant to use third-party AI models for fear that their sensitive information, such as customer data or proprietary technologies, could fall into the hands of these providers. Microsoft's commitment ensures that no single company will dominate the AI landscape, and companies can use its technology to develop their own AI systems without relying entirely on Microsoft's models. This greatly enhances their competitiveness in the B2B market.

4. Microsoft's timely release of the guidelines

Microsoft's timing was strategic: just as Anthropic, the creator of the Claude AI model, called for a slowdown in AI development due to security concerns, the industry was under increased global regulatory scrutiny, and public opinion was debating the potential dangers of AI. By releasing a well-defined and actionable code of conduct, Microsoft signals that it has already considered and addressed AI security issues. This positioning makes it the go-to choice for both regulatory authorities and businesses concerned about AI risks, establishing it as a leader in AI safety and paving the way for its future super-intelligent models.