Zuckerberg Backs Safe AI Development Amid Debate Over Slowing Progress

In a post on X, Zuckerberg referenced a blog post he wrote last month and said AI labs have a responsibility to train their models safely.

“Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens. The reality is: People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned,” he wrote.

Zuckerberg said trust and alignment are extremely important to the progress of AI models.

“There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind,” he said.

“Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well,” he added.

Zuckerberg said Meta had delayed the release of Muse for several months to focus on safety and security.

“Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us,” he said.

The Meta boss also supported the idea of engaging independent evaluators to assess AI systems developed by labs.

“I'm proud of the security foundations we've built. Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators,” Zuckerberg wrote.

Zuckerberg further argued that maintaining a balance of power is key as AI technology develops.

“Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well. I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do,” he said.

In his earlier blog post, Zuckerberg discussed the opportunities and challenges associated with superintelligence.

“The defining questions of our age are who will have access to superintelligence and what will we direct it towards. Will it be centralized and restricted to a few institutions, or will it be a tool that empowers everyone?” he wrote.

Zuckerberg said Meta's approach is based on individual empowerment as a source of prosperity, invention as the primary purpose of superintelligence, and a balance of power as the foundation of safety.

“All new technologies create opportunities and challenges. Superintelligence will be among the most important technologies in history, so its opportunities and challenges will likely be greater than any we've seen in our lifetimes. We should take this very seriously,” he added.

However, Zuckerberg rejected fears of an extinction-level event and said Meta remained committed to developing AI based on principles of individual empowerment.

“It is surprising that the discourse from many developing AI is so filled with doom. I do not understand why anyone who believes that AI will eliminate most jobs and much of humanity's relevance would rush to build that future,” he wrote.

He also questioned the idea that AI's risks can only be addressed through an extreme concentration of power.

“The notion that AI is so dangerous that the only safe path is an extreme concentration of power seems inherently problematic,” Zuckerberg said.

He added that it is increasingly important to have a clear philosophy and set of values for ensuring that superintelligence benefits humanity.

“Meta is committed to building with the principles of individual empowerment as the source of prosperity, invention as AI's purpose, and a balance of power favouring people as the foundation for addressing safety risks,” he wrote.

The debate over whether to slow AI development is being described as an inflection point for the industry. What began as a question of principle, after Anthropic researcher Jacob Coxon publicly resigned and warned of the potential risks posed by building “superintelligent” systems, has developed into a broader debate over how the AI industry should evolve.