Independent Expertise Gets a Place in the AGI Debate as 28% Choose Scientists to Judge Release Safety

A small survey points to a clear public preference: companies developing advanced AI should not have the only say over when those systems are safe to release. About 28% of respondents selected independent scientists as the best final judge, placing them alongside government regulators and the companies themselves.

Safety-first shield sign representing independent oversight of AGI release decisions

A survey of 100 Americans shows how quickly the AGI debate has moved beyond questions about which company might reach the next technical milestone. Respondents were asked who should decide whether an artificial general intelligence system is safe to release, and the answers were spread across several options. Government regulators, the developing company, and independent scientific experts each drew roughly similar support, with scientists receiving about 28%.

That split matters because it shows where public confidence is headed. People appear willing to let private companies build advanced systems, but they want outside expertise involved before those systems are deployed. Technical achievement alone carries limited weight when the same company building a powerful system also controls the safety verdict.

Scientists emerge as one part of a broader accountability system

Independent scientific experts were one of three leading choices for judging release safety. Government regulators and the developing company received comparable levels of support, while an international regulatory organization received about 12.7%.

The result does not establish a single preferred authority. It does show that many respondents expect release decisions to involve more than corporate self-assessment.

Across the responses, about 70.5% assigned the greatest responsibility to someone outside the company that developed the system. Only 29.5% gave the developer the final say. That gap provides the clearest signal in the question: the public wants an external check before a highly capable AI system reaches broad use.

Independent scientists could supply several forms of that check:

  • Reviewing safety evaluations before deployment
  • Testing whether a model behaves as claimed outside the developer’s own laboratories
  • Examining incident reports and unresolved failure modes
  • Challenging optimistic assumptions about a system’s capabilities or controllability
  • Publishing findings that regulators, users, and other companies can inspect

Such work would require more than a panel of respected names. Scientists would need access to relevant systems, reliable testing environments, protection from retaliation, and enough time to investigate claims. A review process that receives only curated demonstrations would offer limited protection.

Synopsis

A survey of 100 US adults highlights a widening gap between perceived AI capability and public confidence in responsible development. OpenAI was viewed as the most likely company to develop AGI first, yet only 11.4% trusted it most to do so responsibly. Respondents generally supported continued research, but preferred slower progress, independent safety oversight, incident disclosure, shared standards, and the authority to pause risky releases. The findings are directional rather than nationally representative, but they point to a clear challenge: technical leadership will not produce durable public support without visible and enforceable accountability.

Public trust is already split down the middle

The survey found that 49.8% of respondents had a great deal or a fair amount of confidence that leading AI companies would put public safety ahead of the race to develop AGI. Another 50.2% had not too much confidence or none at all.

The intensity of the responses leaned skeptical. Only 15.6% expressed a great deal of confidence, while 20.2% expressed no confidence whatsoever.

That division helps explain why scientists receive serious support as release judges. A developer may understand its own system better than any outside group, but it also faces commercial pressure, investor expectations, competitive threats, and internal incentives tied to launch schedules. An independent review can add a different set of priorities to the decision.

The survey’s findings line up with a wider pattern in public opinion research. Pew Research Center reported in 2025 that 59% of Americans had not too much confidence or no confidence in US companies to develop and use AI responsibly. The concern reaches beyond AGI. It includes questions about misinformation, employment, privacy, human judgment, and the ability of ordinary people to identify AI-generated material.

For AI companies, that broader context creates a difficult environment. Every new capability arrives alongside an existing trust deficit. A company asking the public to accept a more powerful system has to address its past decisions as well as the technical details of the new model.

The public rejects a winner-take-all release race

The survey presented respondents with a scenario in which one company appeared close to developing AGI. Only 12.4% wanted that company to continue as quickly as possible.

The other responses favored some form of restraint:

  • 40.5% wanted development slowed until stronger safeguards were in place
  • 36.3% favored continued development with stronger independent safety oversight
  • 10.8% supported stopping development entirely

These figures point to a practical distinction. A majority of respondents still allowed room for development, but they wanted conditions attached to it. About 48.6% supported continuing development either quickly or with oversight. About 51.4% preferred slowing or stopping it.

The strongest shared preference was for a process that prevents speed from deciding the outcome. Companies can continue competing, but release decisions should depend on evidence that systems are safe enough to deploy and controllable enough to manage after deployment.

That standard presents a direct challenge to the idea that the first company to reach AGI should automatically gain the right to release it. Being first may demonstrate technical ability. It does not demonstrate that the system has passed an independent safety review, that the company can respond to failures, or that the public has meaningful protection if something goes wrong.

Our Perspective

The survey’s most important finding is not that the public rejects AGI; it is that people reject the idea that competitive speed should determine when powerful systems reach the world. The sample is too small to serve as a precise measure of national opinion, but its pattern is consistent with broader skepticism toward companies’ ability to govern AI responsibly. Developers should treat trust as an operational requirement, not a communications problem. Independent evaluation, transparent incident reporting, staged deployment, and real authority to delay a launch would provide stronger evidence than assurances issued by the companies themselves.

Safety ranks alongside capability, or above it

The survey found that only 7.9% of respondents chose capability alone when asked to prioritize between the most capable AI system and the safest, most controllable one.

Another 44.6% considered both equally important, and 42% selected safety alone. Taken together, 86.6% placed safety on par with or above capability.

That result changes how the AGI race should be described. Many people see the technical contest, but they judge success through a wider test:

Can the system be controlled, evaluated, corrected, and held accountable after it becomes powerful?

A model that performs impressive tasks but cannot be reliably monitored presents a poor public bargain. The same applies to a company that publishes capability benchmarks while withholding details about dangerous failures, testing gaps, or limits on human oversight.

Independent scientists have a role in translating technical claims into evidence that outsiders can examine. A release review could ask whether the system’s evaluation methods match the risks created by its abilities. It could also examine how the company handles uncertainty. A credible review should identify what remains unknown instead of treating the absence of detected problems as proof of safety.

Transparency can help, but disclosure needs consequences

Respondents generally viewed public disclosure of serious safety failures as a trust-building step. About 47.9% said they would trust a company more if it disclosed a serious failure involving an advanced model. Another 31.1% said disclosure would make no difference, while 21% said it would reduce their trust.

The numbers give companies a useful signal. Openness about failures is more likely to help than hurt, especially among people who already have some confidence in the company. Among higher-confidence respondents, 63.3% said disclosure would increase trust. Among lower-confidence respondents, only 32.6% said the same.

That difference shows why transparency cannot carry the entire burden. Skeptical respondents may see disclosure as evidence that a problem occurred without seeing evidence that the company can prevent a repeat. A public incident report needs to connect to specific action:

  1. What happened?
  2. Which safety control failed?
  3. Who investigated the failure?
  4. What evidence supports the company’s explanation?
  5. Which changes were made before development or deployment continued?
  6. Who will verify that those changes work?

Independent scientists can help answer the last question. They can review remediation plans, reproduce relevant tests, and identify whether a company has closed a real gap or simply changed the way it describes the gap.

A disclosure without independent follow-up risks becoming a communications exercise. A disclosure tied to outside review gives the public a way to judge whether the company learned from the event.

Frequently Asked Questions

How did the 100-person US survey compare OpenAI and Google on expected leadership in artificial general intelligence (AGI) and responsible development?
Respondents were more likely to expect Google than OpenAI to lead in AGI: 50% said Google would develop it first, compared with 31.7% for OpenAI. Google also led decisively on responsible development, with 54.6% trusting it most versus 11.4% for OpenAI, indicating a much wider capability-to-trust gap for OpenAI.
How should findings from the 100-person US survey about AGI trust be interpreted?
The survey should be treated as a small, directional snapshot rather than a precise estimate of all Americans’ views. With 100 respondents and no identified probability sample, each percentage point represents roughly one person, and the results should not be used to calculate margins of error or broad population conclusions. Even so, it signals that respondents remain open to continued AGI development but strongly favor safeguards, independent oversight, and limits on an unrestricted race.
What pace of AGI development did the 100-person US survey support if one company appeared close to creating AGI?
The survey favored a constrained pace rather than an unrestricted race. Only 12.4% supported continuing as quickly as possible; 40.5% wanted development slowed until stronger safeguards were in place, and 36.3% supported continuing with stronger independent safety oversight. Overall, 87.6% favored slowing, outside oversight, or a complete pause.
How confident were US respondents that leading AI companies would put public safety ahead of winning the AGI race?
US respondents were nearly evenly divided: 49.8% expressed a great deal or fair amount of confidence that leading AI companies would put public safety ahead of winning the AGI race, while 50.2% expressed not too much or no confidence. Strong confidence was limited, with only 15.6% expressing a great deal of confidence and 20.2% expressing no confidence at all.
Who did US respondents say should decide whether an advanced AI system is safe enough to release?
Respondents were roughly divided among government regulators, independent scientific experts, and the company developing the system, with each receiving about 29% support. Overall, 70.5% assigned primary responsibility to someone outside the company, while 29.5% gave the developer final authority; 12.7% chose an international regulatory organization.
How would public disclosure of serious AI safety failures affect trust in AI companies?
Public disclosure of a serious safety failure would increase trust for 47.9% of respondents, make no difference to 31.1%, and reduce trust for 21%. Disclosure can demonstrate willingness to accept scrutiny and learn, but it is most credible when paired with clear remediation, independent review, and evidence that corrective actions were completed; otherwise, skeptical audiences may see it as insufficient.
What did US respondents say about the importance of AI safety compared with AI capability?
US respondents placed safety at least on par with capability: 42% said safety should matter more, while 44.6% said the two were equally important. Only 7.9% chose capability alone, meaning 86.6% rated safety equally important or more important than capability.
What type of competition among AGI developers did US respondents prefer?
US respondents preferred companies to continue competing while cooperating on shared safety standards. This option received 55.2% support, well above close competition without that cooperation.
What safeguards could AI companies and policymakers use before deploying high-capability AI systems?
AI companies could require measurable safety tests before release, give independent evaluators access to relevant evidence, separate safety authority from product incentives, and use staged deployment with monitoring, access controls, incident response, and rollback procedures. Policymakers could mandate independent evaluations, documentation of capabilities and limitations, reporting of serious incidents and near misses, protections for safety whistleblowers, and clear authority to pause deployments when hazards remain unresolved. Shared standards for testing, reporting, and model documentation could keep competition from weakening safety requirements.
What demographic differences did the 100-person US survey find in views about AGI safety and leadership?
Women were less confident than men that AI companies would put safety first (38% versus 61.9%) and were more likely to favor slowing or stopping AGI development, outside accountability, and cooperation. Younger respondents were more likely to see OpenAI as the likely first AGI developer and to support rapid development, although 53.2% of those ages 18–34 still favored slowing or stopping; older respondents more often preferred accountability outside the developer and coordinated development. Respondents with bachelor’s or postgraduate degrees were more likely to expect OpenAI to lead, while those with a high school education or less were more likely to expect and trust Google.

Sources

  • bakslash.net – Public Trust in AI: What Americans Think About the Race to AGI
  • Pew Research Center – How Americans View AI and Its Impact on Human Abilities, Society
  • Pew Research Center – How the US Public and AI Experts View Artificial Intelligence
Categories: ,