In a recent announcement that has sent shockwaves through the tech community, Mark Zuckerberg, the founder of Facebook and current chief executive of Meta, has declared his intention to develop an artificial general intelligence (AGI) system. What’s even more alarming is his commitment to making it open source, raising concerns about the potential consequences of unleashing such a powerful technology upon the world.
Zuckerberg, in a Facebook post, emphasized the need for “full general intelligence” in the next generation of tech services. The idea of AGI, a theoretical AI system capable of surpassing human intelligence across various tasks, has long been a topic of both fascination and trepidation. Experts and politicians globally have voiced their concerns, fearing the possibility that AGI, if uncontrolled, could pose a significant threat to humanity.
The Meta chief executive’s assertion that Meta would consider making its AGI open source has drawn criticism from prominent figures in the field of artificial intelligence. Dame Wendy Hall, a professor of computer science and a UN advisory body member on AI, expressed her fear, deeming the prospect of open source AGI as “really very scary” and labeled Zuckerberg’s consideration as irresponsible.
Hall warned against releasing open source AGI before establishing proper regulatory frameworks. She stated, “In the wrong hands, technology like this could do a great deal of harm. It is so irresponsible for a company to suggest it.” Despite Zuckerberg’s assurance that Meta would act responsibly, experts argue that decisions regarding AGI should not rest solely in the hands of a tech company.
Last year, Meta, along with other tech firms, pledged to allow governments to vet AI tools before and after release at a global AI safety summit in the UK. However, the idea of open sourcing AGI has ignited a new level of concern. Dr. Andrew Rogoyski, a director at the Institute for People-Centred AI, emphasized the need for international consensus in making decisions that could have world-saving or catastrophic consequences.
Criticism of Meta’s open-source approach isn’t new. Last year, the company’s decision to open source its Llama 2 AI model faced backlash, with experts comparing it to “giving people a template to build a nuclear bomb.”
The debate around AGI is gaining momentum as other tech giants like OpenAI and Google DeepMind also pursue AGI development. OpenAI’s chief executive, Sam Altman, cautioned that further AI advances might be impossible without breakthroughs in energy provision, such as nuclear fusion.
Zuckerberg, in an interview, did not provide a timeframe for AGI development but hinted at Meta’s significant investment in infrastructure for creating new AI systems. As the tech world navigates the uncharted waters of AGI, the fear of unleashing a force beyond human control looms large, prompting calls for caution, regulation, and international collaboration. The question remains: Is the pursuit of AGI an ambitious leap into the future or a perilous plunge into the unknown?