A group of senior experts, including two “godfathers” of AI, warns that the world is not adequately prepared for advancements in artificial intelligence. They emphasize that governments are lagging in regulating this technology.
The experts point out that the shift towards autonomous AI systems by tech companies could greatly enhance the impact of AI. They stress the need for governments to have safeguards in place to trigger regulatory action when AI products reach a certain level of capability.
Jeffrey Hinton and Yoshua Bengio, two of the three “godfathers of AI,” along with 23 other experts, made recommendations for a government safety framework in a report titled “Managing Extreme AI Risks Amid Rapid Advancements.”
The report calls for stricter requirements as technology advances rapidly, increased funding for AI safety institutions, stricter risk checks by tech companies, and limitations on the use of autonomous AI systems in crucial social roles.
The experts express concerns about the lack of AI safety research and governance mechanisms to prevent misuse and recklessness. They warn that unchecked progress in AI could lead to severe consequences, such as a loss of human control over AI systems or even the potential alienation or extinction of humanity.
The development of “agent” AI systems, which can operate autonomously to complete tasks, represents the next stage in commercial AI advancement. These systems have the potential to significantly impact various aspects of society.
After Newsletter Promotion
Recent advancements in AI, such as GPT-4o by OpenAI and Google’s Project Astra, highlight the growing capabilities of AI systems. These developments raise concerns about the potential impact of AI on society and the need for proactive safety measures.
Authors of the report include renowned figures like Yuval Noah Harari and the late Daniel Kahneman. The recommendations presented in this report aim to address the challenges posed by the rapid advancements in AI.
Government officials from various countries are set to discuss AI safety measures at the AI Seoul Summit. These discussions are crucial in ensuring that AI technology is developed and regulated responsibly to mitigate potential risks.
Source: www.theguardian.com
