A recent scandal involving non-consensually created intimate images generated by Elon Musk’s X, using its Grok AI tool, has highlighted what one pioneer in the field calls a lack of constraint within the artificial intelligence industry.
AI Industry Faces Scrutiny Over Unconstrained Development
Yoshua Bengio, a computer scientist widely regarded as one of the “godfathers of AI,” stated that technology companies are developing systems without sufficient technical and societal safeguards. Bengio spoke as he appointed historian Yuval Noah Harari and former Rolls-Royce chief executive Sir John Rose to the board of his AI safety lab.
X has announced it will prevent Grok from creating revealing images of individuals, even for premium subscribers, following public and political criticism. Asked about the implications of the incident, Bengio said the AI sector, while “not completely a free for all,” requires attention.
“It is too unconstrained and, because frontier AI companies are building increasingly powerful systems without the appropriate technical and societal guardrails, this is starting to have more and more visible negative effects on people,” Bengio said.
He believes improved governance, including the inclusion of individuals with strong moral principles on company boards, is part of the solution. Bengio has appointed Maria Eitel, founder of the Nike Foundation, as chair of his safety lab, LawZero, which launched last year. He earned the “godfather of AI” title after winning the 2018 Turing award, shared with Geoffrey Hinton, who later won a Nobel, and Yann LeCun.
Harari, author of Sapiens: A Brief History of Humankind, has frequently cautioned against the rapid development of AI and recently published Nexus, detailing his concerns. The former Swedish prime minister Stefan Löfven will serve as the first member of LawZero’s global advisory council.
“It’s not only a technical discussion for companies building frontier AI systems,” said Bengio. “It also comes down to what choices are made about AI that we consider to be morally right.”
Bengio, a professor of computer science at the University of Montreal, has secured $35 million (£26 million) in funding for LawZero. The lab is developing Scientist AI, a system designed to monitor autonomous systems – known as AI agents – and identify potentially harmful behavior.
“The whole construction of the board has been guided by the idea that we need a group of people who are extremely reliable in a moral sense, who can help us keep to LawZero’s mission of delivering technical solutions for trustworthy, highly capable, safe-by-design AI systems as a global public good,” said Bengio.
Last month, Bengio cautioned against granting AI rights, expressing concern over signs of self-preservation and arguing that humans should retain the ability to shut down such systems.
Discover more from Archyworldys
Subscribe to get the latest posts sent to your email.
