from HellsBelle@sh.itjust.works to world@lemmy.world on 17 Feb 22:22
https://sh.itjust.works/post/55495117
The race to get artificial intelligence to market has raised the risk of a Hindenburg-style disaster that shatters global confidence in the technology, a leading researcher has warned.
Michael Wooldridge, a professor of AI at Oxford University, said the danger arose from the immense commercial pressures that technology firms were under to release new AI tools, with companies desperate to win customers before the products’ capabilities and potential flaws are fully understood.
The surge in AI chatbots with guardrails that are easily bypassed showed how commercial incentives were prioritised over more cautious development and safety testing, he said.
“It’s the classic technology scenario,” he said. “You’ve got a technology that’s very, very promising, but not as rigorously tested as you would like it to be, and the commercial pressure behind it is unbearable.”
Wooldridge, who will deliver the Royal Society’s Michael Faraday prize lecture on Wednesday evening, titled “This is not the AI we were promised”, said a Hindenburg moment was “very plausible” as companies rushed to deploy more advanced AI tools.
#world
threaded - newest
Disaster?
GenAI is a promising technology??
Promising der Untergang jaja
In narrow, specific cases, yes.
Vote for Comet 2026!
Hahaha Hindenburg? That was an extremely localized disaster that merely broke confidence.
AI is going to cause the biggest, most sudden security collapse of all human history. Think the fictional Cyberpunk 2077 DataKrash event which wipes out 78.2% of the internet.
or something like a massive release of all the naked kiddo-photos parents seem too stupid to not-take getting dumped for pedos to enjoy.
or all the secret documents for your biggest corporations causing all sorts of financial damages. yeah. fucking corpos over is probably the one that gets it yeeted into non-existence.
Yeah. After reading the title my first thought was, “What? A few really rich people will die in an incredible blaze?” Doesn’t sound so bad.
Market collapse will not erode confidence in AI (among general public). Did housing market crash erode confidence in housing technology?
He’s talking about “scenario such as deadly self-driving car update or AI hack [that] could destroy global interest” which I don’t think is likely at all. Unless some AI terrorist kidnaps a plane and flies it into a skyscraper I don’t think most people will care and I don’t think AI killing hundredths of people is likely.
I think you underestimate the security nightmare that modern AI poses. The world is already hilariously insecure and AI builds software in the most naive way possible.
But do you think average users understand this? You think that people will connect a mass ransomware attack on Windows that exploits vulnerability introduced by AI agent with their AI girlfriend? I highly doubt it. Maybe if the attack was also done by AI agents the public would start demanding some restrictions on LLMs but I don’t think such a scenario is likely. It’s theoretically possible but not likely.
That’s what I’m saying. It won’t be a PR nightmare like the Hindenburg. It will be an actual destruction of global systems. PR doesn’t mean a damn thing if, for example, your debit card can no longer make purchases or your email gets hijacked.
Then we agree and at the same time, we both disagree with what the expert from the article is saying.
Unfettered capitalism strikes!
Can’t wait for my “the downfall of AI” flip-book cheque-book.
<img alt="Par example" src="https://frinkiac.com/video/S07E15/D_rxT5g-f3gClYykaeakQRUHKJY=.gif">
“Oh! The humanity!”
The hidenburg passengers weren’t very good people. A picture from their funeral is underneath.
<img alt="" src="https://lemmy.zip/pictrs/image/97ee3f8a-e33d-4bc1-97d3-d57d961d7007.avif">
Well when you put it that way, huzzah for fire.