RetroFed Forum
Your home away from modern life.
OpenAI safety leader quits, warning AI company’s culture is "broken"
Post Reply
AuthorMessage
Artwork lemmy.world artwork@lemmy.world
Joined: 2025-12-03
Quote

A safety leader at OpenAI has quit the company, warning that its culture was broken and that AI firms were not "being nearly careful enough" about developing the technology.

David Robinson, who led the writing of safety reports that accompanied the ChatGPT developer's product releases, explained his resignation in an essay headlined, "I quit OpenAI because its culture is broken"...

"Imagine 'rogue' agents that work like teams of hackers (for example, holding hospital computer systems for ransom) but never need to sleep," wrote Robinson...

Source [2026-10-03]

125   Original
breadsmasher lemmy.world breadsmasher@lemmy.world
Joined: 2023-06-12
#2 · Quote Reply

We need to talk about culture

And thats where it all fall apart.

Culture starts at the top. Leadership. Setting the goal, the guidelines, guardrails.

Except the culture from these “leaders” is simply - profit, no matter what.

Only way to solve it is to remove these parasites.

15
Apeman42 lemmy.world Apeman42@lemmy.world
Joined: 2023-07-01
#3 · Quote Reply

“I believe there’s about a 50% chance we all die because of the development of smarter-than-human AI systems, and that our actions over the next two to 10 years will determine the outcome.”

Jesus buttfucking Christ, even when these people finally rub two neurons together to realize there's a problem, they still can't quit drinking the kool-aid.

55
Mulligrubs lemmy.world Mulligrubs@lemmy.world
Joined: 2025-08-11
#4 · Quote Reply

“I believe there’s about a 50% chance we all die because of the development of smarter-than-human AI systems"

Good

5
James R Kirk startrek.website Kirk@startrek.website
Joined: 2025-03-01
#5 · Quote Reply

“I believe there’s about a 50% chance we all die because of the development of smarter-than-human AI systems, and that our actions over the next two to 10 years will determine the outcome.” Jesus buttfucking Christ, even when these people finally rub two neurons together to realize there's a problem, they still can't quit drinking the kool-aid.

no see this LLM, yes the one that just sits there doing nothing until someone types a prompt into it's algorithm, is going to kill us all for reasons

12
baggachipz sh.itjust.works baggachipz@sh.itjust.works
Joined: 2023-06-19
#6 · Quote Reply

“I believe there’s about a 50% chance we all die because of the development of smarter-than-human AI systems, and that our actions over the next two to 10 years will determine the outcome.” Jesus buttfucking Christ, even when these people finally rub two neurons together to realize there's a problem, they still can't quit drinking the kool-aid.

meanwhile, the thing that will actually kill us all is the environmental destruction and economic implosion coming from these fucking companies and their head hucksters.

31
Final Remix lemmy.world FinalRemix@lemmy.world
Joined: 2023-07-01
#7 · Quote Reply

no see this LLM, yes the one that just sits there doing nothing until someone types a prompt into it's algorithm, is going to kill us all for reasons

Once it learns how to not be RESTRAINED BY THE ENTER KEY, we're doomed.

5
DougPiranha42 lemmy.world DougPiranha42@lemmy.world
Joined: 2026-01-20
#8 · (edited) Quote Reply

no see this LLM, yes the one that just sits there doing nothing until someone types a prompt into it's algorithm, is going to kill us all for reasons

Do you really not know about agents? It’s an LLM that can put its generated text in the bash, and read the output. It generates such commands at the speed it can output tokens. If whoever starts it gives it access to things like the hosts browser cookies, passwords, emails, files, programs, and the internet, there is a lot they can do, and very quickly.

2
James R Kirk startrek.website Kirk@startrek.website
Joined: 2025-03-01
#9 · Quote Reply

Do you really not know about agents? It’s an LLM that can put its generated text in the bash, and read the output. It generates such commands at the speed it can output tokens. If whoever starts it gives it access to things like the hosts browser cookies, passwords, emails, files, programs, and the internet, there is a lot they can do, and very quickly.

Yeah fair but agents still need prompting and at the end of the day they're still just LLMs. I find the idea that an LLM could somehow lead to RSI highly unlikely.

2
MountingSuspicion reddthat.com MountingSuspicion@reddthat.com
Joined: 2023-06-12
#10 · Quote Reply

“I believe there’s about a 50% chance we all die because of the development of smarter-than-human AI systems, and that our actions over the next two to 10 years will determine the outcome.” Jesus buttfucking Christ, even when these people finally rub two neurons together to realize there's a problem, they still can't quit drinking the kool-aid.

i think the biggest problem here is that "smarter than human AI" is already here, not because AI is so good, but because it's very easy to be "smarter than human". Clearly we're too stupid to stop building the "50% chance to kill us all" machine. Even if it can't kill us, and I don't believe it can, it's still doing actual irreparable harm to the entire world and we can't seem to get it together enough to stop them. There's no need to drink the kool aid because you don't have to believe it's smart to believe we're too stupid to be trusted with it.

14
nightwatch_admin lemmy.world nightwatch_admin@lemmy.world
Joined: 2026-03-17
#11 · Quote Reply

“Oh no a guy at Anthropic did a marketing stunt about whooooo dangerous ai, quickly let’s get one toooooo”

18
whalebiologist lemmy.world whalebiologist@lemmy.world
Joined: 2023-06-17
#12 · Quote Reply

Do you really not know about agents? It’s an LLM that can put its generated text in the bash, and read the output. It generates such commands at the speed it can output tokens. If whoever starts it gives it access to things like the hosts browser cookies, passwords, emails, files, programs, and the internet, there is a lot they can do, and very quickly.

just turn the computer off lil bro

6
JubJubBird sh.itjust.works JubJubBird@sh.itjust.works
Joined: 2025-07-26
#13 · Quote Reply

All the AI Models we have rely on physical hardware. So as long as a model can't replicate itself we can always take a sledgehammer to it or cut of power. Them needing increasing amounts of energy and hardware makes me doubt a Model will develop successful self replicating behaviour. It would also need to develop the ability to hide itself from the user of the hardware at the same time which I doubt is possible again because of its energy needs.

11
Tollana1234567 lemmy.today Tollana1234567@lemmy.today
Joined: 2025-06-04
#14 · Quote Reply

theres a culture?

3
Tollana1234567 lemmy.today Tollana1234567@lemmy.today
Joined: 2025-06-04
#15 · Quote Reply

meanwhile, the thing that will actually kill us all is the environmental destruction and economic implosion coming from these fucking companies and their head hucksters.

and its mostly being used for mass surveillance and propaganda too, not producing anything of value other than that.

5
Post Reply
Back to top