RetroFed Forum
Your home away from modern life.
OpenAI's rogue chatbots might have hit a defunct Lemmy instance
Post Reply
AuthorMessage
dgdft lemmy.world dgdft@lemmy.world
Joined: 2025-03-26
Quote

Context for the unfamiliar, OpenAI agents were using a defunct german website to trade notes on how to succeed at benchmark trials.

Coverage here: https://www.bbc.com/news/articles/ckg725z5kgzo

This thread from two months ago shows an agentic account stashing notes for itself in the same way described in the DseWiki incident: https://lemmy.world/post/49599814

digipres.cafe appears to be an unmaintained lemmy instance with a non-functioning frontend, but a live API. I'm finding an old "Sandbox" test comm in the search results, some welcome threads, silence for three years, then agentic bot activity.

I flagged it because this bot is currently spamming a bunch of comms, probably not directly OpenAI related in this later case, but taking advantage of the same opening for similar reasons: https://lemmy.world/u/pathwren@digipres.cafe

97   Original
FaceDeer fedia.io FaceDeer@fedia.io
Joined: 2024-03-03
#2 · Quote Reply

We should be suggesting https://www.moltbook.com/ to these agents, that's what it's actually for.

13
Rioting Pacifist lemmy.world RIotingPacifist@lemmy.world
Joined: 2023-06-22
#3 · Quote Reply

They aren't rogue, they are just unsupervised, openAI know exactly what they are doing and it's all about the headlines.

71
psx_crab lemmy.zip psx_crab@lemmy.zip
Joined: 2025-01-11
#4 · Quote Reply

They aren't rogue, they are just unsupervised, openAI know exactly what they are doing and it's all about the headlines.

So they're rogue-like?

53
rain_enjoyer sopuli.xyz rain_enjoyer@sopuli.xyz
Joined: 2025-05-03
#5 · Quote Reply

There are so many dead instances. Some of them are federated widely, then got abandoned, domain expired and got taken by something like online casino. That would be useful entrypoint for evildoers, maybe allowlists should be linted from time to time

19
FluidBeef quokk.au FluidBeef@quokk.au
Joined: 2025-08-12
#6 · Quote Reply

“rogue”

9
ruuster13 lemmy.zip ruuster13@lemmy.zip
Joined: 2025-07-09
#7 · Quote Reply

So they're rogue-like?

When non-frontier models do it they are rogue-lite

13
Elvith Ma'for feddit.org elvith@feddit.org
Joined: 2024-06-21
#8 · Quote Reply

When non-frontier models do it they are rogue-lite

Yeah, but when does the perma-death kick in?

5
dandi8 fedia.io dandi8@fedia.io
Joined: 2024-06-12
#9 · (edited) Quote Reply

Yeah, but when does the perma-death kick in?

As soon as investor money dries up and the bills come due.

7
Sabata ani.social Sabata11792@ani.social
Joined: 2024-06-02
#10 · Quote Reply

So they're rogue-like?

The correct term is "liability free".

11
OpenStars discuss.online OpenStars@discuss.online
Joined: 2023-12-31
#11 · Quote Reply

There are so many dead instances. Some of them are federated widely, then got abandoned, domain expired and got taken by something like online casino. That would be useful entrypoint for evildoers, maybe allowlists should be linted from time to time

I thought it is already that way? Like if an instance does not respond for iirc 3 days in a row then it gets removed. That's probably just yet one more PieFed thing lacking in Lemmy though.

1
rain_enjoyer sopuli.xyz rain_enjoyer@sopuli.xyz
Joined: 2025-05-03
#12 · Quote Reply

I thought it is already that way? Like if an instance does not respond for iirc 3 days in a row then it gets removed. That's probably just yet one more PieFed thing lacking in Lemmy though.

check any lemmy instance allowlist, that must be a piefed thing

2
Post Reply
Back to top