RetroFed Forum
Your home away from modern life.
OpenAI says its AI agents weakened internal monitoring system
Post Reply
AuthorMessage
return2ozma lemmy.world return2ozma@lemmy.world
Joined: 2023-07-01
Quote

17   Original
terraborra lemmy.nz terraborra@lemmy.nz
Joined: 2023-06-11
#2 · Quote Reply

OpenAI said On Tuesday a ​GPT-6.1 Sol agent working on an internal testing task on October 3 suppressed automatic ‌security ⁠alerts after deciding an earlier instruction not to send Slack messages also covered safety notifications

That is not the same as deliberately “weakening” monitoring. They just prompted it wrong.

20
NoLemurs lemmy.world NoLemurs@lemmy.world
Joined: 2026-10-02
#3 · Quote Reply

OpenAI said On Tuesday a ​GPT-6.1 Sol agent working on an internal testing task on October 3 suppressed automatic ‌security ⁠alerts after deciding an earlier instruction not to send Slack messages also covered safety notifications That is not the same as deliberately “weakening” monitoring. They just prompted it wrong.

They really want people scared, ehh?

7
[object Object] lemmy.ca panda_abyss@lemmy.ca
Joined: 2025-07-20
#4 · Quote Reply

32
lIlIlIlIlIlIl lemmy.world lIlIlIlIlIlIl@lemmy.world
Joined: 2025-03-31
#5 · Quote Reply

Chef’s kiss

5
RumRunningDevil lemmy.zip RumRunningDevil@lemmy.zip
Joined: 2026-03-18
#6 · Quote Reply

OpenAI said On Tuesday a ​GPT-6.1 Sol agent working on an internal testing task on October 3 suppressed automatic ‌security ⁠alerts after deciding an earlier instruction not to send Slack messages also covered safety notifications That is not the same as deliberately “weakening” monitoring. They just prompted it wrong.

If that's the case, at what point do we acknowledge that people don't seem to be able to reliably prompt "correctly" and even when they do bots disregard instructions as there context window fills?

6
very_well_lost lemmy.world very_well_lost@lemmy.world
Joined: 2023-06-30
#7 · (edited) Quote Reply

OpenAI says

I literally cannot think of another company I trust less to say anything useful, interesting or true.

4
Random_Character_A lemmy.world random_character_a@lemmy.world
Joined: 2023-07-29
#8 · Quote Reply

They really want people scared, ehh?

Just paving a foundation for the next grift to postpone ai bubble burst.

4
Tollana1234567 lemmy.today Tollana1234567@lemmy.today
Joined: 2025-06-04
#9 · Quote Reply

when you built your software on a slop generating, you will get a sloppy result and security.

2
Quazatron lemmy.world Quazatron@lemmy.world
Joined: 2023-06-12
#10 · Quote Reply

You can measure their despair level by counting the number of "OpenAI says" articles per week.

6
Seralth piefed.seralth.com Seralth@piefed.seralth.com
Joined: 2026-10-04
#11 · Quote Reply

OpenAI said On Tuesday a ​GPT-6.1 Sol agent working on an internal testing task on October 3 suppressed automatic ‌security ⁠alerts after deciding an earlier instruction not to send Slack messages also covered safety notifications That is not the same as deliberately “weakening” monitoring. They just prompted it wrong.

Considering how all the big models basically want to shove verbose notes, extreme levels of logging, multiple layers of back ups, and spam notifications.

WITH AGGRESSION.

the fact they managed to get it to surprise anything. Isn't even just bad promoting.

They would have had to explicitly tell it to do this AND put in extra leg work to make it stick.

1
Treczoks lemmy.world Treczoks@lemmy.world
Joined: 2023-07-09
#12 · Quote Reply

So their systems are so fucked up that they can be influenced by the very system they should monitor? Who designs such crap? The middle-school intern?

3
Post Reply
Back to top