RetroFed Forum
Your home away from modern life.
AIs can’t stop recommending nuclear strikes in war game simulations
Post Reply
AuthorMessage
Grail multiverse.soulism.net Grail@multiverse.soulism.net
Joined: 2026-01-14
#102 · Quote Reply

no, its incapable of making choices because there is nothing there to make the choices. Its just fancy way of interacting with the data it has been trained with. Though i suppose if there was a way to let llm function "live" instead of only by responding to queries, it could be possible to at least test if it could act on its own, but i dont think it can -> we would know by now because it wo...

No, LLMs are not just an interface for accessing training data. If that were true, then their references would actually work. The fact that LLMs can hallucinate and make stuff up proves that they are not just accessing the training data. The ANN is generating new (often incorrect) information.

1
GladiusB lemmy.world GladiusB@lemmy.world
Joined: 2023-07-01
#103 · Quote Reply

Story goes that Reagan got freaked out after watching the film and asked the chairman of the joint chiefs of staff if it'd be that easy to hack into the US military. After a week of looking into it came the answer: “no, the problem is much worse than that”, and fifteen months after having watched it signed the confidential directive "National Policy on Telecommunications and Automated Informati...

The war room was actually much more high tech than their war room at the time. They realized they needed to invest in computers. Fast.

3
unwarlikeExtortion lemmy.ml unwarlikeExtortion@lemmy.ml
Joined: 2024-01-26
#104 · Quote Reply

No, that I can't answer — it would depend entirely on the level of fallout and where it happens to land. You would need to be able to perfectly, and I mean perfectly, predict weather months in advance in order to prepare accordingly. The reaility is that for an AI, or rather an AGI, to make the choice to launch nukes would require them to reach a point where they accept the potential loss of th...

An AI can easily start nuclear war, as can a human.

The only thing preventing a nuclear disaster are all the institutional measures limiting its accessiblity.

If you gave a single human (or a single AI) access to a magic no-strings-attached 'Send a Nuke' button, either the human/AI is the second coming of Jesus Christ, or a nuke will befall some unlucky portion of the population sooner or later. Bonus points if people can talk to the AI or if access to the button is hereditary.

1
willington lemmy.dbzer0.com willington@lemmy.dbzer0.com
Joined: 2023-08-16
#105 · Quote Reply

Play stupid games, win stupid prizes.

-1
LoremIpsumGenerator lemmy.world LoremIpsumGenerator@lemmy.world
Joined: 2023-12-02
#106 · Quote Reply

Did we not learn from Sarah and John Connor long ago?

6
athatet lemmy.zip athatet@lemmy.zip
Joined: 2025-09-12
#107 · Quote Reply

Now tell that to your high-school English teacher when they assign you a research project.

You aren’t they.

3
reksas sopuli.xyz reksas@sopuli.xyz
Joined: 2023-06-11
#108 · Quote Reply

No, LLMs are not just an interface for accessing training data. If that were true, then their references would actually work. The fact that LLMs can hallucinate and make stuff up proves that they are not just accessing the training data. The ANN is generating new (often incorrect) information.

if the hallucinations are result of something actually happening in the background, that would be quite interesting. It would also be very bad for rest of us since it might mean the billionaires who own the damn things would be in position to get even worse deathgrip on our world. If they ever manage to create agi, the worst thing that could happen isnt that it breaks free and enslaves humanity but that it doesnt and it helps the billionaires enslave us further and make sure we cant ever even think about fighting back.

But i think the hallucinations are based on incorrect information in the training data, they did train it from stuff from reddit too. Any and everything will be considered true, but if 99% of the data says one thing and 1% says another, then i think it will reference that 99% more often but it cant know that the 1% is wrong, can even real humans know it for certain? And since it cant evaluate anything, there might be situations where that 1% of data might be more relevant due to some nebulous mechanism on how it processes data.

llms have been made to act extremely helpful and subservient, so if they actually could "think" wouldnt they factcheck themselves first before saying something? I have sometimes just asked "are you sure?" and the llm starts "profusely apologizing" for providing incorrect information or otherwise correcting itself.

Though i wonder how it would answer if it truely had no initialization querys, as they have same hidden instructions on every query you make on how to "behave" and what not to say.

1
Hossenfeffer feddit.uk Hossenfeffer@feddit.uk
Joined: 2023-06-14
#109 · Quote Reply

It's torment nexuses all the way down...

5
Grail multiverse.soulism.net Grail@multiverse.soulism.net
Joined: 2026-01-14
#110 · Quote Reply

if the hallucinations are result of something actually happening in the background, that would be quite interesting. It would also be very bad for rest of us since it might mean the billionaires who own the damn things would be in position to get even worse deathgrip on our world. If they ever manage to create agi, the worst thing that could happen isnt that it breaks free and enslaves humanity...

if they actually could "think" wouldnt they factcheck themselves first before saying something

No. They don't have access to the original training data, or to the internet. They're stuck remembering it the same way a human remembers something: with neurons. They cannot search the dataset for you. The best they can do is remember and tell you.

1
olduffer lemmy.world ODuffer@lemmy.world
Joined: 2023-06-18
#111 · (edited) Quote Reply

Such a great game!

Back when I was a single man, and lived on my own, I had a HD projector. I filled most of my living room wall with this game. Good times

1
reksas sopuli.xyz reksas@sopuli.xyz
Joined: 2023-06-11
#112 · Quote Reply

if they actually could "think" wouldnt they factcheck themselves first before saying something No. They don't have access to the original training data, or to the internet. They're stuck remembering it the same way a human remembers something: with neurons. They cannot search the dataset for you. The best they can do is remember and tell you.

but they do have access to internet? At least gpt can search based on the text it outputs when its processing the query

1
Duamerthrax lemmy.world Duamerthrax@lemmy.world
Joined: 2023-08-27
#113 · Quote Reply

https://www.youtube.com/watch?v=CYrQr0auPDM

1
Grail multiverse.soulism.net Grail@multiverse.soulism.net
Joined: 2026-01-14
#114 · Quote Reply

but they do have access to internet? At least gpt can search based on the text it outputs when its processing the query

Really? Must be a new feature, it didn't when I tried it. I know they can execute code, I guess the engineers added a search tool. Regardless, that tool isn't part of their fundamental design. It's something they have to go and access, and most of the time they won't. If you were to experiment by asking it to write a scientific paper, you'd find the references are garbage with broken links and nonexistent papers. Hallucinations. It's just making something plausible sounding up, the same as a lazy human might.

1
TonyTonyChopper mander.xyz TonyTonyChopper@mander.xyz
Joined: 2023-07-01
#115 · Quote Reply

Literally the plot of Metal Gear Solid Peace Walker

1
lorty lemmy.ml lorty@lemmy.ml
Joined: 2023-09-19
#116 · Quote Reply

High-ranking General: "Show me how to defeat my enemies"

Artificial "Inteligence": Just nuke them lmao

0
lorty lemmy.ml lorty@lemmy.ml
Joined: 2023-09-19
#117 · Quote Reply

It was willing to accept a conditional surrender, which was not an offer on the table. The options were unconditional surrender or invasion and pacification. The projected cost in lives of that operation was in the millions. The bombings of Hiroshima and Nagasaki combined didn't even kill 1/10th of those projections.

What made the Japanese surrender was the Soviet Union declaring war. They held out hope until the very end that the soviets would mediate a peace, even after the nukes.

0
reksas sopuli.xyz reksas@sopuli.xyz
Joined: 2023-06-11
#118 · Quote Reply

Really? Must be a new feature, it didn't when I tried it. I know they can execute code, I guess the engineers added a search tool. Regardless, that tool isn't part of their fundamental design. It's something they have to go and access, and most of the time they won't. If you were to experiment by asking it to write a scientific paper, you'd find the references are garbage with broken links and ...

yeah, i think that is because it knows how research papers should look like and how references look like, but since it has no reasoning, it will just do whatever. I used gpt to diagnose my problem with internet getting cut off and it determined its because of drivers, which sounds reasonable. Then it suggested that i download the latest ones and it did link to correct website but it also tried to download stuff that doesnt exist. No idea how it determined the version numbers and such, maybe based on earlier patterns.

But it isnt making stuff up, its just outputting the best data it can based on what it has been trained with and what it can find. Its not lazyness but just doing what its doing. Just like code that isnt doing what you want it to do isnt doing it out of malice but because there is a mistake in the code.

1
NihilsineNefas slrpnk.net NihilsineNefas@slrpnk.net
Joined: 2025-06-19
#119 · (edited) Quote Reply

Holy shit I almost took you seriosly. Then I read the part about how "them" created AIDS lmfaoooo And I thought I was a good shitposter. Whew. I am thoroughly outclassed. People villify nuclear weapons to ludicrous proportions, and that was kind of my whole point. Would you, as a thinking and feeling person, if given the choice, choose to be instantly annihilated by a nuclear bomb or live to be...

Congratulations for failing to address anything I said.

In response to your piss poor argument of "would you rather suffer a poison that makes your children deformed and gives you and everyone in your village/town/city turbocancer, or would you rather have your city turned into a smoldering crater?"

Considering that modern nuclear weapons, excluding a couple of nuclear artillery shells, 'viable deterrent' devices and dirty bombs, are Thermonuclear devices capable of up to and beyond the triple digit megaton range.

The weapon known colloquially as 'Tsar Bomba' would have had a yield of 100Mt if they used the original Uranium tamper instead of the Lead they used instead, so as to stop it from irradiating the entire area of their test site. As a result it 'only' had a yield of 50Mt.

The blast wave it created circled the globe three times and shattered windows 500 miles away.

So, you tell me.

Turbocancer for you, your family, friends and their family, your neighbours, their neighbours, any livestock, pets or wild animals, because the scientists that got picked up by government agencies after the last war, wanted to test out their new chemical concoction on the newest group they had deemed to be an 'enemy'.

Or everything you've ever known being converted into a high temperature plasma setting fire to an area 60 miles in diameter, then afterwards everything downwind gets covered in radioactive ash (and also given turbocancer) when the 40 mile high cloud of debris falls out of the sky, all because the scientists that got picked up after the last war wanted to see how much physics they could fit into a bomb.

Or are you willing to admit that maybe comparing the two is like comparing Fluorine and TNT.

1
NihilsineNefas slrpnk.net NihilsineNefas@slrpnk.net
Joined: 2025-06-19
#120 · Quote Reply

Their only condition was that they wanted to keep the Emperor. It was ridiculous of the Allies to demand a wholly conditional surrender. All those people got blown up just to win the argument about that one point. They could have ran a conventional air bombing campaign against tactical targets, but they decided to drop nukes on a "tactical" target in the middle of a huge city! And then they did...

They could have ran a conventional air bombing campaign against tactical targets, but they decided to drop nukes on a “tactical” target in the middle of a huge city!>

I hate to be the bearer of bad news, but they did that AS WELL.

Operation Meetinghouse was the US firebombing of Tokyo on 9th-10th of March 1945 which destroyed a 16 square mile area, killing over 100,000 civilians and making millions homeless

There's also the B-29 raids america launched from the Marianas that lasted from 17 November 1944 until 15 August 1945

1
Grail multiverse.soulism.net Grail@multiverse.soulism.net
Joined: 2026-01-14
#121 · Quote Reply

yeah, i think that is because it knows how research papers should look like and how references look like, but since it has no reasoning, it will just do whatever. I used gpt to diagnose my problem with internet getting cut off and it determined its because of drivers, which sounds reasonable. Then it suggested that i download the latest ones and it did link to correct website but it also tried ...

It doesn't have access to the training data. It's not outputting training data, it's making up something that feels like the training data.

1
Grail multiverse.soulism.net Grail@multiverse.soulism.net
Joined: 2026-01-14
#122 · Quote Reply

They could have ran a conventional air bombing campaign against tactical targets, but they decided to drop nukes on a “tactical” target in the middle of a huge city!> I hate to be the bearer of bad news, but they did that AS WELL. Operation Meetinghouse was the US firebombing of Tokyo on 9th-10th of March 1945 which destroyed a 16 square mile area, killing over 100,000 civilians and making m...

Civilian homes are not tactical targets.

2
NihilsineNefas slrpnk.net NihilsineNefas@slrpnk.net
Joined: 2025-06-19
#123 · Quote Reply

Civilian homes are not tactical targets.

Could not agree more, hence why it's a war crime, yknow?

1
Post Reply Page 3 of 3   Goto page « First 1, 2, 3
Back to top