RetroFed Forum
Your home away from modern life.
AI Images Can Obscure the Reality of Factory Farms | Prompt revision steered AI-generated images towards idyllic scenes even when told to be realistic
Post Reply
AuthorMessage
usernamesAreTricky lemmy.ml usernamesAreTricky@lemmy.ml
Joined: 2023-06-01
Quote

An estimated 99% of farm animals in the United States are raised in concentrated animal feeding operations, or CAFOs. Often called factory farms, these facilities raise livestock in densely packed, enclosed spaces, with some housing tens of thousands of animals at one time.

[...]

In a new Technology in Society paper, Sheng and co-authors analyzed 4,800 independently generated images and found that ChatGPT defaulted to pastoral imagery when prompted to depict dairy and pig farms, even when they requested more realistic images. However, when researchers disabled the underlying prompt revision, the generated images depicted more intensive livestock farming.

135   Original
naught101 lemmy.world naught101@lemmy.world
Joined: 2024-05-08
#2 · (edited) Quote Reply

I don't know how someone can think "AI CAN obscure reality ..."

Obviously the fundamental truth is "AI does obscure reality ..." (Often this will be inconsequential, but that doesn't make it less true).

(Edit: especially an academic, FFS)

27
Blaster M lemmy.world Blaster_M@lemmy.world
Joined: 2023-07-08
#3 · Quote Reply

well, to be fair, we trained most models away from non-sfw images, so ugly images get cleaned up to look nice. That's a consequence of making image models that don't do things you don't want your kids to see

24
dermanus lemmy.ca dermanus@lemmy.ca
Joined: 2025-03-05
#4 · Quote Reply

well, to be fair, we trained most models away from non-sfw images, so ugly images get cleaned up to look nice. That's a consequence of making image models that don't do things you don't want your kids to see

I was thinking the same. They're probably weighted against gory, distressing images. Think of the headlines: " creates graphic slaughter house for children's storybook project"

17
GreenCrunch piefed.blahaj.zone GreenCrunch@piefed.blahaj.zone
Joined: 2025-08-08
#5 · Quote Reply

I was thinking the same. They're probably weighted against gory, distressing images. Think of the headlines: " creates graphic slaughter house for children's storybook project"

OLD MACDONALD NO!!!

8
frongt lemmy.zip frongt@lemmy.zip
Joined: 2025-07-31
#6 · Quote Reply

well, to be fair, we trained most models away from non-sfw images, so ugly images get cleaned up to look nice. That's a consequence of making image models that don't do things you don't want your kids to see

Yeah. If I asked you to draw a picture of a pig farm, you'd probably draw a barn and pigsty with pigs and a trough, too. Which way should it be weighted, if any?

7
usernamesAreTricky lemmy.ml usernamesAreTricky@lemmy.ml
Joined: 2023-06-01
#7 · (edited) Quote Reply

well, to be fair, we trained most models away from non-sfw images, so ugly images get cleaned up to look nice. That's a consequence of making image models that don't do things you don't want your kids to see

It's a little bit more specific than that, prompt rewriting is a step they added intentionally to remap prompts. So not exactly trained to make them less about reality, but actually changes your prompt to the image generator to be less about reality

Sheng found an explanation deep within the technical documentation for DALL-E 3, OpenAI’s text-to-image AI model for ChatGPT: An internal language model rewrites or expands user prompts to add more details before images are generated.

4
bert_macklin_fbi lemmy.world bert_macklin_fbi@lemmy.world
Joined: 2023-06-28
#8 · Quote Reply

“The moment that I found out it is actually a prompt revision that is erasing all the reality, I was absolutely shocked,” says Sheng. “That’s insane.”

If you're going to insist on using an image generation program instead of actual photos, at least put in the effort to use it correctly. Share some photos, a URL to search results, etc. and instruct it to use them as inspiration.

8
BeMoreCareful lemmy.world BeMoreCareful@lemmy.world
Joined: 2023-06-12
#9 · Quote Reply

“The moment that I found out it is actually a prompt revision that is erasing all the reality, I was absolutely shocked,” says Sheng. “That’s insane.” If you're going to insist on using an image generation program instead of actual photos, at least put in the effort to use it correctly. Share some photos, a URL to search results, etc. and instruct it to use them as inspiration.

That's illegal

0
lightnsfw reddthat.com lightnsfw@reddthat.com
Joined: 2023-08-15
#10 · Quote Reply

Why are they using AI photos for this at all? In what context could that possibly be acceptable?

6
chewypoops lemmy.world chewypoops@lemmy.world
Joined: 2026-02-05
#11 · Quote Reply

Why are they using AI photos for this at all? In what context could that possibly be acceptable?

You need to read the article.

Factory Farms aren't making the AI images, researchers are. The complaint, apparently, is that AI image generators aren't trained on enough animal cruelty to realistically depict a modern slaughterhouse.

This is a problem because the author of this article thinks that in the future, people will rely on AI image generators to understand the world around them, and honestly, if that's already the assumption, then we are cooked.

4
chewypoops lemmy.world chewypoops@lemmy.world
Joined: 2026-02-05
#12 · Quote Reply

That's illegal

Because there is nothing in this world more sacred than corporate intellectual property and the copyright code that protects capital. /s

2
Bane_Killgrind lemmy.dbzer0.com Bane_Killgrind@lemmy.dbzer0.com
Joined: 2025-06-15
#13 · Quote Reply

You need to read the article. Factory Farms aren't making the AI images, researchers are. The complaint, apparently, is that AI image generators aren't trained on enough animal cruelty to realistically depict a modern slaughterhouse. This is a problem because the author of this article thinks that in the future, people will rely on AI image generators to understand the world around them, and ho...

No... Images of realistic farms can be generated by these models, but they are set up to intentionally block that realistic depiction.

Look at the examples in the article. The service is injecting extra instructions into all these requests invisibly.

7
usernamesAreTricky lemmy.ml usernamesAreTricky@lemmy.ml
Joined: 2023-06-01
#14 · Quote Reply

“The moment that I found out it is actually a prompt revision that is erasing all the reality, I was absolutely shocked,” says Sheng. “That’s insane.” If you're going to insist on using an image generation program instead of actual photos, at least put in the effort to use it correctly. Share some photos, a URL to search results, etc. and instruct it to use them as inspiration.

Image search results are getting flooded with AI generated images. Even using filters to block domains with known AI-generated images still has a lot leak into it. There's a good chance you'll just be asking the models to use AI-gen images as a reference by doing that

6
usernamesAreTricky lemmy.ml usernamesAreTricky@lemmy.ml
Joined: 2023-06-01
#15 · Quote Reply

No... Images of realistic farms can be generated by these models, but they are set up to intentionally block that realistic depiction. Look at the examples in the article. The service is injecting extra instructions into all these requests invisibly.

But to be clear this means realistic as in depictions of factory farming at all, not necessarily still perfect representations of it either

1
bert_macklin_fbi lemmy.world bert_macklin_fbi@lemmy.world
Joined: 2023-06-28
#16 · Quote Reply

Image search results are getting flooded with AI generated images. Even using filters to block domains with known AI-generated images still has a lot leak into it. There's a good chance you'll just be asking the models to use AI-gen images as a reference by doing that

Ugh. I feel like dingdong for not thinking of that.

3
Bane_Killgrind lemmy.dbzer0.com Bane_Killgrind@lemmy.dbzer0.com
Joined: 2025-06-15
#17 · Quote Reply

But to be clear this means realistic as in depictions of factory farming at all, not necessarily still perfect representations of it either

I'm searching around but I can't find it, there was some discussion of students doing research and how depicting fantasy farms undermines it's actual use as a research tool.

The output of these models is highly editorialized and just like the recent court case the publishers should be liable for misinformation and slander generated by these things.

1
Post Reply
Back to top