| Post Reply | RetroFed Forum Forum Index » Selfhosted |
| Author | Message | ||
|---|---|---|---|
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
I just spent the past 2 weekends migrating from Lightroom CC with just under 1TB of photos, mostly RAWs, making up about 50,000 files. I kind of made it up as I went and I spent a lot of time testing and validating. I'm going to do a writeup here to hepefully help ayone else coming acrross this and/or in case someone has ideas. My Requirements:
Getting your pictures out
My solution going forwardBecause I was discovering this as I went, I tried some version of all of the options above, but going forward, I have a process which should be much easier. First, I will parse the catalog which is a SQLite db and extract the newest "version" of each picture and the content I care about. I will store it in a CSV for long-term holding. Once metadata is stored, I'll go and request the archive through the website. That will take a few hours to possibly days (it took me about 2 hours on a Friday night). Once that's done, you get an email and a link to a personalized site. You have to parse the (for me) 50+ links and download them sequentially. It took me a few hours to download 1 TB limited by my local bandwidth (for which I'm eternally grateful). With my TrueNAS storage, I have the luxury of landing the data and uploading it to Immich separately. For XMPs, the edit data, you have to get that from a local source so either export originals or the desktop app "Archive All" option. You'll have to decide what you need and maybe you have fewer requirements than me. Landing the PicturesThe next challenge is grabbing all of that data, pictures and ratings and applyhing them in Immich. Luckily, it has a fantastic API so I can script the whole thing. Most of the mapping happened by picture name and there were a few times where I had to dig into exif to identify a picture. Overall, i think I had 40 or so files out of 50k+ which couldn't be mapped. Encountered Problems:
Disclaimer
Future
|
||
| 169 Original | |||
artyom
piefed.social
artyom@piefed.socialJoined: 2025-06-08 |
Yeah Google does the same. When you Takeout your photos they split the images and metadata into separate files. Bunch dicks. |
||
| 38 | |||
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
Yeah Google does the same. When you Takeout your photos they split the images and metadata into separate files. Bunch dicks.
I haven't documented this yet but I did do Google Takeout. It is just as bad and they rotate credentials every few minutes so they make it really hard to download the 80 files they output my pictures into Immich has
Edit: voyage0 correctly pointed out that I used/meant immich-go, not built-in tools |
||
| 19 | |||
inari
piefed.zip
inari@piefed.zipJoined: 2026-02-07 |
Adobe: not even once |
||
| 17 | |||
|
schnokobaer
feddit.org
schnokobaer@feddit.org Joined: 2024-06-28 |
Very interesting, saving this as I'm planning to migrate to Immich too but I'm still in the uhemm.. conceptual phase... One question not really related to the core of your post: is running Immich in a VM inside a VM fine in terms of performance? I seem to remember somewhere someone saying that something as resource intensive as Immich would be severely hindered in a VE
|
||
| 5 | |||
|
zener_diode
feddit.org
zener_diode@feddit.org Joined: 2025-04-06 |
Very interesting, saving this as I'm planning to migrate to Immich too but I'm still in the uhemm.. conceptual phase... One question not really related to the core of your post: is running Immich in a VM inside a VM fine in terms of performance? I seem to remember somewhere someone saying that something as resource intensive as Immich would be severely hindered in a VE The stack is Proxmox runn...
Running Docker inside a VM is the recommended way to run Docker on Proxmox. Personally, I just run Docker inside LXC containers. Aparently, this is supposed to be not entirely stable, but its never given me any problems. (I commit an entirely different sin against efficiency, by keeping each service in its own LXC container, each with its own Docker host.) I also run Immich (in Docker inside a container), and haven't noticed any performance issues. But I'm the only user, and I don't use it heavily, so ymmv. |
||
| 11 | |||
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
Very interesting, saving this as I'm planning to migrate to Immich too but I'm still in the uhemm.. conceptual phase... One question not really related to the core of your post: is running Immich in a VM inside a VM fine in terms of performance? I seem to remember somewhere someone saying that something as resource intensive as Immich would be severely hindered in a VE The stack is Proxmox runn...
what zener_diode said. when i was setting up this version of my homelab (this is v2), i had to contend with how to run docker. The general concensus is that the "best" way to run it is Proxmox>VM>Docker. Proxmox>LXC>Docker is supposed to be viable too. Proxmox>Docker is possible but is not recommend. I have 20 active docker services with about 30 containers running all sorts of services and they're extremely reliable under this setup. The only time I've had problems is when I ran out of disk space (128gb) because stale docker images weren't pruned. |
||
| 6 | |||
|
foofiepie
lemmy.world
foofiepie@lemmy.world Joined: 2023-07-01 |
Yikes. I’ve dabbled with LR enough to know the basics but haven’t done much in the way of importing files, so most of my photos are sat in storage. I want to be rid of Adobe entirely. |
||
| 2 | |||
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
Yikes. I’ve dabbled with LR enough to know the basics but haven’t done much in the way of importing files, so most of my photos are sat in storage. I want to be rid of Adobe entirely. Is Immich as straightforward to use as LR?
Immich is not like Lightroom at all. Immich is more akin to Google Photos or Apple Photos. It's a library ONLY. Lightroom is for developing raws, publishing, and storing. |
||
| 16 | |||
|
foofiepie
lemmy.world
foofiepie@lemmy.world Joined: 2023-07-01 |
Immich is not like Lightroom at all. Immich is more akin to Google Photos or Apple Photos. It's a library ONLY. Lightroom is for developing raws, publishing, and storing.
Oh. Ok thanks. I need to do my research. |
||
| 4 | |||
|
Onsotumenh
discuss.tchncs.de
Onsotumenh@discuss.tchncs.de Joined: 2023-07-25 |
Oh. Ok thanks. I need to do my research.
The open source equivalent to LR would be Darktable. |
||
| 16 | |||
|
schnokobaer
feddit.org
schnokobaer@feddit.org Joined: 2024-06-28 |
Running Docker inside a VM is the recommended way to run Docker on Proxmox. Personally, I just run Docker inside LXC containers. Aparently, this is supposed to be not entirely stable, but its never given me any problems. (I commit an entirely different sin against efficiency, by keeping each service in its own LXC container, each with its own Docker host.) I also run Immich (in Docker inside a ...
I see. I'm fairly new to this, obviously. Appreciate the context. |
||
| 3 | |||
|
undrwater
lemmy.world
undrwater@lemmy.world Joined: 2023-07-14 |
Incredible how software companies can be actively hostile to customers. |
||
| 6 | |||
idk (she/her)
szmer.info
Tiger_Man_@szmer.infoJoined: 2025-08-06 |
what is cc because i dont think you are using c compiler as lightroom alternative |
||
| 2 | |||
ragingHungryPanda
piefed.keyboardvagabond.com
ragingHungryPanda@piefed.keyboardvagabond.comJoined: 2025-07-30 |
I'm wondering if immich supports reading an existing file structure, so you could maintain the file system and mount it in both immich and next cloud or whatever else? |
||
| 2 | |||
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
I'm wondering if immich supports reading an existing file structure, so you could maintain the file system and mount it in both immich and next cloud or whatever else?
I think that's possible |
||
| 2 | |||
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
what is cc because i dont think you are using c compiler as lightroom alternative
CC is "creative cloud" its the Adobe cloud-ified software offering. All the software you used to love, with fewer features and a monthly rate! |
||
| 2 | |||
|
hirihit640
sh.itjust.works
hirihit640@sh.itjust.works Joined: 2024-10-28 |
Mind sharing which local AI you used, the harness, etc? |
||
| 3 | |||
|
CybranM
feddit.nu
CybranM@feddit.nu Joined: 2023-06-17 |
The open source equivalent to LR would be Darktable.
Darktable is honestly really good but man is it a daunting learning curve. I've been getting into darktable over the last week and I'm starting to understand the basics haha Disable every module except like 5 and try to understand those |
||
| 3 | |||
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
Mind sharing which local AI you used, the harness, etc?
Hardware: I have a custom setup with a bunch of amd graphics cards. I will do a writeup about that sometime this year. I use opencode exclusively. It's probably not the best harness but it's the one that gives users the most control and I like that. The actual models I used for this work are Qwen3.8 27b - FP8 and Qwen3.8 - Flash - Next UD_Q6_K. I wrote my own agents with duty separation. Flash is the orchestrator and long-horizon guide. While 27b is the faster, more expandable worker. This combination feels about as smart as an opus 4.8 with maybe not as great token efficiency. For simple tasks, i use the worker directly. I have a ton of repo documentation and my agents have access to read and write to Forgejo, both for git and api (issues and PRs respectively) Maybe I need to write an article about this... |
||
| 7 | |||
|
voyage0
sh.itjust.works
voyage0@sh.itjust.works Joined: 2026-06-04 |
I haven't documented this yet but I did do Google Takeout. It is just as bad and they rotate credentials every few minutes so they make it really hard to download the 80 files they output my pictures into Immich has built-in compatible tooling to handle Takeout, bless them Takeout Edit: voyage0 correctly pointed out that I used/meant immich-go, not built-in tools
When you say immich has build in tooling for google takeout, do you mean [immich-go] (https://github.com/simulot/immich-go) or is there another, possibly better, way? |
||
| 4 | |||
|
voyage0
sh.itjust.works
voyage0@sh.itjust.works Joined: 2026-06-04 |
Very interesting, saving this as I'm planning to migrate to Immich too but I'm still in the uhemm.. conceptual phase... One question not really related to the core of your post: is running Immich in a VM inside a VM fine in terms of performance? I seem to remember somewhere someone saying that something as resource intensive as Immich would be severely hindered in a VE The stack is Proxmox runn...
You could run it in LXC directly with [community-scripts] (https://community-scripts.org/scripts/immich). I have it running like this for close to a year and am really happy with it. It provides you with a |
||
| 1 | |||
|
punkibas
lemmy.zip
punkibas@lemmy.zip Joined: 2025-06-04 |
Running Docker inside a VM is the recommended way to run Docker on Proxmox. Personally, I just run Docker inside LXC containers. Aparently, this is supposed to be not entirely stable, but its never given me any problems. (I commit an entirely different sin against efficiency, by keeping each service in its own LXC container, each with its own Docker host.) I also run Immich (in Docker inside a ...
I've been doing this for years too, keeps services isolated and I can share the same GPU with several containers. Works great! |
||
| 2 | |||
|
frongt
lemmy.zip
frongt@lemmy.zip Joined: 2025-07-31 |
I'm wondering if immich supports reading an existing file structure, so you could maintain the file system and mount it in both immich and next cloud or whatever else?
Yes, it does. |
||
| 1 | |||
|
snadas
lemmy.world
snadas@lemmy.world Joined: 2024-08-08 |
I’ve been on a similar journey, but am stuck on a particular issue. We have fifteen or so years of albums in Lightroom that we would use as our source of truth and then export those photos to various photo hosters. I came upon a similar solution as you with extracting things from the catalog SQLite DB and using a naming scheme for dealing with the lack of nested albums. The biggest issue though is the lack of custom sorting. Almost every album uses a custom order to tell some sort of story and doesn’t always follow the capture time of the image. There’s this feature request out there right now, but it doesn’t seem to have much traction. Have you had to deal with or otherwise work around this issue, or are your collections basically chronological? |
||
| 2 | |||
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
I’ve been on a similar journey, but am stuck on a particular issue. We have fifteen or so years of albums in Lightroom that we would use as our source of truth and then export those photos to various photo hosters. I came upon a similar solution as you with extracting things from the catalog SQLite DB and using a naming scheme for dealing with the lack of nested albums. The biggest issue though...
I haven't had to deal with custom ordering. Everything I've shot can be chronological with the exception of some portfolio albums where I simply forgot order mattered. I haven't spent a ton of time in Immich's backend but do you know where they would implement such a feature? Would sorting by file name solve this? Does the ui use the api to call pictures in a specific order? It seems like functionality is platform-dependent. |
||
| 1 | |||
|
hirihit640
sh.itjust.works
hirihit640@sh.itjust.works Joined: 2024-10-28 |
Hardware: I have a custom setup with a bunch of amd graphics cards. I will do a writeup about that sometime this year. I use opencode exclusively. It's probably not the best harness but it's the one that gives users the most control and I like that. The actual models I used for this work are Qwen3.8 27b - FP8 and Qwen3.8 - Flash - Next UD_Q6_K. I wrote my own agents with duty separation. Flash ...
If you wrote an article I'd read it! But this is a great starting point nonetheless, thanks |
||
| 3 | |||
DanWolfstone
leminal.space
DanWolfstone@leminal.spaceJoined: 2025-02-19 |
When you say immich has build in tooling for google takeout, do you mean [immich-go] (https://github.com/simulot/immich-go) or is there another, possibly better, way?
I used immich-go when I was migrating over, worked a treat. |
||
| 2 | |||
|
quadrant5835
lemmy.zip
quadrant5835@lemmy.zip Joined: 2026-01-27 |
I'm wondering if immich supports reading an existing file structure, so you could maintain the file system and mount it in both immich and next cloud or whatever else?
I use it and it works great for me. My use case is I have several users which backup our mobile phones into Immich. Then I created an additional "user" that is more like a service account. Under this extra account I have it set to scan an external path which I a drive where we upload everything from a DSLR camera. Then I share this users library with my main account so I can browse our DSLR images while on the go through Immich. |
||
| 2 | |||
|
afk_strats
lemmy.world
afk_strats@lemmy.world Joined: 2023-09-06 |
When you say immich has build in tooling for google takeout, do you mean [immich-go] (https://github.com/simulot/immich-go) or is there another, possibly better, way?
no, you're completely correct. I used immich-go which is what I recommend |
||
| 2 | |||
|
ChapulinColorado
lemmy.world
ChapulinColorado@lemmy.world Joined: 2023-08-09 |
Yeah Google does the same. When you Takeout your photos they split the images and metadata into separate files. Bunch dicks.
It was faster to export the 1000 items at a time via the photos web UI which still kept the metadata together. Apple was not much better, requiring an unsupported third party tool. I have to give it to them, that truly made me not want to use their products ever again. |
||
| 2 | |||
| Post Reply |
Back to top |