| Post Reply | RetroFed Forum Forum Index » Selfhosted |
| Author | Message | ||
|---|---|---|---|
Nickelalloy
lemmy.world
Nickelalloy@lemmy.worldJoined: 2025-09-02 |
So I recently quitted Google Drive and downloaded all my data and hoping to keep it on Hard drives myself, They are external plug in types and I want the files synced like it was on my computer. So when I plug it in it copies/syncs the things on my computer, anyone knows somethign like that? |
||
| 46 Original | |||
|
Joined: 2022-05-05 |
@Nickelalloy Maybe Back In Time is a possible solution.Its using rsync and it is possible to be scheduled.github.com/bit-team/backintime |
||
| 3 | |||
|
dihutenosa
piefed.social
dihutenosa@piefed.social Joined: 2025-06-04 |
Syncthing? git-annex? |
||
| 23 | |||
ISOmorph
feddit.org
ISOmorph@feddit.orgJoined: 2024-07-06 |
I use freefilesync. You can tailor what is copied where and save it to an executable batch file. If you want to trigger the batch file when your external drive is plugged in you can create a udev rule. Best is you look that up yourself, since it heavily depends on your system (no chatgpt tho!). |
||
| 2 | |||
kellenoffdagrid
lemmy.zip
kellenoffdagrid@lemmy.zipJoined: 2026-05-15 |
Kinda depends on exactly how much you want it to sync, e.g. should it truly sync all files from the synced volume to all clients, or do you want the files to only sync/download to clients when requested, keeping a "master copy" on a server? For me, I use Syncthing for a simple setup where I want multiple machines to have a few different shared folders that sync with each other, all files updated on-disk when connected to a network. For a more Google Drive-style approach with only fetching/syncing files onto client disk when explicitly chosen, I believe Nextcloud has what you need, but I've not used it on any of my own machines. It can be self-hosted or paid for, depending on what you prefer. |
||
| 1 | |||
Bob Smith
sopuli.xyz
bismuthbob@sopuli.xyzJoined: 2023-06-06 |
I do something like that with rsync. The syntax is a bit tricky to figure out at first, but the idea is that you take a known-good copy of your data and run rsync to copy it to the removable drive. After the first sync, you can run the command to check for any changes and push the changes from your main data to the copy on the drive. You'll want to research the command and the options, but you can theoretically run something like: An additional trick is to run the command with -n at the end of it before you run it without -n at the end. -n performs a 'dry run' where it will output what the changes are going to be when you actually run the sync operation. This can help you spot issues like mistyping the file path in your command. If you're only syncing one or two changes and the dry run indicates that it is going to basically re-transfer your entire data folder, then you probably got something wrong. Another fun thing about rsync is that if you've got ssh server set up on your home computers, you can run rsync to sync files from one computer to another one on your network. |
||
| 8 | |||
|
lntl
lemmy.ml
lntl@lemmy.ml Joined: 2023-06-04 |
Congrats, great life choice
You have multiple external drives. Are they USB? How many?
Are they not usually plugged in? Is there a requirement to keep them air gapped between syncs?
Like others have said, a shell script that calls rsync is maybe the way to go and with some more information on number of drives, drive interface type, and air gap requirements it may change |
||
| 4 | |||
cecilkorik
lemmy.ca
cecilkorik@lemmy.caJoined: 2023-06-14 |
rsync, SyncThing, or Nextcloud. I use all three, often on the same machine at the same time, for various purposes. rsync is great for scheduled syncs (but intentionally not TOO frequent -- where blowing away one copy would almost instantly blow away the other copy could be a concern.) and outstanding for one-off syncs. With the right command line options it can even create a rough approximation of snapshots with copy-on-write rolling incremental backups. I believe this is the original documentation for that particular trick although it has spawned many genuine backup tools which operate very similarly using rsync under the hood, like rsnapshot. SyncThing is great for large, intensive datasets that you want to keep perfectly synchronized across multiple computers at the same time. One example is my saved games, so without relying on Steam "cloud saves" or anything, I can just save my game and hop from gaming on one computer onto my laptop and pick up right where I left off. Nextcloud is what I use for keeping separate copies of all my documents, photos from my phone, etc. It's easier than SyncThing to setup and manage in my opinion, it's simple and reliable and reasonably user-friendly in most use-cases, and seems to be more compatible with a lot of software due to its similar design to something like Dropbox. It isn't ideal for handling huge numbers of files or very large folders in my personal opinion, but it does work if you want to try it. |
||
| 21 | |||
|
gravitas_deficiency
sh.itjust.works
gravitas_deficiency@sh.itjust.works Joined: 2023-06-20 |
|
||
| 10 | |||
|
BCsven
lemmy.ca
BCsven@lemmy.ca Joined: 2023-06-17 |
rsync, SyncThing, or Nextcloud. I use all three, often on the same machine at the same time, for various purposes. rsync is great for scheduled syncs (but intentionally not TOO frequent -- where blowing away one copy would almost instantly blow away the other copy could be a concern.) and outstanding for one-off syncs. With the right command line options it can even create a rough approximation...
GRsync is helpful so you can toggle the delete files on destination or not, based on source deletion. Other toggles also, and it shows you what the command line string would be if you did it manually |
||
| 1 | |||
ryannathans
aussie.zone
ryannathans@aussie.zoneJoined: 2023-09-20 |
rsync, SyncThing, or Nextcloud. I use all three, often on the same machine at the same time, for various purposes. rsync is great for scheduled syncs (but intentionally not TOO frequent -- where blowing away one copy would almost instantly blow away the other copy could be a concern.) and outstanding for one-off syncs. With the right command line options it can even create a rough approximation...
Syncthing good for small datasets too |
||
| 7 | |||
|
friend_of_satan
lemmy.world
friend_of_satan@lemmy.world Joined: 2023-06-19 |
rsync, SyncThing, or Nextcloud. I use all three, often on the same machine at the same time, for various purposes. rsync is great for scheduled syncs (but intentionally not TOO frequent -- where blowing away one copy would almost instantly blow away the other copy could be a concern.) and outstanding for one-off syncs. With the right command line options it can even create a rough approximation...
My man. rsync and SyncThing are the only two sync softwares I use anymore. Well, I still have a single computer connected to dropbox for sharing with other folks, but for my own data, it's those two tools all the way. |
||
| 7 | |||
|
WolfLink
sh.itjust.works
WolfLink@sh.itjust.works Joined: 2024-06-06 |
I have bash scripts of the form |
||
| 9 | |||
|
FauxLiving
lemmy.world
FauxLiving@lemmy.world Joined: 2025-02-10 |
Syncthing good for small datasets too
and medium sized ones |
||
| 8 | |||
rako
tarte.nuage-libre.fr
rako@tarte.nuage-libre.frJoined: 2026-01-07 |
Be aware that if you have a single machine syncthing won't work. Use any software that can do software merging, like meld, it does the job |
||
| 1 | |||
|
magnue
lemmy.world
magnue@lemmy.world Joined: 2026-04-09 |
Syncthing is the closest to what you want. |
||
| 5 | |||
|
Onomatopoeia
lemmy.cafe
Onomatopoeia@lemmy.cafe Joined: 2025-01-02 |
Syncthing is the closest to what you want.
That only works from PC to PC (it was my first thought too). |
||
| 3 | |||
K3CAN
lemmy.radio
K3can@lemmy.radioJoined: 2023-06-21 |
Rsync. You could leave the drive plugged in and schedule a daily/hourly sync, or you could have the system trigger a sync whenever you plug the drive in. |
||
| 5 | |||
|
lch361
discuss.tchncs.de
lch361@discuss.tchncs.de Joined: 2026-09-15 |
So you want to sync files from a drive whenever you plug it in to the computer? Sounds like a udev + rsync solution. Udev mounts the drive and runs rsync. |
||
| 6 | |||
|
randombullet
programming.dev
randombullet@programming.dev Joined: 2023-07-26 |
I rsync everything with ssh keys. Really easy to do. |
||
| 12 | |||
Nickelalloy
lemmy.world
Nickelalloy@lemmy.worldJoined: 2025-09-02 |
I rsync everything with ssh keys. Really easy to do.
This I will check out! Thanks! |
||
| 1 | |||
Nickelalloy
lemmy.world
Nickelalloy@lemmy.worldJoined: 2025-09-02 |
Syncthing is the closest to what you want.
Thanks! |
||
| 1 | |||
Nickelalloy
lemmy.world
Nickelalloy@lemmy.worldJoined: 2025-09-02 |
So when I plug it in it copies/syncs the things on my computer, anyone knows somethign like that? So you want to sync files from a drive whenever you plug it in to the computer? Sounds like a udev + rsync solution. Udev mounts the drive and runs rsync.
Great, this I will check out! |
||
| 2 | |||
Nickelalloy
lemmy.world
Nickelalloy@lemmy.worldJoined: 2025-09-02 |
rsync, SyncThing, or Nextcloud. I use all three, often on the same machine at the same time, for various purposes. rsync is great for scheduled syncs (but intentionally not TOO frequent -- where blowing away one copy would almost instantly blow away the other copy could be a concern.) and outstanding for one-off syncs. With the right command line options it can even create a rough approximation...
Thanks a lot man! |
||
| 1 | |||
|
needanke
feddit.org
needanke@feddit.org Joined: 2024-07-12 |
That only works from PC to PC (it was my first thought too).
I don't know why you are being downvoted. You are right, Syncthing does not support local sync. |
||
| 2 | |||
vegetaaaaaaa
lemmy.world
vegetaaaaaaa@lemmy.worldJoined: 2023-06-17 |
So when I plug it in it copies/syncs the things on my computer, anyone knows somethign like that? So you want to sync files from a drive whenever you plug it in to the computer? Sounds like a udev + rsync solution. Udev mounts the drive and runs rsync.
This is the correct solution for unattended file copy/sync, plug the external drive and wait till the copy finishes. The only difficulty is monitoring progress/completion/failure if that's on a headless machine. I built a basic orchestration system with systemd .path/.mount/.timer/.service units, logging and monitoring around this, once you understand your exact needs and get it working, it works. |
||
| 1 | |||
|
GMac
feddit.org
GMac@feddit.org Joined: 2026-01-09 |
I do something like that with rsync. The syntax is a bit tricky to figure out at first, but the idea is that you take a known-good copy of your data and run rsync to copy it to the removable drive. After the first sync, you can run the command to check for any changes and push the changes from your main data to the copy on the drive. You'll want to research the command and the options, but you ...
Be careful with --delete |
||
| 1 | |||
Bob Smith
sopuli.xyz
bismuthbob@sopuli.xyzJoined: 2023-06-06 |
Be careful with --delete if you automate the rsynch, include a safety check that the source drive is mounted correctly and is not empty. Wouldnt want a drive failure to be read as empty and delete everyrhing on the target....
That's a solid piece of advice. Before I automate any rsync jobs, I'm going to familiarize myself with mountpoint so I can check on the front end of the job. |
||
| 2 | |||
| Post Reply |
Back to top |