Rsync

Recently I have been playing with rsync a lot. In the process of synching source A to B, as well as synching between machines I have grown familiar with how it works. It is for this reason that the move from using ftp for rsync to update the static part of the website began to make sense.

When I write a blog post I update wordpress with the markdown from the static blog post and then I run hugo to prepare the static site. I then used Filezilla to upload the changed files.

As I write this my consolidated photo album is being uploaded to kDrive, to serve as an offsite backup but the journey to this point took about two weeks, due in part to experimentation and learning to use various tools.

Tools I used

• rsync
• Google Takeout
• Flickr Export
• jdupe
• Gemini
• Euria
• Le Chat, by Mistral

Work Flow

The first step is to request your data from Google Photos via the Google Takeout Tool, the Flickr Export tool for flickr, and to download all your photos locally from Apple Photos before disconnecting the local library from iCloud. Disconnecting Photos from iCloud gives you 30 days to realise you made a terrible mistake and fix it.

I downloaded my photographs from Google Photos via Google Takeout before using Exiftool to repopulate the exif metadata. Once this was done, I had to move the files from the mac to the Raspberry Pi running photoprism. For this I used rsync because it can run in the background as you sleep.

The Rsync command

The command is rsync -avzP /source/ user@remote_host:/destination/

-a is for the archive mode

• v is verbose. It tells you what it’s doing -z compresses data to save a little on bandwidth -P gives you a progress report in the form n/total number of files.

The Process

With Photoprism I moved the files from the takeout folder, in full, to the import folder in Photoprism. As there were a lot of files I let it run overnight.