45Drives Knowledge Base
KB450087 - Parallel Rsync
https://knowledgebase.45drives.com/kb/parallel-rsync/

KB450087 - Parallel Rsync

Posted on November 19, 2018 by Rob MacQueen


Parallel rsync allows you to copy with multiple threads so it can work on different files at the same time. The Parameter ā€œPā€ sets the number of threads

  • ls -1 $LOCAL_DIR | xargs -I {} -P 5 -n 1 rsync -avh --progress $LOCAL_DIR/{} $RECV_DIR
  • -P sets number of parallel threads

Example:

ls -1 /mnt/mylocalfiles/ | xargs -I {} -P 5 -n 1 rsync -avh --progress /mnt/mylocalfiles/{} /mnt/myrecievingdirectory/

Remove {} after /mnt/mylocalfiles/ for Ubuntu