45Drives Knowledge Base
KB450087 - Parallel Rsync
https://knowledgebase.45drives.com/kb/parallel-rsync/

KB450087 - Parallel Rsync

Posted on November 19, 2018 by Rob MacQueen


Parallel rsync allows you to copy with multiple threads so it can work on different files at the same time. The Parameter “P” sets the number of threads

  • ls -1 $LOCAL_DIR | xargs -I {} -P 5 -n 1 rsync -avh --progress $LOCAL_DIR/{} $RECV_DIR
  • -P sets number of parallel threads

Example:

ls -1 /mnt/mylocalfiles/ | xargs -I {} -P 5 -n 1 rsync -avh --progress /mnt/mylocalfiles/{} /mnt/myrecievingdirectory/

Remove {} after /mnt/mylocalfiles/ for Ubuntu

KB450087 - Parallel Rsync - 45Drives Knowledge Base
Did you know  45Drives offers free  public and private  webinars ? Click here to learn more  & register! Build & Price

KB450087 – Parallel Rsync

You are here:

Parallel rsync allows you to copy with multiple threads so it can work on different files at the same time. The Parameter “P” sets the number of threads

  • ls -1 $LOCAL_DIR | xargs -I {} -P 5 -n 1 rsync -avh –progress $LOCAL_DIR/{} $RECV_DIR
  • -P sets number of parallel threads

Example:

ls -1 /mnt/mylocalfiles/ | xargs -I {} -P 5 -n 1 rsync -avh –progress /mnt/mylocalfiles/{} /mnt/myrecievingdirectory/

Remove {} after /mnt/mylocalfiles/ for Ubuntu

Was this article helpful?
Dislike 4
Views: 4374
© 2024 - 45Drives Knowledge Base
Unboxing Racking Storage Drives Cable Setup Power UPS Sizing Remote Access