45Drives Knowledge Base
KB450087 - Parallel Rsync

KB450087 - Parallel Rsync

Posted on November 19, 2018 by Rob MacQueen

Parallel rsync allows you to copy with multiple threads so it can work on different files at the same time. The Parameter “P” sets the number of threads

  • ls -1 $LOCAL_DIR | xargs -I {} -P 5 -n 1 rsync -avh --progress $LOCAL_DIR/{} $RECV_DIR
  • -P sets number of parallel threads


ls -1 /mnt/mylocalfiles/ | xargs -I {} -P 5 -n 1 rsync -avh --progress /mnt/mylocalfiles/{} /mnt/myrecievingdirectory/

Remove {} after /mnt/mylocalfiles/ for Ubuntu

There are no comments yet.

CentOS Archives - 45Drives Knowledge Base
Did you know  45Drives offers free  public and private  webinars ? Click here to learn more  & register! Build & Price

KB450087 – Parallel Rsync

Parallel rsync allows you to copy with multiple threads so it can work on different files at the same time. The Parameter “P” sets the number of threads ls -1 $LOCAL_DIR | xargs -I {} -P 5 -n 1 rsync -avh –progress $LOCAL_DIR/{} $RECV_DIR -P sets number of parallel threads Example: ls -1 /mnt/mylocalfiles/ | […]

Read more »

KB450001 – CentOS 7 Install Procedure

Scope/Description This guide details a fresh installation of CentOS 7.9 for a single boot drive or redundant boot drives. Prerequisites CentOS ISO pre-installed on a USB drive   Steps Upon boot, hit the up arrow and select “Install CentOS Linux 7” shown below. Don’t change the language; just click ‘Continue’ You will see the following […]

Read more »

KB450012 – StorCLI

Scope/Description This guide details the process of installing and using StorCLI on a system with LSI 9361 MegaRAID. Prerequisites System Configured with MegaRAID Internet Connection to pull down packages Steps Two great Storcli documents can be found at: https://www.thomas-krenn.com/en/wiki/StorCLI https://communities.cisco.com/docs/DOC-59532 Download Storcli curl -LO http://images.45drives.com/Firmware/LSI9361/storcli/Linux/storcli-007.0606.0000.0000-1.noarch.rpm Extract the rpm package to a directory Once the rpm […]

Read more »

KB450016 – Identifying Drives using HighPoint GUI with R750 Controller Cards

To identify where your drives are located when using the Rocket750 cards use the Highpoint webGUI and the following diagram. For example, as seen in the screenshot below, In the Highpoint WebGUI under Physical->Devices you can see all the drives numbered the same way as they are in the wiring diagram below. Note circled in […]

Read more »

KB450022 – Rebuilding Failed Redundant Boot Drives

How do I know one of my boot drives has failed? Open the Disk Utility and scroll down to your RAID devices. If one of them has failed you will see DEGRADED. Alternately you may open a terminal and enter the command “cat /proc/mdstat” This will list the current status of all RAIDs you have […]

Read more »

KB450033 – How do I replace a failed drive with LSI 9361 cards

The recommended utility to use with the LSI 9361 SAS card is StorCLI. StorCLI allows command line tools to manage and control LSI MegaRAID controllers. It can be downloaded at –> https://docs.broadcom.com/docs/12351376 Once the rpm package is downloaded, extract it to a directory on your Storinator. From there, changing into that director and run the […]

Read more »

KB450138 – How to install and start the Highpoint WebUI

Scope/Description This guide will show you how to install and start the Highpoint WebUI for Rocket 750 HBA cards Prerequisites A server with the highpoint HBA driver installed Steps First, make sure wget is installed Centos/Rocky yum install wget -y dnf install wget -y Ubuntu apt install wget -y Now we can download the WebUI […]

Read more »

KB450288 – Changing from FreeNAS to Houston

Scope/Description This article details the process of changing your OS from FreeNAS to Ubuntu/CentOS. It includes the process of importing the pool and making necessary changes. Prerequisites A FreeNas pool configured and Houston running on CentOS7/Ubuntu 20.04 Steps FreeNAS System Take note of everything configured (Share, Groups-Users, IPs) Export the pool through the Web UI […]

Read more »

KB450272 – Installing Postgresql Server on CentOS 7 for DaVinci Resolve

Scope/Description In this article, we’ll install and configure a Postgresql Server on CentOS 7 for use with DaVinci Resolve Prerequisites CentOS 7 Client with DaVinci Resolve Steps To begin, we’ll have to install the postgresql server on our CentOS 7 server. We can do this with “yum install postgresql postgresql-server” [root@45drives~]# yum install postgresql postgresql-server […]

Read more »

KB450238 – Recovering a Corrupted CentOS Boot Partition

Scope/Description How to repair a CentOS installation that is stuck booting into GRUB.   Prerequisites A unit that is unable to properly boot into CentOS Access to the IPMI management port on the 45 Drives unit Java installed for ISO mounting ISO for the matching version of CentOS 7 downloaded   Steps Open the Java […]

Read more »
© 2023 - 45Drives Knowledge Base
Unboxing Racking Storage Drives Cable Setup Power UPS Sizing Remote Access