LINUX: Filesystem Usage Monitoring with Timestamp (While transferring large volume of data using rsync)

Rsync Operation – Syncing Files Locally

rsync -avzh <source path> <destination>

1. -v : verbose
2. -r : copies data recursively (but don’t preserve timestamps and permission while transferring data
3. -a : archive mode, archive mode allows copying files recursively and it also preserves symbolic links, file permissions, user & group ownerships and timestamps
4. -z : compress file data
5. -h : human-readable, output numbers in a human-readable format

Monitor/Watch running rsync process by another session or user
=========================================================

Using strace:
strace -e open $(ps -o lwp= -LC rsync | sed ‘s/^/-p/’)

Using lsof:
lsof -ad3-999 -c rsync

To run lsof continously, use below command:
while true; do lsof -ad3-999 -c rsync; sleep 2; echo; done

 

Please you use below script for filesystem monitoring with timestamp

while true
do
df -h  |awk '!/Filesystem/' | awk -v dt="$(date +'%D %T')" '{print dt,$2,$3,$4,$5,$6}'
sleep 60
done

 

 

My Example:-

1. vi nas_util.sh -> Copy the script on this file
2. touch /tmp/nas_utilization
3. chmod 777 /tmp/nas_utilization
4. nohup sh nas_util.sh > /dev/null 2>&1 >/tmp/nas_utilization &
5. Open new session and use tail -f /tmp/nas_utilization

Sample Output