Monday, 15 February 2016

Robo Copy

Robocopy is a command-line file copy utility from Microsoft. Unlike normal copy commands, Robocopy is designed for reliable copy or mirroring  while maintaining the permissions, attributes, owner information, timestamps and properties of the objects copied.


Robocopy Syntax

ROBOCOPY <source> <destination> [file…] [options]

<source>        Source Directory (local or network path)
<destination>  Destination Directory (local or network path) and
[file…]              Specifies the file or files to be copied. You can use wildcard characters (* or ?), if you want. If theFile parameter is not specified, *.* is used as the default value.


/mon:<N>Monitors the source, and runs again when more than N   changes are detected.
/mot:<M>Monitors source, and runs again in M minutes if changes   are detected.
/rh:hhmm-hhmmSpecifies run times when new copies may be started.
/pfChecks run times on a per-file (not per-pass) basis.
/ipg:nSpecifies the inter-packet gap to free bandwidth on slow lines.
/slCopies the symbolic link instead of the target.

Important
When using the /SECFIX copy option, specify the type of   security information you want to copy by also using one of these additional   copy options:·           /COPYALL·           /COPY:O
·           /COPY:S
·           /COPY:U
·           /SEC
File selection options

OptionDescription
/aCopies only files for which the Archive attribute is set.
/mCopies only files for which the Archive attribute is set,   and resets the Archive attribute.
/ia:[RASHCNETO]Includes only files for which any of the specified attributes   are set.
/xa:[RASHCNETO]Excludes files for which any of the specified attributes are   set.
/xf <FileName>[ ...]Excludes files that match the specified names or paths. Note   that FileName can include wildcard characters (* and ?).
/xd <Directory>[ ...]Excludes directories that match the specified names and paths.
/xctExcludes changed files.
/xnExcludes newer files.
/xoExcludes older files.
/xxExcludes extra files and directories.
/xlExcludes “lonely” files and directories.
/isIncludes the same files.
/itIncludes “tweaked” files.
/max:<N>Specifies the maximum file size (to exclude files bigger than N   bytes).
/min:<N>Specifies the minimum file size (to exclude files smaller than N   bytes).
/maxage:<N>Specifies the maximum file age (to exclude files older than N   days or date).
/minage:<N>Specifies the minimum file age (exclude files newer than N   days or date).
/maxlad:<N>Specifies the maximum last access date (excludes files unused   since N).
/minlad:<N>Specifies the minimum last access date (excludes files used   since N) If N is less than 1900, Nspecifies the number   of days. Otherwise, N specifies a date in the format YYYYMMDD.
/xjExcludes junction points, which are normally included by   default.
/fftAssumes FAT file times (two-second precision).
/dstCompensates for one-hour DST time differences.
/xjdExcludes junction points for directories.
/xjfExcludes junction points for files.
Retry options

OptionDescription
/r:<N>Specifies the number of retries on failed copies. The default   value of N is 1,000,000 (one million retries).
/w:<N>Specifies the wait time between retries, in seconds. The default   value of N is 30 (wait time 30 seconds).
/regSaves the values specified in the /r and /w   options as default settings in the registry.
/tbdSpecifies that the system will wait for share names to be   defined (retry error 67).
Logging options

OptionDescription
/lSpecifies that files are to be listed only (and not copied,   deleted, or time stamped).
/xReports all extra files, not just those that are selected.
/vProduces verbose output, and shows all skipped files.
/tsIncludes source file time stamps in the output.
/fpIncludes the full path names of the files in the output.
/bytesPrints sizes, as bytes.
/nsSpecifies that file sizes are not to be logged.
/ncSpecifies that file classes are not to be logged.
/nflSpecifies that file names are not to be logged.
/ndlSpecifies that directory names are not to be logged.
/npSpecifies that the progress of the copying operation (the number   of files or directories copied so far) will not be displayed.
/etaShows the estimated time of arrival (ETA) of the copied files.
/log:<LogFile>Writes the status output to the log file (overwrites the   existing log file).
/log+:<LogFile>Writes the status output to the log file (appends the output to   the existing log file).
/unicodeDisplays the status output as Unicode text.
/unilog:<LogFile>Writes the status output to the log file as Unicode text   (overwrites the existing log file).
/unilog+:<LogFile>Writes the status output to the log file as Unicode text   (appends the output to the existing log file).
/teeWrites the status output to the console window, as well as to   the log file.
/njhSpecifies that there is no job header.
/njsSpecifies that there is no job summary.
Job options

OptionDescription
/job:<JobName>Specifies that parameters are to be derived from the named job   file.
/save:<JobName>Specifies that parameters are to be saved to the named job file.
/quitQuits after processing command line (to view parameters)./nosd:
/noddIndicates that no destination directory is specified.
/ifIncludes the specified files.

Examples of Microsoft’s Robocopy syntax.
  1. To copy contents of C:\UserFolder to C:\FolderBackup:
               Robocopy C:\UserFolder C:\FolderBackup
  1. To copy all contents including empty directories of SourceFolder to DestinationFolder:
Robocopy C:\SourceDir C:\DestDir /E
  1. Copy files from one computer to another, skipping files already in the destination.
              ROBOCOPY \\RX-PC-01\usr\Frames \\Rx-PC-02\Frames *.doc /S
  1. Move files over 14 days old (note the MOVE option will fail if any files are open and locked).
              ROBOCOPY C:\SourceFoldern D:\DestinationFolder /move /minage:14
  1. /MIR is an option to ROBOCOPY where you mirror a directory tree with all the subfolders including the empty directories and you purge files and folders on the destination server that no longer exists in source.
               ROBOCOPY \\sourceserver\share \\destinationserver\share /MIR
Or
           ROBOCOPY source-drive:\DIR destination-drive:\DIR /MIR
  1. The following command will mirror the directories using Robocopy:
Robocopy \\RX-Server-01\Docs \\Rx-Server-02\Docs /MIR /FFT /Z /XA:H /W:5

/MIR specifies that Robocopy should mirror the source directory and the destination directory. Note that this will delete files at the destination if they were deleted at the source.
/FFT uses fat file timing instead of NTFS. This means the granularity is a bit less precise. For across-network share operations this seems to be much more reliable – just don’t rely on the file timings to be completely precise to the second.
/Z ensures Robocopy can resume the transfer of a large file in mid-file instead of restarting.
/XA:H makes Robocopy ignore hidden files, usually these will be system files that we’re not interested in.
/W:5 reduces the wait time between failures to 5 seconds instead of the 30 second default.
  1. Use Robocopy to copy all changes to files in a directory called c:\data to a directory that contains the date, like data_20091124.  Create a batch file as follows.
@echo off
set day=%date:~0,2%
set month=%date:~3,2%
set year=%date:~6,4%
Robocopy “c:\data” “c:\backup\data\%day%-%month%-%year%\” /MAXAGE:1
  1. To mirror the directory “C:\”Folder Name” ” to \\RX-Server-02\Share  ” excluding \\server2\Share\prog” from being deleted (since it isn’t present in C:\directory) use the following command:
              Robocopy “C:\Files” “\\RX-PC-01\Files” /MIR /XD  \\server2\ directory\prog”
Robocopy can be setup as a simply Scheduled Task that runs daily, hourly, weekly etc. Note that Robocopy also contains a switch that will make Robocopy monitor the source for changes and invoke synchronization each time a configurable number of changes has been made. This may work in your scenario, but be aware that Robocopy will not just copy the changes, it will scan the complete directory structure just like a normal mirroring procedure. If there are a lot of files & directories, this may hamper performance.

Robocopy, short for Robust File Copy, is a command-line directory replication and file copy command utility that first made available as feature in Windows Vista and Windows Server 2008, although it has been available as part of Windows Resources Kit. In Windows 7 and Windows Server 2008, Robocopy utility is further enhanced with ability to multi-threaded copy operation feature.
Multi-threaded support allows Robocopy to open multiple threads simultaneously, allowing many files to be copied in parallel. With multi-threaded copying, total time required to complete the operation will be drastically reduced and cut, when comparing with with typical copying one file at time in serial sequential order.
As Robocopy is generally a command-line only utility (although a GUI add-on is available for Robocopy), the new multi-threaded operation capability has to be called via a new switch supported by Robocopy. The new multi-threaded copy feature can be enabled and turned on with the following parameter:
/MT[:n]
Where n will instruct Robocopy to do multi-threaded copies with n threads (default 8). The value of n must be at least 1 and not greater than 128 (between 1 to 128), with 1 as single thread. In fact, Robocopy will copy files and folders in multi-threaded operation by default, with 8 threads in one go. Note that /MT[:n] switch is not compatible with the /IPG and /EFSRAW operations.
For example,
Robocopy C:\Mydocs C:\Yourdocs /MT:32


No comments:

Post a Comment