Monday, 15 February 2016

Robo Copy

Robocopy is a command-line file copy utility from Microsoft. Unlike normal copy commands, Robocopy is designed for reliable copy or mirroring  while maintaining the permissions, attributes, owner information, timestamps and properties of the objects copied.


Robocopy Syntax

ROBOCOPY <source> <destination> [file…] [options]

<source>        Source Directory (local or network path)
<destination>  Destination Directory (local or network path) and
[file…]              Specifies the file or files to be copied. You can use wildcard characters (* or ?), if you want. If theFile parameter is not specified, *.* is used as the default value.


/mon:<N>Monitors the source, and runs again when more than N   changes are detected.
/mot:<M>Monitors source, and runs again in M minutes if changes   are detected.
/rh:hhmm-hhmmSpecifies run times when new copies may be started.
/pfChecks run times on a per-file (not per-pass) basis.
/ipg:nSpecifies the inter-packet gap to free bandwidth on slow lines.
/slCopies the symbolic link instead of the target.

Important
When using the /SECFIX copy option, specify the type of   security information you want to copy by also using one of these additional   copy options:·           /COPYALL·           /COPY:O
·           /COPY:S
·           /COPY:U
·           /SEC
File selection options

OptionDescription
/aCopies only files for which the Archive attribute is set.
/mCopies only files for which the Archive attribute is set,   and resets the Archive attribute.
/ia:[RASHCNETO]Includes only files for which any of the specified attributes   are set.
/xa:[RASHCNETO]Excludes files for which any of the specified attributes are   set.
/xf <FileName>[ ...]Excludes files that match the specified names or paths. Note   that FileName can include wildcard characters (* and ?).
/xd <Directory>[ ...]Excludes directories that match the specified names and paths.
/xctExcludes changed files.
/xnExcludes newer files.
/xoExcludes older files.
/xxExcludes extra files and directories.
/xlExcludes “lonely” files and directories.
/isIncludes the same files.
/itIncludes “tweaked” files.
/max:<N>Specifies the maximum file size (to exclude files bigger than N   bytes).
/min:<N>Specifies the minimum file size (to exclude files smaller than N   bytes).
/maxage:<N>Specifies the maximum file age (to exclude files older than N   days or date).
/minage:<N>Specifies the minimum file age (exclude files newer than N   days or date).
/maxlad:<N>Specifies the maximum last access date (excludes files unused   since N).
/minlad:<N>Specifies the minimum last access date (excludes files used   since N) If N is less than 1900, Nspecifies the number   of days. Otherwise, N specifies a date in the format YYYYMMDD.
/xjExcludes junction points, which are normally included by   default.
/fftAssumes FAT file times (two-second precision).
/dstCompensates for one-hour DST time differences.
/xjdExcludes junction points for directories.
/xjfExcludes junction points for files.
Retry options

OptionDescription
/r:<N>Specifies the number of retries on failed copies. The default   value of N is 1,000,000 (one million retries).
/w:<N>Specifies the wait time between retries, in seconds. The default   value of N is 30 (wait time 30 seconds).
/regSaves the values specified in the /r and /w   options as default settings in the registry.
/tbdSpecifies that the system will wait for share names to be   defined (retry error 67).
Logging options

OptionDescription
/lSpecifies that files are to be listed only (and not copied,   deleted, or time stamped).
/xReports all extra files, not just those that are selected.
/vProduces verbose output, and shows all skipped files.
/tsIncludes source file time stamps in the output.
/fpIncludes the full path names of the files in the output.
/bytesPrints sizes, as bytes.
/nsSpecifies that file sizes are not to be logged.
/ncSpecifies that file classes are not to be logged.
/nflSpecifies that file names are not to be logged.
/ndlSpecifies that directory names are not to be logged.
/npSpecifies that the progress of the copying operation (the number   of files or directories copied so far) will not be displayed.
/etaShows the estimated time of arrival (ETA) of the copied files.
/log:<LogFile>Writes the status output to the log file (overwrites the   existing log file).
/log+:<LogFile>Writes the status output to the log file (appends the output to   the existing log file).
/unicodeDisplays the status output as Unicode text.
/unilog:<LogFile>Writes the status output to the log file as Unicode text   (overwrites the existing log file).
/unilog+:<LogFile>Writes the status output to the log file as Unicode text   (appends the output to the existing log file).
/teeWrites the status output to the console window, as well as to   the log file.
/njhSpecifies that there is no job header.
/njsSpecifies that there is no job summary.
Job options

OptionDescription
/job:<JobName>Specifies that parameters are to be derived from the named job   file.
/save:<JobName>Specifies that parameters are to be saved to the named job file.
/quitQuits after processing command line (to view parameters)./nosd:
/noddIndicates that no destination directory is specified.
/ifIncludes the specified files.

Examples of Microsoft’s Robocopy syntax.
  1. To copy contents of C:\UserFolder to C:\FolderBackup:
               Robocopy C:\UserFolder C:\FolderBackup
  1. To copy all contents including empty directories of SourceFolder to DestinationFolder:
Robocopy C:\SourceDir C:\DestDir /E
  1. Copy files from one computer to another, skipping files already in the destination.
              ROBOCOPY \\RX-PC-01\usr\Frames \\Rx-PC-02\Frames *.doc /S
  1. Move files over 14 days old (note the MOVE option will fail if any files are open and locked).
              ROBOCOPY C:\SourceFoldern D:\DestinationFolder /move /minage:14
  1. /MIR is an option to ROBOCOPY where you mirror a directory tree with all the subfolders including the empty directories and you purge files and folders on the destination server that no longer exists in source.
               ROBOCOPY \\sourceserver\share \\destinationserver\share /MIR
Or
           ROBOCOPY source-drive:\DIR destination-drive:\DIR /MIR
  1. The following command will mirror the directories using Robocopy:
Robocopy \\RX-Server-01\Docs \\Rx-Server-02\Docs /MIR /FFT /Z /XA:H /W:5

/MIR specifies that Robocopy should mirror the source directory and the destination directory. Note that this will delete files at the destination if they were deleted at the source.
/FFT uses fat file timing instead of NTFS. This means the granularity is a bit less precise. For across-network share operations this seems to be much more reliable – just don’t rely on the file timings to be completely precise to the second.
/Z ensures Robocopy can resume the transfer of a large file in mid-file instead of restarting.
/XA:H makes Robocopy ignore hidden files, usually these will be system files that we’re not interested in.
/W:5 reduces the wait time between failures to 5 seconds instead of the 30 second default.
  1. Use Robocopy to copy all changes to files in a directory called c:\data to a directory that contains the date, like data_20091124.  Create a batch file as follows.
@echo off
set day=%date:~0,2%
set month=%date:~3,2%
set year=%date:~6,4%
Robocopy “c:\data” “c:\backup\data\%day%-%month%-%year%\” /MAXAGE:1
  1. To mirror the directory “C:\”Folder Name” ” to \\RX-Server-02\Share  ” excluding \\server2\Share\prog” from being deleted (since it isn’t present in C:\directory) use the following command:
              Robocopy “C:\Files” “\\RX-PC-01\Files” /MIR /XD  \\server2\ directory\prog”
Robocopy can be setup as a simply Scheduled Task that runs daily, hourly, weekly etc. Note that Robocopy also contains a switch that will make Robocopy monitor the source for changes and invoke synchronization each time a configurable number of changes has been made. This may work in your scenario, but be aware that Robocopy will not just copy the changes, it will scan the complete directory structure just like a normal mirroring procedure. If there are a lot of files & directories, this may hamper performance.

Robocopy, short for Robust File Copy, is a command-line directory replication and file copy command utility that first made available as feature in Windows Vista and Windows Server 2008, although it has been available as part of Windows Resources Kit. In Windows 7 and Windows Server 2008, Robocopy utility is further enhanced with ability to multi-threaded copy operation feature.
Multi-threaded support allows Robocopy to open multiple threads simultaneously, allowing many files to be copied in parallel. With multi-threaded copying, total time required to complete the operation will be drastically reduced and cut, when comparing with with typical copying one file at time in serial sequential order.
As Robocopy is generally a command-line only utility (although a GUI add-on is available for Robocopy), the new multi-threaded operation capability has to be called via a new switch supported by Robocopy. The new multi-threaded copy feature can be enabled and turned on with the following parameter:
/MT[:n]
Where n will instruct Robocopy to do multi-threaded copies with n threads (default 8). The value of n must be at least 1 and not greater than 128 (between 1 to 128), with 1 as single thread. In fact, Robocopy will copy files and folders in multi-threaded operation by default, with 8 threads in one go. Note that /MT[:n] switch is not compatible with the /IPG and /EFSRAW operations.
For example,
Robocopy C:\Mydocs C:\Yourdocs /MT:32


Wednesday, 3 February 2016

Configuring NTP on Windows Using GPO

In short, here's how to configure NTP using GPO

In Active Directory, the PDC Emulator should get the time from an external time source and then all member computers of this domain will get the correct time. Since the PDC Emulator can move around, we make sure the GPO is applied only to the current PDC Emulator using a WMI filter.
1. Go to the WMI Filters section in GPMC and create a new filter like the following:
Configuring_NTP_using_WMI-filter
Here's the query for you to cut'n'paste: Select * from Win32_ComputerSystem where DomainRole = 5
2. Create a GPO and apply it to the Domain Controllers OU with the following settings: Computer Configuration/Policies/Administrative Templates/System/Windows Time Service/Time Providers
Configuring_NTP_using_GPO1
Configuring_NTP_using_GPO2
Configuring_NTP_using_GPO2

3. Assign the WMI Filter to the GPO.
Configuring_NTP_using_WMI-filter-apply
That's done! Happy NTP syncing.

Configuring NTP on Windows Server 2012


This is all you need if you want to keep it simple. Run using PowerShell as admin:

w32tm /config /manualpeerlist:pool.ntp.org /syncfromflags:MANUAL
Stop-Service w32time
Start-Service w32time


W32tm is the command to use. Sure, there are articles out there mentioning "net time", but you should not use that. Some other also mentions editing the registry directly, but as Microsoft mentions in the article: It is recommended that you do not directly edit the registry unless there is no other alternative. But if you really want to check the registry, it's here: HKLM\System\CurrentControlSet\Services\W32Time.

Which NTP-server to use? Or several?

The pool.ntp.org is a round-robin of random selected NTP servers. As they say "This is usually good enough for end-users". But you might want to add several NTP-servers yourself for redundancy?
w32tm /config /manualpeerlist:"0.pool.ntp.org 1.pool.ntp.org" /syncfromflags:MANUAL
Just keep adding them with a space in between them. Yes, I know some sites say you should separate them using comma but that doesn't work. Also, I've experienced issues that it configures correctly, but still after restarting the service, it doesn't work. I just needed to do the configuration again, and try once more. Also, remember that cut'n'paste from the web can sometimes screw up the " character so write it manually instead of cut'n'paste to be sure.

Don't forget your firewall

If you got a firewall between your host and the Internet, it might drop udp/123 which is the NTP protocol.