If we have a successful build on our build server (CCNET) all ASP.NET website files are copied to the virtual directory (%output_dir%) so non-developers can see/test the latest version of the website. At the end of the build the following bat file is executed.
rmdir /s /q "%output_dir%"
mkdir "%output_dir%"
xcopy "%source_dir%*" "%output_dir%" /e /c /i /q /-y
The problem is I find the copying slow and was wondering if there are any copy commands available in Windows 2008 that are faster than xcopy? The source and destination are on the same drive. Below are the arguments we use when copying.
/e = copies directories and sub directories including empty ones.
/c = continues copying even if there are errors
/i = if destination does not exist destination is directory
/q = don't display filenames
/-y = confirm overwrite
From a performance standpoint only, xcopy or robocopy will give you similar results. I ran through a couple of tests on a Windows Vista 64-bit SP2 box to do some comparisons. All copies were performed between a internal 7200 RPM Sata II disk and an external USB 2.0 drive or on the same internal drive itself where indicated. No special setup was done (make up your own mind if that invalidates/validates the test), only to input the command into a batch file to execute. PowerShell was used to capture the start and stop times. After a couple of passes here are the averages from the tools I played with:
File: 732,909,568 bytes (698 MB), 1 ISO file copied to different directory on the same internal disk.
File: 732,909,568 bytes (698 MB), 1 ISO file copied to external USB disk.
Files: 45,039,616bytes (42.9MB) 5 random files copied to external usb disk
Files/directoies: 1,087,180,800 bytes (1.01 GB), 27 files/8 directories copied to external USB disk.
This is by no means an exhaustive test, but just throwing a quick real world scenario at some of the more popular tools in this genre shows that your pretty safe sticking with either xcopy or Robocopy (from a performance standpoint only). Also the Robocopy option
/NP
(No Progress) saves you 0 time. That doesn't mean you cannot benefit from using something other than xcopy however. Robocopy is a great example (from Wikipedia):Robocopy is notable for capabilities above and beyond the built-in Windows copy and
xcopy commands, including the following:
I typically use:
or some other variant of the parameters - perhaps
/NFL /NDL /NS /NC /NP
to match the "quiet"Actually, by eliminating the Network, you really restricted your testing. You might wish to consider using a network share, which is going to be bulk of admin work.
Additionally, you should use FTP, and skip CIFS altogether. Eseutil.exe is another utility you could throw in there. ( an Exchange util that can be used elsewhere, along with it's four dependent dlls. )
Then I'd like to see your results.
I use XCopy for the same purpose. What I also did was added another NIC to that server and put it on a separate subnet. Then made a direct connection to the server I am transferring files from. That way the 2 machines are moving the copied data via one subnet and users can still access via the second nic which is connected directly to the LAN.
You say the source and destination are on the same drive, but are they both on the build server?
If the build server is the location of the source and destination, consider moving one folder or the other to another drive, maybe on another controller.
If the build server is not the location of the source and destination (build drops are not always on the server they are built on), consider creating a task on the server where the source and destination folders reside. Then just kick off that task remotely.
I have had to do several copies over the years. We have one Windows Server 2008 R2 machine that has a single directory with over 12M images inside it (approximately 400GB).
Obviously I would prefer it not be such a large directory BUT:
Anyway, I just thought I'd share my experience with them because of the unusual nature of my really large directory.