Home / server / Questions / 450746
Accepted
Ryan
Asked: 2012-11-21 23:43:55 +0800 CST

Faster way to mirror a FTP site

  • 772

I am currently using wget -m to mirror a remote FTP but the speed suck, what are the good alternative (command) so we can parallel to download in order to boost the speed up?

linux

2 Answers

  1. As mentioned by pQd lftp is a great tool for that and it's included in "all" distributions.

    lftp -u user,pwd -e "mirror --parallel=3 --verbose /$REMOTE_DIR /$LOCAL_DIR" $REMOTE_HOST

    You can run it several times with time and different values of --parallel to find the best value.

    • 16
  2. Best Answer

    Take a look at lftp. It's quite a powerful ftp client that has an option for parallel downloads:

    'mirror' can download several files in parallel (--parallel option) and a single file with 'pget' (--use-pget-n option).

    It's available in standard debian's repository so you should have it as well in ubuntu without using 3rd party binaries or compiling it from source.

    • 9