Home / ubuntu / Questions

Questions[wget](ubuntu)

Martin Hope
Rey Leonard Amorato
Asked: 2014-05-09 10:42:36 +0800 CST
  • 22

I'm writing my own script to download multiple items (simultaneously, one item per command) using wget and I need a progress bar. I currently utilize zenity --progress for my progress bars, but the problem is it spawns multiple progress bars when downloading.

What I want to achieve is something similar to the file transfer dialog in Nautilus:

Ubuntu's file transfer dialog

Can anyone point me to the right direction as to which program(s) or language(s) that will achieve this.

NOTE: I only have basic knowledge of shell scripting, not much else.

wget
Martin Hope
user239598
Asked: 2014-01-28 06:38:02 +0800 CST
  • 47

Using a web browser (IE or Chrome) I can save a web page (.html) with Ctl-S, inspect it with any text editor, and see data in a table format. One of those numbers I want to extract, but for many, many web pages, too many to do manually. So I'd like to use WGET to get those web pages one after another, and write another program to parse the .html and retrieve the number I want. But the .html file saved by WGET when using the same URL as the browser does not contain the data table. Why not? It is as if the server detects the request is coming from WGET and not from a web browser, and supplies a skeleton web page, lacking the data table. How can I get the exact same web page with WGET? - Thx!

MORE INFO:

An example of the URL I'm trying to fetch is: http://performance.morningstar.com/fund/performance-return.action?t=ICENX&region=usa&culture=en-US where the string ICENX is a mutual fund ticker symbol, which I will be changing to any of a number of different ticker symbols. This downloads a table of data when viewed in a browser, but the data table is missing if fetched with WGET.

wget
Martin Hope
Sourav
Asked: 2012-02-13 08:39:47 +0800 CST
  • 160

How can I download files (that are listed in a text file) using wget or some other automatic way?

Sample file list: 

www.example.com/1.pdf
www.example.com/2.pdf
www.example.com/3.pdf
wget
Martin Hope
Chinmay Kanchi
Asked: 2011-11-10 16:08:34 +0800 CST
  • 56

When using wget in a script to download some files from Google Docs, the name of the file is not preserved. For example:

wget 'http://spreadsheets.google.com/pub?key=pyj6tScZqmEfbZyl0qjbiRQ&output=xls'

saves the file as pub?key=pyj6tScZqmEfbZyl0qjbiRQ instead of indicatorhivestimatedprevalence15-49.xls, which is what I get if I click on the link in a browser. Is there any way to enforce this "browser-like" behaviour in wget?

wget