Home / ubuntu / Questions / 537416
In Process
Anandu M Das
Asked: 2014-10-16 06:26:28 +0800 CST

Copy a word from the html file of a web page using shell script

  • 772

I am trying to write a shell script which should crawl into a web page and fetch a particular character/phrase from its html and display it. Particular character means, for example if the html of the webpage contains a phrase, say password:blah, then I want to print the very next character/word to password, i.e., in short I want the script to print blah. How can I do this?

If more explanation needed, kindly ask. Thanks in advance!

scripts

2 Answers

  1. You don't need a shell script. Probably the following compound command is what you need:

    curl -s webpage | grep -Po 'password:\K\w+'

    For example, the case of this page works:

    curl -s http://askubuntu.com/questions/537416/copy-a-word-from-the-html-file-of-a-web-page-using-shell-script | grep -Po 'password:\K\w+'
    • 2

  2. Something like that should work:

    wget -qO- http://website.com | grep -oP 'password:.*'

    See man wget for all options. wget can download the whole website.

    • 0