How to scrape a page and save to file

[malefic 48]

Hey again.

 

I have a bot that fills in some fields and then clicks SUBMIT.

On the next page there is some information that I want saved into a file - how would I do that??

 

I do the screen_scrape and the left / right thing is the HTML tags between which the info I want sits.

How do I get that bit of info to save into a file?

 

Cheers

[Guest jonathani501]

If I understand correctly you:

    add to list

    then used $page scrape

 

The next thing to do is click a node and go to Variable Commands > save to file

In the Save to File area click Browse and pick the name you want and add .txt, .html, etc.

In the what to save area right click the Sub Parameters and click "insert list" and you're done.

 

Run your script and it will save all the content.

[Guest luminus]

The above is correct. The key (and most confusing part) is to use "add to list", choose or create your list, and then click OK without choosing a parameter.

 

THEN highlight the blank parameter node and use $pagescrape on the browser side after highlighting the appropriate info.

 

That will add your scraped info to the list. Then you can save the list to a file if you desire, or whatever you want. The finished script will look like the following:

 

http://screencast.com/t/mG6BWSieGLn

 

 

 

[malefic 48]

Cheers - will go and have a go at cracking this one

[malefic 48]

Okay - bound to be something stupid, but the script now creates the file to save to but nothing gets saved into it.

My bot looks like:

 

http://tinyurl.com/ykfk3tx

 

This tool is going to be so cool when I manage to understand how to use it properly!!