Search Engine Autocomplete

[John Marshall 8]

Hi,

 

How do you get UBot to use the autocomplete function of search engines? My aim is to be able to input a word to a search engine text box and extract all of the autocomplete results, for both before and after the keyword.  So, the bot would go to google, bing, or similar, and enter

 

keyword a

keyword b

keyword c

 

for the whole alphabet and download all of the autocomplete results to a text file. 

 

Similarly, it would do the same for:

a keyword

b keyword

c keyword 

 

Please note that I wish to achieve this without using api because there are a number of places I want to extract results where there is no api available.

 

Many thanks,

 

John

 

 

[pash 504]

http://network.ubotstudio.com/forum/index.php/topic/17781-ask-amazon-buyer-keyword-api/?p=109546

http://network.ubotstudio.com/forum/index.php/topic/16282-autocomplete-search-engine-url/

[John Marshall 8]

Many thanks, Pash.

 

Please note that I wish to achieve this without using api because there are a number of places I want to extract results where there is no api available.

 

Many thanks,

 

John

[HelloInsomnia 1103]

For the most part they all have hidden API's which you can use Fiddler to see the requests being made.

 

But for a more basic example to just scrape the search field autocomplete you could use the change attribute command to change the keyword over and over again in the box and then just scrape the dropdown.

 

So for Google it may look like:

change attribute(<name="q">,"value","water b")
add list to list(%keywords,$scrape attribute(<class="sbqs_c">,"innertext"),"Delete","Global")

[John Marshall 8]

Thanks, Helloinsomnia. That's given me something to work on.

 

Most appreciated