myhq 0 Posted March 10, 2016 Report Share Posted March 10, 2016 (edited) hi, I have two list of keywords, and i want to search for all possible variations, how is this done best? example: list 1:keyword 1keyword 2keyword 3 list 2:city 1city 2city 3 searches:keyword 1 city 1keyword 1 city 2keyword 1 city 3keyword 2 city 1keyword 2 city 2etc etcNote: list 2 could be empty for a list of regular searches.. Next step would be to scrape X urls per keyword combination and add it to a table:keyword combo, url, domainkeyword combo, url, domain>> lets say X=50, then the keyword combo would repeat 50 times, with 50 different urls, before heading to the next keyword combo>> url should be trimmed to domain>> duplicate root urls from different keyword combos should be skipped.I thought the best way to do this is to directly navigate to search query URLS (something like: http://screencast.com/t/3DlTrS2Exmo ) ,but i need some help how to walk through all the keywords variations and paging in the url. Cheers! Edited March 10, 2016 by myhq Quote Link to post Share on other sites
Code Docta (Nick C.) 638 Posted March 10, 2016 Report Share Posted March 10, 2016 ok, had some problems.This script is actually crashing ubot 5 and it should not. clear list(%keywords)clear list(%cities)clear list(%joined)add list to list(%keywords,$list from text("keyword 1keyword 2keyword 3keyword 4keyword 5",$new line),"Delete","Global")add list to list(%cities,$list from text("city 1city 2city 3",$new line),"Delete","Global")loop($list total(%cities)) { set(#city NLI,$next list item(%cities),"Global") loop($list total(%keywords)) { add item to list(%joined,"{$next list item(%keywords)} {#city NLI}","Don\'t Delete","Global") }} but that is the idea,see attached file tracker issuehttp://tracker.ubotstudio.com/issues/1006if u experience the same thing please plus one it, thanks +1 CDjoin-keyword-city-lists.ubot Quote Link to post Share on other sites
Code Docta (Nick C.) 638 Posted March 11, 2016 Report Share Posted March 11, 2016 here is an updated versiomI got it to run with a wait inside first loop as suggested by support in tracker. then added set list position to 0 to fix a bug in my script. join-keyword-city-lists - 2.ubot Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.