Monovski 4 Posted December 30, 2014 Report Share Posted December 30, 2014 Hi everyone,I just purchased ubot studio I have basic question here, I have project to create bot for my self like these:1. Scrape urls from specific website that contain articles match with my keywords2. Store the urls to specified folder4. Grab articles from urls I saved5. Save article in specified folder become: article 1, article 2, article 3 and so onPlease help with sample script you made is very appreciatedThanks so much and Please see image http://oi58.tinypic.com/34p04mv.jpg Quote Link to post Share on other sites
Bot-Factory 602 Posted December 31, 2014 Report Share Posted December 31, 2014 Welcome to the ubot world. You will find a lot of examples here:http://www.ubotstudio.com/tutorials Please take some time to look through that stuff. Dan Quote Link to post Share on other sites
Ptrick125 45 Posted December 31, 2014 Report Share Posted December 31, 2014 If you want to get a list of the links, first get the "Add list to list" command out, then in the "List to Add" spot you need to put in a "Scrape attribute" parameter to get the class of links or however they're classified. Quote Link to post Share on other sites
Edward_2 85 Posted January 1, 2015 Report Share Posted January 1, 2015 Welcome to the forum jbsgroup. If your looking for example scripts try searching google with a footprint. inurl:ubotstudio.com "[free]" inurl:ubotstudio.com "example" ect It works better than really any forum search. and here is something to start you with. this will scrape google results via regex. add list to list(%results, $find regular expression($scrape attribute(<class="r">, "innerhtml"), "(?<=href\\=\\\")http.*?(?=\\\")"), "Delete", "Global") 1 Quote Link to post Share on other sites
Monovski 4 Posted January 1, 2015 Author Report Share Posted January 1, 2015 Hi, Happy new year! Thanks for all reply, But please check to target website: kompasiana.com then try to search something until you find search result then click the page number at the bottom (like my image #3 above) the url in the browser wont change so I can't scrape the next page (e.g page number 2, 3, 4 and so on) Thanks so much Quote Link to post Share on other sites
Bot-Factory 602 Posted January 1, 2015 Report Share Posted January 1, 2015 Hi, Happy new year! Thanks for all reply, But please check to target website: kompasiana.com then try to search something until you find search result then click the page number at the bottom (like my image #3 above) the url in the browser wont change so I can't scrape the next page (e.g page number 2, 3, 4 and so on) Thanks so muchWhy does the URL has to change? you can just click those buttons and it will show the new results.By the way.. the kompasiana.com site is presenting results from google so you could just work with google directly? Dan Quote Link to post Share on other sites
Monovski 4 Posted January 5, 2015 Author Report Share Posted January 5, 2015 thanks for all reply but I skipp it until found good solution Quote Link to post Share on other sites
deliter 203 Posted January 11, 2015 Report Share Posted January 11, 2015 Havnt read your problem to be honest,but doing a scrape yourself really is a pivotal point in learning ubot,but WATCH this group of beginner tutorials from Automation League,this guy also has a lot of bot submissions in the bot bank,great guy and an even better teacher,project build a gogle scraper,8 tutorials from absolute beginner leading to the scraper Quote Link to post Share on other sites
arunner26 51 Posted January 11, 2015 Report Share Posted January 11, 2015 deliter,Nice post, thanks for pointing out the videos. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.