mdc101

Where is the advanced edit. I dont see it

Thank you so Much!! I appreciate your help. Regards Matt

Hi LoWrIdErTJ You need to be logged into G+ See https://plus.google.com/u/0/111294201325870406922/posts click on the "view all" under "Have Rand in circles" on left hand side. A div box will load Its not the primary page but the pop up box that holds the names we are after. I don't see any footer data in the box to focus on.

Hi Guys How do you change the html to make it load the next set of data <div class="RP PY" style="top: 0px;"> shows first 18 names <div class="RP PY" style="top: 68px;"> shows next lot <div class="RP PY" style="top: 204px;"> shows next lot So when we look at the html you get <div class="RP PY" style="top: 0px;"> <div class="RP PY" style="top: 0px;"> <div class="RP PY" style="top: 0px;"> <div class="RP PY" style="top: 0px;"> <div class="RP PY" style="top: 0px;"> As you scroll down the scrol bar the html changes to <div class="RP PY" sty

LoWrIdErTJ any chance you could provide a snippet!

Hi Guys here is the code i want to scrape <a oid="116663504982888286028" href="./116663504982888286029">John Wright</a> I am after the url of the href ="./116663504982888286029". We want ./116663504982888286029 The inner text name example "John Wright" So if the list contains an 1000 names I want to scrape them

Hi Gurus, Need to scratch your brains!! Scraping data from G+ To get to see this data Goto G+ and click on circles and then do a search on someone's name. Click on their profile and the click on view all under the persons circles on the left navigation. The ajax pop up loads with all the data. What I have noticed is the data is exposed only as the css style top: 0px; changes example <div class="RP PY" style="top: 0px;"> shows first 18 names <div class="RP PY" style="top: 68px;"> shows next lot <div class="RP PY" style="top: 204px;"> shows next lot We have incremen

hey guys how do you submit a text field when there is no button to press? How do you send the ENTER keystroke or how is this done?

Is there a way to pass keyboard short cuts to ubot. example if you want twitter to scroll down how would you pass the page down key?

Thanks for the feedback

Thanks John, Man all I can say is the deeper I dig and the more I learn about this tool the better it gets. Thank you for you help and mentoring. Regards Matt

Thanks John Appreciate the help. Would we be able to use the same code above to split the string, into two strings, then into two columns in a csv file? How would you go about doing this? Example column A: Question Is there any good cross-platform project management tool? Column B: Category Project Management Thanks Matt

Hi Guys I have scraped a list of data and was wondering if it is possible to delete parts of each sentence in a list here is an example What are the best project management tools for SEO? Search Engine Optimization (SEO) and Project Management Is there any good cross-platform project management tool? Project Management Is there any good project management tool based on Django? Project Management Is there any project management tool like gitorious, redmine, trac, but using external tools for wiki and bugtracker? Project Management What is the best multi-user, online project management too

Thanks John

Hi Guys Is there a way to time how long one loop cycle takes. What I want to do is set the expected time it will take to complete a run. Example time for 1 loop x loops = time till completion in hours:minutes:seconds Is this possible? Thanks

Any ideas guys?

One thing I have noted is my proxy's are not running through the list. They are sticking on the first row. Should I use a random function to garb a random proxy

Hi Guys I am sure this is easy but I cant seem to figure out how to count the rows in a txt file. Here is the scenario I have a list of txt file of proxies and a txt file of user agents. I have created a command that harvests the user agents. In the following code is set the proxy. I then want to set the user agent. Instead of running the user agent scraper command every time I want to wrap the command with an if statement that checks to see if the file exists first and if it exists it has more than one row. if it does not exist then the command runs and creates it. How do I wrap t

Thanks that did the trick John. Should this reload script not maybe be added to the change proxy command. I will add this as a suggestion. Thanks for the help the proxies. They being set now

Hi Guys I am working with the proxy rotation feature in ub4. basically it will allow me to turn on proxy support and then allow me to toggle between normal proxies or private authenticated proxies. Well that's the idea. I have not got passed the plain proxy setting yet. IP:Port I based this off Lily's example but for some reason I am not getting the IP address set. In whatsmyip the IP stays the same even though ot is rotating through the IP list. Could someone run a test or indicate what I am doing wrong here as it can't be that difficult. I have read through nearly all the proxy examp

Ah very clever! Thanks John that's a cool way of working with a large list where you need randomness. Thanks guys for the feedback, appreciated

HI I have shrunk the file down to about 27 lines and it runs through pretty quickly. What I did notice is it changes the useragent every 5th run. Is this how the random list item works? Is there a way to say grab 25 random urls from a large list text file and then have the used as the useragents and on every 5th run it grabs a new set of say 25 random urls? Ideally one would think that random list item would be every run.

Hi Guys I have created a large list of user agents The one file scraped by my bot was about 8900. I then ran a test to work on swapping the user agent ui open file("Mobile useragents: ", #MobileUserAgentList) ui open file("Browser user agents:", #BrowserUserAgentList) add list to list(%CurrentUserAgentList, $list from text(#BrowserUserAgentList, $new line), "Delete", "Global") set user agent($random list item(%CurrentUserAgentList)) navigate("http://show-ip.net/browserinfo/", "Wait") As soon as we get to set user agent($random list item(%CurrentUserAgentList)) The bot seems to take ag

Thanks for the feedback guys

Hi Folks I would like to know what the best way to use the define command. I have read through all the threads but would like to tap into the Gurus minds and find out what is the practical real world best practices for using the define command in bots. From what I have figured out it can make the bots pretty light and as it could eliminate duplicate code if the bots routines are planned well. Is it possible to keep all the defined commands in one functions tab? i.e. a tab that holds all set functions and command. Then from other tabs that process tasks call on the commands using the custo