kev123

You cant do this with ubot compiled exe. several people have tried thanks kev123

meter is 2checkout going to be in that update thanks kev123

you should be able to get this in the 10< seconds range. In one of my apps for each link I 1.strip http www. etc 2.get the hostname 3.work out the tld 4. work out if its a subdomain. this involves creating sub lists and seeing if contains in a "tld list"/hashset per 100,000 takes 2 seconds granted its in c# but if you use the large data plugin the overhead of ubot shouldn't be very large and what i'm doing involves a lot more. if you cant get it below ten seconds using the large data plugin post you code here maybe time for me to spend a afternoon optimizing the plugin if possible.

Hey software glad to see your getting started with the plugin. if you have any questions post here and myself or one of the heavy users will likely help out. thanks kev123

Sahin The issue isn't with the plugin. ubots add item to list isn't thread safe. If you require high performance lists use my large date free plugin. thanks kev123

yeah just drop the list in like %proxylist in the proxy box.

define newdefine(#result) { alert($find regular expression(#result,"\\<title\\b[^>]*\\>\\s*(?<Title>[\\s\\S]*?)\\</title\\>")) } yes you can use a define inside just like normal way in ubot. Keep in mind it behaves the same way ubot defines work where local variables are local to that define only in your example the second define would need to look like this. and edit the first define to pass #result in.

comment("add some sites to list just for example") clear list(%urls) add item to list(%urls,"http://www.ubotstudio.com","Delete","Global") add item to list(%urls,"http://www.bing.com","Delete","Global") add item to list(%urls,"http://www.ebay.com","Delete","Global") add item to list(%urls,"http://www.stackoverflow.com","Delete","Global") divider comment("add proxies as a list here") plugin command("Smartthreads.dll", "Thread control Add proxys", "10.1.1.1:80 10.2.2.2.2:80 etc", "Basic List", "") plugin command("Smartthreads.dll", "Thread control normal", "Test", $list total(%urls), 3, "Yes") d

comment("add some sites to list just for example") clear list(%urls) add item to list(%urls,"http://www.ubotstudio.com","Delete","Global") add item to list(%urls,"http://www.bing.com","Delete","Global") add item to list(%urls,"http://www.ebay.com","Delete","Global") add item to list(%urls,"http://www.stackoverflow.com","Delete","Global") divider plugin command("Smartthreads.dll", "Thread control normal", "Test", $list total(%urls), 3, "No") define Test(#pos) { set(#result,$plugin function("HTTP post.dll", "$http get", $list item(%urls,#pos), $plugin function("HTTP post.dll", "$http userage

hey sorry for delay in response yes it will work fine if you have problems post here and i'll take a look,

looks good thanks

Meter I'm about to create a new install shortly have you plans to send out a update with the features you have mentioned? I don't want to start customising if some of the mentioned features are going to be added soon. thanks kev123

good article although nowadays I only program in ubot for the odd quick job this is applicable for most programming languages(apart from the two copy's of ubot open of course) thanks kev123

hi you are correct you need to use stop and start button, there is a command to stop the plugin. thanks Kev123

if your talking about one copy per machine then yes it would. The reason being is I have some apps that running more than one instance on the same machine can cause problems with shared resources on that machine. no matter how much you tell people they don't listen and it leads to false errors being reported.

think aymen added a follow error pages command.

thanks dan sounds great

Couple of feature requests Ability to disable java and css in the browser and change user agent- reason being is it will be more close to the format returned by http requests, as some pages are different with java enabled. When loading in html ability to switch back to browser view- When I load html in it would be nice to be able to switch to browser view and the html be rendered. Highlight of elements on mouse over- a bit like how ubot does in there browser. I do a lot of inner scraping where i'll scrape a web page sections the scrape from them again. Sometimes it can be difficult to s

as dan said code example if you can thanks

glad you enjoy using the plugin.

Regex isn't really designed for html documents and its very easy for a complex page to cause issues. You will also find you will have to make more and more complex regex to achieve certain things. where as xpath is designed with html/xml in mind and makes things much easier. in proper programming languages you can also do much more complex stuff. for example in a c# project I use the "parent attributes" of a xpath node to determine if a link on a page is in comments on the page. thanks kev123

great product works well

Version 2.3 fixed error with proxys in scraper module updated thanks

no I don't think so but you can with largedata plugin

ubotem Have you got a code sample? MMD no because you would need to use ubot internal threads to accomplish this and that could cause problems. You can however use advanced add commands.