Jump to content



Photo

[Free] Plugin Large Data


  • Please log in to reply
199 replies to this topic

#1 kev123

kev123

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 735 posts
  • OS:Windows 8
  • Total Memory:8Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 26 April 2014 - 02:19 PM

My latest free plugin good for large table data storing

 

commands and functions are

 

bigdatacommands.png

 

bigdatafunctions.png

 

Please make sure to look at the example code to see how everything works.

 

you can get the plugin here

http://robobest.com/...rge-datatables/

 

if you have already downloaded one of my plugins you should have a email shortly

 



#2 blumi40

blumi40

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 968 posts
  • LocationEurope/Germany
  • OS:Windows 8
  • Total Memory:8Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 26 April 2014 - 02:23 PM

thx  nice done!
viagra.dll   :) :)



#3 Code Docta (Nick C.)

Code Docta (Nick C.)

    Member for Hire

  • Fellow UBotter
  • PipPipPip
  • 1308 posts
  • LocationIn a Python or UBot IDE or ubotdocta.com
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 26 April 2014 - 02:32 PM

Relly super kewl!!

 

Thanks Kev


UBot Expert Tutorials

 

ubot-docta-header-ubot-expert-store.png

 

UBot expert tutorials and documentation at ubotdocta.com


#4 a2mateit

a2mateit

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 1759 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 26 April 2014 - 02:35 PM

Very nice!

 

Thanks for keeping it free



#5 kev123

kev123

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 735 posts
  • OS:Windows 8
  • Total Memory:8Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 26 April 2014 - 02:36 PM

thanks guys this thing eats massive amounts of data. going offline i'll explain any of the functions/commands tomorrow if people have questions but the example code should explain.



#6 LoWrIdErTJ - BotGuru

LoWrIdErTJ - BotGuru

    Botguru.net

  • Moderators
  • 4524 posts
  • LocationMichigan
  • OS:Windows 10
  • Total Memory:8Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 26 April 2014 - 03:03 PM

looks good nice job bud.

 

I subscribed and some reason didnt get a confirmation email or one to download.  look forward to taking a look.  nice job again



#7 Jeredoc

Jeredoc

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 116 posts
  • LocationFrance
  • OS:Windows 7
  • Total Memory:4Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 26 April 2014 - 03:18 PM

really nice thank u !  ;)



#8 Aymen

Aymen

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 1361 posts
  • OS:Windows 8
  • Total Memory:4Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 26 April 2014 - 03:43 PM

nice little handy plugin

Great job


★★★List Of Killer Ubot Plugins★★★

 

Need Support ? Submit a support ticket here

 

Refund Policy is Clear : No Refunds on all Ubot Plugins


#9 the_way

the_way

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 557 posts
  • OS:Windows 8
  • Total Memory:3Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 26 April 2014 - 04:50 PM

much appreciated kev


2VHxTj5.png


#10 Sanjeev

Sanjeev

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 269 posts
  • LocationIndia, Mumbai
  • OS:Windows 10
  • Total Memory:8Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 26 April 2014 - 05:22 PM

Thanks Kev!



#11 dutchman

dutchman

    Member

  • Fellow UBotter
  • PipPip
  • 15 posts
  • LocationNetherlands
  • OS:Windows 8
  • Total Memory:< 1Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 26 April 2014 - 11:41 PM

Thanks really appreciated Kev !!!

#12 jamesfar

jamesfar

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 511 posts
  • OS:Windows 8
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 27 April 2014 - 12:04 AM

nice


The best proxies provider so far.
* Fast and Great Support. * No software restriction.

* It is favourite proxies provider on GSA forum. * Almost 2000 positive reviews on fiverr. * More than 1000s active clients

 

Try It !


#13 julius

julius

    Member

  • Fellow UBotter
  • PipPip
  • 13 posts
  • LocationMakati
  • OS:Windows 8
  • Total Memory:4Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 27 April 2014 - 02:20 AM

Just what I needed.. hope this works.. thanks tsong! :)



#14 kev123

kev123

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 735 posts
  • OS:Windows 8
  • Total Memory:8Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 27 April 2014 - 04:20 AM

TJ check PM.

 

to explain some of the return commands to ubot a bit better, 

 

list from large table

return large table csv

large table return

 

with the above commands you can specify a range for example row 10 to row 100 or you can return the full large table by specify 0 0 in row start and row finish.

 

Large table bulk input

 

I created this command to enable multithreading to be stored to a single main table.

 

plugin command("Bigtable.dll", "Large Table bulk input", "bulkinputtest", "1,2,3,4,5,6,7,8,9")

 

the above is not the best way to use this if you adding more than one line to large table in a thread the following is

 

plugin command("Bigtable.dll", "Large Table bulk input", "bulkinputtest", %somethingscraped)

 

so say for example you where scraping and then carrying a inner scrape of that you would add to a list like this

 

add item to list(%somethingscraped, "scrape1,scrape2,scrape3,scrape4", "Don\'t Delete", "Local")

 

so each line in the local list is a comma separated row of your scrapes. the local list is then added to the table.

 

check the example code to see how it works.
 

Thanks to everyone else for feedback i'm going to do a update later in the week to improve efficiency of a couple of the commands which were added at the last min to prove concept(most average users wont notice a difference only the heavy scrapers). If you have any suggestions for other commands let me know.



#15 Sanjeev

Sanjeev

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 269 posts
  • LocationIndia, Mumbai
  • OS:Windows 10
  • Total Memory:8Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 27 April 2014 - 05:07 AM

Hey Kev, is it (thread) safe to use local lists for multi threading?

 

I remember ,there was  a mention on UbotDev's 'Thread counter'  plugin  thread - saying that lists are not 'thread safe'  and also Aymen's local dictionary plugin was created  becuase  ubot's  native  'local' lists/variables are not fully thread safe.

 

Thanks.



#16 kev123

kev123

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 735 posts
  • OS:Windows 8
  • Total Memory:8Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 27 April 2014 - 05:17 AM

its the variables that can, that's why Aymen's local dictionary plugin was created. Local lists shouldn't be a issue I believe aymen added them so you can have large lists that are to big for ubots lists. I may be wrong but I haven't ever had issues with local lists as long as there in a define.



#17 Sanjeev

Sanjeev

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 269 posts
  • LocationIndia, Mumbai
  • OS:Windows 10
  • Total Memory:8Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 27 April 2014 - 05:43 AM

 

I haven't ever had issues with local lists as long as there in a define.

Thanks, that's all I wanted to know. :)



#18 rocket976

rocket976

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 548 posts
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 27 April 2014 - 08:03 AM

Great stuff Kev cant wait to try this. Thank  you. !



#19 webpro

webpro

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 759 posts
  • LocationQuebec
  • OS:Windows 10
  • Total Memory:8Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 27 April 2014 - 03:04 PM

KEV MY MAN

 

 

viagra.dll

INDEED



#20 UBotDev

UBotDev

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 1395 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 27 April 2014 - 04:17 PM

Thanks for the plugin. I think in modern days large data really is a problem, but UBot at core doesn't handle them well (I was even told it was never meant to).

 

However, was wondering, how exactly this plugin solves large data problem; by loading only a subset of data at a time, that's it, right?

 

Hey Kev, is it (thread) safe to use local lists for multi threading?

 

I remember ,there was  a mention on UbotDev's 'Thread counter'  plugin  thread - saying that lists are not 'thread safe'  and also Aymen's local dictionary plugin was created  becuase  ubot's  native  'local' lists/variables are not fully thread safe.

 

Thanks.

I think you got that wrong. There I was referring to global lists being accessed from threads, not lcoal ones.

 

its the variables that can, that's why Aymen's local dictionary plugin was created. Local lists shouldn't be a issue I believe aymen added them so you can have large lists that are to big for ubots lists. I may be wrong but I haven't ever had issues with local lists as long as there in a define.

Whats wrong with local variables? I never had problems with them but lately noticed that people are using workarounds for them. Is that really needed? I've didn't found a single example which would prove that local variables don't work.


CLICK UBotDev.com - Download FREE UBot Plugins!

______________________________________________

 





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users