KneeOnLite
-
Content Count
12 -
Joined
-
Last visited
Posts posted by KneeOnLite
-
-
Can someone please give me a clue here Im completely stuck
-
I just can't get this working, I've tried all sorts of different things, setting list positions, incrementing list position variable and everything you can think of. I've rebuilt the script more times than I can remember and have watched the csv videos over and over.
Can anyone cast any light on how to achieve this? I have attached the sample bot and the csv is here http://www.mediafire.com/?r9xne1c7hei1yom
I carnt help but know exactly how you feel just keep at it It looks very close to me, but there agin I know next to nothing. One thing though is that list accountslist actually populated? Good luck.
-
I have been using freeproxylist.not the free ones but VIP lists it costs 25$ a month for virtually unlimited proxies here are a couple to try out
IP Then Port
202.187.17.5:3128
213.0.88.86:8080
213.115.152.75:80
61.244.235.34:3128
92.49.9.155:3128
190.144.53.138:80
195.168.109.60:8080
200.238.83.49:3128
I can normaly download about 200 very hour or so and run then through Scrapebox to get rid of the slow and dead ones. They have been great I usually have a current list of 100 working proxies that I can filter just about any way I need through the website.
-
OK I ran the bot in a loop it still saves only one page at a time instead of adding the data to a file or a list, I also tried add to list instead of save to file and the save to file and add to list togeather. I think Im missing something simple here. Quite frankly Ive had trouble saving stuff and working with lists from the begining.
Ubot is great but it really needs a better help system, I have been all over the net downloading Tutorials/videos and reading, it would be great if there was one place where a new user like me could go and find a structured help system.
-
If you are not running a loop how are you overwriting the data? Are you running the script from the beginning each time? Because that WILL overwrite the data.
As stated above, you need to run it in a loop and add it to a list prior to saving it to the file. I hope that helps.
John
Thanks John I tried to run it in a loop before but will try it again and add to list before I save to file.
-
what are you trying to scrape????give me the url and i will take a look
to me it looks like you are just scraping the url
Pftg4
Thanks but I really dont want to give out the URL but it is a page similar to Google and the bot does actually scrape what I need it just wont save page 1 then add page 2 then 3 and so on. The problem is data saved is getting over written and it saves only the last page scrapped.
-
hi Welcome to the forum
what you need to do is add everything to a list then save to file at the end outside of your loop,
what is happening now is that you are overwriting what you just saved because your save to file is inside the loop that should sort out your problem,but that amount of data all in one lisy this might be problem i think you should split it up but this is just my opinion hopethis helps some what
Pftg4
Hi thanks for the fast reply, but Im confused, I dont have a loop running, and when I tried Add to list I couldnt get it to work. I think I must have tried a hundred different ways and commands, but the good news is I managed to learn some other stuff along the way by my trial and error.
-
I am trying to scrape a webpage of its links, that bit works OK I then have a svae to file and that bit works. Next my bot clicks a next link and will loop again (once I add the Loop) through the same thing. So heres my problem when I check the file it is only saveing the latest page that has been scrapped all the other stuff has been overwritten. It will have about 4,200 pages to scrape.
How can I get my bot to add each page it scrapes to a list, Ive tried most options such as add to list but Im getting nowhere fast. Im have trouble saving stuff to lists. here is what Im tring to do...
http://www.pagezz.com/Capture.jpg
-
Thanks this helped me out with something I have been stuck with
-
Thanks Andy that clears thing up a bit, so if I use the document folder constant at the begining of my bots then I can specify a store location.
-
Firstly Hello all, Ive been busy reading the forums and watching the tutorials on the forums and on some of the sites, thanks to everyone who made the effort to make them and answer Newbie questions like the one Im just about to ask.
Ive managed to make a couple of simple bots that work, one logs into cpanel and creates a specified number of emai accounts, then logs out storing the account information in a file for later use.
The next one logs into a proxy forum and downloads a list of fresh proxies to my desktop.
No big deal but for me a non programmer its a huge step. Right enough babbling One thing Im confused with, if I create a list within Ubot where is that list stored is there a default location. I am running win 7.
Save to File Problem
in General Discussion
Posted
OK I got it. What really confused me is the add to list, I was expecting to open the list and see data, now I moved the save to file outside the loop and saved the data from the list to file. It works just great, and the stupid thing is pftg4 gave me the answer in the first post. Thanks to all. Live and learn.