faraz
-
Content Count
27 -
Joined
-
Last visited
Posts posted by faraz
-
-
It can be done.. Scrape first the top 10 google result sites then enter them one by one on that site
http://ipagerank.org
then scrape the details..
Well, I could do that I suppose but wont that site ban my ip.
As for what details I want except google page rank, they are the number of links indexed
and the number of links pointing to the site.
This is web based but is more a ip block analyzer than anchor text analyzer: http://tools.seobook...s/backlinks.php
This could be automated with winautomation or auto hotkey then brought into ubot via list or table: http://tools.seobook...klink-analyzer/
Again, I am concerned whether my ip or the ip of my clients will be banned while using this.
Faraz
-
You can use this kind of sites to scrape website statistics
http://ipagerank.org/results/www.allcleaningbusiness.com
I am not sure if this will help because I want to get the link details about the top 10 sites in google.
Is there any other site like this which could help?
Faraz
-
oh,Boy!
That means there's nothing I can do about it.
I hope there's some sort of update which helps with this.
Faraz
-
well, there is a sequake extension for internet explorer too.
But, I haven't tried it yet.
will try it and see if it works.
-
Hi,
I use firefox a lot and I use the seoquake plugin to do some seo research.
So, I want to build a bot, which helps me to scrape data from the seo quake plugin for the top 10 results.
So, I would input a keyword or a list of keywords and it would scrape the seoquake data for the top 10 results.
I have attached a screenshot to show what it looks like.
The problem is that I cant see this seoquake data in the browser within ubot.
So, what am I supposed to do?
Faraz
-
I would select generate a standard UI
Selection 1
Selection 2
Selection 3
Then I would have the client create a file with the filenames in that list
c:\data\filename1.txt
d:\otherdata\filename2.txt
c:\backup\filename3.txt
I would then explain to the user that this is a one to one relationship that
"Selection 1" would equate to c:\data\filename1.txt
"Selection 2" would equate to d:\otherdata\filename2.txt
"Selection 3" would equate to c:\backup\filename3.txt
That is the way would approach until the ability to dynamically load the UI fields programmatically.
I hope that helps.
Ah, Thanks.
This helped me indirectly.
So, now I will just ask the client to create files that are being used by the bot
and to store those files in the folder, where the bot looks for the file.
So, its okay now.
Thanks,
Faraz
-
Do as Lillt suggest
filename1
filename2
filename3
The same logic applies. You can then apply a folder prefix and even append a filename extension to the selection.
Well, most probably I will be selling the bot and the problem is that I dont know, what are the different filenames in a person's hard drive.
So, how can I choose only 3 filenames.
Different persons can have various different filenames, and it is impossible for me to guess those names.
Hope you understand.
-
One way you could do this is you could use a UI list box, and have random words that represent each list.
cow=list 1
tree=list2
chicken=list3
Then use an if then else command:
If>Evaluate>Value 1=Cow
Then > draw from list 1
If>Evaluate>Value 1=tree
Then > draw from list 2
If>Evaluate>Value 1=chicken
Then > draw from list 3
Well, actually I meant something different.
Maybe, I should have said a file.
So, I want the user to be able to choose any file from his hard drive.
Since the file is actually a list of links(or urls), that is why I said choosing a list.
But now I think I should have said file.
So, user chooses a file which contains a list of urls.
and then bot chooses each item from that list to scrape data.
How do I do that?
-
Hi,
I am building a bot and I want the user to be able to choose which list should be worked upon.
The steps are :
User chooses list
Then that list is used to create a loop
where the bot navigates to each of the urls in the list
and then scrapes it.
I have got the scraping part correct.
The part that I am not getting is how to get the user to choose the list
and make the bot work with it.
Faraz
-
I need a keyword bot created. Something that will accept a seed word (or phrase), look it up on the Google Keyword Tool and then check all the results for competition.
Please contact me if you are interested, and I'll send you the exact flow that I want.
I'd rather pay someone to do it instead of doing it myself because of time constraints.
Hi,
I can do this for you.
Let me know the details.
Faraz
-
Try the bot in post #17, mate.
Wow,Its working perfectly now.
Can you tell me what was wrong with the bot I created?
Want to make sure this kind of things doesnt happen again.
Please explain the logic of the "clear list" command.
I just dont get it, how it is working if I am clearing the list.
And one more thing.
The results I am getting have ,'s in them. eg, 63,20,000 or 20,000
so how do I remove those ,s . but keep in mind that there will be certain results without ,s such as
260 or 2 or 790.
Anyways, I have to go to be bed now. Its about 1:30 am in my part of the world.
Thanks.
Will read your answer when I get up.
Bye,
And thanks again everyone.
-
Correct me if I am wrong but you are trying to increase the size of the list WHILE you are in a looping situation. Right?
If that is the case then you are setting yourself up for an infinite loop in the event you do not set the logic up correctly.
LillyT's suggestion about using the list position is a good one. But here is what I am wondering. I doubt seriously that you can increase that list's size while the Loop that you are in has that list's amount when you first went into it.
As far as modifying the List's total record count while in a Loop using that original total is probably a question best left up to Seth.
Well, no! I am not trying to increase the size of the list.
there is one list which I am using to set the number of loops.i.e the keyword list.
so, if the keyword list has 50 items, there should be 5 loops.
and each time the loop happens the bot scrapes a page and adds the result to a list.
so, when the bot stops, there should be 50 results in the scraped list.
Hope this is clear now.
-
1. At the very beginning of the script, do
clear list > %keyword list
clear list > %competition
2. After the add to list > %keyword list, do a set list posiiton (0).
3. Move the sub: google results scraping out of the loop, and to the end of the script.
Let us know how you get on.
Well, I dont this I should be clearing the lists, because then how will the loop work the 2nd time,
if the list is cleared.
and how will I save the competition list, if I clear it each time.
I moved the sub google results scrape out of the loop and when I check the competition txt file,
it is just showing the list result where the bot came to a stop, although it stopped when the list ended.
so that part is working now.
-
And your list is populated by more than one item right? Really wish I could send you an example. . .
The set list position should just allow you to loop without that range error, not repeat the same item over and over.
Where exactly do I put the set list position command.
should I put it outside the loop or inside it.
I had put it inside the loop just below where I choose the number of loops command.
-
Hi faraz. Go under the variable commands and grab the set list position command. You need to set the list position for that list you are using to zero
Okay, I did that and it keeps repeating the same item again and again.
-
Will need to see the whole loop to advise. Can you post a screen shot or upload the ubot file?
I couldn't upload the screenshot,
so I am uploading the ubot file.
-
It's likely to be a problem with your code, where you are trying to access an list item that's not in the list.
Can you post a screen shot of the loop?
Here's the actual error that I am receiving:
you have exceeded the range of the list.
command: $next list item
-
$add to list (0)
[/code]
The $list total will do the job Ok. No other command is required.
Ah,Thanks.
I used this one and it worked.
Just one more problem.
I have created a loop to get this to work.
And I have chosen the "list total" command to choose the number of times, the bot loops.
But, now I find a message which says that the range has exceeded list total.
So, what can I do about this.
-
Sounds like you need the if then else command
If search page "whatever"
Then add to list -constant
Else-do something else that does not involve adding anything to a list.
or delete else all together.
Its up to you.
Well, I am already using the if then else command, but I dont know how to add the zero.
As you said:
If search page "whatever" ----------------- I have already done this
Then add to list -constant ------------------- I dont know how to add the constant(which is zero) to the list
So, how do I do that?
-
HI,
I am actually creating a bot which scrapes a page and before the page scrape starts I have
put a "search page" command to search for a certain element on the page.
What I want is that if that element is not on the page, then 0 (zero) should be added to the list
where the rest of the scraped results are added.
So, how am I supposed to do that. I am not sure which command should be used to do that.
One more question.
I am using a loop to scrape these results.
and I want it to loop for the number of items in a list.
So, I have chosen the number of cycles of the loop using the "List total"
command. So, say the list has 50 items, the bot will loop 50 times.
What I want to know is, will that be enough to control the number of loops
or do I have to give a separate command to stop the bot?
Faraz
-
Okay thanks for the answers. I will check out the REPLACE tutorial.
As for the set list position command, will it make the script stop when it has cycled through all the list items?
I want the script to stop when it has completed all the items in the list, instead of giving me an exceeded list range error. I dont want it to start over the list items again.
I hope I have explained this properly.
Faraz
-
Hi,
I am trying to scrape number of competing pages from the google page and save it to a csv file.
now the problem is that when the number of results is 79,900 or 1,20,000 or something like this which contains comas, then 79 and the 900 are saved into 2 different columns and not in one column as it should be. and the 1,20,000 then is saved as 3 different columns with numbers 1 20 and 000 in the 3 columns.
Now, what am I supposed to do to correct this?
another problem is that I am using a loop for this bot, where the bot uses the number of keywords in the list as the number of cycles. but when I run this bot, I get an error message at the end of the list i.e. You have exceeded the range of the list. So, could anyone tell me why this is happening?
I have a confusion too. Since I am in India, when I visit google , it shows up as google India. What I want to know is that what happens when someone uses this bot in the USA? will they also be taken to google india or will they be taken to google's usa site?
Faraz
-
Here you go
http://img413.imageshack.us/img413/8035/75641897.jpg
Oh, wow!
This seems to be just what I wanted.
Thank you so much.
Faraz
-
Hi,
I want to build a keyword bot, where if I enter a list of keywords or maybe just one keyword.
the bot should find out its google competition.
Actually, I have already built a bot where if I enter a keyword , it gives the number of results for that keyword.
Now, what I want to do is that instead of just putting in the keyword in the search box. the bot should put the keyword in quotes and then find out the number of results.
so, if I put in a keyword say ( cheap cigars), the box should put "cheap cigars" in the search box and display results according to that.
the problem is that I am not sure how to make the bot put quotes around that keyword.
I hope I was able to make this clear.
I would also like to know how to do this same thing for a list of keywords.
Faraz
Facebook Apps
in General Discussion
Posted
I am not sure I understand.
Is this something we can create with ubot? the facebook applications, i mean.