hatkyinc

Odeesuba, Any updates?

Thanks a2mateit, but I do need the other data, I am scrapping the entire data untill now, but wanted to move to the file download. Odeesuba, I would love to see how you do it. I did see the command, but I don't understand if it's possible to avoid the interactive save file, since I am running this program as a batch...

Using the adwords keyword tool. How Do I save the file after pressing the "donwload"? Steps to button: 1. Go to google adwords keyword tool. 2. Do some search, say "test". 3. Press "keyword idea" tab if you happen to be in the other one. 4. Under the tab (very close under) there are a few grey buttons, one is "donwload" with an arrow. 5. click that. 6. "all search results" 7. doesn't matter the format, click "download" Now open a Ubot save window, but how do I script to save the file without interaction

Is there a way to control HTTP_ACCEPT_LANGUAGE http header in ubot4? Since Ubot3 was using internet explorer it was controllable from "internet options"... Is there a way, like some generic http headers control that I am missing? or should I open this as a request...

From my experience, the compile problems are network/server related and are kind bad doing some hours and works perfectly on other hours.

Thanks a lot, I found my problem while trying to put here a test bot showing the problem. I was doing something like: Change attribute "" (empty). Send keys "keyword". Change attribute "keyword" (because the keyword is not in English it gets garbled). And this used to work before Google changed something. I just added another command at the end. Send keys " " (Space) And this fixed it. (space at the end of the keyword doesn't have meaning ) Thanks a lot for everybody!

Really thanks for trying, but I don't want alternative, I need only this.

I need also search amounts and similar keywords. (not just long tails)

Thanks, but I need a lot more then that.

The google keyword tool used to work with ubot3. Now you can't do a search in it with ubot. I think the problem is that ubot "change field" and "send keys" both fail to trigger some event. You do one of the two (or both) and press the search, and it's like you didn't type anything. (even pressing the search button manually). If on the other hand, you change the value manually (in the browser) and ubot presses the search it works. I assume some kind of java script solution is possible ("run javasctipt"). Either by some "send keys/change..." event Or just finding what should be triggered,

For advance users, there is already a way to use mysql even in version 3. I am using it for a long time, with shell commands to the local mysql client. Works perfectly fine. Sure it takes some work to setup initially, but you can use EVERYTHING that mysql has to offer. It work good since the mysql client has so many options for command line runs. (I know oracle has something similar with the sqlplus command. Access would probably be hard). Just remember to use the 32bit client, 64 doesn't work with ubot until ubot will come in a 64bit version I assume.

Thanks John, I checked the different choose options and choose from chosen seems to do the trick...

Yes, they have different content but it's dynamic and all the structure is the same. The tables aren't even siblings, they have div's separating them and a big node tree...

I have a bot, scraping a site, the problematic part looks like so: choose by attribute id Scrape chosen table &table Now the problem is, there are now 2 tables with the same id (used to be only 1), I need to extract both tables. This code extracts the 1st. How do I extract the 2nd?

I got a bit brave and tested it on my server. Results: 20%-50% less CPU consumption on my bots. WOW! About the same amount of RAM usage if anyone is wondering. (at least it's not worse, same leaks/growth in consumption) The system has no real GPU, just the on cpu one (core i7 2600k with H67 board), but then again, I am not using any HTML5 or otherwise graphical sites. Bugs: On the main bots I haven't seen anything problematic yet. I have a small test bot that gives some error "Xenocode postbuild 2008 - unable to load the required virtual machine" and then ends itself. * Another note

Any bugs and/or issues with Ubot? Does it accelerate "normal" pages or just HTML5/Graphics stuff?

I actually though there are many reasons that you would want to use the different browsers, especially if you are going to develop a new internal browser that isn't ie anymore. Example if you do that, the Google SERPs could look different. (Google and their "personalization") Beside like the web is missing any broken sites in here or there... I actually tried to use the 'in firefox window' for performance and memory, but the 'write to browser' didn't work, and as I said about SERPs... (2 different bots)

I have been hacking this like crazy, so I hope this be useful to someone. Disclaimer/Who this is NOT for This is not for newbies. This is not for anyone looking for a "supported solution" This is probably only for real programmers. (novices can maybe survive this) This is UGLY, who ugly? The "OMFG are you serious we got to do this, this way?" kind of ugly. Prerequisites You got to know how and to handle states with in your bot, whether by DB or files(csv's or what ever). This I am not going to help you with, I assume you can do this or this is not for you. What I mean is that when your b

I am kind of confused with all the posts about the topic. Simply, if I want to multi task jobs by ubot with different proxies at the same time on the same computer, how do you do it? (does each ie proxy switch work on the current thread/ubot/computer? should you use firefox? external program?)

It is funny there is no check file command, I just got that problem, yet it does put an error when you try. I did create an empty file I am going to pack and some text to identify.... Not a nice way, but something for now.

+1 to append file request. Normal programming as another way to open a file to append that doesn't reread the entire file. Usually this would only change a signal character of code. f=open('c:\file.txt','w'); to f=open('c:\file.txt','a'); This is an OS level service and doesn't use the HD to read at all, not to talk about all the memory and processing ubot uses in putting it into a list first.

I am asking for subs. The sub should accept the keyword as a parameter. Like sub name parameter keyword The keyword will be sent from the main program/from a gui that I will make.

I can code stuff but am looking to outsource stuff and want to know the costs. Please price the libs separately, I way want to buy only some after I see the pricing Offers must include ubot code and the right to edit and resell executable files. 1. keyword tool lib: a. sub1: get into the keyword tool, setup language and location(sub parameters), and solve captcha (manually currently) sets the 3 match types to on b. sub2: Gets a keyword (parameter), puts it in and searches, then extract all the columns to a list, then convert the list into a CSV text and return that to the caller. 2. SERP cou

I had many problems with the $eval and string libs and got to a few conclusions. Basicly you need to notice the string that you send. 1st tip: Try it with an online javascript tester like: "http://www.w3schools.com/JS/tryit.asp?filename=tryjs_intro" 2nd tip: Multi line var's don't work out of the box! 3rd tip: Look up chars like ' or " they can kill the string too.

Becouse you create many accounts from the same ip?