jewcat

Alright, I'm scraping a site for specs on different electronics. Each item on the site has a large number of different values to scrape and move into a CSV. Some pages have some specs while others don't, so I am doing a if command to search the page for each value's heading before setting the variable value and adding it into the CSV string. Then I encountered a problem. From page to page the headings for each value are different: Digital<FONT color=#fefefe>:</FONT>Media<FONT color=#fefefe>_</FONT>Broadcast<FONT color=#fefefe>_</FONT>Tuner: Digital<FO

ya, i'd just $replace all $newline with $nothing, should do the trick. or at least get you close to your aim.

I agree that the UI could be far more flexible, and one of the areas that ubot is lacking most is in options for compiled bots (ex. i would love to be able to set the onload url, so the bot opens to a webpage instead of a white blank upon opening), but in the long run I'd say that UI flexibility is an improvement that can wait a good while yet. There's lots of long needed improvements still on the waiting list to improve the actual functionality of ubot that are far more key than making compiled bots look prettier for the end user.

i haven't used it yet, but i was under the impression that ubot let you tap directly into your own decaptcher account. so if that's the case i'd assume you're only going to pay the $2/1000. Hopefully that's the case, need to implement decaptcher into the current bot i'm working with too...

Any news regarding the new beta release? What's the status at this time?

bumping this one, this is getting to be a recurring issue when i'm looking at automating processes on a variety of sites. how can i work with this?

Was going to continue this thread http://ubotstudio.com/forum/index.php?/topic/1943-seeking-help-with-squidoo-lens-making-bot/page__hl__squidoo__fromsearch__1 but it seems no one had anything to say and it doesn't sound like the OP ever made any progress. The issue I'm seeing is that when you click an edit button you get this flashy dHTML lightbox sort of popup window. I encountered the same thing a few times, and it never seems to let me select any elements within these popups. Is there a way to handle these? Same sort of popups boxes you see in Facebook, and Google Buzz...

I'm using a piece of php on my server. The bot inputs a directory name in a text input, and a list of scraped image URLs into another text input. The files are then loaded directly to my server for working with. had it hacked together by a coder on DP. Only issue is that it seems to drop about 20% of the images without fully downloading them. Still can't wait for an actual Save As feature to come along.

Just curious what all captchas are supported by decaptcher. Do they do ANY image captcha?

i clear and reload personally.

Gonna drop a noob question here, lol. What do you mean by "hooks that are removed in compiled bots"?

having an issue sort of like this with a client's bot. everything works fantastic locally, yet refused to clicksome links running ona clinets machine, not sure why yet.

i just did select by attribute -> innertext click chosen and it clicked fine here. Don't know what to say.

Use the Document Constant $meta keywords, you can also scrape meta description... meta_tag_scraper.ubot

navigate away to another page, then retry. usually solves the problem for me.