[How to Scrape Google SERP]

This works for me:

 

 

 

John

 

Wow, it's simple and it works!

 

How did you arrive at this solution, JohnB?

[How to Scrape Google SERP]

Thanks, BotBuddy.

 

Do show us how you arrive at your solution as well so we don't have to keep asking you. =)

[How to Scrape Google SERP]

I was trying to do a research bot, but was stucked at step #1.

 

But what I'm getting from the output are a heap of trash covering the info I want.

 

Either I'm choosing the wrong stuff or I've scrapped the wrong thing...

 

Has anyone done this before? Spent lots of time trying to figure this out but failed.

 

Thus any help is greatly appreciated.

 

(have attached my broken bot here)

ScrapeGoogleSearch.ubot

[How To Choose Option Using Javascript (or via other means)?]

I was at http://www.yello.com.sg, trying to automate posting of an advert.

 

I can make UBot choose the category, but no matter what I try the next set of options just wouldn't appear.

 

(have tried things like Click Chosen & Send Keys... to no avail)

 

The portion of the source code is below. Anyone knows how to do it?

 

Any help is really appreciated. (No idea why I keep having problems with dropdown boxes)

 

_____________________________________________

<td valign="top"> <strong>Category step : 1 </strong>

<select name="maincat" size="10" id="catlevel1" style="height:150;width:230px" onChange="keepid(this.options[this.selectedIndex].value,'id'); showsubmenu(this,'brand',1);">

<option value="9" selected > • Automobile & Motorcycle Parts/ Accessories/ Services</optin>

 

<option value="6" > • Automobiles</optin>

 

<option value="8" > • Insurance & Financing</optin>

 

<option value="7" > • Motorcycles</optin>

[How To Run This Javascript?]

Problem solved! I didn't need to use javascript for this site.

 

Choose by Attribute (category_choose) --> Send Keys File Chosen (Value)

 

Works like a charm, Gogetta.

 

But even after reading, I still don't understand the difference b/w "send keys file chosen" & "send keys field chosen". Anybody can enlighten me? =)

 

 

From the glossary:

 

send keys file chosen:

This command is used specifically for filling text into file input fields, as a means of getting around the lack of direct access to them. This command will not steal focus, and runs entirely in the background. To simulate typing on elements other than file fields, use send keys chosen field. This command no longer works if you have internet explorer 8 installed.

 

send keys field chosen:

This command will simulate keystrokes to input fields other than file fields. This is useful in cases where the field reacts to keystrokes with javascript, and change chosen attribute does not trigger the javascript associated with the element.

[How To Run This Javascript?]

Help...help!

 

How do I run this Javascript in order to get the webpage to respond?

 

I somehow need to get the "jumpmenu" function to work so that onchange="jumpmenu('parent',this)" can get the next drop-down box to appear.

 

Any help is appreciated.

 

Source code is as below:

______________________________________________________________

 

function jumpmenu(target,obj,restore){

eval(target+".location='"+obj.options[obj.selectedIndex].value+"'");

obj.options[obj.selectedIndex].innerHTML="Please Wait ...";

}

//-->

</script>

<select class='adsmanager_required' name='category_choose' onchange="jumpmenu('parent',this)">

<option value="http://www.12zsingapore.com/ads/products/write-ad?Itemid=0" selected='selected'>

Products </option>

 

<option value="http://www.12zsingapore.com/ads/others/write-ad?Itemid=0" >

Others </option>

<option value="http://www.12zsingapore.com/ads/announcements/write-ad?Itemid=0" >

Announcements </option>

<option value="http://www.12zsingapore.com/ads/services/write-ad?Itemid=0" >

Services </option>

</select>

[Image Button that Refuses to be Clicked]

That is a flash button. If you have the the PRO or DEV version of ubot you can use the input commands to get passed it, if not your pretty much screwed.

 

Is there really no way around this? ...otherwise what is UBot good for, since these types of buttons are so common.

[Image Button that Refuses to be Clicked]

There's this image button on Gumtree that refuses to be chosen & clicked.

 

Here's the URL:

http://singapore.gumtree.sg/c-PostAd?CatId=36&EventEndDay=10&EventEndHour=23&EventEndMinute=59&EventEndMonth=11&EventEndSecond=3&EventEndYear=2010&EventStartDay=10&EventStartHour=0&EventStartMinute=0&EventStartMonth=11&EventStartSecond=3&EventStartYear=2010&SelectedLeafCat=SelectedLeafCat#

 

I'm referring to the "Select Images" button that's green in color.

 

Anyone knows how to fix this?

[RichText Textbox -- How to Fill?]

You would use a $newline constant.

 

Is this:

"The quick brown fox

Jumps over the

lazy dog.."

 

all considered one item? is that in a list?

 

Yes...this is all considered one item.

[RichText Textbox -- How to Fill?]

hi can you post the link of that page here?

 

To change iFrame, I've found this page helpful:

http://www.ubotblog.com/ubot-studio-the-change-iframe-body-command/

 

But the formatting of my text is gone...

 

...anybody knows how to space out the text to the next line?

 

For example, my original text is (fills 3 lines):

 

"The quick brown fox

Jumps over the

lazy dog.."

 

But after using the change iFrame command, I'll get this (only 1 line):

 

"The quick brown fox Jumps over the lazy dog.."

 

Anybody knows how to deal with this?

[Able to Copy A Block of Script Over to Another File?]

Just use copy and paste, or right click over the node and copy. Make sure to hit refresh once your done pasting though.

 

I'd want to copy a whole block of nodes...is there a way to do this?

[RichText Textbox -- How to Fill?]

if you use Firefox, open up the page in firefox and right click near the box. have it isolate the frame and it will give you a direct link (url) to the frame. If you're lucky, the whole form will be in a single frame.

 

This is cool. Thanks, JohnB, I'll try this.

[Able to Copy A Block of Script Over to Another File?]

I realized halfway that I've grouped my scripts wrongly. Thus I'll need to move 2 tabs over from one .ubot file to another .ubot file.

 

Is there a way to do this?

[RichText Textbox -- How to Fill?]

Anyone knows how to fill info into a textbox with rich text (not tinyMCE) features?

 

Here's the source code if it helps:

 

 

<div class="first-field" >

<div formfield="label" class="first-label "><span id="lblDescription" class="required">Description</span></div>

<div class="first-input">

 

<a name="Description"></a>

<div class="input-div">

 

<textarea name="Description" id="hdnDescription"

wrap="soft"

cols="65"

maxlength="100000"

style="width:500; height:240;font-family:arial;"

ondescriptiondest="0"

rows="6"

></textarea>

 

<script type="text/javascript">

if (client.nav || client.ie) {

DOM.getElementById("hdnDescription").style.display = "none";

 

var editorTexts = {

'Style' : '[style]',

'Heading1' : 'Heading 1 <h1\>',

'Heading2' : 'Heading 2 <h2\>',

'Heading3' : 'Heading 3 <h3\>',

'Heading4' : 'Heading 4 <h4\>',

'Heading5' : 'Heading 5 <h5\>',

'Heading6' : 'Heading 6 <h6\>',

'Font' : '',

'Size' : '',

'Bold' : 'Bold',

'Italic' : 'Italic',

'Underline' : 'Underline',

'AlignLeft' : 'Align Left',

'Center' : 'Center',

'AlignRight' : 'Align Right',

'JustifyFull' : 'Justify Full',

'HorizontalRule' : 'Horizontal Rule',

'OrderedList' : 'Ordered List',

'UnorderedList' : 'Unordered List',

'Outdent' : 'Outdent',

'Indent' : 'Indent',

'TextColor' : 'Text Color',

'BackgroundColor' : 'Background Color'

};

}

</script>

<script>

var rteDescriptionObj = new RichTextEdit("Description",MainFormObj,500,200,"","","http://pic.classistatic.com/image/pics/classifieds/wysiwyg_editor/",true,false, false, true, false);

jQuery.data($("#hdnDescription")[0],"descRTE",rteDescriptionObj);

</script>

[UBot Doesn't Run After Compiling]

Thanks, LillyT.

 

Does that mean the scripts from every Tab will be executed once I use "botname.exe /auto"?

 

...or will the script from the 1st tab be executed only?

[UBot Doesn't Run After Compiling]

I've got the scripts ready in a few tabs.

 

But after compiling (and running the .exe file), the scripts doesn't run by themselves. How do I make them run the moment I open the file?