ayhoung

unfortunately I don't have that plugin for me so I've switched to JSON Thanks though!

Hi guys, For some reason, when I "navigate" to this xml url "http://www.104.com.tw/i/apis/jobsearch.cfm?pgsz=10&fmt=4&cols=J,JOB", nothing shows up? Is this just an issue with xml files, or is there some way around this? Thanks a lot! Allen

Thanks for the suggestions! It seems load_html was the simplest way to get it to work, but I'll also look into the regex method

Hi everyone, I'm trying to scrape href links from just a portion of the attribute. I've used the "set" function to set the portion to a variable, but it doesn't seem I can use "scrape attributes" on a variable. I'm also trying to add it to a list such as below: Add list to list (%url_list, scrape_attribute($portion_of_page)) Is there any way you know that this could be achieved in some other way? Thanks, Allen

"With the pro and dev version you can multi-thread" As far as I understand, multi-threading does the same thing in multiple threads, like creating an account. Can you input variables into different threads such as page numbers for them to scrape different pages?

Hi guys and experts! I was just hoping to pick your brains here for good methods to speeding up scraping and avoiding redundant information. So let's say a site is continuously updating with new information and has pages and pages of it. Two questions: 1. Can you scrape every individual page as a separate thread to increase speed for scraping? 2. Any good methods of avoiding pages that have already been scraped? What methods do you use? Hoping for interesting insight! Thanks, Allen

Try this: [a-zA-Z0-9\.]*@(specificdomain.com|SPECIFICDOMAIN.COM)

Hi Ubot friends! Running into some trouble trying to implement a simple task: 1) Can an alert window be able to display a lot of information (via scrolling)? I've tried showing lists of information to the user, but the information soon exceeds the border of the window, thus not allowing the user to see the whole information. Any help on this would be appreciated!!

thanks a lot!!

Hi everyone! I was wondering if anyone had a good way to implement a function similar to the explode mechanism in PHP? For example, if I have a sentence of items: apples, oranges, pears And I want to turn it into a list: (0) apples (1) oranges (2) pears How would I go about implementing this? It might be something simple I'm missing. Any help would be appreciated!

Hi guys! Wondering if there's a good solution to deal with infinite scrolling pages? I want to scrape links and titles but I'm not getting all of them due to an ajax-based infinite scroll (a la pinterest). Noobie here, so if you guys have a good solution, please let me know! Thanks Allen

From wikipedia, This is definitely not something that I want to do.

Didn't know about the term 'phishing' beforehand Basically, Ruten doesn't offer a mobile version of the website where you can easily take a picture and upload it for an auction via your cellphone, which is what I want to accomplish. I am merely trying to create a more convenient version of an existing system, and trying to use ubot to accomplish that, since the API doesn't support what I need to undergo this project. Is that still an illegal practice?

Sorry, please let me make it clearer: Basically I'm trying to utilize ubot to make up for missing API. My country (Taiwan) has an auction website that doesn't allow people use their API for uploading items to their auction website (Ruten). What I'm trying to do is to use ubot to compensate. A typical action would look like this: 1. User uses moblile app form fields to input data (ie. user information) 2. Mobile app sends data to server 3. Through some unknown method as yet uBot understands that the user has inputted information 4. Whether through mysql, or using an html page, uBot

Thanks for the reply Vaultboss! I think the real question right now is how can I trigger UBot to execute based on new information. To go into even more detail, I'm trying to make a mobile app that will have a login interface, that will login to a desktop website (using ubot). How can I make UBot respond to user input through this login action? Would constantly polling for new information be a good route to take, or is there a more elegant fashion to do this? Thanks again, Allen