Search the Community
Showing results for tags 'scrape'.
-
Hey guys I want to scrape facebook post url. Let's say I go in a facebook group and make a post. How can I get this post url. Sometimes the admin need to approve so this is no important. I want to get the post url that get appears automatically in a group. I can't figure out how to do it , because sometime the status I just posted in a group can be the 3 offset depending if there is pinned posts I think when you post, the posts area refreshes automatically with the new post. Is there a way to get that post url without scraping. or ..... Any ideas. thank you
-
I am working on a url scraper, and the website tends to include the referall source, but I cannot include that when saving it to a file later on. I was successful in getting it to grab everything after the "/". testwebsite.com/ubotstudio?ref=referral This is what I have so far: [^/]*$ testwebsite.com/ubotstudio?ref=referral How should I have it match everything before the "?" sign?
-
I have my bot set to scrape the "fullhref". And it is working great, but I like to have my bot's run off of the mobile version of a website. Specifically, I need it to get the number out of a url. http://www.roblox.com/User.aspx?ID=43770005 In this case, I would like to get the "43770005". Do you have any recommendations on how to do this?
-
Hi guys, I need to scrape a list pretty much like this: ------------------------------------------------------------------- Jhon Doe Age 18 California Add as friend Mary N Age 22 South Dakota Dann J Cole Age 38 Florida Add as friend Gregory Grady Age 26 North Carolina XYZ LLC Florida Add as friend ------------------------------------------------------------------ My question is just how to scrape the href only for those in the list with "Add as friend"? Thanks alot
-
Hello, My name is Ricardo. I am trying to learn how to scrape URLS and are having a hard time trying to figure out how to get a list of URLs off of googles search page. I am looking here trying to find the "class" so I can select all the URLS on the page. I am looking in here: <a href=" " onmousedown="return rwt(this,'','','','8','AFQjCNET0Cgo85zpZkk1bf16E0ddjYO3Xw','','0CFkQtwIwBw','','',event)">Getting Started With <em>Ubot Studio</em> Drag And Drop - YouTube</a> Not working no matter what I try. Any help is greatly appreciated. Thanks in advance.
-
Hey I'm trying to scrap a page for some keywords and place it in a list, then I want that list to check with another list from a text file. I then want the bot to click all those keywords(links) that are on both of the lists. I tried diffrent sulutions and guides for many many hours now without any luck. Would love some help, or so quick advice on how I should solve this.
-
I've tried to find out how to do this, but I could not. Even I found some threads in the forum about similar questions, I tried the solutions and did not work. Just need to scrape the list of states in this site (this is my code): navigate("http://www.adoos.com/posting/", "Wait") set(#statesscraped, $scrape attribute(<name="geo1_id">, "innertext"), "Global") Thanks guys, really appreciate your help. Luis Carlos
-
Looking for a web-task-automation, scraping, parsing expert who has experience with writing automation scripts. Ubot and other automation software usages are welcome. Task: Write an automation program/script that will fill contact forms with specific data. Here is what the program should do: 1) Import a file of website with URL (we have this file) 2) Go to the URL and locate contact forms 3) Fill out contact forms on the URLs with specific content that we will provide. Ex. we will tell you what to type in the message field, name field etc. 4) Integrate with one of the captcha-byp
-
http://image.chromefans.org/i150/id179/web-proxy-chrome-security.pngHide My Ass Proxy Scraper Never pay a monthly fee again, no more hunting for proxy lists, just click and harvest! The Bot Shop is proud to present the HMA Proxy Scraper Lifetime updates, future features powered by the users - you see an improvement, we will try to get it into the next update, fast, no fuss and no drama! http://www.youtube.com/watch?v=fZOZWJ6U-7g http://www.uniseal.co.nz/Buy-Now-button.jpg A limited $10 discount code available from The Bot Shop Twitter feed......be quick!
-
Sup fellas, Im trying to scrape a password on a web page that has no ID, I tried $page scrape but the html looks like this: Username:<strong>testuser</strong><br/>Password:<strong>testpass</strong> Is there any other way? thanks
-
I'm scraping emails from yellowpages.com and I can scrape the email but it always has the mailto: in my list. I want to remove that before I save it or remove it from the start. Should I use regex or some other way?
-
I posted this before but I made a bot to go to facebook and search for a word thus giving me a list of pages. I want to scrape those pages into a list and capture each one. My code is: type text(<aria-label="search">, #search, "Standard") clear list(%pages) add list to list(%pages, $scrape sttribute(<class="text">, fullhref"), "Delete", "Global") but when it scrapes the data it only gives me one link and not all the links. This is all happening within a javascript window, I presume. Any help will be much appreciated! I am including screen shots to show you what I mean. Yes
-
Hi, I am trying to scrape the current URL of a Yahoo RSS feed (for example: http://news.search.yahoo.com/rss?ei=UTF-8&p=burning+of+fossil+fuels&fr=sfp) set(#url, $url, "Global") - this works for normal webpage URLs, but it will not scrape the RSS feed URL. Is there another simple way to do this?
-
I tried a few things but can't get it to work. What i want to do is loading a page, then using a regular expression that scrapes a particular strings (let's say phone number for example) and add that to a list. I need to scrape this way, because $scrape page or $scrape attribute is not possible on this particular site. So what i want is the webpage loads, it checks whether a particular string is present anywhere on the page, if yes then scrape that string and add it to a list.
