Jump to content
UBot Underground

Biks

Fellow UBotter
  • Content Count

    217
  • Joined

  • Last visited

  • Days Won

    1

Everything posted by Biks

  1. I'm trying to automatically download .ascm (epub's) files from the Overdrive library network. I just can't click the last button to click to actually START the download. This script gets you logged into a temporary account # and gets you to the account loan page where I want to download it. When I run it in NODE mode, it works, but not in the sequence. I've also tried moving the mouse over the button (works in NODE mode), not in the sequence. Scraping the URL then downloading doesn't seem to work either. What am I doing wrong? Note: this is using a temporary library card # - good for 2 we
  2. I'm also trying to download a file via a paywall and having the same problem -I can't start a download file, run node works vs running the entire box doesn't. How did you solve it? I'm trying to download an ebook via Overdrive: https://bpl.overdrive.com/bpl-visitor/content/media/1438507 Obviously you need a library card and logged in to initiate the download/borrow. I can download the .acsm URL directly - that works but the file doesn't open within Digital Editions. It adds something about my subscription when I click it through the online interface. I mean we're taking about having
  3. I'm trying to automate a simple Google alert. Looks like it should be easy, but the standard Ubot choices don't work. You can't drag anything over, and drop menu choices aren't the classic <option value=ITEM>. Google Alerts creation page: https://www.google.com/alerts (obviously login w a Google account) The HTML for one of the drop menus looks like this: <div class="goog-flat-menu-button jfk-select volume_select goog-inline-block" tabindex="0" role="listbox" aria-activedescendant=":6" aria-expanded="false" aria-haspopup="true" style="-webkit-user-select: none;"><div class
  4. This should be simple, but I've never done it before. Let's say I scraped a 300 character long block of text and it's sitting in a variable. I want to shorten it to the first 200 characters. (I know how to FIND the first 200 characters, but I want to delete everything outside of my find)
  5. Does Ubot require Microsoft C++ redistributable to run? Then I'm assuming any compiled bots would also require it... I don't have the Developer Edition of Ubot - all these additional files are also required for compiled bots that go out to others if I DID have the developer edition? Thanks everyone for helping me out on this.
  6. re: Microsoft C++ redistributable What's the deal on that one? Did I forget that I (probably) installed it years ago? Not suggested, but mandatory, right? (I'm trying to keep this as simple as possible)
  7. Simple question: Do compiled bots need .net Framework to run? I'm giving someone (a non programmer) one of my compiled bots on Windows 10. He can't get it to run. I'm assuming this is the issue. (in addition to adding an exclusion to Windows security) Any other tips I should know when giving out bots?
  8. I've done this a million times, now I can't. Just trying to scrape emails. In an earlier version of Ubot, this regex code worked for scraping emails (NODE VIEW): (\([A-Z0-9._%-])+@([A-Z0-9.-]+)\.([A-Z]{2,4})(\ But in CODE VIEW I see this: (\\([A-Z0-9._%-])+@([A-Z0-9.-]+)\\.([A-Z]\{2,4\})(\\ It's adding more slashes. What's going on? When someone says USE THIS REGEX code, do I paste it NODE or CODE view? This regex code is supposed to scrape all variations of emails: [a-zA-Z0-9\._\-]{3,}(@|AT|\s(at|AT)\s|\s*[\[\(\{]\s*(at|AT)\s*[\]\}\)]\s*)[a-zA-Z]{3,}(\.|DOT|\s(dot|DOT)\s|\s*[\[\(\{]\
  9. So what other software can I learn/use to do this? (that won't crash) or I would really love to have this scraped: https://soundcloud.com/harperaudio_us/followers And maybe this too: https://soundcloud.com/audible/followers Anyone willing to run my code on their machine? Does anyone know of anyone who could/would do this? How much do you/they need?
  10. clear list(%followers) navigate("https://soundcloud.com/random-house-audio/followers","Wait") wait for browser event("Everything Loaded","") loop(9999) { add list to list(%followers,$scrape attribute(<class="userBadgeListItem__heading sc-type-small sc-link-dark sc-truncate">,"href"),"Delete","Global") run javascript("window.setTimeout(function() \{ window.scrollTo(0, document.body.scrollHeight) \}, 500)") wait(3) } save to file("C:\\Users\\Public\\Ubot\\Soundcloud\\SCRAPED USERS.txt",%followers) I'm basically do this. Each javascript page load gives me 25 new profiles at the
  11. From what I can see, these deal with data once you've acquired it. The problem is I need to hold 2.5 million entries in memory (before the scrape) before I can do anything with it. I can't parse the INPUT into manageable smaller sections. Giganut, how many Twitter followers can you scrape at one time?
  12. I have never gotten Ubot to scrape beyond a certain point. It seems once I hit around 42,000 entries, the whole thing collapses. I just had this happen twice on the same site. I'm guessing I'm running out of memory. At this point I'm using 16 GIG, will doubling my memory help? I've recently been grabbing followers on a few websites that require you keep loading a new batch of users as you scroll down the page. (using the Javascript load command) There's no way of stopping, saving and continuing beyond a certain point, it's just offering me an endless list. As an example: The Spotify Twitte
  13. Ver 1.1.4.4 installed. Why can't I find the clipboard functions? Searching for CLIPBOARD brings up nothing.
  14. I had the same problem - that seemed to do the trick. (chrome 21)
  15. I was banging my head against Linkedin today. I could scrape and make lists of people, but when I went directly to their profile page, I couldn't scrape ANYTHING. (after changing user agents, turning things off, etc) Apparently Linkedin takes exception to doing this: https://techcrunch.com/2016/08/15/linkedin-sues-scrapers/ Again, it's the profile pages that they're protecting. Anyone have any success with this?
  16. Ya see? That's what I'm dealing with - it doesn't exist/display within Ubot. I captured the above image not logged in with Firefox.
  17. I'm running version 5.9.50. I had this issue years ago, then forgot about it. I couldn't grab the emails. Note: I can SEE the social icons, I just can't click on them.
  18. I'm not a hard core programmer when it comes to Ubot, so I could use some help on what is going on with Amazon. I'm trying to scrape emails (plus social media links) from Amazon profiles. I can see them in a regular browser, they don't even show up within Ubot. Example Profile: https://www.amazon.com/gp/profile/amzn1.account.AGLZ3EQ5DDQQW33D64E33RTXYMHA http://i.imgur.com/0f7V5rD.png This is a capture from Firefox. SEND AN EMAIL doesn't even appear within Ubot. The icons don't link either. Am I dealing with an iframe on the page? What is going on here? How does one scrape this, or did
  19. OK, I finally manged to get a 2captcha account with credits. My script looks correct, I see somebody selecting the images, but they only seem to do one pass at it. Google refreshes the list and wants you to select multiple times. navigate("https://www.youtube.com/channel/UC5WAKQB3fOMPmM6DhDjF5Eg/about","Wait") wait for browser event("Everything Loaded","") wait(2) click(<class="yt-uix-button yt-uix-button-size-small yt-uix-button-default business-email-button">,"Left Click","No") wait(3) click(<class="yt-uix-button yt-uix-button-size-small yt-uix-button-default business-email-button"
  20. ..if any. I'm looking at this on Youtube where I want to reveal an email address in the ABOUT tab: http://i.imgur.com/HdRzY9r.png Is there any service or method that can deal with this? (I've been away from Ubot for a while)
  21. Yea, I was wondering the same thing. Bad Gateway message. Now what do we do? Is there a webpage somewhere that gives the latest status? Where Seth says, "doing server maintenance, keep your panties on and cool yer jets"?
  22. I just tried uploading a photo to Twitter, nada. Was going to post this same type of thread. So...has ANYONE made a ubot that can upload an image to Twitter? (note: the mobile version doesn't give you an option to upload an image) Can I buy someone else's bot that can do this? Is this method some deep dark secret that nobody is willing to disclose? Has anyone taken a crack at it? What's the difficulty? Right now I have a bot that posts a text tweet and follows 4,000 users via 15 accounts. Takes 7 hours to complete, never crashes, works beautifully. I was hoping to could get some images
  23. OK, I'm not a programmer. When I first saw headless browsing advertised, I had no idea what it was. At this point I understand what it's doing - going out on the web without rendering the entire page. I also understand that it's faster. But what exactly can I do or not do with it? One of the thing I only recently discovered is using Scrapebox to actually SCRAPE things - I always used it as a spam bot. I'm now able to plow through hundreds of websites, scraping emails in seconds with Scrapebox and a few proxies. I'm guessing that's what Scrapebox uses - a headless browser and just grabs the
×
×
  • Create New...