BigEfromDaBX
-
Content Count
383 -
Joined
-
Last visited
-
Days Won
3
Posts posted by BigEfromDaBX
-
-
There are several videos and its been some time since I checked them out but I think he has an example logging into Twitter. At the very least I know he covers many topics like using Fiddler which would be helpful in your situation.
Thanks
-
Hi,
Does anyone know of a chrome extension that will grab data from a csv file and automatically fill out a form on a website?
-
Thanks I will take a look at the videos :-)
Sent from my iPad using Tapatalk Pro
Somebody else gave me this website link before also and it asks me to sign in with my facebook account. did that and downloaded the Ubot-Tools but I cant find the tutorial and how log in to websites using the http post plugin.
-
That's probably going to be harder than using an API. An API is meant to be interacted with via requests only. Your WP installation may have certain securities built in which try to prevent such things. But for the record you can open up Fiddler and login in a browser and then do your best to mimic those requests using the plugin. Dan has some free tutorials that go more in depth on these things here: http://www.bot-factory.com/http-plugin-tutorials/
Thanks I will take a look at the videos :-)
Sent from my iPad using Tapatalk Pro
-
You should be able to make requests using the HTTP Post plugin.
Im still trying to figure out how to log into wordpress with that aymen plugin.
-
Yeah that's a great article because I doubt most people know about it but unfortunately the free tier runs like treacle.
If you running a few bots with the built in scheduler where you're having to leave the bots open then it becomes unusable pretty fast.
You might want to take a look at Vultr. You can spin up an instance for $5 a month which is more substantial then the AWS free tier but still very cheap. The only thing you'll need to do is upload your own copy of Windows as an ISO file but this is what I do, they have a guide on how to do it on their own site: https://www.vultr.com/docs/windows-custom-iso-with-virtio-drivers
Thats exactly what I am doing. Im just running one bot with a scheduler. Why does the bots start slowing down the server after time?
-
I have used the 2012 free tier but it seems slow.
-
Which Amazon Instance do you use? I just need to run a compiled bot all the time?
Do you run the server 2008, 2012 or 2016? Free tier?
-
If I generate my key in woocommerce api section can I connect to it with ubot to pull data such as orders?
-
Thanks for that link. I guess thats the phpmyadmin version of sqlite
-
In this case you probably want to create a database that keeps track of the numbers so that they are not kept in memory. At the very least keep the numbers in text files labelled in process or completed or something but having a database with the numbers in it could be more flexible and allow you to store more information related to that tracking number. I would do an sqlite database, Aymen has a plugin for it.
Besides the plugin do I need to install sqlite on the computer that its running on?
-
So im creating a bot thats going to scrape an RSS Feed grab the UPS tracking numbers and log into a website and post the tracking number to a specific customer order. I already did most of it but my question is, whats the best way to create a log file or the best structure. Once I grab the tracking number do whatever I need to do with it, I dont want it to do it again when it scrapes the RSS feed again im guessing thats where a log file will come into place.
Thanks in advance.
-
Here is the link:
Thank you. I will take a look at it
-
You have to also do a http post and pass the credentials/cookies over.
There is a user on the forums here (Dan I think it was) who was selling a great little course on how to use these functions effectively. He goes over how to use them for logging into sites, etc.
Thanks.
-
I just purchased the http plugins which are great. Makes my scraping life so much easier. My question is, how do I scrape pages that I have to log into first?
-
Glad to hear it
@HelloInsomnia I still need to practice on the encoder part as i was still getting the A's with the funny character on the top. But it didnt affect my scrape. Thanks Buddy. You rock
-
1
-
-
Yes http plugin is probably the best way. It depends on the page but for most pages it will be the best way. I wouldn't worry about it but in some cases if there's like something to do with Javascript it wouldn't work since it's not a browser but for scraping this is almost never an issue.
@HelloInsomnia I finally bought the http plugin after remembering that I bought a tutorial from you on scraping. In that tutorial you showed how to scrape and use the http post plugin. Watched your video a few mins. Bought the plugin and now my scraping is soooooo fast and smooth now. Thank you sir
-
1
-
-
Yes http plugin is probably the best way. It depends on the page but for most pages it will be the best way. I wouldn't worry about it but in some cases if there's like something to do with Javascript it wouldn't work since it's not a browser but for scraping this is almost never an issue.
Its a simple scrape of an email from each page. But there are alot of pages that i have to visit.
-
i need to scrape one mail anywhere from 2000 to 10000 pages. That that http plugin the best way to do this? Or is the spawn thread just as good?
-
That doesn't matter so much, Ubot is 32 bit it can only use 2GB of ram anyways. So check to be sure its not running near that number or you could have issues.
It will speed things up and reduce memory issues significantly. Just be sure to use HTTP Clear Headers and HTTP Clear Objects at the end of your thread if you decide to get the plugin (this will help with memory issues).
You Rock. Stay Dry (FL Inside joke LOL)
-
1
-
-
Am I going to have to man up and buy that http get or post plugin that everybody talks about? Will that help me scrape alot of pages fast?
-
Do I need an extra plugin to run that?
-
I got my Virtual Box running windows 7 with 8GB's of ram and 4 Processors.
-
Maybe its a memory problem, its hard to say though for sure. If you can post your code maybe somebody can check it out.
Memory as in my Ram?
Connect To Woocommerce Via Api.
in General Discussion
Posted
My bot connects to my vendor website and gets the status of the order than runs back to the my woocommerce site and changes the status. I also have it update my woocommerce orders with the tracking numbers that my vendors send me.