Grey Hat 4 Posted January 31, 2011 Report Share Posted January 31, 2011 Hi, So for work I'm building a bot that puts together a laundry list of competitors names, URLs,specific products (let's say it's "Vitamin C" Supplements), pricing, and shipping charges if any... I figured I'd be slick and jump straight onto www.nextag.com (sinces it lumps all that info into nice neat lists to scrape from). I was going to dump into .csv and then convert into Excel and here's my report of over 5,000 vitamin C products to compare pricing to ours. I watched Lilly's tutorial on scraping ezine articles and I get the process. My problem is that the format on the nextag site is different than articles. I can't find a ?*&id=* to put my wildcards on. I tried to do Google Shopping. Ran into the same wall. Tried some wildcards but wasn't getting the right result. Does anyone have some suggestions? Is scraping from a comparison cart/site possible? Thanks! Quote Link to post Share on other sites
Praney Behl 314 Posted January 31, 2011 Report Share Posted January 31, 2011 A sample link would really speed up the help you need, as we can look into it and maybe provide a sample script. Cheers! Praney Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.