itexspert 47 Posted January 8, 2015 Report Share Posted January 8, 2015 Guys i have the weirdest issue i was updating my old bot anyway data looks solid and well formatted in Ubot Debugger(Check the picture attached) Issue 1 But when i open it with Excel my data looks jumbled this never happened before to me only things i changed is i added few plugins "Advanced Ubot" by pash and "HMA Commands" from T.J. But i i don't think any of these are the issue they have nothing to do with this error i think something changed inside Excel i don't know what sadly! I added the Details.csv that is what Ubot Outputs try to import it into excel ,i always did this normally without any issues i just import it into exceli set the delimiter to "Comma" and all data was there normally displayed so what i am doing wrong now??? I appreciate any help you guys come up with! details.csv Quote Link to post Share on other sites
arunner26 51 Posted January 8, 2015 Report Share Posted January 8, 2015 itexspert,When I went to download the file you attached I found the name is actually details.csv.txt. So Excel sees it as a text file and not a csv. If your file system has the file extension HIDDEN it is easy for this to happen and you not know it. Quote Link to post Share on other sites
Pete_UK 9 Posted January 8, 2015 Report Share Posted January 8, 2015 (edited) downloaded as details.csv for me. Here is how the data looks in a simple CSV viewer (http://www.csvviewer.com - I use this all the time)... http://content.screencast.com/users/Pete_1/folders/Jing/media/41ab6f4a-e78d-409d-a21c-f3fed7f00873/2015-01-08_1755.png You have line-breaks in your data so excel thinks every line break is a new record. I think! Edited January 8, 2015 by Pete_UK Quote Link to post Share on other sites
itexspert 47 Posted January 8, 2015 Author Report Share Posted January 8, 2015 I don't get it why is this happening all of a sudden?? Nothing is changed same format same stuff if i did had line breake they were there before too but excel never showed mew this and weird part is In Ubot Debugger data is formatted correctly! Quote Link to post Share on other sites
itexspert 47 Posted January 8, 2015 Author Report Share Posted January 8, 2015 Seriously where can you see the error here?? Till few days ago this worked perfectly you can delete the Plugins Part but i dont get it! define Start Scraping using HMA { plugin command("Advanced Ubot.dll", "auto free memory", 15, 120, #mem, "True", "True", "True") clear list(%get_links) if($comparison(#stop,"=",$true)) { then { stop script } else { } } clear table(&Manta Scraped) set table cell(&Manta Scraped,0,0,"COMPANY NAME") set table cell(&Manta Scraped,0,1,"ADDRESS") set table cell(&Manta Scraped,0,2,"PHONE") set table cell(&Manta Scraped,0,3,"CATEGORY") set table cell(&Manta Scraped,0,4,"FOUNDING DATE") set table cell(&Manta Scraped,0,5,"No. EMPLOYEES") set table cell(&Manta Scraped,0,6,"EMAILS") set table cell(&Manta Scraped,0,7,"FAX NUMBER") set table cell(&Manta Scraped,0,8,"ANNUAL REVENUE") set table cell(&Manta Scraped,0,9,"LOCATION/TYPE") set table cell(&Manta Scraped,0,10,"SIC NUMBER") set table cell(&Manta Scraped,0,11,"NAICS NUMBER") set table cell(&Manta Scraped,0,12,"MANAGER/OWNER") set(#counter,1,"Global") loop(#howmanypages) { if($comparison(#stop,"=",$true)) { then { stop script } else { } } add list to list(%get_links,$scrape attribute(<href=w"*/c/*">,"fullhref"),"Delete","Global") click(<innerhtml=#counter>,"Left Click","No") increment(#counter) wait(5) } set(#row,1,"Global") loop($list total(%get_links)) { plugin command("Advanced Ubot.dll", "auto free memory", 15, 120, #mem, "True", "True", "True") clear cookies allow css("No") set user agent("Chrome") navigate($next list item(%get_links),"Wait") wait(3.8) if($exists(<innertext="Suspicious Activity Detected">)) { then { plugin command("HMA Commands.dll", "hma tools", "Change ip", #hma) wait(55) } else { } } if($comparison(#stop,"=",$true)) { then { stop script } else { } } wait(1) set table cell(&Manta Scraped,#row,0,$scrape attribute(<itemprop="name">,"innertext")) set table cell(&Manta Scraped,#row,1,$scrape attribute(<itemprop="address">,"innertext")) set(#phone,$scrape attribute(<rel="mainPhone">,"innertext"),"Global") set(#phone,$replace(#phone,"Phone:",""),"Global") set table cell(&Manta Scraped,#row,2,#phone) set table cell(&Manta Scraped,#row,3,$scrape attribute(<rel="businessCategories">,"innertext")) set table cell(&Manta Scraped,#row,4,$scrape attribute(<itemprop="foundingDate">,"innertext")) set table cell(&Manta Scraped,#row,5,$scrape attribute(<rel="numEmployees">,"innertext")) set(#email,$scrape attribute(<itemprop="email">,"innertext"),"Global") set(#email,$replace(#email,"Email:",""),"Global") set table cell(&Manta Scraped,#row,6,#email) set table cell(&Manta Scraped,#row,7,$scrape attribute(<itemprop="faxNumber">,"innertext")) set table cell(&Manta Scraped,#row,8,$scrape attribute(<rel="annualRevenue">,"innertext")) set table cell(&Manta Scraped,#row,9,$scrape attribute(<rel="locationType">,"innertext")) set table cell(&Manta Scraped,#row,10,$scrape attribute(<rel="sicDetails">,"innertext")) set table cell(&Manta Scraped,#row,11,$scrape attribute(<rel="naicsDetails">,"innertext")) set table cell(&Manta Scraped,#row,12,$scrape attribute(<outerhtml=w"<span class=\"text-primary\" itemprop=\"name\">*</span>">,"innertext")) increment(#row) save to file("{$special folder("Desktop")}\\manta details.csv",&Manta Scraped) } alert("All Info Saved on your Desktop!")} Quote Link to post Share on other sites
itexspert 47 Posted January 9, 2015 Author Report Share Posted January 9, 2015 I fixed it i think all i did is i set windows to "Don't Show Hidden Files,folders or Drives" I tried my older scrapers and everything is working fine really strange issue and a solution is even more weird Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.