a-harvey
-
Content Count
53 -
Joined
-
Last visited
Posts posted by a-harvey
-
-
Thank you I will tell them to fix it.
-
Thank you, that is pulling them in now.
ahahhhhhhhh been trying to get it to work for hours and have a catalogue to build without any images, many thanks
What exactly is the issue have they not set their headers correctly.
-
I don't have the function in the plugin - where do I get it?
-
sorry, yes no idea what I have to change. are the green elements a paid element of the plugin
-
ok installed that what command do I use, I cannot see get download
-
-
Helloinsomnia,
sorry lost me there what do I need to change in the code or add.
many thanks
-
Hi,
I have been using a script for a while to download images from urls and name then when they are downloaded.
script is attached, for some reason it just will not work with the clients new site:
I am getting:
Error: The request was aborted: could not create SSL/TLS secure channel.
Source "file name >loop>download file.
Is there anything I can do my end ?
Many thanks
Andrew
the csv silverim.csv just has a name be that 20 in first cell and url in next
clear table(&images)
create table from file("C:\\Users\\Andrew\\Desktop\\silverim.csv",&images)
set(#row,0,"Global")
create folder($special folder("Desktop"),"SilverstoneImages")
set(#path,"{$special folder("Desktop")}/SilverstoneImages/","Global")
loop($table total rows(&images)) {
download file($table cell(&images,#row,1),"{#path}{$table cell(&images,#row,0)}.jpg")
increment(#row)
}
shell("perl c:\\windows\\exiftool.pl -P -r \"-title<$\{filename;s/\\.[^\\.]+$//;s/[-]/ /g;s/_/ /\}\" -r -sep \" \" -ext jpg C:\\Users\\Andrew\\Desktop\\SilverstoneImages")
shell("perl c:\\windows\\exiftool.pl -artist=\"Silverstone Auctions\" -copyright=\"2019 Silverstone Auctions\" C:\\Users\\Andrew\\Desktop\\SilverstoneImages")
shell("perl c:\\windows\\exiftool.pl -subject=\"Silverstone Auctions RACE RETRO SALE 23rd February 2019\" C:\\Users\\Andrew\\Desktop\\SilverstoneImages")
shell("perl c:\\windows\\exiftool.pl -creator=\"Silverstone Auctions\" C:\\Users\\Andrew\\Desktop\\SilverstoneImages")
shell("perl c:\\windows\\exiftool.pl -P -r \"-description<$\{filename;s/\\.[^\\.]+$//;s/[-]/ /g;s/_/ /\}\" -r -sep \" \" -ext jpg C:\\Users\\Andrew\\Desktop\\SilverstoneImages")
shell("perl c:\\windows\\exiftool.pl -P -r \"-IFD0:XPSubject<$\{filename;s/\\.[^\\.]+$//;s/[-]/ /g;s/_/ /\}\" -r -sep \" \" -ext jpg C:\\Users\\Andrew\\Desktop\\SilverstoneImages")
shell("perl c:\\windows\\exiftool.pl -P -r \"-IFD0:XPComment<$\{filename;s/\\.[^\\.]+$//;s/[-]/ /g;s/_/ /\}\" -r -sep \" \" -ext jpg C:\\Users\\Andrew\\Desktop\\SilverstoneImages")
-
Hi Pash,
Ok so as I thought one is going to have to scrape the html star-red/star-grey from each section and then test for the red stars to generate a value that can then equate to creation of the stars in indesign be that single or as a single image of 5 stars.
Thank you, that clears things up or confirms my initial thoughts so now have a decisive plan as to what needs to happen.
Andrew
-
Thanks Nick, I will look at this also, yes I am subscribed.
I might be able to use that function, to grab the metadata after written and use that as a way to populate a instagram upload "ie the title etc"
-
Hi,
Can someone give me a clue how best one would try and scrape the star ratings from this page:
https://www.classiccarauctions.co.uk/porsche-928-s4-10946
I need to grab all the data into a csv and then generate a print catalogue from it.
The only way I am seeing to do this (the stars are the issue) is to scrape the html as "star red, star grey" and work out some search and replace in the csv which then will convert it to 4 red 1 grey etc.
Any other thoughts on how to get the stars out, is there another way ? am I missing something?
Many thanks
Andrew
-
Thank you the plugin works great.
adding now to my main Ubot but all seems to be working well, many thanks.
Andrew
-
Ok so I have finally got my head around the exif tool and the commands that I use to do what I need are below and do exactly what I am after on a folder of files, ie will be the download images from the above bot.
What would the command be to enable ubot to action the commands below from within UBot so I don't have to apply them outside Ubot.
So not to confuse, the current Ubot, just downloads and names the files based on a csv, I want to after it has finished downloading all the images at that stage run these commends
Many thanks Andrew:
perl c:\windows\exiftool.pl -P -r "-title<${filename;s/\.[^\.]+$ //;s/[-]/ /g;s/_/ /}"" -r -sep " " -ext jpg C:\Users\Andrew\Desktop\testimage
perl c:\windows\exiftool.pl -artist="Silverstone Auctions" -copyright="2019 Silverstone Auctions" C:\Users\Andrew\Desktop\testimage
perl c:\windows\exiftool.pl -subject="Silverstone Auctions AUTOSPORT INTERNATIONAL SHOW SALE 12th January 2019" C:\Users\Andrew\Desktop\testimage
perl c:\windows\exiftool.pl -creator="Silverstone Auctions" C:\Users\Andrew\Desktop\testimage
perl c:\windows\exiftool.pl -P -r "-description<${filename;s/\.[^\.]+$ //;s/[-]/ /g;s/_/ /}"" -r -sep " " -ext jpg C:\Users\Andrew\Desktop\testimage
perl c:\windows\exiftool.pl -P -r "-IFD0:XPSubject<${filename;s/\.[^\.]+$ //;s/[-]/ /g;s/_/ /}"" -r -sep " " -ext jpg C:\Users\Andrew\Desktop\testimage
perl c:\windows\exiftool.pl -P -r "-IFD0:XPComment<${filename;s/\.[^\.]+$ //;s/[-]/ /g;s/_/ /}"" -r -sep " " -ext jpg C:\Users\Andrew\Desktop\testimage
-
Yes strange, I cannot get it to apply any metadata to the images, it just removes what is already there, even if I specify the exact image and location as a single function
hmmmmmmm
-
Many thanks
Naming and downloading is correct yes "that side is working perfect"
I have looked at that tool about 3 years ago, thank you for reminding me of it.
I can get it to do everything but it is just clearing all existing the metadata and not writing anything to it.
hmhmhmhm
path seems correct as it is now finding and wiping the data but won't write the comment will look into the tool again and see if I can figure out why its not now writing the updated info.
-
Yes the path of where the image will be, as I will be downloading them one by one,
so the path is set by the table in the code also the name is being set as its the same name as what I am naming the image.
Hope that follows :
Currently the code takes the url in coll 1 / downloads it to folder "Silverstone Images" on the desktop and gives it the name specified in coll 0
I need to work out the required code to tell it that "this images just downloaded from the specifications given is located here. and apply the same name from the table to the meta data comment.
I am going through the table one image at a time and downloading and naming, maybe its not possible to add the meta data as it downloads each image, maybe I have to download them all then create a new table with the image location and name and cycle through them adding the meta comment.
That maybe a simpler way to do it, as I know what they will be called and where they will be, so maybe I just create another csv with that data and pull that into a new table after it has finshed downloading them all and then get it to apply the meta comment.
clear table(&images)
create table from file("C:\\Users\\Andrew\\Desktop\\silverim.csv",&images)
set(#row,0,"Global")
create folder($special folder("Desktop"),"Silverstone Images")
set(#path,"{$special folder("Desktop")}/Silverstone Images/","Global")
loop($table total rows(&images)) {
download file($table cell(&images,#row,1),"{#path}{$table cell(&images,#row,0)}.jpg")
increment(#row)
} -
Cannot get my head around specifying the image location, which has just been created -ahahahhahaahah
-
Nick,
There are thousands of images pulled at any one time.
FIO they are all named 0.jpg or 1.jpg so they need to be pulled and named Lot_x"title".jpg and cycle through them all, that is working fine with the above, I just wanted to then quickly if possible at the same time write to the metadata the same naming I am doing to the image.
Hope that is more clear.
many thanks
Andrew
-
HelloInsomnia ,
you are correct its the metadata I am now trying to apply, the file download and re-name to what I specify is working great, I just wanted to if possible add another feature which was to put the title "which is what I am naming the downloaded image" into the metadata.
-
No its the meta data I want to amend also.
File name is all sorted and working fine, its apply the same file name from my csv as I am to the downloaded image also to the metadata.
sorry for any confusion.
-
FIO my sliverim.csv folder that I pull into the table has
new name and url in it
so I grab the image from the url and apply the name, so just need to apply the same name to the alt tag.
I don't want to scrape the current alt tag, just write to it as I am when downloading and naming the image.
hope that makes sense.
-
Hi Nick,
So my current code is below, I presume I could just add a command into the download file section that also adds the alt tag from row,0
or would I still need to set the command Alt ?
many thanks Andrew
clear table(&images)
create table from file("C:\\Users\\Andrew\\Desktop\\silverim.csv",&images)
set(#row,0,"Global")
create folder($special folder("Desktop"),"Silverstone Images")
set(#path,"{$special folder("Desktop")}/Silverstone Images/","Global")
loop($table total rows(&images)) {
download file($table cell(&images,#row,1),"{#path}{$table cell(&images,#row,0)}.jpg")
increment(#row)
} -
Hi
Is there any scripts that can apply alt tags to images.
I have some code that downloads an image from a url and names it with a given name, I now need to write the Name also to the Alt Tag of the image.
Is this possible anyone have any thoughts on how to do it.
Many thanks
Andrew
-
Ok where do you get a code signing certificate from - it seems to now be blocked by antivirus when they try and run it.
Unable to scrape individual items from a group on a page. it pulls in all items in the list
in Scripting
Posted
Hi,
I am trying to scrape some individual items from this page.
https://www.silverstoneauctions.com/index.php?option=com_bidding&view=commission&layout=details&id=12678
I have got a few items working fine, but when I try and scrape the item at the bottom, Chassis Number, it pulls in all the date, lot number, MOT etc all from this one selection.
I need all of them but as individual items on the same table row, so ideally scraping Lot Number, Chassis Number, MOT etc.. I don't seem to be able to get it to work with this webpage.
The Same with the top bullets in the description, I can scrape the whole description but not the bullets on their own.. ahhhhh
Any help work be great or the function I need to look at.
Many thanks
Andrew
clear list(%Title)
clear list(%Strap)
clear list(%image)
clear list(%Lot Number)
clear list(%Chassis Number)
navigate("https://www.silverstoneauctions.com/index.php?option=com_bidding&view=commission&layout=details&id=12678","Wait")
clear table(&silvesrtonenew)
add list to list(%Title,$scrape attribute(<class="mb-3 text-blue">,"innertext"),"Don\'t Delete","Local")
add list to list(%image,$scrape attribute(<src="https://www.silverstoneauctions.com/assets/lot_images/xlarge/rec10236-1_1.jpg">,"src"),"Don\'t Delete","Local")
add item to list(%Strap,$scrape attribute(<id="summary">,"innertext"),"Don\'t Delete","Local")
add list to list(%Chassis Number,$scrape attribute(<class="col-7 col-xl-9">,"innertext"),"Don\'t Delete","Local")
add list to table as column(&silvesrtonenew,0,0,%Title)
add list to table as column(&silvesrtonenew,0,1,%Strap)
add list to table as column(&silvesrtonenew,0,2,%image)
save to file("C:\\Users\\Andrew\\Desktop\\silvertest.csv",&silvesrtonenew)