Utility: mediaScraper - metadata made easy!

[matt91]

Originally Posted by jaminben

Could you post what you used inside your mediaScraper.defaults.txt, please.

Sure. I can't do it until I get home this evening, though.

I only deleted (rather than added) from the default settings. I think I deleted "generate properties" (although it still did), and maybe one other thing.

Matt

[jaminben]

So I put the scraper on the server, ran it from there and it imported the metadata into the SageDB Just gotta get it to download all the images now. It still only downloads one image into the fanart backgrounds folder and the episode image into the media's folder.

[matt91]

Originally Posted by jaminben

It still only downloads one image into the fanart backgrounds folder and the episode image into the media's folder.

Are you running it on shows that have lots of fanart?

[jaminben]

Originally Posted by matt91

Are you running it on shows that have lots of fanart?

Yes, Heroes, Lost etc. The old versions picked up the images just fine. I think this is down to user error on my part with the mediaScraper.defaults.txt. I'll wait awhile until I can see someone else's example before I start changing it again.

[evilpenguin]

If your having problems put /saveLog in your mediashrink.defaults.txt and it will save the log files.

[matt91]

I guess I did change the default "3" to "10" for the number of images to download. Not sure why you wouldn't even have three, though.

[evilpenguin]

Just two problems:

1) I must have changed this, you specify the port separately now: /sageTVServer "192.168.0.101" /port 1234
2) Somehow you lost /maxImagesToDownload 3. It defaults to 1 so it doesn't try and download everything.

/addToSageDB /userName "jaminben" /password "*****" /sageTVServer "192.168.0.101" /port **** /centralFanArtPath "\\SAGEWHS\Fanart" /downloadAllFanArt /baseFolder "TV" /defaultProfile inputFile /organizeFiles /tvSE /findFileRegEx "avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms" /throttle 10 /maxImagesToDownload 3

Also, when you run it from the server, you don't need /username, /password, /port, or /sageTVServer. Those will be picked out automatically.

[jaminben]

Originally Posted by evilpenguin

Just two problems:

1) I must have changed this, you specify the port separately now: /sageTVServer "192.168.0.101" /port 1234
2) Somehow you lost /maxImagesToDownload 3. It defaults to 1 so it doesn't try and download everything.

That sorted it out, downloading images as I type.

Very cool tool, I love it.

Thankyou very much.

[jaminben]

I've just noticed that I'm not downloading actor images anymore, have you taken this out? Please say you haven't as I've added an option to view these and I've also asked if Sean could create an actor api as well. If you have removed them any chance you could put them back, please.

[evilpenguin]

Haha, I remembered you said you weren't going to be using actor images for anything so I stopped downloading them

Its easy enough to renable, just look in theTVDB.scrape line 95 and change

?>(>downloadAllFanArt||downloadActors<)&&centralFanartPath&&XdisabledX<:>downloadActors<?

to this...

?>(>downloadAllFanArt||downloadActors<)&&centralFanartPath<:>downloadActors<?

[chiledog]

I ran mediascraper on my files. I changed all the properties (add a few fields) and copied all the fan art to my fan art folder.

But, when I re-imported into SageMC, it did not display the fan art.

Is there any other steps I need to do? (BTW, I have SageMC 6.3.9 and I have the fanart enabled in the config).

Thanks,

PS. I changed the default fanart folder to be another folder outside the SageTV install directory.

[jaminben]

Originally Posted by evilpenguin

Haha, the last e-mail I got from you said you weren't going to use them so I stopped downloading them

Its easy enough to renable, just look in theTVDB.scrape line 95 and change

?>(>downloadAllFanArt||downloadActors<)&&centralFanartPath&&XdisabledX<:>downloadActors<?

to this...

?>(>downloadAllFanArt||downloadActors<)&&centralFanartPath<:>downloadActors<?

Genius, that did the trick

You are correct, I did say that but I changed my mind and thought you may have forgetten about it. I guess not

On a different note, is their anyway to remove the .properties files once its finished doing its thing?

[evilpenguin]

Not really, after I create the .property files and touch the videos, Sage has to read them in. There's really no way for me to detect that.

[jaminben]

Originally Posted by evilpenguin

Not really, after I create the .property files and touch the videos, Sage has to read them in. There's really no way for me to detect that.

Oki, not a problem.

[HokiePerogi]

Can you explain what the following parameters are used for, I didn't seem them documented anywhere in the thread:

/defaultProfile inputFile
/findFileRegEx "avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms"
/throttle 10


Thanks

[evilpenguin]

Its so hard for me to keep track of the current parameter list, I add and remove like 10 a night

If I have some time this week i'll try and go though and see whats still there and being used so I can update the 2nd post.

[chiledog]

Originally Posted by HokiePerogi

Can you explain what the following parameters are used for, I didn't seem them documented anywhere in the thread:

/defaultProfile inputFile
/findFileRegEx "avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms"
/throttle 10


Thanks

throttle 10 is the amount of seconds the tool waits between queries to the server (so it doesn't flood it to much).

[theringnebula]

Hi I am still noticing a few potential bugs in this otherwise very useful tool.

1. XML files generated always have the isHDTV flag set even if the show is standard def.

2. If I use the "/organizeFiles" feature and the episode name has a comma "," in it the program writes the comma to the filename and then it cannot import it into the SageTV database. Example filename: "The Simpsons 2x11 - One Fish, Two Fish, Blowfish, Blue Fish". If you strip out the comma's when writing the file name it should fix this.

3. Episode names that have a "&" in the episode name, description or anywhere else in the XML file won't import to the webserver as it is a special XML character.

Thanks

[evilpenguin]

Originally Posted by theringnebula

Hi I am still noticing a few potential bugs in this otherwise very useful tool.

1. XML files generated always have the isHDTV flag set even if the show is standard def.

2. If I use the "/organizeFiles" feature and the episode name has a comma "," in it the program writes the comma to the filename and then it cannot import it into the SageTV database. Example filename: "The Simpsons 2x11 - One Fish, Two Fish, Blowfish, Blue Fish". If you strip out the comma's when writing the file name it should fix this.

3. Episode names that have a "&" in the episode name, description or anywhere else in the XML file won't import to the webserver as it is a special XML character.

Thanks

I forgot about those first two problems, but I thought #3 was fixed. I'll take a look at it tonight.

[stuckless]

Originally Posted by evilpenguin

I forgot about those first two problems, but I thought #3 was fixed. I'll take a look at it tonight.

ep, just an fyi about #3.... since you are creating the xml, you can wrap the title and description fields inside of an xml CDATA processing intruction. That will tell the xml parse not to parse the content as xml.

ie,
<title><![CDATA[Your Title with & Character]]></title>

Most people opt to do the search and replace method, but xml provides a mechanism for dealing with special characters. This will also protect you if the title contains other xml reserved characters as well.

I don't know which method you are using, but i thought I'd pass this along.