SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations > Batch Metadata Tools

Notices

Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV.

Reply
 
Thread Tools Search this Thread Display Modes
  #201  
Old 12-13-2008, 07:19 AM
talbot3 talbot3 is offline
Sage Advanced User
 
Join Date: Jun 2007
Posts: 82
Stuckless, I can get the backgrounds to work for my movies files if I name them themovie_background.jpg and place it in the same directory as the file. So your program would need to download the background and name it themovie_backgroundnd.jpg and place it in the same folder as themovie.mvk, themovie.jpg, and themovie.mkv.properties.
This would be an awesome addition if its possible.
Reply With Quote
  #202  
Old 12-13-2008, 07:44 AM
stuckless's Avatar
stuckless stuckless is online now
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,521
S M E, I think that some people use folders because it looks "neater" when you browse the filesystem. I only use folders for DVDs, personally. As for the tool, since it is a batch processor, you can quickly run a set of tests against some movies, first with the imdb provider, and then with themoviesdb.com provider. Since the processor uses the movie filename as a key to search on, you may have some issues if your names have dates appeneded to them. (ie, you may get a lot less exact hits)

talbot3, thanks for the info. Of course, for me to do this, I'd also have to install SageMC, then figure out backgrounds, so it's not a high priority feature for me
Reply With Quote
  #203  
Old 12-13-2008, 08:12 AM
electronics4lif electronics4lif is offline
Sage Advanced User
 
Join Date: Dec 2006
Posts: 141
When I pass the --listProviders command after updating to 1.11, themoviedb.com is not listed as an installed provider. Was this not included in the download? Do I need to load it a different way?

Thank you.
Reply With Quote
  #204  
Old 12-13-2008, 08:38 AM
mrdrbdt mrdrbdt is offline
Sage User
 
Join Date: Jul 2007
Posts: 59
Is there documentation somewhere on how to write a provider? After looking at the data pulled from imdb and the moviedb, I think I'd like to pull the categories from imdb, since they match up with the fancy fonts in sagemc, and the descriptions and covers from imdb, since they are more complete and higher res, respectively.

In the short term, is there a way to only update thumbnails? Using forcethumbnails seems to not do anything, they all just get skipped.

Last edited by mrdrbdt; 12-13-2008 at 08:42 AM.
Reply With Quote
  #205  
Old 12-13-2008, 08:50 AM
stuckless's Avatar
stuckless stuckless is online now
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,521
Quote:
When I pass the --listProviders command after updating to 1.11, themoviedb.com is not listed as an installed provider.
make sure that when you "upgrade", that you clean out the previous install first. This project uses versioned jar files (ie, jarname-version.jar) and if multiple versions of the same jar file exists in the same directory, then java will load all of them, BUT, there is no guarantee that it will actually use the version you want.

At the very least, you need to delete all jars in the jars directory before your install over top. Or, to be safer, extract to another location, and them move your metadata.properties (if you have one) into the new extracted area.

I may look into providing a simple installer, if I find that too many people are having issues with installing the tools over top of a previous install.

Quote:
I seem to be having problems with the default imdb provider.
IMDB changed their site, but I fixed it as of 1.11, if it's still broken, then see my comment about installation.

Quote:
Is there documentation somewhere on how to write a provider?
See the wiki. Then check out the source code, and start with providing an implementation for IMediaMetadataProvider. (See the current implementations for additional information)

Quote:
In the short term, is there a way to only update thumbnails? Using forcethumbnails seems to not do anything, they all just get skipped.
--forceThumbnail is only useful in conjunction with --update or --force. But i'll look into it.
Reply With Quote
  #206  
Old 12-13-2008, 08:54 AM
mrdrbdt mrdrbdt is offline
Sage User
 
Join Date: Jul 2007
Posts: 59
Quote:
Originally Posted by stuckless View Post
IMDB changed their site, but I fixed it as of 1.11, if it's still broken, then see my comment about installation.
Yeah, I'm a fool... I started writing that post late last night and then I fell asleep before posting. When I woke up today, I just hit the "post" button and went and got coffee.

Quote:
Originally Posted by stuckless View Post
See the wiki. Then check out the source code, and start with providing an implementation for IMediaMetadataProvider. (See the current implementations for additional information)
I'll have to take a look. I've never written java, so this should be interesting!
Reply With Quote
  #207  
Old 12-13-2008, 08:56 AM
bcjenkins bcjenkins is offline
SageTVaholic
 
Join Date: Jan 2006
Posts: 3,760
Quote:
Originally Posted by stuckless View Post
Gerry, I agree it wouldn't be too much effort, and I'm currently looking into providing additional cover art functionality and providers, so mabe at some point i'll look into backgrounds.

It sounds, from your comment, that backgrounds only work for movies that are in a folder. It's too bad it couldn't also work for movies that are not in individual folders. I typically don't create a new folder each movie. (but maybe I'm just misunderstanding how backgrounds work)
You can output the FanArt to a central directory (eg: /var/media/fanart/video) and name it the title of the movie. As long as we're making requests: I would like to add that I would like to be able to run this twice, once to import DVD Profiler data and once to query for just FanArt.

B
__________________
Running SageTV on unRAID via Docker
Tuning handled by HDHR3-6CC-3X2 using OpenDCT
Reply With Quote
  #208  
Old 12-13-2008, 10:01 AM
mrdrbdt mrdrbdt is offline
Sage User
 
Join Date: Jul 2007
Posts: 59
themoviedb.com categories are frustrating...

I tested this against 7 movies with # of genres set to 2, I got 12 different genres... It seems like they arbitrarily make up the movie categories with no regard to keeping the numbers of available categories reasonable.

Two funny examples
A View to a Kill is listed as a "Chick Flick"..
About Schmidt is listed as "Drama Film/Social Drama Film"

I do like the extend descriptions and large cover art, though. I guess I'm just extra motivated now to figure out how to make a hybrid provider.

the batchimporter is still an awesome tool!
Reply With Quote
  #209  
Old 12-13-2008, 10:25 AM
stuckless's Avatar
stuckless stuckless is online now
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,521
Quote:
You can output the FanArt to a central directory (eg: /var/media/fanart/video) and name it the title of the movie. As long as we're making requests: I would like to add that I would like to be able to run this twice, once to import DVD Profiler data and once to query for just FanArt.
Yeah, it's looking like there may end up being 2 tools; one for metadata and one for cover-art/backgrounds. But, doing a command line tool for coverart and backgrounds, may be limited, since you won't actually be able to choose and select an image from a command shell This means that if I provide a coverart command line tool, then it would have to chose the coverart and background image for you, without you seeing the actual images.

I assume you are using SageMC if you are using Fan Art, since it's my understanding that Fan Art isn't supported in the stock stv??
Reply With Quote
  #210  
Old 12-13-2008, 10:29 AM
stuckless's Avatar
stuckless stuckless is online now
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,521
Quote:
Originally Posted by mrdrbdt View Post
themoviedb.com categories are frustrating...

I tested this against 7 movies with # of genres set to 2, I got 12 different genres... It seems like they arbitrarily make up the movie categories with no regard to keeping the numbers of available categories reasonable.

Two funny examples
A View to a Kill is listed as a "Chick Flick"..
About Schmidt is listed as "Drama Film/Social Drama Film"

I do like the extend descriptions and large cover art, though. I guess I'm just extra motivated now to figure out how to make a hybrid provider.

the batchimporter is still an awesome tool!
If I get a chance tonight, i'll create a simple hybrid IMDB/TheMovieDB provider. The nice thing about the themoviedb API is that is actually supports looking up content based on an IMDB id, so it would be pretty easy for me to create a composite provider that would use IMDB for searching and getting back the base details, but, use themoviedb.com to get the thumbnail url and description.

if I get a couple of hours tonight, then I'll look into that.
Reply With Quote
  #211  
Old 12-13-2008, 11:14 AM
bcjenkins bcjenkins is offline
SageTVaholic
 
Join Date: Jan 2006
Posts: 3,760
Quote:
Originally Posted by stuckless View Post
Yeah, it's looking like there may end up being 2 tools; one for metadata and one for cover-art/backgrounds. But, doing a command line tool for coverart and backgrounds, may be limited, since you won't actually be able to choose and select an image from a command shell This means that if I provide a coverart command line tool, then it would have to chose the coverart and background image for you, without you seeing the actual images.

I assume you are using SageMC if you are using Fan Art, since it's my understanding that Fan Art isn't supported in the stock stv??
Yeah, I switched over just for the feature. I am okay with accepting the first image and manually replacing it if I don't like it. The issue for me is trying to match up the downloaded filenames for whatever name SageMC is looking for. I tried once, and it seems as the aforementioned space character issue is causing problems. I figure the easiest way to take care of it is for the tool I use to generate properties files is also the tool which names the FanArt.

Thanks for taking a look at it.

B
__________________
Running SageTV on unRAID via Docker
Tuning handled by HDHR3-6CC-3X2 using OpenDCT
Reply With Quote
  #212  
Old 12-13-2008, 11:20 AM
stuckless's Avatar
stuckless stuckless is online now
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,521
Quote:
I tried once, and it seems as the aforementioned space character issue is causing problems
Yeah, that should be fixed as of 1.10.... but I'm still unsure how a space at the end of the title is causing problems for fanart. I would have thought that the fanart would have been keyed of the filename and not the title.
Reply With Quote
  #213  
Old 12-13-2008, 03:35 PM
mrdrbdt mrdrbdt is offline
Sage User
 
Join Date: Jul 2007
Posts: 59
Talking

Quote:
Originally Posted by stuckless View Post
If I get a chance tonight, i'll create a simple hybrid IMDB/TheMovieDB provider. The nice thing about the themoviedb API is that is actually supports looking up content based on an IMDB id, so it would be pretty easy for me to create a composite provider that would use IMDB for searching and getting back the base details, but, use themoviedb.com to get the thumbnail url and description.

if I get a couple of hours tonight, then I'll look into that.
That would be sweeeeet!!
Reply With Quote
  #214  
Old 12-13-2008, 07:54 PM
ke6guj ke6guj is offline
Sage Icon
 
Join Date: Jan 2005
Posts: 2,355
+1. That does sound sweet.
__________________
- Jack
__________________________________________
Server: AMD Phenom 9750, 2GB RAM, 2 Hauppauge PVR500, 1 Firewired DCT6200, 1 HDHomerun tuning 2 QAM channels, Vizio 37" HDTV LCD, 1 USB-UIRT

Clients: 1 MediaMVP, 1 Placeshifter Client, & 1 SageTV Client.
Reply With Quote
  #215  
Old 12-13-2008, 10:19 PM
stuckless's Avatar
stuckless stuckless is online now
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,521
Exclamation New Release 1.12

Release 1.12 includes 2 things.

First, I fixed the issue where --forceThumbnail would not overwrite the thumbnail.

Second, I added a Composite Provider. A Composite Provider is a provider that made of 2 other providers, that you configure. This is an advanced feature that does not require programming, but you not use this unless you understand what you are doing. You will need to read the wiki to understand what configuration you need in order to configure your own Composite Provider.

And, most importantly, Composite Providers only work with providers that can support IMDB id information. This is basically all existing providers, except, the DVD Profiler ones. (Sorry DVD Profiler folks )

I've configured a sample provider, to show how it would be done. My sample provider basically uses the imdb provider to search, but then it pulls all detailed information from themoviedb.com, except for Genres. It pulls the Genre information from the imdb provider. Read the wiki.

You should NOT use the sample provider, since it is ONLY created in the event that NO other Composite Providers exist. As soon as you create your own, then it will disappear.

Good luck!
Reply With Quote
  #216  
Old 12-13-2008, 10:25 PM
stuckless's Avatar
stuckless stuckless is online now
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,521
Question Possible new feature/plugin

I have written, but not released, a SageTV MediaFileMetadataParser plugin implementation, that uses the Metadata Tools to automatically fetch thumbnails and metadata information when new vidoes are added to the video library.

I'm currently testing it on my own system. It seems to be working, and if I feel it's working fine over the next couple of weeks, then I'll release it.

I'm just curious what people think about doing automatic metadata lookups when movies are added. I like it personally, or else I wouldn't have written it
Reply With Quote
  #217  
Old 12-13-2008, 11:05 PM
mrdrbdt mrdrbdt is offline
Sage User
 
Join Date: Jul 2007
Posts: 59
Quote:
Originally Posted by stuckless View Post
Second, I added a Composite Provider. A Composite Provider is a provider that made of 2 other providers, that you configure. This is an advanced feature that does not require programming, but you not use this unless you understand what you are doing. You will need to read the wiki to understand what configuration you need in order to configure your own Composite Provider.
That...is....AWESOME

So much for going to sleep tonight! I'm gonna go try it out right now. I'll let you know how it goes.

Thanks again for adding this in!
Reply With Quote
  #218  
Old 12-14-2008, 01:04 AM
PGPfan's Avatar
PGPfan PGPfan is offline
Sage Fanatic
 
Join Date: Apr 2003
Location: Oldtown, Idaho USA
Posts: 862
Quote:
Originally Posted by stuckless View Post
I'm just curious what people think about doing automatic metadata lookups when movies are added. I like it personally, or else I wouldn't have written it
What do people think? Too bad you're a guy or else you'd have a marriage proposal on the way! lol

-PGPfan
__________________
Sage Server: Gigabyte 690AMD m-ATX, Athlon II X4 620 Propus, 3.0 GB ram, (1) VistaView dual analog PCI-e tuner, (2) Avermedia Purity 3D MCE 250's, (1) HD-Homerun, 1.5 TB of hard drives in a Windows Home Server drive pool, Western Digital 300GB 'scratch' disk outside the pool, Gigabit LAN
Sage Clients: MSI DIVA m-ATX, 5.1 channel 100w/channel amplifier card, 2 GB ram, , (1) Hauppauge MVP, (1) SageTV HD-100 Media Storage: unRAID 3.6TB server
Reply With Quote
  #219  
Old 12-14-2008, 07:21 AM
bcjenkins bcjenkins is offline
SageTVaholic
 
Join Date: Jan 2006
Posts: 3,760
Sean,

Does the new release include FanArt?

B
__________________
Running SageTV on unRAID via Docker
Tuning handled by HDHR3-6CC-3X2 using OpenDCT
Reply With Quote
  #220  
Old 12-14-2008, 07:43 AM
stuckless's Avatar
stuckless stuckless is online now
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,521
Quote:
Originally Posted by bcjenkins View Post
Does the new release include FanArt?
B
You are way too optimistic No, unfortunately, I need to better understand the "rules" around how to name and store fanart before i can create that feature. And, I'll need to install SageMC on at least my dev client, so that I can test if it works. And honestly, I haven't looked into it yet.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Automated VideoRedo (DOS batch files) grauchy SageTV Customizations 3 09-08-2011 10:01 PM
STV Import: Read & Write Metadata files for Default STV 5/6 (v2.2.9 18/Feb./2010) JREkiwi SageTV Customizations 249 10-26-2010 12:15 AM
Simple utility to control multiple USB or Serial HD DirecTV STBs jchiso Hardware Support 15 02-19-2009 06:27 PM
DVB-S setup with Digiguide EPG Grabber & XMLTV importer MCE-Refugee SageTV United Kingdom 27 09-08-2008 09:10 AM
Keeping custom metadata for imports via AddShow() Opus4 SageTV Studio 9 02-20-2008 06:35 PM


All times are GMT -6. The time now is 03:58 AM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.