SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations > Batch Metadata Tools
Forum Rules FAQs Community Downloads Today's Posts Search

Notices

Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV.

Closed Thread
 
Thread Tools Search this Thread Display Modes
  #1  
Old 12-18-2010, 10:37 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
BMT 4.9.5 Released (Ratings, and other Goodies)

This release contains a number of enhancements. I've also updated the User Guide with the information as well.

When I upgraded my home machine, and then went into BMT Web UI, it didn't look like it was working. I had to clear my browser cache (shift + reload on the page), and then finally it worked. So, when you load it up, if it's asking for multiple passwords, or you are getting no views, then force a reload of the page. Also, check that when you go into Help, that it shows 4.9.5.

Here's the official bug list that was closed.
Quote:
224 Defect Completed Medium Release4.9.5 sean.stuckless › Parental Rating Mappings BMT
249 Defect Completed Medium Release4.9.5 sean.stuckless › WEBUI: Fanart Refresh BMTWEB BMT
251 Defect Completed Medium Release4.9.5 sean.stuckless › WebUI: Exclude Filter doesn't exclude BMTWEB BMT
252 Defect Completed Medium Release4.9.5 sean.stuckless › VFS: Sage Video Imports view is broken Phoenix
255 Defect Completed Medium Release4.9.5 sean.stuckless › Original Air Date - Off By 1 BMTWEB BMT
256 Defect Completed Medium Release4.9.5 sean.stuckless › Remove Year from Show Metadata BMT
257 Defect Completed Medium Release4.9.5 sean.stuckless › WebUI: Add TV lookup by Aired Date
258 Defect Completed Medium Release4.9.5 sean.stuckless › WebUI: Edit Genres from the web ui BMTWEB BMT

224 - Parental Rating Mappings
There is a new batch tool, "Fix Parental Ratings". This will go through all video files and fix the parental ratings to match what SageTV expects. Before you run this tool, check out the Parental Ratings view, since it will group all your videos by Parental Ratings. Then you can run the Tool, and then re-check the view, to make sure things are what you expect. The parental ratings view is new in 4.9.5. From here on in, ratings will be automatically fixed up when as new metadata is automatically fetched, so this tool, only needs to be run one. If you don't care about parental ratings, the don't worry that tool.

249 - Fanart Refresh
I've added new button to the browser view, refresh fanart. This will refresh the fanart ONLY for the view items and it's children. Use this if you want to get updated fanart, such as episode fanart.

251 - Exclude Filter
The missing metadata view will now exclude items that are in the exclude filter, so that they do not show up in this view.

252 - Sage Import views now work again.

255 - I think I found and fixed a bug that may have contributed to the original air date being off by one in some cases.

256 - Remove Year from show metadata
There is a new batch tool, "Fix Year for TV Shows", and this basically removes the Year metadata from the TV episode so that SageTV does not show the (Year) in the title. NOTE: This does not remove the Year from Titles that have a year in their title.

257 - Lookup by Aired Date
You can now do manual lookups from the web ui using the Aired Date.

258 - Editable Genre Field
You can now edit the Genre field. You can specify multiple genres by separating them with commas.


In addition to these fixes there were a couple of minor enhancements

1. In the "Find Metadata..." dialog it will validate that you have at least a season number, epsidoe number, aired date, or episode title.
2. Fields that are numeric will display blank, if their values are 0. This applies mainly to Season, Epsisode, Year, and Disc.
3. The "update metadata...." dialog has a couple of new options. You can choose whether or not to update fanart, metadata, or if you want to scan sub folders.
4. The batch operations are now sorted by label.
5. The edit metadata panel will now either show MPAA Ratings or Parental Ratings depending on if the media file is a Movie or TV file.
6. The Year is hidden on TV Metadata, since Year is not valid for a TV episode.
7. Preserve recording metadata does not apply to Recordings that were imported. It only applied to native sagetv recordings.

Good luck, and enjoy. And please see the user guide for updated information.

Not sure there will be another release before Christmas, so Merry Chirstmas!
  #2  
Old 12-19-2010, 01:15 PM
crusing crusing is offline
Sage Advanced User
 
Join Date: Sep 2010
Location: Kennewick, WA
Posts: 160
I am still seeing my home movies in the missing metadata folder.

Here is my exclude filter
\\Home Movies\\

I copied this path from one of the items in the missing metadata folder and it matches when I test it.
E:\Home Movies\2010\2010-06\00025.MTS

Any idea what might be wrong? Do I need to do something to clear the videos from the missing metadata folder?

Thank you.
  #3  
Old 12-19-2010, 01:19 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by crusing View Post
I am still seeing my home movies in the missing metadata folder.

Here is my exclude filter
\\Home Movies\\

I copied this path from one of the items in the missing metadata folder and it matches when I test it.
E:\Home Movies\2010\2010-06\00025.MTS

Any idea what might be wrong? Do I need to do something to clear the videos from the missing metadata folder?

Thank you.
Could you post up your exclude filter? And, could you confirm from the Status page that it is running Phoenix 2.3,9, and from the Help dialog, that you are running BMT 4.9.5.
  #4  
Old 12-19-2010, 01:38 PM
crusing crusing is offline
Sage Advanced User
 
Join Date: Sep 2010
Location: Kennewick, WA
Posts: 160
I have checked the version numbers and both match. The only exclude filter I have is "\\Home Movies\\" I have also tried just "Home Movies" both match in the BMT Web.

Thanks
  #5  
Old 12-19-2010, 01:44 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by crusing View Post
I have checked the version numbers and both match. The only exclude filter I have is "\\Home Movies\\" I have also tried just "Home Movies" both match in the BMT Web.

Thanks
I'll add this to my test enviroment and dump some files in there and see what I come up with.
  #6  
Old 12-19-2010, 02:06 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by crusing View Post
I have checked the version numbers and both match. The only exclude filter I have is "\\Home Movies\\" I have also tried just "Home Movies" both match in the BMT Web.

Thanks
You'll be happy to know (maybe) that there is a bug in the exclude filter. It was only excluding based on filenames and not the complete path. That's been fixed. I wasn't planning on doing a release until after christmas, but if it's bothering you enough, i'll send out build with just this fix.
  #7  
Old 12-19-2010, 02:13 PM
crusing crusing is offline
Sage Advanced User
 
Join Date: Sep 2010
Location: Kennewick, WA
Posts: 160
Thanks again for all of your work. No big hurry.

Thanks
  #8  
Old 12-19-2010, 03:43 PM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
Sean,
The OAD match was a great addition, and should help with the issue Mike was talking about. It is currently only for the manual update process, correct? Do you have any plans one way or the other to make it a fall-back if you don't get a match from episode title?
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room
  #9  
Old 12-19-2010, 05:23 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by Fuzzy View Post
Sean,
The OAD match was a great addition, and should help with the issue Mike was talking about. It is currently only for the manual update process, correct? Do you have any plans one way or the other to make it a fall-back if you don't get a match from episode title?
Currently, the tvdb provider will first search by season/episode, then date, then episode title. It does this now from the web ui, or automatically. I could flip episode title and aired date, so that it tries episode title, and if that fails, it uses the aired date, but I originally did it this way because searching by episode title is expensive (I have to download all episodes for all seasons).
  #10  
Old 12-19-2010, 06:55 PM
PLUCKYHD PLUCKYHD is offline
SageTVaholic
 
Join Date: Dec 2007
Posts: 6,257
Quote:
Originally Posted by stuckless View Post
Currently, the tvdb provider will first search by season/episode, then date, then episode title. It does this now from the web ui, or automatically. I could flip episode title and aired date, so that it tries episode title, and if that fails, it uses the aired date, but I originally did it this way because searching by episode title is expensive (I have to download all episodes for all seasons).
Curious why you don't download the series full xml's tvdb provides then update those occasionally locally. I am sure you have your reasons just curious
  #11  
Old 12-19-2010, 07:10 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by PLUCKYHD View Post
Curious why you don't download the series full xml's tvdb provides then update those occasionally locally. I am sure you have your reasons just curious
Well, technically they do get downloaded locally. ie, 2 or more consecutive calls to tvdb for the same series info, actor info, episode info, etc, all gets cached. Phoenix has a "CachedUrl" that transparently caches all data that is accessed via the Url (so, Imdb and TheMovieDB utilize the CachedUrl as well). So, while the code "thinks" it's hitting tvdb for the information, it's really getting the data from the cache most of the time. Typically I cache tvdb information for only a few hours though. That's why from time to time, I tell people to blow away their cache, because they are hitting a window where the information that I have cached doesn't have the latest episode infomation on tvdb (or imdb, themoviedb, etc). Used to cache longer, like 24 hours, but I was telling people to clear their caches more frequently

If posible, i try to not manage information from other sites. ie, I don't want to build a duplicate database of their information, other than what I need in the Wiz.bin.
  #12  
Old 12-19-2010, 07:22 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
 
Join Date: Apr 2009
Location: South Florida
Posts: 464
BMT still isn't picking up some shows with OAD in the titles. Here is a log for one of them.

Code:
2010-12-19 18:21:35,744 - AUTO; MEDIA; \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv; The Tonight Show with Conan O'Brien 2010-01-18; 3582255
2010-12-19 18:21:37,384 - ERROR; \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv; The Tonight Show with Conan O'Brien 2010-01-18; 3582255; Search Failed for SearchQuery [type=TV, fields={QUERY: The Tonight Show with Conan O' Brien ,RAW_TITLE: The  Tonight  Show with  Conan  O' Brien 2010,EPISODE_DATE: 2010-01-19,FILE: \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv,CLEAN_TITLE: The Tonight Show with Conan O' Brien ,EPISODE_TITLE: ,}, hints=Hints [hints={update_fanart: true,update_metadata: true,scan_missing_metadata: true,scan_subfolders: true,known_recording: false,import_tv_as_recording: true,auto: true,}]]
Don't know if the space after the QUERY matters, but it also seems like it's doing the +1 thing still.
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
  #13  
Old 12-19-2010, 08:14 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by ohpleaseno View Post
BMT still isn't picking up some shows with OAD in the titles. Here is a log for one of them.

Code:
2010-12-19 18:21:35,744 - AUTO; MEDIA; \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv; The Tonight Show with Conan O'Brien 2010-01-18; 3582255
2010-12-19 18:21:37,384 - ERROR; \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv; The Tonight Show with Conan O'Brien 2010-01-18; 3582255; Search Failed for SearchQuery [type=TV, fields={QUERY: The Tonight Show with Conan O' Brien ,RAW_TITLE: The  Tonight  Show with  Conan  O' Brien 2010,EPISODE_DATE: 2010-01-19,FILE: \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv,CLEAN_TITLE: The Tonight Show with Conan O' Brien ,EPISODE_TITLE: ,}, hints=Hints [hints={update_fanart: true,update_metadata: true,scan_missing_metadata: true,scan_subfolders: true,known_recording: false,import_tv_as_recording: true,auto: true,}]]
Don't know if the space after the QUERY matters, but it also seems like it's doing the +1 thing still.
These are not recordings, correct? (or have they been imported into recordings, etc) In my testing, using the files that you have posted, I get the correct the data for the correct day. Also could you confirm if the date/time on the file itself is the 19th?
  #14  
Old 12-19-2010, 08:17 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
 
Join Date: Apr 2009
Location: South Florida
Posts: 464
It is not a recording.

The "Date Modified" on the recording in Explorer is 2010/01/19
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
  #15  
Old 12-19-2010, 08:24 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
 
Join Date: Apr 2009
Location: South Florida
Posts: 464
FYI, the Web UI works flawlessly now for OAD lookups. The automatic lookup is what is failing.
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
  #16  
Old 12-19-2010, 09:04 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by ohpleaseno View Post
It is not a recording.

The "Date Modified" on the recording in Explorer is 2010/01/19
Ok, well that makes sense, kind of. I set the OAD for a non-recording to be the file's date/time, but since you have it explicitly in the filename, that should override... looks like I need to do more testing

Quote:
Originally Posted by ohpleaseno View Post
FYI, the Web UI works flawlessly now for OAD lookups. The automatic lookup is what is failing.
That's good to know.
  #17  
Old 12-20-2010, 03:11 PM
evilpenguin's Avatar
evilpenguin evilpenguin is offline
SageTVaholic
 
Join Date: Aug 2003
Location: Seattle, WA
Posts: 3,696
Hey Sean,

It looks like you might be stripping the Year from recorded movies also. I had a movie with a valid year pre-fix and now its been removed.

In addition, i'm unable to manually set the year though the Web Interface anymore. Anytime I set it and save, it just disappears again.

-Scott
__________________
Clients: 1xHD200 Connected to 50" TH-50PZ750U Plasma
Server : Shuttle SFF SSH55J2 w/ Win7 Home, SageTV v7, Core i3 540, 2GB RAM, 30GB SSD for OS, 1.5TB+2x1TB WDGP for Recordings, BluRay, 2xHDHR, 1xFirewire
SageTV : PlayOn, SJQ, MediaShrink, Comskip, Jetty, Web Client, BMT


Having a problem? Don't forget to include a log! (Instructions for: PlayOn For SageTV v1.5, MediaShrink)
  #18  
Old 12-20-2010, 03:31 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by evilpenguin View Post
Hey Sean,

It looks like you might be stripping the Year from recorded movies also. I had a movie with a valid year pre-fix and now its been removed.

In addition, i'm unable to manually set the year though the Web Interface anymore. Anytime I set it and save, it just disappears again.

-Scott
I'll check this out tonight... i thought I was doing a content test of 'TV' but I may have only done 'RECORDING'
  #19  
Old 12-20-2010, 05:49 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by evilpenguin View Post
Hey Sean,

It looks like you might be stripping the Year from recorded movies also. I had a movie with a valid year pre-fix and now its been removed.

In addition, i'm unable to manually set the year though the Web Interface anymore. Anytime I set it and save, it just disappears again.

-Scott
Well, it turns out that I was using 'TV' but the vfs's definitiion of TV was simply a Recording, which is a bug. So, I've fixed that... too lilttle too late for those of you that have lost the 'year' from your recorded movies (sorry).
  #20  
Old 12-20-2010, 07:22 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by ohpleaseno View Post
BMT still isn't picking up some shows with OAD in the titles. Here is a log for one of them.

Code:
2010-12-19 18:21:35,744 - AUTO; MEDIA; \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv; The Tonight Show with Conan O'Brien 2010-01-18; 3582255
2010-12-19 18:21:37,384 - ERROR; \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv; The Tonight Show with Conan O'Brien 2010-01-18; 3582255; Search Failed for SearchQuery [type=TV, fields={QUERY: The Tonight Show with Conan O' Brien ,RAW_TITLE: The  Tonight  Show with  Conan  O' Brien 2010,EPISODE_DATE: 2010-01-19,FILE: \\WHs\dumpster\done\Talk Shows\The Tonight Show with Conan O'Brien\The Tonight Show with Conan O'Brien 2010-01-18.mkv,CLEAN_TITLE: The Tonight Show with Conan O' Brien ,EPISODE_TITLE: ,}, hints=Hints [hints={update_fanart: true,update_metadata: true,scan_missing_metadata: true,scan_subfolders: true,known_recording: false,import_tv_as_recording: true,auto: true,}]]
Don't know if the space after the QUERY matters, but it also seems like it's doing the +1 thing still.
I did more testing tonight. I cannot get this this accept any other date than what is specified in the filename. I created the same file that you used, and it imported fine, using the correct date and i had "import as recording" since I noticed that you are importing them as recordings as well.

When you use the web ui and do a manual find metadata, do you click the "discover defaults" button? If so, does it bring back the correct date?
Closed Thread


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
BMT 4.9.4 Released (Minor Bug Fixes) stuckless Batch Metadata Tools 17 12-15-2010 01:34 PM
BMT: Read this if you don't see any BMT topics Opus4 SageTV Customizations 0 04-25-2010 09:17 PM
Is this an upgrade for me? AMD 5000+ x2, x1250 w/hdmi, other goodies for $499 btrcp2000 Hardware Support 3 09-25-2007 07:52 PM
IMDB Ratings scandx SageTV Customizations 4 09-16-2007 03:41 AM
CES Goodies Enormous General Discussion 6 01-08-2007 10:53 AM


All times are GMT -6. The time now is 08:24 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.