A few hints needed for MediaTitles.xml

[ohpleaseno]

Originally Posted by stuckless

The phoenix.log log file will tell you if it's using the MediaTitles... if you open the file and search for MediaTitles, i think you'll see some messages related to it.

I'm not finding any references to MediaTitles.xml in that file.

I'm having a problem with shows that are preceded by an unrelated show of the same name decades earlier. For instance, The Defenders and Chase.

Here is the filename

\\WHS\SageTV\TheDefenders-Pilot-3367519-0.mkv

Here is the entry I have put in from MediaTitles.xml (to isolate this problem, I'm trying one series at a time to get it right).

<titles>	

<match>

     <regex>[\\/]TheDefenders.*</regex>
     <title>The Defenders (2010)</title>

	
</match>


</titles>

Here is the output from phoenix-metadata.log

2010-12-26 21:32:00,700 - ERROR; \\WHS\SageTV\TheDefenders-Pilot-3367519-0.mkv; The Defenders; 3438975; Failed while parsing series: MediaSearchResult [extraArgs={CLEAN_TITLE: The Defenders,YEAR: 0,EPISODE_TITLE: Pilot,RAW_TITLE: The Defenders,EPISODE_DATE: 2010-09-22,}, id=73282, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=The Defenders, type=TV, url=73282, year=1961]
2010-12-26 21:32:00,737 - ERROR; \\WHS\SageTV\TheDefenders-LasVegasvReid-3395236-0.mkv; The Defenders; 3449383; Failed while parsing series: MediaSearchResult [extraArgs={CLEAN_TITLE: The Defenders,YEAR: 0,EPISODE_TITLE: Las Vegas v. Reid,RAW_TITLE: The Defenders,EPISODE_DATE: 2010-09-29,}, id=73282, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=The Defenders, type=TV, url=73282, year=1961]
2010-12-26 21:32:00,775 - ERROR; \\WHS\SageTV\TheDefenders-NevadavCarter-3405545-0.mkv; The Defenders; 3473876; Failed while parsing series: MediaSearchResult [extraArgs={CLEAN_TITLE: The Defenders,YEAR: 0,EPISODE_TITLE: Nevada v. Carter,RAW_TITLE: The Defenders,EPISODE_DATE: 2010-10-06,}, id=73282, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=The Defenders, type=TV, url=73282, year=1961]
2010-12-26 21:32:00,813 - ERROR; \\WHS\SageTV\TheDefenders-NevadavCerbone-3416743-0.mkv; The Defenders; 3483559; Failed while parsing series: MediaSearchResult [extraArgs={CLEAN_TITLE: The Defenders,YEAR: 0,EPISODE_TITLE: Nevada v. Cerrato,RAW_TITLE: The Defenders,EPISODE_DATE: 2010-10-13,}, id=73282, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=The Defenders, type=TV, url=73282, year=1961]
2010-12-26 21:32:00,850 - ERROR; \\WHS\SageTV\TheDefenders-NevadavRodgers-3446478-0.mkv; The Defenders; 3506013; Failed while parsing series: MediaSearchResult [extraArgs={CLEAN_TITLE: The Defenders,YEAR: 0,EPISODE_TITLE: Nevada v. Rodgers,RAW_TITLE: The Defenders,EPISODE_DATE: 2010-10-27,}, id=73282, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=The Defenders, type=TV, url=73282, year=1961]
2010-12-26 21:32:00,889 - ERROR; \\WHS\SageTV\TheDefenders-LasVegasvBlackBetty-3469654-0.mkv; The Defenders; 3533906; Failed while parsing series: MediaSearchResult [extraArgs={CLEAN_TITLE: The Defenders,YEAR: 0,EPISODE_TITLE: Las Vegas v. Black Betty,RAW_TITLE: The Defenders,EPISODE_DATE: 2010-11-03,}, id=73282, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=The Defenders, type=TV, url=73282, year=1961]
2010-12-26 21:32:00,926 - ERROR; \\WHS\SageTV\TheDefenders-NevadavKillaDiz-3498078-0.mkv; The Defenders; 3542892; Failed while parsing series: MediaSearchResult [extraArgs={CLEAN_TITLE: The Defenders,YEAR: 0,EPISODE_TITLE: Nevada v. Killa Diz,RAW_TITLE: The Defenders,EPISODE_DATE: 2010-11-10,}, id=73282, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=The Defenders, type=TV, url=73282, year=1961]
2010-12-26 21:32:00,982 - ERROR; \\WHS\SageTV\TheDefenders-WhittenvFenlee-3499796-0.mkv; The Defenders; 3554152; Failed while parsing series: MediaSearchResult [extraArgs={CLEAN_TITLE: The Defenders,YEAR: 0,EPISODE_TITLE: Whitten v. Fenlee,RAW_TITLE: The Defenders,EPISODE_DATE: 2010-11-17,}, id=73282, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=The Defenders, type=TV, url=73282, year=1961]

As you can see, it is still looking for 1961's version of the show. To see if the show name wasn't a good match, i also tried to point it to the tvdb entry...

<titles>	

<match>

     <regex>[\\/]TheDefenders.*</regex>
     <metadata type="tv" name="tvdb">164521</metadata>
		
</match>


</titles>

...but no luck. Any ideas?

[stuckless]

After you changed the mediatitles.xml, did you reload the mediatitles? The changes are not picked up until a server restart or if you reload the file using the bmt web ui.

[ohpleaseno]

Then it seems that "Refresh MediaTitles.xml" is broken. I made an adjustment to the .xml file, reloaded it in the WebUI and the adjustment wasn't picked up. A restart of the Sage service picked up the change and it worked.

[stuckless]

Originally Posted by ohpleaseno

Then it seems that "Refresh MediaTitles.xml" is broken. I made an adjustment to the .xml file, reloaded it in the WebUI and the adjustment wasn't picked up. A restart of the Sage service picked up the change and it worked.

Ok... I'll add a bug for that, so that I can fix it in a future build.

[SomeWhatLost]

so, technically a V9 question, but as BMT is still currently v7 I think , this works as a good thread for a Mediatitles.xml question...
so, technically I had all this working and life was good... then I broke my setup, trashed everything and restarted from scratch...
unlike the first time around this time is a real PITA...
I do not understand why...
I did convert my TV episodes (dvd rips) to MKV's just seemed like the thing to do really... VIDEO_TS had its day... time to move on...

1st off, BMT refuses to import my TV shows as TV shows... it insists that they are movies... I would guess its a meta data thing...
so I tried making some matchers...
for example:

 <match>
    <regex>[\\/]Chuck</regex>
    <metadata type="TV" name="TVDB">80348</metadata>
  </match>
  <match>
    <regex>[\\/]Chuck-*</regex>
    <metadata type="TV" name="TVDB">80348</metadata>
  </match>

it wasn't working, so I tried with a wild card at the end?
anyway it still no worky
but the thing that really confuses me is this:

2016-07-20 20:53:29,282 - ERROR; /unraid/TV/Chuck/Chuck-s01e01/CHUCK-S01E01.mkv; CHUCK-S01E01; 454541; Invalid Search Result: MediaSearchResult [extraArgs={RAW_TITLE: C H U C K,EPISODE: 01,PROVIDER: TVDB,CLEAN_TITLE: C H U C K,EPISODE_DATE: 2016-07-16,ID: 80348,FILE: /unraid/TV/Chuck/Chuck-s01e01/CHUCK-S01E01.mkv,SEASON: 01,}, id=80348, imdbId=tt1035912, metadata=sagex.phoenix.metadata.proxy.MetadataProxy, providerId=TVDB, score=1.0, title=Chuck, type=TV, url=80348, year=0]

if it is such an invalid search result, how did BMT discover that the IMDB id was imdbId=tt1035912? I did not know that, I looked it up, BMT is 100% correct, that is the imdb ID.... so if it could find that all on its own, how is it invalid?????

[trk2]

So if you view a show that is incorrectly identified as a movie in the BMT browser, what does it indicate as the source of the metadata? Is it IMDB or TheTVDB? It could be that your TV Metadata provider is configured incorrectly.

[SomeWhatLost]

The all come up as having no Metadata. Essentially blank, just with the filename as the title.

[stuckless]

My guess is that there is some other error in the logs/phoenix.log that might shed some light on this.

[Skirge01]

Since I'm not a programmer, but I've done QA testing, I ran some scenarios on your file naming.

Doesn't work:
/*/Chuck/Chuck-s01e01/CHUCK-S01E01.mkv
/*/Chuck/CHUCK-S01E01.mkv
/*/Chuck/Chuck-s01e01/CHUCK-S01E01-CHUCK VERSUS THE INTERSECT.MKV

Works:
/*/Chuck/Chuck-s01e01/CHUCK - S01E01.MKV

That led me to the TV Title Mask option in BMT, which, on mine, shows:

${Title} - S${SeasonNumber:java.text.DecimalFormat:00}E${EpisodeNumber:java.text.DecimalFormat:00} - ${EpisodeName}

That led me to try this (removing the spaces surrounding the dashes):

${Title}-S${SeasonNumber:java.text.DecimalFormat:00}E${EpisodeNumber:java.text.DecimalFormat:00}-${EpisodeName}

But, that didn't help either. It may be a limitation in whatever coding BMT uses. Stuckless might be able to answer why the above doesn't work. But, either way, adding spaces between the dashes in the filename will certainly fix the issue.

[stuckless]

Originally Posted by Skirge01

Since I'm not a programmer, but I've done QA testing, I ran some scenarios on your file naming.

Doesn't work:
/*/Chuck/Chuck-s01e01/CHUCK-S01E01.mkv
/*/Chuck/CHUCK-S01E01.mkv
/*/Chuck/Chuck-s01e01/CHUCK-S01E01-CHUCK VERSUS THE INTERSECT.MKV

Works:
/*/Chuck/Chuck-s01e01/CHUCK - S01E01.MKV

That led me to the TV Title Mask option in BMT, which, on mine, shows:

${Title} - S${SeasonNumber:java.text.DecimalFormat:00}E${EpisodeNumber:java.text.DecimalFormat:00} - ${EpisodeName}

That led me to try this (removing the spaces surrounding the dashes):

${Title}-S${SeasonNumber:java.text.DecimalFormat:00}E${EpisodeNumber:java.text.DecimalFormat:00}-${EpisodeName}

But, that didn't help either. It may be a limitation in whatever coding BMT uses. Stuckless might be able to answer why the above doesn't work. But, either way, adding spaces between the dashes in the filename will certainly fix the issue.

In the new phoenix, the filename handling has been completely rewritten to support tv with years and other to better support non-sagetv recordings. I have a few tests around this... but I'll add in these filenames and see what happens. The new phoenix is not released yet, but I was hoping to release it soon.

[SomeWhatLost]

so, I tried adding spaces, didn't help, which is odd, because by all accounts it looked exactly like the kind of thing that would of...
but then since this started, I have done all sorts of 'bad' stuff to my meta data, I clicked on the batch "import everything as recordings" which oddly enough did not work on anything that should be a "recording", but did work on all the movies that had missing metadata (the view at the time)...

so, seems like it might be time to start fresh on the metadata front, clean slate and all that... what is the best way to do that? remove the wiz.bin?
I just got all my tuners installed and happy (again), so I really don't want to do a fresh sage install (unless I really need to)... but metadata, I have not successfully worked on yet, so, a wiping it clean and starting fresh doesn't really bother me...

[Skirge01]

You might want to go back to what stuckless originally said and post more of your log file, so he can take a look and perhaps tell you what's going on.

[SomeWhatLost]

Originally Posted by Skirge01

You might want to go back to what stuckless originally said and post more of your log file, so he can take a look and perhaps tell you what's going on.

true, that would technically be best... but my log file is huge...
just thinking starting from scratch may be easier? and don't want to waste stuckless's time debugging stuff, when I want the new stuff he is working on to be released asap...

[stuckless]

Originally Posted by SomeWhatLost

true, that would technically be best... but my log file is huge...
just thinking starting from scratch may be easier? and don't want to waste stuckless's time debugging stuff, when I want the new stuff he is working on to be released asap...

shut down your server.... then delete logs/*.log and sagetv_*.txt... then restart the server, do the lookup, and then the logs will small

[Skirge01]

Originally Posted by SomeWhatLost

and don't want to waste stuckless's time debugging stuff, when I want the new stuff he is working on to be released asap...

I admit the chances are slim and I suspect the issue is isolated to your system, but you MAY have found a bug. If so, it should at least be noted so that the next version doesn't have a similar bug.

[SomeWhatLost]

well they are still ungodly large logs... but if you think its better then just starting fresh, here you go...

[Skirge01]

Admittedly, I'm really not the one to be going over these logs, but I took a quick look at them anyway because I was curious. Hopefully stuckless will get a chance to look at them and give you a real answer.

However, I did notice this:

2016-07-22 17:43:04,095 [Thread-106] WARN sagex.phoenix.metadata.MetadataManager - Mising or Unknown Provider: TVDB

I glanced over my phoenix.log and saw no such warnings, so I don't THINK that's an expected message. Is TVDB listed as a provider in BMT?

[stuckless]

Originally Posted by SomeWhatLost

well they are still ungodly large logs... but if you think its better then just starting fresh, here you go...

Originally Posted by Skirge01

Admittedly, I'm really not the one to be going over these logs, but I took a quick look at them anyway because I was curious. Hopefully stuckless will get a chance to look at them and give you a real answer.

However, I did notice this:

2016-07-22 17:43:04,095 [Thread-106] WARN sagex.phoenix.metadata.MetadataManager - Mising or Unknown Provider: TVDB

I glanced over my phoenix.log and saw no such warnings, so I don't THINK that's an expected message. Is TVDB listed as a provider in BMT?

I did take a look a look at the logs, and I can see why some of these are failing... for example, things like "THE_WALKING_DEAD" get converted to "T H E W A L K I N G D E A D"... and this doesn't find a match... this is because a "rule" in the processing of sagetv filenames where we have to expand the filenames. I can also see that something like The100 also fails to get expanded to "The 100".

I can't figure out why a MediaTitles.xml would not solve this, since it should.

But, both of these types of files were added to the test cases for the new filename parser... and they both failed... but I've fixed it. So, hopefully when the next phoenix ships it will better process these files.

[SomeWhatLost]

well, over the weekend I started fresh with a new wiz.bin, Walking dead was a simple MediaTitles.xml now fixed most of my issues...
the last remaining trouble series are:
Crusade
Dr Who (2005)
Dungeons & Dragons
Falling Skies
Firefly
which is odd, they all worked just fine when they were VIDEO_TS, actually, the only one I even needed a 'matcher' for was Dr Who.. but that was a simple fix...
wonder why I am having so much issue trouble MKV?
as it is 2016, I cant be the first person who has gone from VIDEO_TS -> MKV?
as a side note, my VIDEO_TS -> MKV batch process missed a couple of my Falling Skies episodes, and those imported properly, found their metadata, and set them as recordings.... so it really seems to just be an MKV thing?

[SomeWhatLost]

as a side note, a feature request for BMT 2.0, a better way to deal with genre's like some sort of batch change or something to take care of sci fi vs science fiction, etc...