Metadata Tools 4.0 Beta Thread (aka BMT 4.0)

[broconne]

Originally Posted by stuckless

@broconne - if you are experiencing issues tv dvd sets, then that would be normal. bmt does not support tv dvd sets, but rather it supports the Season Episode format (ie, File - S##E##.avi)

I'm looking to add dvd tv set support, but it's not there yet.

As for the other properties, they are ok... except, mediafile_metadata_parser_plugins=org.jdna.sage.MetadataUpdaterPlugin is no longer used. It doesn't hurt to have it there, but it does nothing.

Thanks Stuckless. I should have clarified. I am backing up from DVD, but extracting each episode individually and naming them in the proper ShowName - S##E## format.

I will note, that if I go into the BMT web intereface, select browse -> Missing MetaData -> Update Metadata it will go through and find the metadata associated with each new item and populate the proper fields. Just doesn't seem to be doing it automatically when a new media file is added.

[stuckless]

Originally Posted by broconne

Thanks Stuckless. I should have clarified. I am backing up from DVD, but extracting each episode individually and naming them in the proper ShowName - S##E## format.

I will note, that if I go into the BMT web intereface, select browse -> Missing MetaData -> Update Metadata it will go through and find the metadata associated with each new item and populate the proper fields. Just doesn't seem to be doing it automatically when a new media file is added.

I noticed that you have System Message turned on, so that you should get a system message for each failed item. Are you seeing system messages for failed items? Also, you have an exclude path set as well, so hopefully your tv files are not under that area.

As long as you have the automatic plugin enabled (enabled by default, and you do appear to have it enabled as well), then the only reason for a file to NOT get scanned is either...
1. It's being skipped/excluded (not the right media type, or the exclude filter kicks in)
2. It can't find a metadata match (but should generate system message in that case)
3. BMT internal error that is not handled (I think I've handled most cases, but maybe you've hit new one)

The automatic plugin is basically the only way that I use bmt, and it's rare, in my case, for it to not work.

In the next release there will be an additional log that will record all media items that bmt handles or skips. For each media item there will be 2 log entries... one that tells that it is handling a file, and a second one that tells that it has updated, skipped, or errored on that item. Once that is in place, at least you'll be able to tell if bmt is handling the file or not.

in the meantime, I'm not sure if you sent me you log files, but you could try and add a new file to your library, wait a few seconds, and then from the web ui create a support zip (log files only) (it's under the tools menu in the web ui) and email me the logs. You may have done this already, but i get so many emails with log files it hard to keep it straight .

[broconne]

Originally Posted by stuckless

I noticed that you have System Message turned on, so that you should get a system message for each failed item. Are you seeing system messages for failed items? Also, you have an exclude path set as well, so hopefully your tv files are not under that area.

As long as you have the automatic plugin enabled (enabled by default, and you do appear to have it enabled as well), then the only reason for a file to NOT get scanned is either...
1. It's being skipped/excluded (not the right media type, or the exclude filter kicks in)
2. It can't find a metadata match (but should generate system message in that case)
3. BMT internal error that is not handled (I think I've handled most cases, but maybe you've hit new one)

The automatic plugin is basically the only way that I use bmt, and it's rare, in my case, for it to not work.

In the next release there will be an additional log that will record all media items that bmt handles or skips. For each media item there will be 2 log entries... one that tells that it is handling a file, and a second one that tells that it has updated, skipped, or errored on that item. Once that is in place, at least you'll be able to tell if bmt is handling the file or not.

in the meantime, I'm not sure if you sent me you log files, but you could try and add a new file to your library, wait a few seconds, and then from the web ui create a support zip (log files only) (it's under the tools menu in the web ui) and email me the logs. You may have done this already, but i get so many emails with log files it hard to keep it straight .

Stuckless,
Thanks a bunch for answering in here.

(1) I don't see any failed messages in my system log.
(2) I don't think its my exclude path. I have my media in \\stafford\Media\TV so I don't think my path should be excluding that.

I didn't see this when I searched the thread, but now I am wondering if this is the problem.

What happens when another program takes over as the automatic media plugin? I had installed, the Ortus trailers, which in the early versions had an issue with taking over meta-data. I have since disabled the Ortus function that was doing meta-data and gone into the BMT plugin config and disabled, then enabled the BMT setting for automatic metadata, assuming that would re-enable it as the metadata provider. But perhaps that is not accurate?

[stuckless]

Originally Posted by broconne

Stuckless,
Thanks a bunch for answering in here.

(1) I don't see any failed messages in my system log.
(2) I don't think its my exclude path. I have my media in \\stafford\Media\TV so I don't think my path should be excluding that.

I didn't see this when I searched the thread, but now I am wondering if this is the problem.

What happens when another program takes over as the automatic media plugin? I had installed, the Ortus trailers, which in the early versions had an issue with taking over meta-data. I have since disabled the Ortus function that was doing meta-data and gone into the BMT plugin config and disabled, then enabled the BMT setting for automatic metadata, assuming that would re-enable it as the metadata provider. But perhaps that is not accurate?

Multiple Metadata Plugins can, and probably will cause issues for each other. For example, bmt will not attempt to find metadata for items that have existing metadata... so if a plugin runs before bmt, and partially fills the metadata, then bmt will probably skip that item. Or, if a plugin runs after bmt, and bmt has already updated the metadata, then that new plugin may in fact "clear" the metadata (either intentionally or accidentally). Also, bmt runs in a separate thread, so if the other plugins run in a separate thread, then they may both attempt to update the metadata at the same time, etc. Bottom line, is that it may get very messy in the metadata field as more and more plugins attempt to automatically update metadata.

I have no idea about the import of ortus trailers, etc, since I run very plugins (bmt, jetty, phoenix fanart), but I have heard some rumblings that they did not play well together, but I have no idea what the issue was there, or even if there was a real issue.

[broconne]

Stuckless -
Is there anyway to find out which plugins are registered to be notified when new media files are detected?

[stuckless]

Originally Posted by broconne

Stuckless -
Is there anyway to find out which plugins are registered to be notified when new media files are detected?

Unfortunately, I don't know of any way to tell if a plugin will listen for new media or not. There are "events" that a plugin would listen for, but there is no way to tell which plugins are listening for which events, to my knowledge. Maybe other developers know more about this than I do??

[phelme]

Originally Posted by stuckless

@phelme - it seems that for some reason the formatted titles are failing on your setup. I've made a note to enhance the formatted titles code so that they will never fail when passed bad data. I'm hoping to get a build out this weekend, so it should contain your fix as well.

Thanks for the 4.5.1 update Stuckless! My bug is gone!

[broconne]

Stuckless -
Thanks for putting out a build with extra logging. I took one of my folders out of my TV directory. After that I ran "Scan Imported Media" from Sage. Once that was finished, I verified that folder was no longer there in my folder view. After that I moved the subdirectory back into my TV directory and ran another scan. Here is the output from phoneix-metadata.log:

2010-08-14 07:41:28,926 - AUTO; MEDIA; /
2010-08-14 07:41:28,926 - SKIP; /
2010-08-14 07:41:29,410 - AUTO; MEDIA; /
2010-08-14 07:41:29,410 - SKIP; /
2010-08-14 07:41:29,770 - AUTO; MEDIA; /
2010-08-14 07:41:29,770 - SKIP; /
2010-08-14 07:41:30,129 - AUTO; MEDIA; /
2010-08-14 07:41:30,129 - SKIP; /
2010-08-14 07:41:30,504 - AUTO; MEDIA; /
2010-08-14 07:41:30,504 - SKIP; /
2010-08-14 07:41:30,816 - AUTO; MEDIA; /
2010-08-14 07:41:30,816 - SKIP; /
2010-08-14 07:41:31,176 - AUTO; MEDIA; /
2010-08-14 07:41:31,176 - SKIP; /
2010-08-14 07:41:31,504 - AUTO; MEDIA; /
2010-08-14 07:41:31,504 - SKIP; /
2010-08-14 07:41:31,832 - AUTO; MEDIA; /
2010-08-14 07:41:31,832 - SKIP; /
2010-08-14 07:41:32,191 - AUTO; MEDIA; /
2010-08-14 07:41:32,191 - SKIP; /
2010-08-14 07:41:32,520 - AUTO; MEDIA; /
2010-08-14 07:41:32,520 - SKIP; /
2010-08-14 07:41:32,910 - AUTO; MEDIA; /
2010-08-14 07:41:32,910 - SKIP; /

Not sure what to make of it.

[stuckless]

Originally Posted by broconne

Stuckless -
Thanks for putting out a build with extra logging. I took one of my folders out of my TV directory. After that I ran "Scan Imported Media" from Sage. Once that was finished, I verified that folder was no longer there in my folder view. After that I moved the subdirectory back into my TV directory and ran another scan. Here is the output from phoneix-metadata.log:

2010-08-14 07:41:28,926 - AUTO; MEDIA; /
2010-08-14 07:41:28,926 - SKIP; /
2010-08-14 07:41:29,410 - AUTO; MEDIA; /
2010-08-14 07:41:29,410 - SKIP; /
2010-08-14 07:41:29,770 - AUTO; MEDIA; /
2010-08-14 07:41:29,770 - SKIP; /
2010-08-14 07:41:30,129 - AUTO; MEDIA; /
2010-08-14 07:41:30,129 - SKIP; /
2010-08-14 07:41:30,504 - AUTO; MEDIA; /
2010-08-14 07:41:30,504 - SKIP; /
2010-08-14 07:41:30,816 - AUTO; MEDIA; /
2010-08-14 07:41:30,816 - SKIP; /
2010-08-14 07:41:31,176 - AUTO; MEDIA; /
2010-08-14 07:41:31,176 - SKIP; /
2010-08-14 07:41:31,504 - AUTO; MEDIA; /
2010-08-14 07:41:31,504 - SKIP; /
2010-08-14 07:41:31,832 - AUTO; MEDIA; /
2010-08-14 07:41:31,832 - SKIP; /
2010-08-14 07:41:32,191 - AUTO; MEDIA; /
2010-08-14 07:41:32,191 - SKIP; /
2010-08-14 07:41:32,520 - AUTO; MEDIA; /
2010-08-14 07:41:32,520 - SKIP; /
2010-08-14 07:41:32,910 - AUTO; MEDIA; /
2010-08-14 07:41:32,910 - SKIP; /

Not sure what to make of it.

That's interesting.... I'm not sure what to make of it as well? Is there one entry per file in your import area? could you send me a list of media files?

[broconne]

Originally Posted by stuckless

That's interesting.... I'm not sure what to make of it as well? Is there one entry per file in your import area? could you send me a list of media files?

Yes, one entry per file.

PM of the directory listing on its way to you.

[dinki]

Can someone tell me how I can get BMT to use the episode images pulled from thetvdb rather than the season image for my imports that are flagged as Sage recordings (shows up in the recordings screen and not videos)? I've got a bunch of Scooby-Doo episodes and it'd be a lot easier on my four year old if she could pick the episode by the different episode thumbnails rather than trying to read the description or memorizing where her favorites are in the list.

[stuckless]

Originally Posted by dinki

Can someone tell me how I can get BMT to use the episode images pulled from thetvdb rather than the season image for my imports that are flagged as Sage recordings (shows up in the recordings screen and not videos)? I've got a bunch of Scooby-Doo episodes and it'd be a lot easier on my four year old if she could pick the episode by the different episode thumbnails rather than trying to read the description or memorizing where her favorites are in the list.

BMT doesn't pull episode specific fanart.

[stuckless]

Originally Posted by broconne

Yes, one entry per file.

PM of the directory listing on its way to you.

For completeness... The problem here was the the ortus-mq plugin (has since been updated). It was handling the MediaFileImported event before bmt and converting the MediaFile to an int.

[broconne]

Originally Posted by broconne

Yes, one entry per file.

PM of the directory listing on its way to you.

To follow up on my problem. Stuckless helped me debug the issue, it turns out that Ortus Trailers, even though I had uninstalled it from the plugin manager, was modifying the metadata of the newly discovered video objects. I updated the OrtusMQ library and all seems to be working.

Thanks for all the help Stuckless.

[infocus13]

Hi

is there any way to make BMT ignore certain folders when scanning for media?

cheers

[ke6guj]

Originally Posted by dkatchalov

Hi

is there any way to make BMT ignore certain folders when scanning for media?

cheers

yes, in the configuration settings in the UI, there is a section where you can enter in an exclude pattern.

[infocus13]

Originally Posted by ke6guj

yes, in the configuration settings in the UI, there is a section where you can enter in an exclude pattern.

thanks ....

So how do I figure out the syntax for this exclude pattern?

I tried putting "Videos" in that field as i have a folder called videos which I want to exclude from BMT.. (\\N3200PRO\NAS\Videos) however the folder still gets scanned!

any ideas? I've been trying to get this to work for hours!!!

cheers

[infocus13]

Ok I've done everything I could think of to exclude the folder but nothing works!

The folder is on the NAS. The path is \\NAS3200Pro\NAS\Videos. In the exclude pattern field in BMT I entered "\\\\N3200PRO\\NAS\\Videos" I've also tried "Videos" and it doesnt work. All my videos in that folder get picked up by BMT and litter my views in sage.

Does this feature not work in BMT at all? Did I get the syntax wrong? Can someone pls help?

Thanks in advance.

[ranger]

I updated to the latest revision of BMT and when I try to browse media in the web interface, it is exceedingly slow. The web browser times out. This happens when clicking on browse and selecting "All TV (Group by Series)" or "All TV (Group by Series/Season". IS anyone else seeing this behavior? Any ideas on what is wrong. I have un-installed and re-installed all related and dependent plugins.

[stuckless]

Originally Posted by dkatchalov

Ok I've done everything I could think of to exclude the folder but nothing works!

The folder is on the NAS. The path is \\NAS3200Pro\NAS\Videos. In the exclude pattern field in BMT I entered "\\\\N3200PRO\\NAS\\Videos" I've also tried "Videos" and it doesnt work. All my videos in that folder get picked up by BMT and litter my views in sage.

Does this feature not work in BMT at all? Did I get the syntax wrong? Can someone pls help?

Thanks in advance.

What version of bmt are you using... if you are still in Sage6, then it's possible that the exclude filter is broken, since I did have to update it the Sage7 release.

Originally Posted by ranger

I updated to the latest revision of BMT and when I try to browse media in the web interface, it is exceedingly slow. The web browser times out. This happens when clicking on browse and selecting "All TV (Group by Series)" or "All TV (Group by Series/Season". IS anyone else seeing this behavior? Any ideas on what is wrong. I have un-installed and re-installed all related and dependent plugins.

Do you have any idea of how large your tv collection would be? ie, there are some known performance issues if you are talking about 1000s of tv shows... but still it shouldn't really time out.

You may want to to restart sage... then reconnect with a new browser session, and then open the view. When it times out, go to the tools menu and create a support request including the log files only. Email that to me, and I'll if there are other issues going one. Typically when I see these kinds of timeouts, there are issues creating the media resources for some odd reason, which hopefully will show up in the log file.

In the next release of bmt, I've switch to a progressive view loading model. ie, instead of sending back all items, i send back pages of items, and there is a button to "load more". I did this because when I load large views, my browser becomes unresponsive because its loading so much data, thumbnails, etc.