Format Detector Plugin for SageTV

[sacrament055]

I don't know if it's a symptom or unrelated but I noticed that my .AVI files are not using LAV splitter, only LAV Video decoder.

[jvl711]

Originally Posted by JREkiwi

Josh, finally had time to do some PD on an issue I am having.

With your code .avi files on my HD300 are displaying with 0 length and black video, but they do play the audio from the file

With the SageTV inbuilt they play fine

sample MediaInfo

Format                                   : AVI
Format/Info                              : Audio Video Interleave
File size                                : 232 MiB
Duration                                 : 29 min 7 s
Overall bit rate mode                    : Variable
Overall bit rate                         : 1 115 kb/s
Writing application                      : VirtualDubMod 1.5.10.2 (build 2540/release)
Writing library                          : VirtualDubMod build 2540/release

Video
ID                                       : 0
Format                                   : MPEG-4 Visual
Format profile                           : Advanced Simple@L5
Format settings                          : BVOP2
Format settings, BVOP                    : 2
Format settings, QPel                    : No
Format settings, GMC                     : No warppoints
Format settings, Matrix                  : Default (H.263)
Muxing mode                              : Packed bitstream
Codec ID                                 : XVID
Codec ID/Hint                            : XviD
Duration                                 : 29 min 7 s
Bit rate                                 : 971 kb/s
Width                                    : 640 pixels
Height                                   : 352 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 25.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Compression mode                         : Lossy
Bits/(Pixel*Frame)                       : 0.172
Stream size                              : 202 MiB (87%)
Writing library                          : XviD 1.2.1 (UTC 2008-12-04)

Audio
ID                                       : 1
Format                                   : MPEG Audio
Format version                           : Version 1
Format profile                           : Layer 3
Format settings                          : Joint stereo
Codec ID                                 : 55
Codec ID/Hint                            : MP3
Duration                                 : 29 min 7 s
Bit rate mode                            : Variable
Bit rate                                 : 128 kb/s
Channel(s)                               : 2 channels
Sampling rate                            : 48.0 kHz
Frame rate                               : 41.667 FPS (1152 SPF)
Compression mode                         : Lossy
Stream size                              : 27.3 MiB (12%)
Alignment                                : Aligned on interleaves
Interleave, duration                     : 24  ms (0.60 video frame)
Interleave, preload duration             : 512  ms
Writing library                          : LAME3.90.
Encoding settings                        : -m j -V 4 -q 2 -lowpass 17.6 --abr 128

John

Are you using the latest version of the plugin? If so can you enable verbose logging from the plugin config. I would like to know how it is identifying it.

Thanks,
Josh

[JREkiwi]

Originally Posted by jvl711

Are you using the latest version of the plugin? If so can you enable verbose logging from the plugin config. I would like to know how it is identifying it.

Yes, using the latest version

File gets detected as this

Wed 7/1 15:47:35.297 [LibraryImporter@6b97d026] Using the format detector plugin
Wed 7/1 15:47:35.298 [LibraryImporter@6b97d026] MediaFormatParserPlugin processing: \\jrekiwi2\avi2\Comedy\QI\QI s08e04 Humans.avi
Wed 7/1 15:47:35.528 [LibraryImporter@6b97d026] FormatName: avi
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Duration: 1746480
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Bitrate: 1118759
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Number of Streams: 2
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] Processing Video (0)
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Video Codes: mpeg4
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Aspect Ration Den: 11
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Aspect Ration Num: 20
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Aspect Ration Num: 1.8181818181818181
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Framerate: 25.0
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Width: 640
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Height: 352
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Interlaced: false
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	SetID: 100
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] Processing Audio (1)
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Audio Codec: MP3FLOAT
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Channels: 2
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Sample Rats: 48000
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Bitrate: 129008
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Language: 
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	SetID: 101
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] MediaFormatParserPlugin - Adding the container metadata
Wed 7/1 15:47:35.559 [LibraryImporter@6b97d026] 	Key: encoder Value: VirtualDubMod 1.5.10.2 (build 2540/release)

When playing back on HD300 now I'm getting no video, but does have audio and timeline. Playback on a Windows client is OK.

Get this file format when detected by your plugin

format=AVI 0:29:06 1118 kbps [#0 Video[MPEG4-Video 25.0 fps 640x352 20:11 progressive id=100]#1 Audio[MP3FLOAT 48000 Hz 2 channels 129 kbps idx=1 id=101 ]

And this one when detected by the SageTV inbuilt detector

format=AVI 0:29:06 1118 kbps [#0 Video[MPEG4-Video 25.0 fps 640x352 20:11 progressive]#1 Audio[MP3 48000 Hz 2 channels 128 kbps idx=1]

Hope this helps

John

[jvl711]

Originally Posted by JREkiwi

Yes, using the latest version

File gets detected as this

Wed 7/1 15:47:35.297 [LibraryImporter@6b97d026] Using the format detector plugin
Wed 7/1 15:47:35.298 [LibraryImporter@6b97d026] MediaFormatParserPlugin processing: \\jrekiwi2\avi2\Comedy\QI\QI s08e04 Humans.avi
Wed 7/1 15:47:35.528 [LibraryImporter@6b97d026] FormatName: avi
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Duration: 1746480
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Bitrate: 1118759
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Number of Streams: 2
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] Processing Video (0)
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Video Codes: mpeg4
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Aspect Ration Den: 11
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Aspect Ration Num: 20
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Aspect Ration Num: 1.8181818181818181
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Framerate: 25.0
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Width: 640
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Height: 352
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Interlaced: false
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	SetID: 100
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] Processing Audio (1)
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Audio Codec: MP3FLOAT
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Channels: 2
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Sample Rats: 48000
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Bitrate: 129008
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Language: 
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	SetID: 101
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] MediaFormatParserPlugin - Adding the container metadata
Wed 7/1 15:47:35.559 [LibraryImporter@6b97d026] 	Key: encoder Value: VirtualDubMod 1.5.10.2 (build 2540/release)

When playing back on HD300 now I'm getting no video, but does have audio and timeline. Playback on a Windows client is OK.

Get this file format when detected by your plugin

format=AVI 0:29:06 1118 kbps [#0 Video[MPEG4-Video 25.0 fps 640x352 20:11 progressive id=100]#1 Audio[MP3FLOAT 48000 Hz 2 channels 129 kbps idx=1 id=101 ]

And this one when detected by the SageTV inbuilt detector

format=AVI 0:29:06 1118 kbps [#0 Video[MPEG4-Video 25.0 fps 640x352 20:11 progressive]#1 Audio[MP3 48000 Hz 2 channels 128 kbps idx=1]

Hope this helps

John

Hi John,

That is 100% perfect. That is exactly what I wanted to see! See that pesky id value. Apparently it is required for .ts/.ps files, but if I included it in AVI files it breaks stuff. I am not sure what the value means. I have tried to trace the code, but I have not succeeded in finding the root. I am going to only include the id value for .ts/.ps files. Not sure if it should also be for .mpg files.

Give me a little while to produce a new version. I have been splitting my time with the Android Client.

Josh

[jvl711]

Originally Posted by JREkiwi

Yes, using the latest version

File gets detected as this

Wed 7/1 15:47:35.297 [LibraryImporter@6b97d026] Using the format detector plugin
Wed 7/1 15:47:35.298 [LibraryImporter@6b97d026] MediaFormatParserPlugin processing: \\jrekiwi2\avi2\Comedy\QI\QI s08e04 Humans.avi
Wed 7/1 15:47:35.528 [LibraryImporter@6b97d026] FormatName: avi
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Duration: 1746480
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Bitrate: 1118759
Wed 7/1 15:47:35.554 [LibraryImporter@6b97d026] Number of Streams: 2
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] Processing Video (0)
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Video Codes: mpeg4
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Aspect Ration Den: 11
Wed 7/1 15:47:35.556 [LibraryImporter@6b97d026] 	Aspect Ration Num: 20
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Aspect Ration Num: 1.8181818181818181
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Framerate: 25.0
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Width: 640
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Height: 352
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	Interlaced: false
Wed 7/1 15:47:35.557 [LibraryImporter@6b97d026] 	SetID: 100
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] Processing Audio (1)
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Audio Codec: MP3FLOAT
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Channels: 2
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Sample Rats: 48000
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Bitrate: 129008
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	Language: 
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] 	SetID: 101
Wed 7/1 15:47:35.558 [LibraryImporter@6b97d026] MediaFormatParserPlugin - Adding the container metadata
Wed 7/1 15:47:35.559 [LibraryImporter@6b97d026] 	Key: encoder Value: VirtualDubMod 1.5.10.2 (build 2540/release)

When playing back on HD300 now I'm getting no video, but does have audio and timeline. Playback on a Windows client is OK.

Get this file format when detected by your plugin

format=AVI 0:29:06 1118 kbps [#0 Video[MPEG4-Video 25.0 fps 640x352 20:11 progressive id=100]#1 Audio[MP3FLOAT 48000 Hz 2 channels 129 kbps idx=1 id=101 ]

And this one when detected by the SageTV inbuilt detector

format=AVI 0:29:06 1118 kbps [#0 Video[MPEG4-Video 25.0 fps 640x352 20:11 progressive]#1 Audio[MP3 48000 Hz 2 channels 128 kbps idx=1]

Hope this helps

John

Here is a beta version to try. I am now only populating the ID field if the file is .ps/.ts. Let me know if this appears to solve the issue

MediaFormatParserPlugin_v0.4_beta.zip

Thanks,
Josh

[JREkiwi]

Originally Posted by jvl711

Here is a beta version to try. I am now only populating the ID field if the file is .ps/.ts. Let me know if this appears to solve the issue

Josh
The debug log still reports IDs, but the file doesn't have any

[#0 Video[MPEG4-Video 25.0 fps 640x352 20:11 progressive]#1 Audio[MP3FLOAT 48000 Hz 2 channels 129 kbps idx=1 ]

Still doesn't work though. No video.

Could it have something to do with the fact that SageTV uses the transcoder to push them to the HD300?

John

[jvl711]

Originally Posted by JREkiwi

Josh
The debug log still reports IDs, but the file doesn't have any

[#0 Video[MPEG4-Video 25.0 fps 640x352 20:11 progressive]#1 Audio[MP3FLOAT 48000 Hz 2 channels 129 kbps idx=1 ]

Still doesn't work though. No video.

Could it have something to do with the fact that SageTV uses the transcoder to push them to the HD300?

John

I did not know that it needed to use the transcoder for AVI files. Is that because it does not support that container? Do you see any info about transcoding in the log when trying to view the video? Are there any errors?

I am a little stumped at the moment.

Josh

[JREkiwi]

Originally Posted by jvl711

I did not know that it needed to use the transcoder for AVI files. Is that because it does not support that container? Do you see any info about transcoding in the log when trying to view the video? Are there any errors?

Josh, finally got some time to test again.
The AVI files detected by SageTV do not transcode. The files detected by your plugin do.

SageTV detects audio as MP3
Your plugin detects audio as MP3FLOAT

MediaInfo shows it as MP3

John

[jvl711]

Originally Posted by JREkiwi

Josh, finally got some time to test again.
The AVI files detected by SageTV do not transcode. The files detected by your plugin do.

SageTV detects audio as MP3
Your plugin detects audio as MP3FLOAT

MediaInfo shows it as MP3

John

Very interesting. Not sure why FFmpeg reports it as MP3FLOAT. I completely overlooked that. I am going to start a map and map MP3FLOAT to MP3. I will make another test version. Thank you for helping deubg this. I wonder if this is causing issues in other places.

Josh

[JREkiwi]

Originally Posted by jvl711

Not sure why FFmpeg reports it as MP3FLOAT.

I spent a little time trying to figure out when MP3FLOAT got added and how it determines that it is and couldn't find anything useful.

Originally Posted by jvl711

I am going to start a map and map MP3FLOAT to MP3. I will make another test version.

Thanks Josh

John

[phantomii]

I would like to see a 64bit linux version for ubuntu.....

[jvl711]

Originally Posted by JREkiwi

I spent a little time trying to figure out when MP3FLOAT got added and how it determines that it is and couldn't find anything useful.

Thanks Josh

John

Hi John,

I added mapping from MP3FLOAT to MP3. I added code so we can easily add additional mappings if needed. Let me know if this looks like it fixes the issue. Thanks again for working thru this with me.

MediaFormatParserPlugin v0.4_attempt2

[jvl711]

Originally Posted by phantomii

I would like to see a 64bit linux version for ubuntu.....

Alright... I think there is some reasonable interest. I am looking at a few things on the Miniclient right now, but next on my list will be a Linux build.

Thanks,
Josh

[Tiki]

Originally Posted by jvl711

Alright... I think there is some reasonable interest. I am looking at a few things on the Miniclient right now, but next on my list will be a Linux build.

Thanks,
Josh

I’m confused - isn’t there already a mini-client for Linux (Placeshifter)?
I thought that was what Stuckless used as his base to create the Android Mini-Client.

I don’t run Linux, but I thought the Placeshifter clients used MPlayer to handle the video playback (rather than Exo or ijk). There may be other differences (for example, I know the Android Mini-Client added code to allow it to work better with simpler remote controls).

[jpwegas]

Originally Posted by Tiki

I’m confused - isn’t there already a mini-client for Linux (Placeshifter)?
I thought that was what Stuckless used as his base to create the Android Mini-Client.

I don’t run Linux, but I thought the Placeshifter clients used MPlayer to handle the video playback (rather than Exo or ijk). There may be other differences (for example, I know the Android Mini-Client added code to allow it to work better with simpler remote controls).

I think Josh meant a Linux build of the Media Format Detector plugin.

--John

[nyplayer]

Originally Posted by Tiki

I’m confused - isn’t there already a mini-client for Linux (Placeshifter)?
I thought that was what Stuckless used as his base to create the Android Mini-Client.

I don’t run Linux, but I thought the Placeshifter clients used MPlayer to handle the video playback (rather than Exo or ijk). There may be other differences (for example, I know the Android Mini-Client added code to allow it to work better with simpler remote controls).

He is talking about the Android FireTV MiniClient which he is improving.

[JREkiwi]

Originally Posted by jvl711

I added mapping from MP3FLOAT to MP3. I added code so we can easily add additional mappings if needed. Let me know if this looks like it fixes the issue. Thanks again for working thru this with me.

The new version works on .AVIs, but now it doesn't work with .TS files on the HD300 or Windows Client

I'll have to get my system back in a working state before I can debug

John

[jvl711]

Originally Posted by JREkiwi

The new version works on .AVIs, but now it doesn't work with .TS files on the HD300 or Windows Client

I'll have to get my system back in a working state before I can debug

John

That was completely my fault. I was rolling back the first change I did, that did not work, and I did not do it correctly.

Try this one:

MediaFormatParserPlugin_v0.4

[jvl711]

Originally Posted by jpwegas

I think Josh meant a Linux build of the Media Format Detector plugin.

--John

Correct!

[JREkiwi]

Originally Posted by jvl711

That was completely my fault. I was rolling back the first change I did, that did not work, and I did not do it correctly.

OK, this one works on everything I've tried so far in my library (.avi, .mp4, .ts) and new recordings (.ts). But recordings made before this version won't play.

I'll try and get some detail, once the re-index process back to SageTV internal finishes

John