OpenDCT: An open source digital cable tuner.

[JustFred]

Originally Posted by RonBoyd

Yeah, and in my late 70's, I have more memories than I will ever be able to recall. Oh, for someone to update the "User's Guide."

The online manual here includes some updates. It's location is a bit obscure and doesn't seem to show up on Google search results in the U.S. Maybe it needs to be moved. What did you have in mind?

[RonBoyd]

Originally Posted by JustFred

The online manual here includes some updates. It's location is a bit obscure and doesn't seem to show up on Google search results in the U.S. Maybe it needs to be moved. What did you have in mind?

No. It's fine there -- I'll just Bookmark it. I don't have anything in mind at the moment. Like always, everything is fine... until it isn't. And then the Panic Button is too easy to push.

[brandypuff]

what's the process to update OpenDCT when my hdhomerun has new channels available? Stop opendct, delete the lineup properties files, restart?

[waylo]

Originally Posted by brandypuff

what's the process to update OpenDCT when my hdhomerun has new channels available? Stop opendct, delete the lineup properties files, restart?

I don't believe you need to do anything with OpenDCT config for just new channels if it's on the same tuner which had been working previously. Go to channel management and enable the channels within SageTV.

[EnterNoEscape]

Originally Posted by waylo

I don't believe you need to do anything with OpenDCT config for just new channels if it's on the same tuner which had been working previously. Go to channel management and enable the channels within SageTV.

Correct.

[brandypuff]

Lately on my HDHomerun OTA EXTEND, i am getting some failed recordings with the above message. I just installed the latest OpenDCT version so i will see if this fixes it. Attached is the log where AmericasGotTalent-TheChampionsFive-11894003-1 failed to record.

[EnterNoEscape]

Originally Posted by brandypuff

Lately on my HDHomerun OTA EXTEND, i am getting some failed recordings with the above message. I just installed the latest OpenDCT version so i will see if this fixes it. Attached is the log where AmericasGotTalent-TheChampionsFive-11894003-1 failed to record.

It looks like the device stopped streaming after a few minutes. You could try the IO based HTTP producer by replacing the opendct.properties opendct.producer.NIOHTTPProducerImpl with opendct.producer.HTTPProducerImpl in case it's a problem with my NIO implementation.

[gclayto]

After many hours of looking through this forum. I haven't found a concise set of instructions on how to setup opendct using a docker. Would someone be so kind as to give me the 2-second tour on how to get it working. Thanks in advance.

[brandypuff]

I removed direct connection from Sage to the EXTEND and connected one of the two tuners via 127.0.0.1:9000. Still having some issues with it:

NFO | jvm 1 | 2019/02/11 09:30:01.655 | 09:30:01.612 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] INFO FFmpegContext - Primary:
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Input #0, mpegts, from 'input-mpeg-ts.ts':
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Duration: 00:00:01.07, start: 37958.202633, bitrate: 4414 kb/s
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Program 3
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Stream #0:0[0xf61], 14, 1/90000: Video: mpeg2video (Main) ([2][0][0][0] / 0x0002), yuv420p(tv), 1920x1080 [SAR 1:1 DAR 16:9], Closed Captions, max. 20000 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Stream #0:1[0xf62](eng), 12, 1/90000: Audio: ac3 (AC-3 / 0x332D4341), 48000 Hz, stereo, fltp, 384 kb/s
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Stream #0:2[0xf63](spa), 15, 1/90000: Audio: ac3 (AC-3 / 0x332D4341), 48000 Hz, mono, fltp, 96 kb/s
INFO | jvm 1 | 2019/02/11 09:30:01.655 |
INFO | jvm 1 | 2019/02/11 09:30:01.655 | 09:30:01.613 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] INFO FFmpegContext - Primary:
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Output #0, mpegts, to 'E:\Record\DanielTigersNeighborhood-JodisFirstDayatSchoolDanielPlaysatJodisHouse-11927660-0.ts':
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Stream #0:0, 0, 1/90000: Video: mpeg2video, yuv420p(tv), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, max. 20000 kb/s, 90k tbn, 59.94 tbc
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Stream #0:1(eng), 0, 1/90000: Audio: ac3, 48000 Hz, stereo, fltp, 384 kb/s
INFO | jvm 1 | 2019/02/11 09:30:01.655 | Stream #0:2(spa), 0, 1/90000: Audio: ac3, 48000 Hz, mono, fltp, 96 kb/s
INFO | jvm 1 | 2019/02/11 09:30:01.655 |
INFO | jvm 1 | 2019/02/11 09:30:01.655 | 09:30:01.614 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] INFO FFmpegTranscoder - Initialized FFmpeg transcoder stream output.
INFO | jvm 1 | 2019/02/11 09:30:24.486 | 09:30:24.483 [SageTVTuningMonitor-59] INFO SageTVTuningMonitor - 'DCT-HDHomeRun Prime Tuner 131D17FC-0' produced first 30512776 packets.
INFO | jvm 1 | 2019/02/11 09:30:24.486 | 09:30:24.484 [SageTVTuningMonitor-59] INFO SageTVTuningMonitor - 'DCT-HDHomeRun Prime Tuner 131D17FC-0' recorded first 29337776 bytes.
INFO | jvm 1 | 2019/02/11 09:49:51.170 | [GC pause (G1 Evacuation Pause) (young) 84M->10M(128M), 0.0134460 secs]
INFO | jvm 1 | 2019/02/11 10:00:00.278 | 10:00:00.219 [NIOHTTPProducerImpl-3951CT-HDHomeRun Prime Tuner 131D17FC-0] INFO NIOHTTPProducerImpl - Producer thread has stopped.
INFO | jvm 1 | 2019/02/11 10:00:00.278 | 10:00:00.220 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] WARN NIOSageTVMediaServer - Unable to send 'CLOSE' because the socket has not been initialized.
INFO | jvm 1 | 2019/02/11 10:00:00.278 | 10:00:00.220 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] ERROR FFmpegTransSageTVConsumerImpl - Unable to re-connect to server. Waiting for SageTV to restart recording...
INFO | jvm 1 | 2019/02/11 10:00:00.278 | 10:00:00.220 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] ERROR FFmpegTransSageTVConsumerImpl - Unable to stream 'E:\Record\DanielTigersNeighborhood-JodisFirstDayatSchoolDanielPlaysatJodisHouse-11927660-0.ts' via upload ID 2070720049 => java.nio.channels.ClosedByInterruptException
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at java.nio.channels.spi.AbstractInterruptibleChannel.end(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at java.nio.channels.SocketChannel.open(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at opendct.consumer.upload.NIOSageTVMediaServer.startUpload(NIOSageTVMediaServer.java:84)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at opendct.consumer.FFmpegTransSageTVConsumerImpl$FFmpegUploadIDWriter.write(FFmpegTransSageTVConsumerImpl.java:507)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at opendct.video.ffmpeg.FFmpegContext$WriteCallback.call(FFmpegContext.java:454)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at org.bytedeco.javacpp.avformat.av_interleaved_write_frame(Native Method)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at opendct.video.ffmpeg.FFmpegTranscoder.streamOutput(FFmpegTranscoder.java:1070)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at opendct.consumer.FFmpegTransSageTVConsumerImpl.run(FFmpegTransSageTVConsumerImpl.java:164)
INFO | jvm 1 | 2019/02/11 10:00:00.278 | at opendct.util.ThreadPool$1.run(ThreadPool.java:39)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.util.concurrent.FutureTask.run(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.lang.Thread.run(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 |
INFO | jvm 1 | 2019/02/11 10:00:00.279 | 10:00:00.221 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] INFO FFmpegContext - Returning AVERROR_EOF in readCallback.call()
INFO | jvm 1 | 2019/02/11 10:00:00.279 | 10:00:00.221 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] WARN mpegts - [3c15a740] PES packet size mismatch
INFO | jvm 1 | 2019/02/11 10:00:00.279 | 10:00:00.223 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] INFO FFmpegTranscoder - FFmpeg transcoder ended with code 0
INFO | jvm 1 | 2019/02/11 10:00:00.279 | 10:00:00.223 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] WARN NIOSageTVMediaServer - Unable to send 'CLOSE' because the socket has not been initialized.
INFO | jvm 1 | 2019/02/11 10:00:00.279 | 10:00:00.223 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] ERROR FFmpegTransSageTVConsumerImpl - Unable to close the file 'E:\Record\DanielTigersNeighborhood-JodisFirstDayatSchoolDanielPlaysatJodisHouse-11927660-0.ts' upload ID 2070720049 => java.io.IOException: The socket is not available.
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at opendct.consumer.upload.NIOSageTVMediaServer.sendMessage(NIOSageTVMediaServer.java:417)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at opendct.consumer.upload.NIOSageTVMediaServer.endUpload(NIOSageTVMediaServer.java:375)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at opendct.consumer.FFmpegTransSageTVConsumerImpl$FFmpegUploadIDWriter.closeFile(FFmpegTransSageTVConsumerImpl.java:440)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at opendct.consumer.FFmpegTransSageTVConsumerImpl.run(FFmpegTransSageTVConsumerImpl.java:179)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at opendct.util.ThreadPool$1.run(ThreadPool.java:39)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.util.concurrent.FutureTask.run(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 | at java.lang.Thread.run(Unknown Source)
INFO | jvm 1 | 2019/02/11 10:00:00.279 |
INFO | jvm 1 | 2019/02/11 10:00:00.279 | 10:00:00.224 [FFmpegTransSageTVConsumerImpl-3953CT-HDHomeRun Prime Tuner 131D17FC-0] INFO FFmpegTransSageTVConsumerImpl - FFmpeg Transcoder consumer thread stopped.
INFO | jvm 1 | 2019/02/11 10:00:00.280 | 10:00:00.228 [SageTVRequestHandler-2318CT-HDHomeRun Prime Tuner 131D17FC-0] INFO HDHRNativeCaptureDevice - HDHomeRun is now unlocked.
INFO | jvm 1 | 2019/02/11 10:00:00.280 | 10:00:00.228 [SageTVRequestHandler-2318CT-HDHomeRun Prime Tuner 131D17FC-0] INFO SageTVPoolManager - Cleared mapping for virtual capture device 'DCT-HDHomeRun Prime Tuner 131D17FC-0'.
INFO | jvm 1 | 2019/02/11 10:02:26.349 | 10:02:26.270 [ChannelManager-47] INFO ChannelManager - Updating the HDHomeRun channel lineup HDHomeRun DRI Tuner 131D17FC (dct_hdhomerun).
INFO | jvm 1 | 2019/02/11 10:02:26.349 | 10:02:26.270 [ChannelManager-47] INFO HDHomeRunChannels - Connecting to HDHomeRun using the URL 'http://192.168.0.213:80/lineup.xml'
INFO | jvm 1 | 2019/02/11 10:02:26.349 | 10:02:26.289 [ChannelManager-47] INFO ChannelManager - Updating the HDHomeRun channel lineup HDHomeRun HDTC-2US 10562C06 (atsc_hdhomerun_10562c06).
INFO | jvm 1 | 2019/02/11 10:02:26.349 | 10:02:26.289 [ChannelManager-47] INFO HDHomeRunChannels - Connecting to HDHomeRun using the URL 'http://192.168.0.170:80/lineup.xml'

[EnterNoEscape]

You could try changing from NIOHTTPProducerImpl to HTTPProducerImpl in the config file.

[rickgillyon]

Can anyone spot problems in the attached OpenDCT log? All was working well until a few weeks ago, now every few days CPU jumps to 100% and the system becomes unresponsive. Most things still work, but OpenDCT docker shows stopped (and so Sage shows no scheduled recordings). The CPU stays pinned at 100% with the process "app" until I restart the server. I was wondering if anyone can spot anything going wrong in the log before I try to get unRAID people to look at the diagnostics. Thanks!

The only thing I've changed before all this started was shifting Sage back to Java8 - could this have caused a problem with OpenDCT?

[EnterNoEscape]

Originally Posted by rickgillyon

Can anyone spot problems in the attached OpenDCT log? All was working well until a few weeks ago, now every few days CPU jumps to 100% and the system becomes unresponsive. Most things still work, but OpenDCT docker shows stopped (and so Sage shows no scheduled recordings). The CPU stays pinned at 100% with the process "app" until I restart the server. I was wondering if anyone can spot anything going wrong in the log before I try to get unRAID people to look at the diagnostics. Thanks!

The only thing I've changed before all this started was shifting Sage back to Java8 - could this have caused a problem with OpenDCT?

All I see is that the buffer is overflowing likely because the disk can't keep up.

[rickgillyon]

Originally Posted by EnterNoEscape

All I see is that the buffer is overflowing likely because the disk can't keep up.

Thanks. That's weird. It's working fine now, but recordings are set to go to NVME cache, so I'd be surprised if it couldn't keep up unless something else is going on. Hopefully the other diagnostics turn something up...

Edit: Monitoring memory, this seems to be a problem with recent versions of Plex eating up all available memory and grinding the system to a halt. So OpenDCT being the first docker to quit was just a red herring.

[EnterNoEscape]

Originally Posted by rickgillyon

Thanks. That's weird. It's working fine now, but recordings are set to go to NVME cache, so I'd be surprised if it couldn't keep up unless something else is going on. Hopefully the other diagnostics turn something up...

Edit: Monitoring memory, this seems to be a problem with recent versions of Plex eating up all available memory and grinding the system to a halt. So OpenDCT being the first docker to quit was just a red herring.

I'm glad you figured this one out. I've had a similar problem before related to another process using so much memory random processes started getting killed. I would agree that a well performing NVMe disk shouldn't be a bottleneck for recordings.

[KryptoNyte]

I'm no longer using the Ceton cablecard tuner, and not sure I will ever use it again. I would like to use the HDHR Quatro tuners with Premium TV. Is there a change that I can make to speed up the tuning for the Quatro?

Current properties file is attached.

I should mention that I'm also using the original beige HDHR dual tuner for 2 OTA tuners. The Quatro has 1 tuner dedicated to OTA and the other 3 to Premium TV at this point.

[EnterNoEscape]

Originally Posted by KryptoNyte

I'm no longer using the Ceton cablecard tuner, and not sure I will ever use it again. I would like to use the HDHR Quatro tuners with Premium TV. Is there a change that I can make to speed up the tuning for the Quatro?

Current properties file is attached.

I should mention that I'm also using the original beige HDHR dual tuner for 2 OTA tuners. The Quatro has 1 tuner dedicated to OTA and the other 3 to Premium TV at this point.

It is taking a long time to tune in? The code is already oriented to be as fast as is reasonably reliable. If the streams are really well compressed, you might speed things up by reducing the read/write buffer size so it writes the data out more frequently: consumer.ffmpeg.rw_buffer_size=262144

[KryptoNyte]

I will modify the buffer value as soon as recordings complete to see. It's taking anywhere from 8 to 18 seconds to tune when I select "watch now," for the Premium TV channels. The OTA channels coming in on the same Quatro device tune and play in about 3 seconds. In VLC, I can tune Premium TV with the Quatro in about 3 seconds also.

Is there a way that I can disable ffmpeg entirely and just take the stream that's coming in?

[EnterNoEscape]

Originally Posted by KryptoNyte

I will modify the buffer value as soon as recordings complete to see. It's taking anywhere from 8 to 18 seconds to tune when I select "watch now," for the Premium TV channels. The OTA channels coming in on the same Quatro device tune and play in about 3 seconds. In VLC, I can tune Premium TV with the Quatro in about 3 seconds also.

Is there a way that I can disable ffmpeg entirely and just take the stream that's coming in?

Certainly, you just need to change to the raw consumer. Change opendct.consumer.FFmpegTransSageTVConsumerImpl to opendct.consumer.RawSageTVConsumerImpl in the config file.

[jhkoenig]

When changing away from ffmpeg, be aware that I had Sage record several "lifestyle" cable channels will odd frame rates that would not play back. In desperation, I set all of those channels to pass through ffmpeg. That solved it, but killed the ability off Comskip to detect commercials. At least it saved the WAF.

[KryptoNyte]

Originally Posted by jhkoenig

When changing away from ffmpeg, be aware that I had Sage record several "lifestyle" cable channels will odd frame rates that would not play back. In desperation, I set all of those channels to pass through ffmpeg. That solved it, but killed the ability off Comskip to detect commercials. At least it saved the WAF.

To clarify, you're using the HDHR Premium TV service in Sage via OpenDCT. You had problems with playback on files with odd framerates (on what playback devices?). You changed OpenDCT to run all media through ffmpeg in OpenDCT, and in doing so, comskip doesn't work anymore?