SageTV Hanging

[Wrx4me]

I would appreciate some help troubleshooting an issue I am having. My SageTV hangs when changing channels. The first and second channel changes work normally, but by the third channel change everything hangs, and I get a spinning circle sometimes for 6 minutes before the channel eventually changes. Other times if I try to bring up the Program Guide I get the same spinning circle same with navigating the UI.
I updated Java to v1.8.0_201 and updated Ubuntu but I still can’t figure out what’s suddenly causing the hanging. I see a lot of the following in my log files when the hanging occurs

Tue 1/29 19:42:40.067 [AWTThreadWatcher-0023a50004fc@18644d8] EventThread-0023a50004fc Hang Detected - hang time = 84051 UILocker=Thread[EventRouter-0023a50004fc,5,main]
Tue 1/29 19:42:40.825 [AWTThreadWatcher-0023a50004fc@18644d8] EventThread-0023a50004fc Hang Detected - hang time = 84809 UILocker=Thread[EventRouter-0023a50004fc,5, main]

My system consists of:
SageTV V9.1.10.479 on Ubuntu VM 18.04.1
Opendct V_0.5.29-1
2 HDHomerun Primes
1 HDPVR

Please help, Thank you!

[JustFred]

Posting the entire log file would be helpful. It may need to be zipped.

[Wrx4me]

Originally Posted by JustFred

Posting the entire log file would be helpful. It may need to be zipped.

You're right JustFred. I had to remove some parts of the file to get under the 750kb limit. Zip file attached.

[wnjj]

One of the thing listed in the active threads in seeker is “verifying existence of all TV media files”. I don’t know if that’s what is causing the hang or just a victim but you can disable it by setting “seeker/disable_video_directory_verifications=true” in sage.properties.

It does cause SageTV to check on all of the media files and perhaps you have a problem file or disk.

[Wrx4me]

Originally Posted by wnjj

One of the thing listed in the active threads in seeker is “verifying existence of all TV media files”. I don’t know if that’s what is causing the hang or just a victim but you can disable it by setting “seeker/disable_video_directory_verifications=true” in sage.properties.

It does cause SageTV to check on all of the media files and perhaps you have a problem file or disk.

I made the change and tried changing channels but I'm still in spinning circle hell. Keep it coming, thanks.

[wnjj]

Do you have limits set on free disk space?

Tue 1/29 19:09:21.441 [Fork-BASE-55376@163c15d1] VideoDiskspaceReqProportion: 0.7251039324501439
Tue 1/29 19:09:21.442 [Fork-BASE-55376@163c15d1] VideoDiskspaceFreeProportion: 0.72328014029453

I don’t know what code logged this but it seems to suggest your near the limit. Maybe when you change channels it’s attempting to clean up to make room for the new recording?

[graywolf]

Curious, what is the size of your wiz.bin?

[Wrx4me]

Originally Posted by wnjj

Do you have limits set on free disk space?

Tue 1/29 19:09:21.441 [Fork-BASE-55376@163c15d1] VideoDiskspaceReqProportion: 0.7251039324501439
Tue 1/29 19:09:21.442 [Fork-BASE-55376@163c15d1] VideoDiskspaceFreeProportion: 0.72328014029453

I don’t know what code logged this but it seems to suggest your near the limit. Maybe when you change channels it’s attempting to clean up to make room for the new recording?

The VM is running on Unraid and I have 6.5 TB available for recording.

[Wrx4me]

Originally Posted by graywolf

Curious, what is the size of your wiz.bin?

I've been suspecting a corrupt Wiz.bin as well, its currently 86 MB. Is there a way to repair or check it's health?

[graywolf]

No expert so take all with grain of salt.
For recordings made by v7 and above the metadata should be in the file. Prior to that or files modified (handbrake, etc) then you might want .properties files for the metadata.
Then with sagetv down, move wiz.bin and wiz.bak to a safe location. Then start save and should rebuild the wiz.bin
You do lose your flag (Archive, watched, don’t like) settings and probably your favorites.
Another method I’ve heard but not tried would be to use the web GUI and export the xml file of all recordings then stop sagetv , move the wiz.* files, start sagetv then use the web GUI to import the xml file. Think that preserves your favorites and flag settings

[wnjj]

Originally Posted by Wrx4me

I've been suspecting a corrupt Wiz.bin as well, its currently 86 MB. Is there a way to repair or check it's health?

If you aren’t getting any errors in the log file when starting up the server it’s probably fine. Hangs are usually out of memory or non-responsive hardware.

[Wrx4me]

Originally Posted by graywolf

No expert so take all with grain of salt.
For recordings made by v7 and above the metadata should be in the file. Prior to that or files modified (handbrake, etc) then you might want .properties files for the metadata.
Then with sagetv down, move wiz.bin and wiz.bak to a safe location. Then start save and should rebuild the wiz.bin
You do lose your flag (Archive, watched, don’t like) settings and probably your favorites.
Another method I’ve heard but not tried would be to use the web GUI and export the xml file of all recordings then stop sagetv , move the wiz.* files, start sagetv then use the web GUI to import the xml file. Think that preserves your favorites and flag settings

Good to know, may try it as a last resort.

[Wrx4me]

Originally Posted by wnjj

If you aren’t getting any errors in the log file when starting up the server it’s probably fine. Hangs are usually out of memory or non-responsive hardware.

On initial startup of the HD300 the Menu Header Disk Space Bar sometimes shows 'Updating' for about 5 minutes and at this time everything is frozen when that re-appears then I know I can start using the UI again. I have memory in my Sagesttings file set to 2048 MB, the server has 4 GB allocated, would that cause a problem?

[graywolf]

There is a java heap plugin that shows heap usage icon you might try and observe what it says when you get the spinning circles
Just a thought

[wnjj]

Originally Posted by Wrx4me

On initial startup of the HD300 the Menu Header Disk Space Bar sometimes shows 'Updating' for about 5 minutes and at this time everything is frozen when that re-appears then I know I can start using the UI again. I have memory in my Sagesttings file set to 2048 MB, the server has 4 GB allocated, would that cause a problem?

I don’t know how all of the hardware drivers work on Linux but I can share something for our 64-bit Windows development that may help. When testing it, JustFred had a similar minutes-long delay with the disk space bar. The issue turned out to be remnant video capture device info in the registry that was causing the system to poll for devices that didn’t exist. Each one took 30 seconds or more to timeout. I suspect something in your system is off with the capture devices or whatever method is used to locate and start using them. Again, Linux device drivers is outside my understanding so hopefully someone else can offer some suggestions.

[Wrx4me]

Originally Posted by wnjj

I don’t know how all of the hardware drivers work on Linux but I can share something for our 64-bit Windows development that may help. When testing it, JustFred had a similar minutes-long delay with the disk space bar. The issue turned out to be remnant video capture device info in the registry that was causing the system to poll for devices that didn’t exist. Each one took 30 seconds or more to timeout. I suspect something in your system is off with the capture devices or whatever method is used to locate and start using them. Again, Linux device drivers is outside my understanding so hopefully someone else can offer some suggestions.

Bingo! I think you may be onto something. This started a few weeks ago when I took my dual HDHomerRUN (Non Prime) device offline because my roof antenna has been having issues. It maybe polling both devices, how do I clean out those entries?

[JustFred]

Originally Posted by Wrx4me

Bingo! I think you may be onto something. This started a few weeks ago when I took my dual HDHomerRUN (Non Prime) device offline because my roof antenna has been having issues. It maybe polling both devices, how do I clean out those entries?

When I originally identified the problem, removing references to the HDHR devices in sage.properties didn't help. Unfortunately, I'm not running any Sage Linux versions, so can't give any specific help. Try to find & remove whatever persistent knowledge of the HDHR exists in the OS (driver-related?).

For the benefit of others reading this thread, I made a change to the Windows native code that uses a different means to resolve the issue. The first build that includes the fix is Windows v9.2.0 installer beta v1.104. Yes, I know this is the Linux forum

[Wrx4me]

I wonder where that would be for Linux. I may start by removing all the unassigned tuners in my properties file to see if that has any effect.

[Wrx4me]

Removing unassigned tuners from the properties file helped a little but it is not a fix as it still hangs but not with a lot of spinning circles, just freezes.

[JustFred]

Originally Posted by Wrx4me

it still hangs but not with a lot of spinning circles, just freezes.

Hard to make further diagnosis without seeing what's in the log file.