unRAID (some additional tips)

[stuckless]

Out of the box (at for me), unRAID doesn't schedule a Parity check. If you go into Setting -> Schedule, you can schedule a Parity check. I tend to do it weekly (I think)... it takes about 11 hours on my setup.

I also have Pushbullet configured on unRAID (in the Notifications area), so I get a message when the Parity check starts, and when it ends (and if there are errors, it will show them).

Other people might have other unRAID tips... feel free to post it here.

[wayner]

You might want to start a recording about two minutes early as some of us have issues with unRAID having to "warm-up" where the first minute or two of a recording fail - as is mentioned in this thread: https://forums.sagetv.com/forums/showthread.php?t=64184

[stuckless]

Originally Posted by wayner

You might want to start a recording about two minutes early as some of us have issues with unRAID having to "warm-up" where the first minute or two of a recording fail - as is mentioned in this thread: https://forums.sagetv.com/forums/showthread.php?t=64184

That's a good tip, but I suspect that's not the norm, and is likely do to some configuration of unRAID (drives, etc).... I've recorded 100s of shows now, and I've had this happen 0 times.

[Fuzzy]

Originally Posted by stuckless

That's a good tip, but I suspect that's not the norm, and is likely do to some configuration of unRAID (drives, etc).... I've recorded 100s of shows now, and I've had this happen 0 times.

Same here. I have no issues recording in unRAID from my HDHomeRuns using openDCT, and do not recall any issues with the HD-PVR for the week or so I had it connected to the unRAID server. My recordings go to the SSD cache drives first, then the mover pushes them to the HDD array every hour.

[panteragstk]

Originally Posted by Fuzzy

Same here. I have no issues recording in unRAID from my HDHomeRuns using openDCT, and do not recall any issues with the HD-PVR for the week or so I had it connected to the unRAID server. My recordings go to the SSD cache drives first, then the mover pushes them to the HDD array every hour.

Same here. Never had this issue. I record directly to the drives in my recording share.

[graywolf]

Most likely depending upon if you spin down those drives or not

[panteragstk]

Originally Posted by graywolf

Most likely depending upon if you spin down those drives or not

Very true. I don't spin mine down any longer. Got tired of waiting for them to spin up when trying to watch a movie or something.

I will say that there are numerous plugins that are pretty fantastic. Here are the ones I use:

Advanced Buttons

This is a simple plugin that adds some buttons to Docker, Plugin and Dashboard pages, allowing containers to be started/stopped/updated in batch ans plugins to be updated in batch.

CA Backup / Restore Appdata

Part of the CA family, CA Backup / Restore Appdata will either manually or on a schedule, automatically backup your docker appdata for easy restoring in case of a cache drive failure

CA Cleanup Appdata

Part of the CA family, Cleanup Appdata will scan your appdata share to determine which folders are no longer in use (due to an uninstalled docker application) and prompt you to remove them)

Command Line Tool

Shell In A Box implements a web server that can export arbitrary command line tools to a web based terminal emulator. A Command Line tool is created under the Tools menu. Backup and restore user home directory on system shutdown and start. Also includes screenfetch for command line screenshots. Support.

Community Applications

A Plugin to keep your docker application lists up to date and easily sort them by category and add them to your running containers. unRaid v6.1+ only.

Dynamix Schedules

Dynamix Schedules is a front-end utility for the built-in hourly, daily, weekly and monthly schedules. It allows the user to alter the schedule execution times using the GUI.

Dynamix System Information

Dynamix System Information shows various details of your system hardware and BIOS. This includes processor, memory and sub-system components.

Dynamix System Temperature

Dynamix System Temperature shows in real-time the temperature of the system CPU and motherboard. Temperatures can be displayed in Celsius or Fahrenheit. Your hardware must support the necessary probes, and additional software drivers may be required too.

Fix Common Problems

A Plugin to diagnose and suggest fixes for common problems, configuration mistakes, etc.

Preclear Disks

This plugin is a parser for Joe L. excelent Preclear Disk Script. It also include a fast post-read verify option, courtesy of bjp999.

Ransomware Protection

A plugin designed to minimize the damage that a ransomware attack can cause on your server

Statistics

This plugin is used to send statistics anonymously using Google Forms and TOR. Don't worry, you will be asked before sending every report.

Tips and Tweaks

This plugin lets you change certain Linux settings that may improve performance of your unRaid server. If you remove the tips.and.tweaks plugin, the last settings will remain until unRaid is rebooted.

Unassigned Devices

This plugin uses UDEV to automount and share disks that are not part of your unRAID array. Available devices are listed under the "Main/Unassigned Devices" tab.

unBALANCE

unBALANCE frees up space from one disk in your array, by moving the user shares folders you select to other disks in the array.

User Scripts

A plugin to act as a simple front end for any user scripts to allow you to run them without entering the command line

[EnterNoEscape]

Originally Posted by panteragstk

Ransomware Protection

A plugin designed to minimize the damage that a ransomware attack can cause on your server

This one particular is a little interesting in implementation. The only problem I see is that the bait files are somewhat predictable. Anyone who is in the ransomware business would likely find a way to figure out what's going on before it trips something similar to how anti-virus finds a virus.

[BobPhoenix]

Originally Posted by stuckless

That's a good tip, but I suspect that's not the norm, and is likely do to some configuration of unRAID (drives, etc).... I've recorded 100s of shows now, and I've had this happen 0 times.

I only noticed this when I tried to record from my HDPVRs. When I switched the HDPVRs to a VM for this and other recording problems this particular one went away. My HVR-2250s and HDHRs never have this problem.

[stuckless]

Originally Posted by BobPhoenix

I only noticed this when I tried to record from my HDPVRs. When I switched the HDPVRs to a VM for this and other recording problems this particular one went away. My HVR-2250s and HDHRs never have this problem.

I run 2 HDPVRs, but like Fuzzy, I do record to ssd initially.

[BobPhoenix]

Originally Posted by stuckless

I run 2 HDPVRs, but like Fuzzy, I do record to ssd initially.

2 HDPVRs for me as well. Mine go to spinners outside the array completely along with all the other tuners. Not sure why only the HDPVRs have a problem but they are the only recording devices that cause problems on so many recordings. Doesn't happen to ALL recordings from HDPVRs but it does happen to many (~ 75% when I was testing this for two days). I suppose it could be the volume of data and a drive spin up but OTA recordings in MPEG2 come out about the same file size as the H264 recordings from HDPVRs. So not sure that is the whole story or not. Especially since the same recording drives are used with a Windows VM with no recording start problems. I might also try recording to my SSD pool and run mover hourly to the Array. Don't really care what works just would like to eliminate the VM if I can.

[panteragstk]

Originally Posted by EnterNoEscape

This one particular is a little interesting in implementation. The only problem I see is that the bait files are somewhat predictable. Anyone who is in the ransomware business would likely find a way to figure out what's going on before it trips something similar to how anti-virus finds a virus.

That's the one I use. I do agree that the way he's done it can be predictable, but with my UTM in place (Sophos) I doubt it will ever be an issue before I notice something wrong. Plus I plan on putting a second unraid server in as a backup in case something crazy happens.

What would you say would/could be better protection?

[KarylFStein]

Originally Posted by panteragstk

What would you say would/could be better protection?

Something like Crashplan .

[panteragstk]

Originally Posted by KarylFStein

Something like Crashplan .

Against a malware or ransomware attack?

[Fuzzy]

Originally Posted by BobPhoenix

2 HDPVRs for me as well. Mine go to spinners outside the array completely along with all the other tuners. Not sure why only the HDPVRs have a problem but they are the only recording devices that cause problems on so many recordings. Doesn't happen to ALL recordings from HDPVRs but it does happen to many (~ 75% when I was testing this for two days). I suppose it could be the volume of data and a drive spin up but OTA recordings in MPEG2 come out about the same file size as the H264 recordings from HDPVRs. So not sure that is the whole story or not. Especially since the same recording drives are used with a Windows VM with no recording start problems. I might also try recording to my SSD pool and run mover hourly to the Array. Don't really care what works just would like to eliminate the VM if I can.

Do you have your cable box locked to a specific resolution?

[EnterNoEscape]

Originally Posted by KarylFStein

Something like Crashplan .

If you're using the cloud service, that probably would work out well. If you're using the free service and not already backing up to another network that your infected computer does not have easy access to, you'd be equally in a bad place because your backup would likely become encrypted too.

[EnterNoEscape]

Originally Posted by panteragstk

That's the one I use. I do agree that the way he's done it can be predictable, but with my UTM in place (Sophos) I doubt it will ever be an issue before I notice something wrong. Plus I plan on putting a second unraid server in as a backup in case something crazy happens.

What would you say would/could be better protection?

I'm saying I've got a better idea, just that this one might only get you so far and it's based on an idea. I'm curious if there are any testimonials from anyone this saved from needing to recover from backup.

[stuckless]

Originally Posted by Fuzzy

Do you have your cable box locked to a specific resolution?

I don't recall doing anything specific, myself, but now that you mention this... I do have my STB set to 720p output. I think I used to use 1080i, but I think that caused issues many years ago, when I first set this up. @BobPhoenix what is your STB set to? Side note... my recording quality is set to grest/best (forget which) and 1hr recordings take about 3.7g of space. I also record a lot less... about 3-4 recordings a night (sometimes a little more). I think your schedule has much more... but still seeing 75% failure rating would be concerning even for the amount of recordings I get. And lastly, the only failed recordings that I used to get were a result of the power supply... and since moving to using the power from the PC case... I haven't had any HALTs in HDPVR recordings.

[willieb]

Originally Posted by stuckless

I don't recall doing anything specific, myself, but now that you mention this... I do have my STB set to 720p output. I think I used to use 1080i, but I think that caused issues many years ago, when I first set this up. @BobPhoenix what is your STB set to? Side note... my recording quality is set to grest/best (forget which) and 1hr recordings take about 3.7g of space. I also record a lot less... about 3-4 recordings a night (sometimes a little more). I think your schedule has much more... but still seeing 75% failure rating would be concerning even for the amount of recordings I get. And lastly, the only failed recordings that I used to get were a result of the power supply... and since moving to using the power from the PC case... I haven't had any HALTs in HDPVR recordings.

This thread is timely. Finishing up my first week of running unRAID as my production SageTV box. Basically the only problem I have noticed is with my two HDPVRs, and just like BobPhoenix, I have had halts in recordings. I really just started noticing this Tuesday when I was watching a recorded show (taking advantage of the snow day in the Northeast). I would put my rate somewhere in the 75% range too. They aren't debilitating and the HDPVR seems to recover and keep going, only missing 30 seconds or soar a time, but I had it happen 3 different times in The Americans on FX. I recorded a couple movies overnight last night and I had halts in the system notifications this morning (didn't have time to check the files to see if they were minor). I just set up 3 recordings during the day today so I will see how they went when I get home from work. I have had my HDPVRs working with these same set top boxes for years. I have replaced the power supplies a couple times like everyone else but I think power supplies are stable now (at least they worked great in Windows a few days ago).

I think my STBs are locked to some resolution but I will have to see what it is. For some reason I have 1080i stuck in the back of my head. I also think I have the HDPVRs set to record on the highest res possible in Sage settings which is like 5.9MB/s or something. Is there a way to change this outside of SageTV on unRAID - just curious - I am not aware of anything akin to a registry like we had in windows where I had defined a new bitrate for "HDPVRMAX". If the bitrate is the issue it would be great to tweak it by degrees and find the highest stable rate.

It's good to know that everyone is not seeing this, Stuckless. Happy to troubleshoot this weekend and compare notes with people. I already have a few other SageTV related tweaking on my list so this will just be one more thing. Seems like we should be able to come up with a fix for this one.

[Fuzzy]

I asked about the resolution thing, because if the box is changing resolutions on channel changes, it can definitely throw the HD-PVR for loops. Being locked is going to be much more reliable, but if you do want the native resolution of the channel, I'd recommend a pretty significant wait-after-tuning delay to give the boxes output time to steady out before having the HD-PVR try to lock onto it.