1000 shows deleted, wondering why?

[newyankee]

Just encountered an event that deleted 1000 files, which were eventually recovered.

Like a lot of folks, I've just upgraded an old v6 XP system to v9 on win7 and new hardware. The upgrade has been a success during the last week, but an attempt to move some shows to secondary storage proved disastrous.

Live TV is recorded to a local SSD in the Sage 9 server, and a QNAP NAS box is used for long term bulk storage. Typically, I shut down the Sage service, move files, and restart Sage. I tested this process and all went as expected with Sage 9.

Today I tried to archive another group of files, and 1) some of the transferred files showed up in the recording directory as something I never recorded, 2) some were missing, and 3) about one half of the original NAS files were missing.

The deleted shows were available in the QNAP "recycle" bin, but the filenames were altered to add a ".delete" at the end. I restored the files to the original directory and manually removed the ".delete" appendage. I then restored a sage image (wiz) a few days old, and all was back to normal.

Something went wildly wrong, kind of wondering if related to the Skylake microcode bug.

Would appreciate any info on how Sage could add a ".delete" to a filename and then delete it. Sage 9 is a great improvement, but perhaps I added one too many plugins. Anyway, most interested in how to prevent this from reoccurring.

[trallyus]

Did you check the show settings as maybe when you updated as check your recording settings as maybe AutoDelete was turned on or adjusted when you updated.

If you want to keep all your recordings make sure keep at most is set to All as it may have gotten changed to some number instead of All

Just a suggestion to check while waiting for a real solution.

[graywolf]

Today I tried to archive another group of files, and 1) some of the transferred files showed up in the recording directory as something I never recorded, 2) some were missing, and 3) about one half of the original NAS files were missing.

1. V6 would sometimes renumber the airing id in the wiz.bin but not change it on the file so that it ended showing previous recordings with the info from the new airing id/epg. Fortunately this was fixed in v7 and above.

The.delete is (from my understanding) is that sagetv marks a deleted file by adding the .delete then asynchronously performs the physical delete later

[newyankee]

Originally Posted by trallyus

Did you check the show settings as maybe when you updated as check your recording settings as maybe AutoDelete was turned on or adjusted when you updated.

If you want to keep all your recordings make sure keep at most is set to All as it may have gotten changed to some number instead of All

Just a suggestion to check while waiting for a real solution.

I checked the current recording settings, from the backup wiz.bin, and autodelete was defaulted on, but the number was set to All. Now turning autodelete off.

My best guess now is that restarting the sage service, and the drive rescans, triggered the Skylake CPU hyperthread bug that corrupts process execution. I'm going to disable hyperthteading and proceed with caution.

I am certainly enjoying the upgrade to v9, and all the plugin tweeks by the community.

Thanks for the reply's, most helpful.

[davidk21770]

Is there a way to turn autodelete off for everything? Or groups? I thought that there was at least a favorite setup where I could set that as a default for all favorites, but I can only find the individual recordings / favorite settings -- for almost 6000 recordings...

[Tiki]

You can change the defaults that will be used for NEW favorites, but I don't know any way to batch edit existing favorite settings.

[graywolf]

Probably could be done using groovy and the sage APIs. Would need to see if one of the APIs could be used to list all Favorites (most likely) loop thru them and use an API (maybe) to then set the value

[BobPhoenix]

You can set the recordings to archived and then they will not get deleted. You can select grouped recordings and archive them all at the same time.

[newyankee]

Originally Posted by BobPhoenix

You can set the recordings to archived and then they will not get deleted. You can select grouped recordings and archive them all at the same time.

Yes, I did notice that archived recordings were not deleted in my case. Also, good to know that there is no global switch to turn off autodelete, since I could not find one. Manually editing settings in each favorite is easier than removing the ".delete" in a thousand files.

I have turned off Skylake hyperthreading, seems very stable, and will report back after I try the same file transfer again.

[davidk21770]

I remember seeing ways to batch archive files. I think that's my ticket. Thanks!

Edit -- yep. Easy to create a menu under Malore with all my unarchived videos in a single group and then set archived for the whole group. Took less than 5 minutes.