auto-delete functionality went nuts

[crusader]

Hi,

I need some help with my Lego... I mean SageTV -- it behaves very strangely. Data:
- 1TB harddrive is given completely to sageTV for recordings and right now is completely full
- intelligent recording is ON (though I tried to switch it off)
- I think it is irrelevant, but just in case -- I am using SageMC+TV Explorer+BMT

Now, when I go to My TV/RecordedTV/Information I see "deletion" queue -- i.e. list of items that are going to be deleted when we run out of space. Problem:
- this list has not changed for 1 month (I have zero free space)
- my recorded favorites disappear in a day or two

I.e. yesterday I had StarTrek 4x3 -- tomorrow it just disappeared, even though there are plenty of watched recording, intelligent recordings, etc that were around for month.

Help! This drives my wife nuts... My waf is dipping dangerously low!

Michael.

[crusader]

Ok, you think that if SageMC was mentioned -- thread has to be moved somewhere else.
I tried to use default STV and (surprise!) result is totally the same -- I filled all space on my disk and sage stopped. Stopped recording, stopped liveTV, etc. It just as if it treats all existing recording as manual recordings (but they are not, I've checked!). On the other hand it happily gets rid of liveTV recordings (I have Intelligent recordings OFF and related option ON).

Debug logs attached... It feels like that logic responsible for cleanup does not see existing recordings at all!

Help! Maybe I should re-import existing recordings somehow?

[GKusnick]

My guess (without combing through your logs) is that you have some permissions problem that's preventing Sage from being able to delete those files. Or possibly some plugin or add-on is holding them open so they can't be deleted. Have you tried deleting one of them manually in Sage, and if so, what happens?

[crusader]

I thought about it -- ensured that all security descriptors allow user (sage is running under) to delete those files. If I delete recording in sage -- it just works.

Btw -- I can't find a thing in the logs -- it just complains about absense of space.

[Fuzzy]

quick check, have you checked that the applicable favorites have 'AutoDelete' turned on?

[crusader]

yep, in default STV 'AutoDelete' flag is set for every favorite.

I wonder if it can have something to do with BMT? As far as I remember for BMT to update metadata for recording (e.g. to set season/episode numbers when I press 'Scan' in BMT's web-interface) -- it has to delete existing "airing" and recreate it with new metadata (using some SageTV API). I wonder if this process makes recording 'invisible' for auto-delete functionality? :-\

Because I had to press that scan button regularly -- for some reason SageTV is refusing to call automatic BMT plugin every time recording is created. And I have a hunch that my problems started roughly around the time I started playing with BMT/fanart...

Update -- somehow after running for about 1 day with no free disk space SageTV managed to "find" about 0.5Gb. I had debug flag ON. Anyone interested in the log file? It does not make a lot of sense to me...

[Fuzzy]

I believe the older versions of BMT had these problems.. 4.x though I think is better about it - it only changes the 'safe' stuff for sage recordings, leaving the title/showid the same, so it stays tied to the favorite. Do your favorites show with white borders on them in the default stv? this would indicate that they are still tied to the favorite, and should still be subject to the autodeletion.

[crusader]

Checked it -- all recordings have white border. All groups have that border too. red 'F', some have 'W' and 'HD'

I''ll try to setup BMT 4.0... But meanwhile, assuming that existing recordings info is somehow corrupted in qiz.bin -- is there any way to correctly rebuilt that info? Maybe some kind of "reimport"?

Also -- is there any way to check 'deletion queue' in default STV?

P.S. Damn, default STV is SO much faster and responsive on my setup (Celeron D 2.9Ghz server, HD200 extender) than SageMC+fanart :-) -- no sluggishness, no sudden 'magic circle' for 10 secs, etc

[GKusnick]

Originally Posted by crusader

Also -- is there any way to check 'deletion queue' in default STV?

No, because there is no "deletion queue" as such. SageTV does not maintain a persistent queue of recordings to be deleted in a specific order. Instead, it selects programs for deletion at the time space is needed, according to the rules described in Appendix C of the manual. What SageMC shows you in its deletion queue is (I assume) just SageMC using those rules to guess what might be deleted next. (That's why complaining about the contents of that list got your post moved to the SageMC forum.)

Instead of just checking for the red F in the recordings list, try selecting one of those recordings and choosing Favorite Options > Adjust Favorite Options. This will take you to the actual favorite corresponding to that recording, which may not be the one you think it is. For instance if you've accidentally created a keyword favorite that covers most of your existing recordings and has autodelete turned off, that could override the autodelete setting on the favorites that originally caused them to be recorded. (That could also perhaps explain why it's behaving as if IR is turned on even after you turned it off.)

Also, instead of adding or upgrading plugins, in your shoes I would be removing or disabling plugins in order to get back to a stock config until this problem is resolved. Then you can add back plugins one by one, verifying after each one that things are still working as you expect. That's the best way to isolate the problem either to the SageTV core or to a specific plugin.

[crusader]

I did remove everything, using standard STV right now, not a single series/favorite has manual flag (not a single recording has that flag too) -- effect is the same.
I said this already -- it does not work in "stock configuration". Only reasonable assumption I can make is that something is busted in wiz.bin and some magic regeneration process might fix that.

And yes -- I used your method to get to series info... No luck -- auto-delete flag is ON.

[crusader]

This is getting retarded... I have repeated the same steps (use all free space with bogus files and attempt to do another recording) -- it "works" now if I start Sage client on server (i.e. not through my HD200 extender -- in that case everything just stops).
Here is the piece of log:

Sun 4/25 23:56:54.188 DISKSPACE MANAGEMENT: freeSpace=102MB safeAirs=[A[965463,934691,"Translated/Tom and Jerry/Tom and Jerry: The Magic Ring",0@0320.21:00,59], A[1025514,1002064,"America's Next Top Model",0@0423.20:00,59]] verySafeAirs=[FA[stationID=40465 Pulp time=Sun 4/25 22:00:00.000 dur=2:00:00], A[1007617,1007416,"Pulp",40465@0425.22:00,120]]
Sun 4/25 23:56:54.200 Added:Wasted[id=1027416 Airing=A[1006915,457813,"Two and a Half Men",21657@0425.22:30,30]]
Sun 4/25 23:56:54.260 Carny got a Wasted job of A[1006915,457813,"Two and a Half Men",21657@0425.22:30,30]
Sun 4/25 23:56:54.301 Deleted media segment file S:\SageTV\TwoandaHalfMen-CastratingSheepinMontana-1006915-1.mpg dtime=100 len=613892096
Sun 4/25 23:56:54.438 CARNY Processing 277 Agents & 2220 Airs
Sun 4/25 23:56:54.496 Deleted media segment file S:\SageTV\TwoandaHalfMen-CastratingSheepinMontana-1006915-0.mpg dtime=194 len=2531196928
Sun 4/25 23:56:54.501 DISKSPACE MANAGEMENT COMPLETE FreeSpace=3247
Sun 4/25 23:56:54.502 Seeker waiting for 3 mins.

As you see somehow Sage decided to get rid of "Castrating Sheep in Montana" episode of "Two and Half Men" show (wich is my favorite with autodelete ON). Not mentioning the fact that it did not work when I tried this using extender, it is very strange that this episode was selected for deletion. I'll explain why:

According to sage doco "Favorites with AutoDelete ON" have higher priority than intelligent recordings (I have plenty of them, even though I switched off Intelligent recording two days ago) or "Watched shows" (even plentier). That particular show did not have watched flag.
As an additional piece of info I'd like to mention that about month ago I reset watched flag on entire "Two and Half Men" series (I was using SageMC back then) -- so very likely I watched that show already, but assuming that "reset watched flag" functionality works ok -- this should not matter. Can this "reset watched flag for entire series" operation be the cause of my troubles?

[crusader]

Got this today from Sage support (Thank you George, you are the man!):

I'm sorry to say, but it looks like that plugin you used removed the channel information from the recording detail. Since that is gone Sage believe it's either a converted recording or an imported file and Sage will never delete those.

And indeed -- I waited for a recording to appear, went into my BMT 3 webinterface, pressed 'Scan', ticked 'Scan recordings', pressed 'Scan', waited for process to complete and (surprise!) -- its gone! I mean channel information from recording is not present in detailed info for that recording (as well as HD flag and white border for most recordings (but I swear it was there before -- maybe after restart sage restores it?)).

Would be nice for sage to mark those imported recordings somehow... Because by looking at it you would never guessed anything wrong.

Among other quirks my BMT shows:
- automatic plugin does not get called, ever -- that is why I have been using 'Scan' button
- when I search for something (in webUI, Firefox) it does not show all found items -- sometimes it says '2 items' in the left upper corner, but does not show any, or show only few

I have no idea if these are connected to my main problem, but decided to note them here just in case...