SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV Github Development

Notices

SageTV Github Development Discussion related to SageTV Open Source Development. Use this forum for development topics about the Open Source versions of SageTV, hosted on Github.

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 02-21-2017, 06:26 PM
graywolf's Avatar
graywolf graywolf is offline
Sage Icon
 
Join Date: Oct 2009
Location: NC
Posts: 1,231
.delete files

This past weekend, I upgraded one of my systems from V6 to V9. Went fairly smoothly.

In the process, discovered that some shows went to a samba recycle bin I have on my system where it is <show>-<episode>-<airingid>-0.mpg.delete

Any thoughts/ideas on why this might have happened?
WAF was asking why and if I can recover them.

My thought was to remove the .delete extension and just move back to the Import directory it was in. But not knowing a reason why they were deleted in the first place, don't know steps to prevent it in the future.
Reply With Quote
  #2  
Old 02-21-2017, 06:42 PM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
I'm not familiar with anything that would rename the files like that.
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room
Reply With Quote
  #3  
Old 02-21-2017, 07:15 PM
EnterNoEscape's Avatar
EnterNoEscape EnterNoEscape is offline
SageTVaholic
 
Join Date: Jun 2010
Location: Harrisburg, PA
Posts: 2,556
The logs would likely bring some light to this situation. SageTV renames file to end in .delete when it finds something particularly corrupt/incomplete about them such as they are 0 length. It only does this when it thinks it created the file (aka recordings). It will then slowly delete them.
__________________
SageTV v9 Server: ASRock Z97 Extreme4, Intel i7-4790K @ 4.4Ghz, 32GB RAM, 6x 3TB 7200rpm HD, 2x 5TB 7200rpm HD, 2x 6TB 7200rpm HD, 4x 256GB SSD, 4x 500GB SSD, unRAID Pro 6.7.2 (Dual Parity + SSD Cache).
Capture: 1x Ceton InfiniTV 4 (ClearQAM), 2x Ceton InfiniTV 6, 1x BM1000-HDMI, 1x BM3500-HDMI.

Clients: 1x HD300 (Living Room), 1x HD200 (Master Bedroom).
Software: OpenDCT :: WMC Live TV Tuner :: Schedules Direct EPG
Reply With Quote
  #4  
Old 02-22-2017, 05:36 AM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,842
When sage deletes a file it does it in two steps. First it removes the file info from the wiz.bin and renames the files to *.delete. Then it deletes the *.delete files asynchronously.

If they are lost files you can rename them and move them back. The trick is to find out why sage deleted them in the first place.
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #5  
Old 02-22-2017, 10:43 AM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
Quote:
Originally Posted by tmiranda View Post
When sage deletes a file it does it in two steps. First it removes the file info from the wiz.bin and renames the files to *.delete. Then it deletes the *.delete files asynchronously.

If they are lost files you can rename them and move them back. The trick is to find out why sage deleted them in the first place.
It will only rename the file and asynchronously delete it if it failed to delete it in it's first attempt, so something is preventing the deletion of the files. There's even protection against the file getting added to the async queue, and for some reason sage being killed before it gets a chance to actually remove it, in that it will write the file to a list in sage.properties ("linux/delete_queue="), so that it will be re-added to the queue on next launch
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room

Last edited by Fuzzy; 02-22-2017 at 10:46 AM.
Reply With Quote
  #6  
Old 02-23-2017, 07:25 AM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,842
Quote:
Originally Posted by Fuzzy View Post
It will only rename the file and asynchronously delete it if it failed to delete it in it's first attempt, ...
I thought that behavior was changed. I could be wrong.
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #7  
Old 02-23-2017, 07:41 AM
EnterNoEscape's Avatar
EnterNoEscape EnterNoEscape is offline
SageTVaholic
 
Join Date: Jun 2010
Location: Harrisburg, PA
Posts: 2,556
Also if it can't rename the file, it will still queue it for deletion as it is.
__________________
SageTV v9 Server: ASRock Z97 Extreme4, Intel i7-4790K @ 4.4Ghz, 32GB RAM, 6x 3TB 7200rpm HD, 2x 5TB 7200rpm HD, 2x 6TB 7200rpm HD, 4x 256GB SSD, 4x 500GB SSD, unRAID Pro 6.7.2 (Dual Parity + SSD Cache).
Capture: 1x Ceton InfiniTV 4 (ClearQAM), 2x Ceton InfiniTV 6, 1x BM1000-HDMI, 1x BM3500-HDMI.

Clients: 1x HD300 (Living Room), 1x HD200 (Master Bedroom).
Software: OpenDCT :: WMC Live TV Tuner :: Schedules Direct EPG
Reply With Quote
  #8  
Old 02-23-2017, 05:56 PM
Narflex's Avatar
Narflex Narflex is offline
Sage
 
Join Date: Feb 2003
Location: Redondo Beach, CA
Posts: 6,308
A lot of this behavior depends on settings in Sage.properties...and we changed it a few times...but I'm fairly sure it's a Linux only thing where when it needs to delete a file, if it's above a certain small size, then it'll rename it to .delete, put it into a deletion queue and then asynchronously delete them at a certain rate to prevent overloading the disk with file deletion requests.
__________________
Jeffrey Kardatzke
Google
Founder of SageTV
Reply With Quote
  #9  
Old 02-23-2017, 07:05 PM
EnterNoEscape's Avatar
EnterNoEscape EnterNoEscape is offline
SageTVaholic
 
Join Date: Jun 2010
Location: Harrisburg, PA
Posts: 2,556
Quote:
Originally Posted by Narflex View Post
A lot of this behavior depends on settings in Sage.properties...and we changed it a few times...but I'm fairly sure it's a Linux only thing where when it needs to delete a file, if it's above a certain small size, then it'll rename it to .delete, put it into a deletion queue and then asynchronously delete them at a certain rate to prevent overloading the disk with file deletion requests.
I accidentally caused Seeker to record the entire schedule at once and I saw this happen in Windows too.
__________________
SageTV v9 Server: ASRock Z97 Extreme4, Intel i7-4790K @ 4.4Ghz, 32GB RAM, 6x 3TB 7200rpm HD, 2x 5TB 7200rpm HD, 2x 6TB 7200rpm HD, 4x 256GB SSD, 4x 500GB SSD, unRAID Pro 6.7.2 (Dual Parity + SSD Cache).
Capture: 1x Ceton InfiniTV 4 (ClearQAM), 2x Ceton InfiniTV 6, 1x BM1000-HDMI, 1x BM3500-HDMI.

Clients: 1x HD300 (Living Room), 1x HD200 (Master Bedroom).
Software: OpenDCT :: WMC Live TV Tuner :: Schedules Direct EPG
Reply With Quote
  #10  
Old 02-23-2017, 08:08 PM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
Quote:
Originally Posted by Narflex View Post
A lot of this behavior depends on settings in Sage.properties...and we changed it a few times...but I'm fairly sure it's a Linux only thing where when it needs to delete a file, if it's above a certain small size, then it'll rename it to .delete, put it into a deletion queue and then asynchronously delete them at a certain rate to prevent overloading the disk with file deletion requests.
The settings are all called Linux/xxx, but as far as I can tell, the code isn't Linux specific for the deletion parte (might be wrong though). There are different settings. One forces the async deletion (default true) the other forces the progressive deletion (default false).
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room
Reply With Quote
  #11  
Old 09-07-2017, 01:18 PM
MattHelm MattHelm is offline
Sage Icon
 
Join Date: Jun 2005
Location: Chicago, IL
Posts: 1,182
OK, just to add to this. On a Windows 10 machine, I deleted 3 series yesterday. A few minutes later I looked, and most of the shows were still on the drives with .delete added to the end of them. Never had this issue before. Recordings are all local. (Not that I delete entire 100+ show series often.) Sorry, don't have logs with me.
__________________
Server #1= AMD A10-5800, 8G RAM, F2A85-M PRO, 12TB, HDHomerun Prime, HDHR, Colossus (Playback - HD-200)
Server #2= AMD X2 3800+, 2G RAM, M2NPV-VM, 2TB, 3x HDHR OTA (Playback - HD-200)
Reply With Quote
  #12  
Old 09-10-2017, 03:35 PM
Narflex's Avatar
Narflex Narflex is offline
Sage
 
Join Date: Feb 2003
Location: Redondo Beach, CA
Posts: 6,308
SageTV temporarily renames files when deletion is requested in order to keep the UI responsive...it will delete these files within short order though.
__________________
Jeffrey Kardatzke
Google
Founder of SageTV
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Cannot delete files JonTom Phoenix 16 04-17-2018 09:52 AM
Delete Comskip Files not working dwycoff SageTV v7 Customizations 3 11-07-2010 11:30 PM
delete remote files? clskier SageMC Custom Interface 2 03-11-2010 10:37 AM
delete 'live tv' files automatically? spiderx SageTV Software 8 12-04-2005 02:32 PM
Delete Orphan Files snoopy SageTV Customizations 6 08-05-2005 10:12 PM


All times are GMT -6. The time now is 09:03 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.