Comskip and File Cleanup

[pvr599]

Hi guys,
This might have been asked somewhere, but I can't seem to find the answer.

Comskip is not cleaning up the leftover .edl and .txt files. Is there a setting I'm missing or something?

Thanks,
Dana

[gplasky]

Comskip doesn't do that. Whatever you are using to monitor the files for Comskip to process does it. For example, I use DirMon and in the DirMon program you set that up. I think it is the same with SJQ and CommercialDetector.

Gerry

[tmiranda]

Originally Posted by gplasky

Comskip doesn't do that. Whatever you are using to monitor the files for Comskip to process does it. For example, I use DirMon and in the DirMon program you set that up. I think it is the same with SJQ and CommercialDetector.

Gerry

If you're using CommercialDetector there is a setting to tell it what files to clean up when a recording is deleted. .edl and .txt are in the default list.

There is another setting to tell CommercialDetector what types of files to consider video. This is done to prevent CommercialDetector from deleting the .edl and .txt when you convert a file from .mpg to some other format.

[pvr599]

Thanks for the responses.
I went to Commercial Detector configuration in the plugins and I do see the setting "Cleanup Files With These Extensions" and it does have edl,log,txt,incommercial there. I'm not sure why it's not working.

gplasky - I've used Dirmon with Showanalyzer in the past. I looked into Dirmon to clean the files, but it seems it wants to run a program to make it work. How did you set it up to remove the files without running something?

Thanks for the help!!

[gplasky]

I'm running comskip with it. In DirMon I suppose you could just point it to a batch file that does nothing and/or set the parameters so that it will essentially never run. (Like only run your batch on files greater than 200 GB in size.) Or run Sage in debug mode and figure out why it's not cleaning up. Make sure in COmmercialDetector you use the same path as your recording directory in Sage. (UNC or mapped) It needs to be exactly the same.

Gerry

[Soulive]

I've been using commericaldetector also and noticed the artifacts not getting cleaned up. Haven't really looked into why. The clean up orphans manual method in the plugin works fine though.

[tmiranda]

Originally Posted by Soulive

I've been using commericaldetector also and noticed the artifacts not getting cleaned up. Haven't really looked into why. The clean up orphans manual method in the plugin works fine though.

It should clean up after itself. Can you set the debug level to Trace, delete a file, and then post the log? I'd like to see why it's not working.

Thanks,

Tom

[crusing]

I have the same issue but never bothered to look into it. It seems to work 95% of the time, but leaves files behind some times. Temp recordings from watching live TV seem more likely to leave behind comskip files.

[tmiranda]

Originally Posted by crusing

It seems to work 95% of the time, ....

That means it doesn't work 5% of the time. I'd like to see it work close to 100% Would really appreciate it if you could provide a log and point out what it failed to remove.

Tom

[crusing]

It will take some trial and error to reproduce, so to clarify you want debugging on in the Comskip options or in SageTV or both? If Comskip can you let me know what the output file path is?

[crusing]

FYI. I went in to Commercial Detector advanced options and told it to delete orphaned files and it returned 206.

[tmiranda]

Originally Posted by crusing

It will take some trial and error to reproduce, so to clarify you want debugging on in the Comskip options or in SageTV or both? If Comskip can you let me know what the output file path is?

Turn on debugging in Sage and set CommercialDetector debug levle to Trace, leave comskip as is.

[Soulive]

After deleting a JimmyKimmelLive recording the following was left over...

[Norval@ninja2 recordings]$ ls -l JimmyKimmelLive-10000555-0.logo.txt
-rwxr--r-- 1 Soulive users 6300 Oct 25 01:08 JimmyKimmelLive-10000555-0.logo.txt

Guess I need to add logo.txt to the extensions option.

See attached log...

[tmiranda]

Originally Posted by Soulive

After deleting a JimmyKimmelLive recording the following was left over...

[Norval@ninja2 recordings]$ ls -l JimmyKimmelLive-10000555-0.logo.txt
-rwxr--r-- 1 Soulive users 6300 Oct 25 01:08 JimmyKimmelLive-10000555-0.logo.txt

Guess I need to add logo.txt to the extensions option.

See attached log...

There is a setting in the comskip.ini file to delete the logo file and the comskip.ini that comes with CommercialDetector has this set to "1" (true), did you edit the comskip.ini?

I think the settling is "delete_logo_file", make sure it's set to 1. If the line is not in the .ini you can add it.

You can add logo.txt to your list of files for CommercialDetector to cleanup but I prefer to let comskip take care of that automatically.

[Soulive]

Correct, I am using the donators and the "delete_logo_file" was set to 0. I've modified per your recommendation. Thanks!

[tmiranda]

Originally Posted by Soulive

Correct, I am using the donators and the "delete_logo_file" was set to 0. I've modified per your recommendation. Thanks!

There are other settings that you should alter in the comskip.ini. The easiest thing to do is use the comskip.ini that comes with CommercialDetector, that will work fine with the donator's version of comskip.exe.

[crusing]

I deleted what I could last night and no files were left behind. I will check again tonight.

[crusing]

I think the bug might occur when a delayed delete is performed. I have a couple of show with files left behind and both were delayed deletes. This could also explain why I see more left behind on "live" tv.

[tmiranda]

Originally Posted by crusing

I think the bug might occur when a delayed delete is performed. I have a couple of show with files left behind and both were delayed deletes. This could also explain why I see more left behind on "live" tv.

That's a good possibility. It's difficult to handle the delayed deletes because the core sends an event saying the MediaFile has been deleted when it actually has not been deleted. I have special code in there to handle these delayed deletes but it's hard to test because I can't easily force Sage to actually do a delayed delete. If you have a reliable way to do so let me know and I'll make sure it works properly.

[bigbill]

I've been deleting the .logo.txt files manually for years. Why didn't I search for this article. Geez.

Thanks for this.. I have edited my donators comskip.ini and I hopefully will not need to do the manual delete again.