Commercial Advance Beta Release

[turak]

Originally posted by stanger89
Hey for those of you interested in cleaning up all those txt files orphaned when Sage deletes recordings I've found a rather simple way to do it. Simply enter the following at a command prompt. It assumes you are in the SageTV recordings dir

for /f "tokens=1 delims=." %i in ('dir /s/b *-0.txt') do if NOT EXIST %i.mpg (del %i.txt)

And if you would like to test it (to see what will be deleted) with out deleting anything:

for /f "tokens=1 delims=." %i in ('dir /s/b *-0.txt') do if NOT EXIST %i.mpg (echo %i.txt)

I already had my SageTV video directories samba mounted on my linux box. So I just wrote a simple perl script to delete orphaned txt files and set it to run from crontab once an hour. I know this doesn't help most people, but I thought I'd mention it incase anyone else samba mounts their sage dirs.

[turak]

Malore,
Would it be difficult to add a txt search dir property? i. e. comskip_search_dirs=e:\tv,f:\tv
then the client would check these dirs for txt files that match the mpg. Right now I can't use comskip on one of my clients because it is on a different subnet then the server. I have a linux box doing port forwarding between the client and server for sagetv. The linux box samba mounts my sagetv video drives and shares those drives to my client. Basiclly what I'm saying is I can't use UNC paths to make comskip work, but I could make it work if I had a property to add directories to check for txt files. I'm sorry if you find this post confusing.

-Scott

P.S. Thanks for the kickass mod.

[JasonJoel]

Although this doesn't help you, I just want to point out that you do NOT need UNC paths setup.

You can also just map the drives with the same drive letter they have on the SageTV server and comskip works fine.

Obviously if you are recording on your C drive though, you are SOL with that method...

Jason Bottjen

Originally posted by turak
Malore,
Would it be difficult to add a txt search dir property? i. e. comskip_search_dirs=e:\tv,f:\tv
then the client would check these dirs for txt files that match the mpg. Right now I can't use comskip on one of my clients because it is on a different subnet then the server. I have a linux box doing port forwarding between the client and server for sagetv. The linux box samba mounts my sagetv video drives and shares those drives to my client. Basiclly what I'm saying is I can't use UNC paths to make comskip work, but I could make it work if I had a property to add directories to check for txt files. I'm sorry if you find this post confusing.

-Scott

P.S. Thanks for the kickass mod.

[turak]

Originally posted by JasonJoel
Although this doesn't help you, I just want to point out that you do NOT need UNC paths setup.

You can also just map the drives with the same drive letter they have on the SageTV server and comskip works fine.

Obviously if you are recording on your C drive though, you are SOL with that method...

Jason Bottjen

Yeah. I managed to get it to work on one of my video directories by mapping the samba share to F:\tv, but my other video directory is on drive E: which is used by my DVD+/-RW on the client. I just think having a variable in the properties file with dirs to do a file test on would make it more compatible with different peoples setups (including mine ) with little effort involved in implementing it.

[JasonJoel]

Yeah, I had to move my DVD/CD drive to another drive letter because of that same issue. But since it is really easy to do that in XP, I did it and haven't looked back since.

That said, it would be nice if you didn't have to do all of that!

Jason Bottjen

Originally posted by turak
Yeah. I managed to get it to work on one of my video directories by mapping the samba share to F:\tv, but my other video directory is on drive E: which is used by my DVD+/-RW on the client. I just think having a variable in the properties file with dirs to do a file test on would make it more compatible with different peoples setups (including mine ) with little effort involved in implementing it.

[malore]

Originally posted by redman
Does anyone have the logic details that describe how the frames are calculated into a commercial?

First it reads through the entire video file and saves the frame numbers that are black. Then it looks for gaps between black frames that are greater than the minimum commercial size and less than the maximum comercial size. It joins consecutive commercials together to form a commercial break. It then goes through the list of commercial breaks and prints out only the ones greater than the minimum commercial break and less than the maximum commercial break.

If you set verbose=2 in the comskip.ini you will be able to see this process.

Example:
start: 791, end: 968, len: 5.91s
--start: 968, end: 1088, len: 4.00s 9.91s
--start: 1088, end: 3306, len: 74.01s 83.92s

start: 8856, end: 9767, len: 30.40s
--start: 9767, end: 10666, len: 30.00s 60.39s
--start: 10666, end: 11566, len: 30.03s 90.42s
--start: 11566, end: 11715, len: 4.97s 95.40s
--start: 11715, end: 12039, len: 10.81s 106.21s
--start: 12039, end: 12465, len: 14.21s 120.42s
--start: 12465, end: 13366, len: 30.06s 150.48s

start: 23828, end: 23948, len: 4.00s
--start: 23948, end: 24869, len: 30.73s 34.73s
--start: 24869, end: 25768, len: 30.00s 64.73s
--start: 25768, end: 26667, len: 30.00s 94.73s
--start: 26667, end: 27568, len: 30.06s 124.79s

--------------------
792 3301
8865 13366
23873 27568

[Jere_Jones]

I haven't been able to commit to the sage community website in a while so I'll post an update here.

Changelist to Ver 0.30

• An XXX.log file will be created for any verbose setting (to aid in troubleshooting)
• Added scene change detection
• Added fuzzy logic - MAJOR ADDITION (recommend running with verbose=1 to understand) (I think this is the key to perfect detection!)
• Console window now shows the timecode of frame being analyzed (easier to understand than frame numbers)
• MPEG path and filename can contain spaces. (ATTN: ellweber)
• Started support for "special cases" (e.g. Home Improvement always has a 2-4 second "sponsored by" segment followed by a 10 second commercial followed by 30-60 seconds of credits/outtakes - Mark the outtakes as show)
• Various internal cleaning and optimization

I'm attaching two zip files. Everyone will need comskipexe.zip. Just replace the files in the SageTV directory and you should be good to go. The comskipsrc.exe is for anyone who wants the changes I made to the source files.

If comskip doesn't work 100% for you, I would appreciate it if you would follow this procedure:

1. Change the comskip.ini verbose to "verbose=10".
2. Run comskip on the trouble mpg.
3. Email the resultant .log file along with an explanation of the problem (i.e. It didn't mark a commercial from 4:56 to 5:34) to jere.jones@gmail.com
4. Wait for feedback and/or updated comskip.

If even a few people do that with a wide enough variety of shows, I think we can have comskip up to 99.9% effectiveness.

Jere

[redman]

Gonna play with this just as soon as I can.

Excellent.

[insomniac]

Awesome!

Thank you very much for your time and contribution. Giving it a try now!

I.

Originally Posted by Jere_Jones

I haven't been able to commit to the sage community website in a while so I'll post an update here.

Changelist to Ver 0.30

• An XXX.log file will be created for any verbose setting (to aid in troubleshooting)
• Added scene change detection
• Added fuzzy logic - MAJOR ADDITION (recommend running with verbose=1 to understand) (I think this is the key to perfect detection!)
• Console window now shows the timecode of frame being analyzed (easier to understand than frame numbers)
• MPEG path and filename can contain spaces. (ATTN: ellweber)
• Started support for "special cases" (e.g. Home Improvement always has a 2-4 second "sponsored by" segment followed by a 10 second commercial followed by 30-60 seconds of credits/outtakes - Mark the outtakes as show)
• Various internal cleaning and optimization

I'm attaching two zip files. Everyone will need comskipexe.zip. Just replace the files in the SageTV directory and you should be good to go. The comskipsrc.exe is for anyone who wants the changes I made to the source files.

If comskip doesn't work 100% for you, I would appreciate it if you would follow this procedure:

1. Change the comskip.ini verbose to "verbose=10".
2. Run comskip on the trouble mpg.
3. Email the resultant .log file along with an explanation of the problem (i.e. It didn't mark a commercial from 4:56 to 5:34) to jere@sage-community.org
4. Wait for feedback and/or updated comskip.

If even a few people do that with a wide enough variety of shows, I think we can have comskip up to 99.9% effectiveness.

Jere

[heffe2001]

Just stuck it on my box, but only had one show with no commercials detected (having a problem with Sage firing off Comskip, but I'm using Neilm's STV, not sure if it's that, or something on my setup), it's running on that file now, will post if I have any problems...

[Jere_Jones]

I've noticed a similar problem with Nielm's STV. If it comskip runs automatically, it runs fine, but if I tell it to run on a specific show (via Malore's Recording's Option menu), then it doesn't work right at all.

I'm not sure what the problem is, but I'm looking for a fix internal to Comskip.

Jere

[heffe2001]

I'd REALLY like it to run like the suggestion above, basically have a executable I could run on ANY machine (no client/server needed), that will parse the directory for any shows recorded without txt files, and create them automatically. The only problem I can see is that if the program is currently being recorded, the above program would try to comskip it too (and comskip stuff off the movie channels, which would be bad as well).

[Jere_Jones]

This is just minor update that allows the path to comskip and the path to the mpeg to contain spaces. This is in response to a/an (upcoming?) change to Nielm's stv to correct a problem with Sage "forgetting" what the current working directory is.

For those developers out there: now that comskip doesn't have a problem with spaces, I HIGHLY recommend calling it with the FULL path of the exe and the mpeg.

Jere

[Gaurav]

Hey Jere,
i had CA working perfectly before this latest update to comskip and Neilm's STV. Now it's throwing Dr Watson errors at random. All i get is a logo file and an empty txt file.

[Jere_Jones]

Gaurav,

Search your drives for a file called comskip.exe.bat

If you find it, what is it's path? What happens if you run it?

Jere

[Gaurav]

as it usually happens, the problem disappeared as soon as i posted it.

[rrussell]

Gaurav - that's the strangest looking cat avatar I have ever seen.

[TiltRod]

Jere,

I am having a similar problem with the paths.

When I drag and drop the mpg onto comskip, it works like a charm. However, if i let sage background detect it hangs with a cmd.exe process.

I did a search for the comskip.exe.bat file and i found it on my D: drive. This drive is only used for backups and i don't understand why it is being created there. My Sage directory is on the c: drive. i "ass"ume that since the bat file is referencing ".\comskip.exe" it is not finding it to execute because it sees D:\ as the working directory. Is this correct. I haven't tried this yet, but i again assume that if i made a copy of comskip.exe on D: that it would work.

My issue is what in the code is sending it to a drive that doesn't contain either the sage directory structure nor my video files. Any help is appreciated.

-D

BTW this is in reference to 0.31 version

[nielm]

Just FYI, there is a bug in nielm.stv v1.4 which stops background comm detect from working... Fixed in v.1.5

[Gaurav]

Originally Posted by rrussell

Gaurav - that's the strangest looking cat avatar I have ever seen.

it might be strange but at least i have one