ComSkip XVid batch HQ 1200 bitrate

[roxy99]

Originally Posted by grauchy

What if I've already run comskip earlier? What changes should be made to the batch file to NOT run comskip because I already have a comskip file.

you need to have a vcf comskip file. Normally comskip is configured to produce an edl or txt file. However for the batch file to generate a virtualdub script file it needs a vcf file. If you configure your comskip.ini to produce both vcf and edl formats, then all you need to do is set the batch file to grab the preproduced vcf file. Eg- you may already be producing edl files regularly thru dirmon so why not produce the vcf at the same time. Its a good sugestion and I'll look into incorporating it.

[roxy99]

Just as I thought- it was the audio all along. Was there anything different in the way in which you captured this mpg? DGindex produced a straight wav instead of an mpa.

So anyway here are the corrections you need to made to the batch file. Under the Set Avisynth commands near the beginning are the following 3 lines:

FOR %%G IN (%CAPDIR%\*ms.mpa) DO %DC%  -auto -out %CAPDIR%\cutaudio.mpa "%%G"
"%BS%" -core( -input "%CAPDIR%\cutaudio.mpa" -output "%CAPDIR%\%~n2.wav" -2ch -logfilea "C:\besweet\BeSweet.log"  ) -profile( ~~~~~ Default Profile ~~~~~ )
del %CAPDIR%\*.mpa

Change to:

FOR %%G IN (%CAPDIR%\*.wav) DO %DC%  -auto -out %CAPDIR%\cutaudio.wav "%%G"
"%BS%" -core( -input "%CAPDIR%\cutaudio.wav" -output "%CAPDIR%\%~n2.wav"  -2ch ) -azid( -s stereo -L -3db ) -ssrc( --rate 48000 )
Del  %CAPDIR%\cutaudio.wav

[roxy99]

Just posting to follow up with Davephan if the modification posted above worked or not

[davephan]

Originally Posted by roxy99

Just as I thought- it was the audio all along. Was there anything different in the way in which you captured this mpg? DGindex produced a straight wav instead of an mpa.

So anyway here are the corrections you need to made to the batch file. Under the Set Avisynth commands near the beginning are the following 3 lines:

FOR %%G IN (%CAPDIR%\*ms.mpa) DO %DC%  -auto -out %CAPDIR%\cutaudio.mpa "%%G"
"%BS%" -core( -input "%CAPDIR%\cutaudio.mpa" -output "%CAPDIR%\%~n2.wav" -2ch -logfilea "C:\besweet\BeSweet.log"  ) -profile( ~~~~~ Default Profile ~~~~~ )
del %CAPDIR%\*.mpa

Change to:

FOR %%G IN (%CAPDIR%\*.wav) DO %DC%  -auto -out %CAPDIR%\cutaudio.wav "%%G"
"%BS%" -core( -input "%CAPDIR%\cutaudio.wav" -output "%CAPDIR%\%~n2.wav"  -2ch ) -azid( -s stereo -L -3db ) -ssrc( --rate 48000 )
Del  %CAPDIR%\cutaudio.wav

Roxy99,

I tried the modification to the script for 16:9 video, and it worked! I ran it on a small 196 meg 16:9 test video file using the HQ two pass script. The AVI file looks good. The size is compressed to 56 megs. I try the script on some larger 4 gig mpeg2 16:9 video files.

I don't know how hard it would be to have the script automatically detect 4:3 or 16:9 aspect ratio.

Thanks again for your help getting the script to work with 16:9 videos!

Dave

[roxy99]

There are a whole bunch of parameters I'd like to automate but need to learn C# to program. It would be a good project.

[xj-boonie]

Originally Posted by davephan

Roxy99,

I tried the modification to the script for 16:9 video, and it worked! I ran it on a small 196 meg 16:9 test video file using the HQ two pass script. The AVI file looks good. The size is compressed to 56 megs. I try the script on some larger 4 gig mpeg2 16:9 video files.

I don't know how hard it would be to have the script automatically detect 4:3 or 16:9 aspect ratio.

Thanks again for your help getting the script to work with 16:9 videos!

Dave

I'm eager to try this, but am wondering if there is a way to have a 16:9 and 4:3 version to pick between the 2 depending on the source.

[roxy99]

Auto detection is something I want as well. Erik, I hope you are following this thread because maybe you can help.

The source is always 4:3 material for SD. So when I manually set the batch to create a 16:9 avi output, I am cutting out the black bars, the padding, that the broadcast inserted to make the 16:9 source a 4:3 source.

There is no metadata in the mpg2 stream that I am aware of that signals that the video source is a black bar padded 4:3 video (ie 16:9 without the bars). Hence an autodetect parameter must be present.

If Erik can put in his comskip a feature which can output a flag in txt format that says basically 'hi I'm a 4:3 video with blck bars' then the batch file can detect the existence of that file and branch to the right script line for croping.

I will pm Erik about it.

Erik, from you I would need the comskip file to output a log file as follows:

Sourcename169.log or Sourcename43.log

For example:

If I am converting CSIepisodename.mpg which happens to be black barred 16:9 then comskip should produce a text file named CSIepisodename169.log
We know comskip is scanning the mpg for black bars already, so this should not be a problem.

[erik]

The standard log file create when verbose=1 writes the following line
Dominant aspect ratio: 1.7800
where the number 1.7800 is replaced by the actually measured dominant aspect ratio.

Maybe you can grep this data from the log file?

[erik]

If you want to know the exact location of the video you also may set verbose=10
and grep the lines that look like
Frame: 3107 Ratio: 2.33 MinY: 226 MaxY: 854 MinX: 226 MaxX: 1686
Frame: 3756 Ratio: 1.34 MinY: 10 MaxY: 1078 MinX: 234 MaxX: 1678
Frame: 5687 Ratio: 1.78 MinY: 10 MaxY: 1078 MinX: 10 MaxX: 1910
Frame: 6615 Ratio: 1.37 MinY: 10 MaxY: 1078 MinX: 226 MaxX: 1686
Frame: 7854 Ratio: 1.78 MinY: 10 MaxY: 1078 MinX: 10 MaxX: 1910
Frame: 27653 Ratio: 1.86 MinY: 154 MaxY: 934 MinX: 234 MaxX: 1678
Frame: 29637 Ratio: 0.00 MinY: 10 MaxY: 1078
Frame: 30094 Ratio: 1.78 MinY: 10 MaxY: 1078 MinX: 10 MaxX: 1910
Frame: 45455 Ratio: 1.37 MinY: 10 MaxY: 1078 MinX: 234 MaxX: 1686
Frame: 47610 Ratio: 1.78 MinY: 10 MaxY: 1078 MinX: 10 MaxX: 1910

These lines signal all the detected AR changes. a ratio of 0.00 signals a undefined AR.
Due to a don't care border of 10 the values never get to 0,1088,1920 etc.
Once you know which part of the video you want to keep you also can decode the area of the video.
Now of course I could look into how to dump this in a simpler to read format.....

[roxy99]

Originally Posted by erik

The standard log file create when verbose=1 writes the following line
Dominant aspect ratio: 1.7800
where the number 1.7800 is replaced by the actually measured dominant aspect ratio.

Maybe you can grep this data from the log file?

That's great news! Thanks erik. I am not at home so can you post a sample log file where this parameter is present and I'll be able to start analyzing it. Is dominant aspect ratio ever an oddball number like 1.7804, or 1.7794 etc? If so I would have to QGREP and then do numeric operations on it.

Thanks

[erik]

This is the data surrounding the mentioned line

Logo fraction:              0.6748      
Maximum volume found:         7453
Average volume:                760
Sound threshold:               500
Silence threshold:             100
Minimum volume found:            0
Average frames with silence:    48
Black threshold:                25
Minimum Black level found:      13
Average brightness:            521
Uniformity level:                0
Average non uniformity:        239
Maximum gap between logo's:    181
Suggested logo_threshold:   0.6750
Suggested shrink_logo:	         5
Max commercial size found:      49
Dominant aspect ratio:      1.7800
Score threshold:            1.0500
Framerate:                  29.97
Total commercial length:    0:5:7.47
Block list after weighing
----------------------------------------------------
  #     sbf  bs  be     fs     fe    sc      len   scr cmb   ar                   cut bri  logo   vol  sil corr stdev        cc
  0:+0    0   0   0      1   3113   0.10  103.837  0.11   0 1.78            L      a    951+ 0.84  625- 51+  0.000    95           
  1:--    2   1   1   3114   3437   2.00   10.777  0.06   0 2.33          A          b  672= 0.00 2027= 97=  0.000    67           
  2:--    1   1   0   3438   3754   4.50   10.544  0.07   2 2.33          A  C     a    397! 0.00 1633= 95=  0.000    39           
  3:--    1   1   0   3755   3885   2.25    4.338  0.05   2 1.37             C       b  396! 0.00 1565= 93=  0.000    39           
  4:--    2   1   1   3886   5384   3.00   49.983  0.04   1 1.37          A  CN      b  437- 0.00 1801= 97=  0.000    43           
  5:--    6   2   4   5385   5681   9.00    9.877  0.16   1 1.37          A  C S   a b  626= 0.00  893+ 480  0.000    62           
  6:--   19   5  14   5682   6600   3.00   30.631  0.29   0 1.78               S   a b 1188= 0.00  501! 52+  0.000   118           
  7:--   14  14   0   6601   7848   2.00   41.608  0.13   0 1.37          A        a   1151= 0.00 1585= 94=  0.000   115           
  8:++    5   1   4   7849  26714   0.00  629.463  0.02   0 1.78           EL        b  189= 0.97  456= 37=  0.000    18           
  9:--   24   4  20  26715  27631   3.00   30.564  0.05   0 1.78               S   a b  658= 0.00  484! 42-  0.000    65           
 10:--   21  21   0  27632  28102   6.00   15.682  0.15   0 1.85          A    S     b 1104= 0.00 1764= 90=  0.000   110           
 11:+-    4   1   3  28103  44521   0.00  547.814  0.05   0 1.78           EL        b  434- 0.79  715- 38!  0.000    43           
 12:--   18   4  14  44522  45439   3.00   30.597  0.29   0 1.78               S   a b 2093= 0.00  598! 58=  0.000   209           
 13:--   15  15   0  45440  46353   6.00   30.464  0.38   0 1.37          A    S     b 1845= 0.00 1715= 91=  0.000   184           
 14:--    1   1   0  46354  47616   2.00   42.109  0.31   0 1.37          A        a   2306= 0.00 1491= 92=  0.000   230           
 15:+0   10   1   9  47617  50139   0.10   84.151  0.06   0 1.78            L      a b  412- 0.47  895+ 50+  0.000    41           
 16:--   11   9   2  50140  51036   6.00   29.897  0.13   0 1.37          A    S     b  630= 0.00 1409= 87=  0.000    63           
 17:--   11   2   9  51037  51951   6.00   30.497  0.05   0 1.37          A    S     b  442- 0.00 1795= 93=  0.000    44

[grauchy]

I've been using this batch file for about a week and I find it to be pretty useful. A couple of glitches I'm trying to work out though.

First
The avi files come out perfectly and I'm able to play them back. But inside SageTV when I try to play them back SageTV thinks that they are shorter (time wise) than they really are. I think it has to do with the fact that the file is now smaller.

How do I make SageTV just forget about the the old size and just playback the full file? I stops playback before the end cause it thinks the file is over.

Second
I already have ShowAnalyzer and it can produce whatever cut, edl, txt, log file is needed for commercial processing. Is there anyway to get this batch file to take advantage of that? It seems a waste to send the file for commercial processing all over again.

[roxy99]

Originally Posted by grauchy

I've been using this batch file for about a week and I find it to be pretty useful. A couple of glitches I'm trying to work out though.

First
The avi files come out perfectly and I'm able to play them back. But inside SageTV when I try to play them back SageTV thinks that they are shorter (time wise) than they really are. I think it has to do with the fact that the file is now smaller.

How do I make SageTV just forget about the the old size and just playback the full file? I stops playback before the end cause it thinks the file is over.

Second
I already have ShowAnalyzer and it can produce whatever cut, edl, txt, log file is needed for commercial processing. Is there anyway to get this batch file to take advantage of that? It seems a waste to send the file for commercial processing all over again.

To answer your first question do not try to mimic the existence of the mpg in your regular recordings. Ideally it would be nice to leave it just there but I guess its a no go.
Your new AVI file should be in a media import directory and from there played back.

Your second question- can you configure show analyser to produce a 'vcf' file? If so then you can place 'rem' in front of the comskip line in the batch file. You will need to modify the batch to also move and copy the proper vcf file from the Soucr folder to the Temp folder where all the processing is done. I'll have to add an 'If Exist' branch in the batch to search for the valid vcf file and copy/paste. Something I'll have to get around to doing.

[grauchy]

Thanks for the quick reply.

1) I put the avi file in the media import folder not the recordings folder but SageTV still only wants to playback the first part of the file. I must be doing something wrong I just can't figure out what it is.

2) ShowAnalyzer - Looks like .vcf is not an option, Thanks for the info though.

[roxy99]

The batch file now reads the comskip log file to determine the aspect ratio based on the line:
Dominant Aspect ratio: xxxxx

I have define 1.9600 to be widescreen because on my system, 16:9 cropped videos are detected by comskip as having an aspect ration of 1.9600.
(Erik, why is that so?).

This value can only be set by trial and error. 1.9600 works on my setup but YMMV so you need to run a test. Take a known widescreen mpg and run comskip. Look in the comskip log file for the value that appears in the line Dominant aspect ratio:

For instance, if your log file says Dominant aspect ratio for widescreen is 1.8400, then you need to modify the Set command for Wide in the batch file.

Set Wide=Dominant aspect ratio:      1.9600

Change it to

Set Wide=Dominant aspect ratio:      1.8400

When changing the command Set Wide=xxx, be sure to leave the same spaces or else the detection string won't work

(All the set commands are at the beginning of the batch file HQConvert2Pass.bat).

I have left ver 1.3 until everyone is comfortable with 1.4. Remember, 1.9600 is a point value. There is no arithmetic comparisson for >1.7500 for example. That would be nice but the batch file is using a string comparison.


Good luck

[roxy99]

Just an update. Very soon I'll post a new batch file that employs a smart stretch on 4:3 sources for people with 16:9 widescreen. The new script will stretch 4:3 sources in a non-linear fashion to maintain the correct aspect ratio on the center with gradual stretchin at the ends to eliminate pillar boxes.

[roxy99]

Its now there on page 1. Download version 1.5 and extract all files to c:\Project.

If you are asked weather or not to over-write files in c:\Project answer 'Yes' to all.

Remember to reconfigure your Set commands in HQConver2Pass.bat according to your directories.

That is personalize these directories to your setup

Set CUTDIR=c:\Project\Converted
set CAPDIR=c:\Project\misc
set VDir=c:\VirtualDub
SET WORKDIR=c:\PROJECT
set SDIR=c:\Project\source

In processMPG.bat

FOR %%f IN (c:\Project\Source\*.mpg) DO call HQConvert2pass.bat %%f c:\Project\misc\%%~nf.mpg

Replace c:\Project\Source with your source directory
and C:\Project\Misc with your temp directory (on same physical drive as Source)

PS- If you downloaded 1.5 on March 29, then please redownload today, I fixed a bug.
PPS- BTW, I can't take credit for the resize function. Believe it or not I got it from a Star Wars fan site ( See http://www.originaltrilogy.com/forum...42&STARTPAGE=1. Moth3r is the author of the function.)

[roxy99]

Anyone try the new update yet?

[Apap]

Originally Posted by roxy99

Anyone try the new update yet?

I havent tried the latest update yet but so far this program works great on my SD recordings with stereo mpg audio. It doesnt seem to work with my HD recordings with AC3 audio yet but i saw a post about that.

Does your latest update incorporate the AC3 fix into it or will I have to modify it myself?

Thanks for your excellent work so far. This program rocks and has been just about perfect in commercial removal and the video quality is great!

Apap

[roxy99]

Originally Posted by Apap

I havent tried the latest update yet but so far this program works great on my SD recordings with stereo mpg audio. It doesnt seem to work with my HD recordings with AC3 audio yet but i saw a post about that.

Does your latest update incorporate the AC3 fix into it or will I have to modify it myself?

Thanks for your excellent work so far. This program rocks and has been just about perfect in commercial removal and the video quality is great!

Apap

AC3 is another kettle of fish. If Dgindex produces an AC3, then yes, the program should give the user the choice NOT to make an mp3. However with a batch script program flow is awkward to control. So I may have to make a different batch just for dealing with AC3.

When Dgindex produces a stereo mpa, then the only logical thing to do is make an mp3.

I invite you to modify it yourself if you can in the meantime and please share the modified batch file with us. You would be helping me out alot.