ComSkip XVid batch HQ 1200 bitrate

[roxy99]

Originally Posted by bobtom

The audio is 192 mp3 and the video is 512x384 29fps xvid

Was it HD sourced?
I just did the 2 hour episode of 24 and 5gb ended up becoming 800mb. I like a ration of 1/5. That's with the HQ version. Try the HQ version and let me know what happens.

[blade]

Originally Posted by bobtom

Hey roxy99 after running your program the mpg file cam out a xvid file larger than the mpg. Ever heard of this?

I read about it on the doom9.net forum awhile back. I don't recall if the thread dealt specifically with Xvid or not just that it was about the converted file being larger than the original.

[roxy99]

Originally Posted by blade

I read about it on the doom9.net forum awhile back. I don't recall if the thread dealt specifically with Xvid or not just that it was about the converted file being larger than the original.

Could be just a bizare anamoly with xvid then.

Bobtom,

Please test some other files and let us know. Then try the HQ 1200 640 x 480 versio to see if the bug is specific only to the 800 bps/512x384 version of the batch file.
(Although I doubt the bug is specific to that 512x384 version of the batch file.)

The HQ 1200 648x480 version produces an avi that is virtually perceivably identical to the source mpg file.

[blade]

Originally Posted by roxy99

Could be just a bizare anamoly with xvid then.

Yeah, it was late and my post wasn't too clear. I've never read about the problem with this program in particular, but rather just the problem in general.

[bobtom]

roxy99 glad to report that everything works perfect. The other file in question was very fuzzy (over the air antenna). Comskip couldn't find the commercials and the transcoder must have been going through hell. Now using cable tv connection and everything works PERFECT! Awesome program man. Perfect quality.

For people who havn't tried this...you need to it removes the commercials and transcodes the video into nice compact avi's. Audio is dead on. So far comskip has been flawless.

[jbilich]

I just did my first conversion and I'm happy to say it went very well. I've been looking for a quick and easy way to convert my SageTV recordings to divx or xvid files, so this was perfect. Thanks a lot Roxy

One quick question...my first conversion was done with a file that was about 30 minutes long (about 1 GB). The entire conversion process took almost exactly an hour (using the HQ batch file). Does it normally take that long for everyone, about 2x the length of the file? I have a pretty new computer with an Athlon Dual Core x2 3800+ if that helps with a time estimate. Thanks for the help.

[roxy99]

Originally Posted by jbilich

I just did my first conversion and I'm happy to say it went very well. I've been looking for a quick and easy way to convert my SageTV recordings to divx or xvid files, so this was perfect. Thanks a lot Roxy

One quick question...my first conversion was done with a file that was about 30 minutes long (about 1 GB). The entire conversion process took almost exactly an hour (using the HQ batch file). Does it normally take that long for everyone, about 2x the length of the file? I have a pretty new computer with an Athlon Dual Core x2 3800+ if that helps with a time estimate. Thanks for the help.

I have an athlon 3200 xp (single processor, 32bit). A one hour episode less commercials results in 42 minutes of avi. The avi alone takes my system just over 1 3/4 hours. Comskip takes 10 minutes, mp3 and remuxing another 10 minutes. So, 1 hr show=> 105min +10min +10min 125min. Hence 2hours.

So I am getting about the same results as you. Granted my cpu is slower but 64bit dual core doesn't you help much with a 32 bit application such as this. Avisynth is not optimized for Athlon 64.

I'd say that sounds about right. More importantly, how do you find the video quality?

[jbilich]

Yeah I figured the dual core wouldn't do much for the speed since it really only improves multitasking. Good to know the conversion time was about the same.

As for the quality...it was pretty good over all. The only thing I noticed was that the video seemed slightly darker than the original SageTV file. I don't know much about any of the programs involved in the conversion so I'm not sure if this is easily tweaked. Let me know if there's anything I can change to fix the slightly darker conversion file. Thanks again!

[davephan]

The ComSkip XVid batch HQ 1200 bitrate scripts are working great on my Windows XP Pro and Windows 2000 Pro computers. The picture quality look very good on my SD 60 inch project TV.

I have two computers working on compressing about 1 TB of Mpeg2 files. A seldomly used computer is working full-time, and my main SageTV computer is working part time. I will be adding a third computer seldomly used computer to work full-time on the compression job. Compressing those video files seems to requre many computer systems to keep up and clean up the backlog!

I would like to set the priority to as low as possible on my main SageTV Windows XP Pro computer. I can set it while it runs to low prority, but the next time I run it again, it is back to normal proriity. Does anyone know of a way to make the priority always low without having to change the priority level each time the scripts are run?

Dave

[jan smit]

I am presently not using this program any more but if I remember right you should (in HQProcessMpg.bat) replace "HQConvert2pass.bat" replace by:
start "conversion" /low /wait "C:\Project\HQConvert2pass.bat"

jan

[bobtom]

Jan why not?

[bobtom]

If anybody wants to normalize their audio I have a simple solution. Assuming that you have roxy99's Convert scripts working all you have to do is:
1. Download normalize, "an audio file volume normalizer".
2. Extract the file into your C:\Project folder
3. Edit your Convert2Pass.bat file(Just type in the bold parts.):

set NL="%WORKDIR%\normalize.exe"
set DG="%WORKDIR%\DGIndex.exe"
set LM="%WORKDIR%\Lame.exe"
Set WV="%WORKDIR%\Wavemp3.exe"
set COMSKIP="%WORKDIR%\comskip.exe"
set VDUB="C:\VirtualDub\vdub.exe"
Set DC="%WORKDIR%\delaycut.exe"
Set BS="c:\Besweet\BeSweet.exe"
SET AVIWAV="%WORKDIR%\AVI2WAVCMD.exe"

%NL% "%CAPDIR%\%~n2.wav"
%LM% --preset cbr 192 "%CAPDIR%\%~n2.wav" "%CAPDIR%\%~n2.mp3"
%WV% -q "%CAPDIR%\%~n2.mp3"

Now the sound will be nice and level. No more super loud or super quiet parts in TV shows or movies.

[roxy99]

Originally Posted by bobtom

If anybody wants to normalize their audio I have a simple solution. Assuming that you have roxy99's Convert scripts working all you have to do is:
1. Download normalize, "an audio file volume normalizer".
2. Extract the file into your C:\Project folder
3. Edit your Convert2Pass.bat file(Just type in the bold parts.):

set NL="%WORKDIR%\normalize.exe"
set DG="%WORKDIR%\DGIndex.exe"
set LM="%WORKDIR%\Lame.exe"
Set WV="%WORKDIR%\Wavemp3.exe"
set COMSKIP="%WORKDIR%\comskip.exe"
set VDUB="C:\VirtualDub\vdub.exe"
Set DC="%WORKDIR%\delaycut.exe"
Set BS="c:\Besweet\BeSweet.exe"
SET AVIWAV="%WORKDIR%\AVI2WAVCMD.exe"

%NL% "%CAPDIR%\%~n2.wav"
%LM% --preset cbr 192 "%CAPDIR%\%~n2.wav" "%CAPDIR%\%~n2.mp3"
%WV% -q "%CAPDIR%\%~n2.mp3"

Now the sound will be nice and level. No more super loud or super quiet parts in TV shows or movies.

Its even easier than that to normalize and no download is needed. Scroll down to the line in the main batch file where you see the avisynth lines. Look for the line that sets the audio parameter. At the end of the line, add .Normalize()

[roxy99]

Originally Posted by roxy99

Its even easier than that to normalize and no download is needed. Scroll down to the line in the main batch file where you see the avisynth lines. Look for the line that sets the audio parameter. At the end of the line, add .Normalize()

Actually try changing:

set AVISYNTH5=audio = WAVSource(...)

To

set AVISYNTH5=audio = WAVSource(...).Normalize(.98)

[roxy99]

Originally Posted by jbilich

Yeah I figured the dual core wouldn't do much for the speed since it really only improves multitasking. Good to know the conversion time was about the same.

As for the quality...it was pretty good over all. The only thing I noticed was that the video seemed slightly darker than the original SageTV file. I don't know much about any of the programs involved in the conversion so I'm not sure if this is easily tweaked. Let me know if there's anything I can change to fix the slightly darker conversion file. Thanks again!

You will need to use the tweak plugin (see http://neuron2.net/tweak/tweak.html, download and extract dll into C:\Project).

The following modifications in bold are then needed in the batch file

setlocal
:
:
set AVISYNTH4=LoadPlugin("%WORKDIR%\MSharpen.dll")
set AVISYNTH41=LoadPlugin("%WORKDIR%\Tweak.dll")
set AVISYNTH5=audio = WAVSource("%CAPDIR%\%~n2.wav")
:
:
echo %AVISYNTH4% >>"%CAPDIR%\%~n2.avs"
echo %AVISYNTH41% >>"%CAPDIR%\%~n2.avs"
:
:
rem 4:3 screen
echo Video=MPEG2Source("%CAPDIR%\%~n2.d2v").Crop(6, 6, -6, -6).LeakKernelDeint(1,10,false,false,false,false,false,0).LanczosResize(624,464).MSharpen(20,130).Tweak(0,0,20,0) >>"%CAPDIR%\%~n2.avs"
:
:
endlocal

[davephan]

The MPEG2 to AVI batch files have been working great for weeks. The quality seems to be very close to the orginal.

The main problem is the very high CPU load to transcode the video files. This problem can be solved by running multiple computers dedicated to transcoding video files.

I now have 3 older computers working full time trancoding files. The slowest is a Pentium 3 with about 300 MHz CPU, and the fastest an Athlon XP+1800. I also use my SageTV computer as a fourth computer part time, which has an Athlon XP+2800. I have converted just about 1 TB of files so far. The slowest computer sometimes takes a day to convert a long movie file. Therefore, it might not be worth it to try to use a computer that is too slow. I might logging in the scripts to get more specific numbers on how long it takes to run on various computers.

I think that may one or two fairly high-end computers dedicated to transcoding video files could keep up with the new programs that are recorded.

Dave

[roxy99]

Originally Posted by davephan

The MPEG2 to AVI batch files have been working great for weeks. The quality seems to be very close to the orginal.

The main problem is the very high CPU load to transcode the video files. This problem can be solved by running multiple computers dedicated to transcoding video files.

I now have 3 older computers working full time trancoding files. The slowest is a Pentium 3 with about 300 MHz CPU, and the fastest an Athlon XP+1800. I also use my SageTV computer as a fourth computer part time, which has an Athlon XP+2800. I have converted just about 1 TB of files so far. The slowest computer sometimes takes a day to convert a long movie file. Therefore, it might not be worth it to try to use a computer that is too slow. I might logging in the scripts to get more specific numbers on how long it takes to run on various computers.

I think that may one or two fairly high-end computers dedicated to transcoding video files could keep up with the new programs that are recorded.

Dave

Hey dude you got like a factory going! Kewl.
What my next step is to do what you're doing with only one 600mhz pc running fulltime. I'm planning to setup dirmon2 and modify that batch so that dirmon2 triggers the batch based on detecting new files added. I record about 15 hours of TV a week. Assume also that I will watch 15 hours per week. That is 30 hours out of 168 hours per week that Sage is running. In reality its less than 30hours because often I am watching a recording while another channel is recordinging. This means I have at least 138 hours per week of idle PC time. So What I plan to do is copy-paste files to the transcoding pc on a scheduled basis when Sage is idle using dirmon2 and allowing the transcoding pc to run.

So there is plenty of Idle

[davephan]

After successfully transcoding many 4 x 3 files, I tried transcoding 16 x 9 files. The process fails just after the DIndex.exe part completes.

The only change I made was to part of the HQConvert2Pass.bat file:

rem 4:3 screen
REM Video=MPEG2Source("%CAPDIR%\%~n2.d2v").Crop(6, 6, -6, -6).LeakKernelDeint(1,10,false,false,false,false,false,0).LanczosResize(624,464).MSharpen(20,130) >>"%CAPDIR%\%~n2.avs"
REM Widescreen
echo Video=MPEG2Source("%CAPDIR%\%~n2.d2v").Crop(6, 60, -6, -60).LeakKernelDeint(1,10,false,false,false,false,false,0).LanczosResize(624,352).MSharpen(20,130) >>"%CAPDIR%\%~n2.avs"


To switch from 4 x 3 to 16 x 9, I remarked the 4:3 section and unremarked the 16:9 section.

Is there anything else that needs to be changed to make the process work with 16 x 9 mpeg2 files?


Dave

[roxy99]

Originally Posted by davephan

After successfully transcoding many 4 x 3 files, I tried transcoding 16 x 9 files. The process fails just after the DIndex.exe part completes.

The only change I made was to part of the HQConvert2Pass.bat file:

rem 4:3 screen
REM Video=MPEG2Source("%CAPDIR%\%~n2.d2v").Crop(6, 6, -6, -6).LeakKernelDeint(1,10,false,false,false,false,false,0).LanczosResize(624,464).MSharpen(20,130) >>"%CAPDIR%\%~n2.avs"
REM Widescreen
echo Video=MPEG2Source("%CAPDIR%\%~n2.d2v").Crop(6, 60, -6, -60).LeakKernelDeint(1,10,false,false,false,false,false,0).LanczosResize(624,352).MSharpen(20,130) >>"%CAPDIR%\%~n2.avs"


To switch from 4 x 3 to 16 x 9, I remarked the 4:3 section and unremarked the 16:9 section.

Is there anything else that needs to be changed to make the process work with 16 x 9 mpeg2 files?


Dave

Therefor its failing at the besweet mpa to wav conversion. The 16:9 still requires a regular non-HD 4:3 source which happens to have wide black bars on top and bottom. So its essentially just cropping the black bars off a 4:3 letterboxed source and converting it to a 16:9 Divx.

The only reason I can think of its failing other than if you're feeding it HD is that your video source includes a Dolby digital audio stream. This will cause Besweet to crash since at presents its designed to expect a stereo mpa stream. In order for the batch to accept digital audio I would need to modify it for your needs. Please confirm if your audio stream is digital.

[grauchy]

What if I've already run comskip earlier? What changes should be made to the batch file to NOT run comskip because I already have a comskip file.