Utility: MediaShrink v3.0 - An HTPC focused encoder

[nyplayer]

Originally Posted by coppit

Questions:
- that's equivalent to using the "rescan imported media" menu item under setup, right?
- it also requires that I install jetty or one of the other plugins, right?

I manually did the "rescan imported media" and still ended up with my encoded recordings moved from the recordings section to the videos section.

I think I figured it out. I did an experiment where I did this:
- I copied the file, changed the extension to mkv, then used "touch" to make sure it had the same timestamp.
- I copied the file, changed the extension to mkv, used "touch" to make sure it had the same timestamp, removed the show ID, and inserted spaces between the words in the name.
- I put the letter "s" in the middle of the show ID in name of the original mpg file.

All three worked, so apparently the timestamp is what SageTV uses to identify the recording.

The timestamp is not what Sage uses to Identify a recording it use the ID of the file. By touching it or changing the name what you did was force Sage to rescan the file.

Here is a batchjob that I use I make sure that the CMT plugin has created a properties file. It has never failed me. What I did was download the latest HandBrake which uses constant quality which is better than bitrate. I copied the Handbrake files into "%shrinkpath%\mediaEngineBins\HandBrake 9.4"

set shrinkpath=C:\MediaShrink

if exist "%~d1%~p1%~n1.tmp" copy "%~f1.properties" "%~d1%~p1%~n1.mkv.properties"
if exist "%~d1%~p1%~n1.tmp" del "%~f1"
if not exist "%~f1" if exist "%~d1%~p1%~n1.tmp" move "%~d1%~p1%~n1.tmp" "%~d1%~p1%~n1.mkv"
if exist "%~d1%~p1%~n1.tmp" exit 1
if exist "%~d1%~p1%~n1.mkv" exit 0
move "%~f1" "%~d1%~p1"
set checkuse=%ERRORLEVEL%
if %checkuse% NEQ 0 exit 1
if exist "%~f1.properties" findstr.exe /I /C:"CMT Metadata" "%~f1.properties"
set CMTERR=%ERRORLEVEL%
if %CMTERR% NEQ 0 exit 1
if not exist "c:\temp" md "c:\temp"
if exist "%~d1%~p1tmpEncode\%~n1.encoded.mkv" del "%~d1%~p1tmpEncode\%~n1.encoded.mkv"
md "%~d1%~p1tmpEncode"
cd "%shrinkpath%\mediaEngineBins\HandBrake 9.4"
c:
start /BELOWNORMAL /I /B /W HandBrakeCLI.exe -i "%~f1" -o "%~d1%~p1tmpEncode\%~n1.encoded.mkv"  --preset "Normal" -w 720
set shrinklevel=%ERRORLEVEL%
if %shrinklevel% NEQ 0 DEL "%~d1%~p1tmpEncode\%~n1.encoded.mkv"
if %shrinklevel% NEQ 0 EXIT %shrinklevel%
if %shrinklevel% EQU 0 if exist "%~d1%~p1tmpEncode\%~n1.encoded.mkv" move "%~d1%~p1tmpEncode\%~n1.encoded.mkv" "%~d1%~p1tmpEncode\%~n1.mkv"
if %shrinklevel% EQU 0 if exist "%~d1%~p1tmpEncode\%~n1.mkv" "%shrinkpath%\mediaEngineBins\touch.exe"  -r "%~f1" "%~d1%~p1tmpEncode\%~n1.mkv"
if %shrinklevel% EQU 0 move "%~d1%~p1tmpEncode\%~n1.mkv" "%~d1%~p1"
if %shrinklevel% EQU 0 if exist "%~d1%~p1%~n1.mkv" copy "%~f1.properties" "%~d1%~p1%~n1.mkv.properties"
if %shrinklevel% EQU 0 if exist "%~d1%~p1%~n1.mkv" DEL "%~f1"
if exist "%~f1" move "%~d1%~p1%~n1.mkv" "%~d1%~p1%~n1.tmp"
if exist "%~f1" exit 1
"%shrinkpath%\mediaEngineBins\wget.exe" --delete-after --tries=3 --directory-prefix="C:\MediaShrink\mediaEngineBins" "http://user:password@servername:8080/sage/GlobalCommand?command=UpdateMediaLibrary"
if exist "%~d1%~p1%~n1.mkv" exit 0

[coppit]

Thanks nyplayer, but that's not working for me. I wonder if it's because my recordings are on a network drive that's Linux underneath?

Anyway, MediaShrink does the right thing (somehow), so I guess I'll stick with that.

Question: My bat file command has these options:

start "MediaShrink" /B /LOW /WAIT mediaShrink.exe %COMMAND% /handbrakeProfile "Normal" /inPlace /vProfile HQ /xRes 1280 /decomb /autoCrop /acodec lame /cutComm

However, my videos are still coming out 1920x1080, interlaced, with AAC audio. Does anyone know what the issue might be? I replaced the handbrakecli.exe binary, if that matters.

I've attached part of an autoencode log for an encoding that's going on right now. I don't see options being passed to handbrake.

[nyplayer]

Originally Posted by coppit

Thanks nyplayer, but that's not working for me. I wonder if it's because my recordings are on a network drive that's Linux underneath?

Anyway, MediaShrink does the right thing (somehow), so I guess I'll stick with that.

Question: My bat file command has these options:

start "MediaShrink" /B /LOW /WAIT mediaShrink.exe %COMMAND% /handbrakeProfile "Normal" /inPlace /vProfile HQ /xRes 1280 /decomb /autoCrop /acodec lame /cutComm

However, my videos are still coming out 1920x1080, interlaced, with AAC audio. Does anyone know what the issue might be? I replaced the handbrakecli.exe binary, if that matters.

I've attached part of an autoencode log for an encoding that's going on right now. I don't see options being passed to handbrake.

In my testing I had problems with /handbrakeProfile "Normal" I just removed it for some reason it would disable all the other commands. By default it should use the normal.

PS if you updated to the latest HandBrakeCli you need to make the change in the post below.
http://forums.sagetv.com/forums/show...&postcount=204

[DarkWolf77]

So I have a new tuner (the HD Homerun), and found that the recordings, though they look great, are huge files, so I decided to start using mediashrink again to get them shrunken down to a more manageable size and let it play more nicely with my streaming devices as an added bonus. However, for some reason with Sage v9, I found that Sage deletes the transcoded files for some reason if I use mediashrink with the /inplace option. It sees the old file is gone then decides to delete the new one as well. Here are the logs:

Mon 8/1 14:37:00.747 [PluginEventQueue@13a4530] CD: sageEvent: MediaFile cleanup successful Channel 10-1
Mon 8/1 14:37:11.162 [ThreadMonitor@a614a4] Top 10 Cumulative CPU(sec) PooledThread:24 16197998@qtp-27218321-2:22 13425866@qtp-27218321-7:12 XcodeStderrConsumer:10 main:5 PooledThread:2 Timer-4:1 Seeker:1 LuceneShowTransactionTask:1 LucenePersonTransactionTask:1
Mon 8/1 14:37:11.163 [ThreadMonitor@a614a4] Top 10 %CPU (last 300s) 16197998@qtp-27218321-2:2% XcodeStderrConsumer:1%
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.aspects
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.autoEncode.(1).log
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.edl
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.log
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.logo.txt
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.mp4

Any ideas for workarounds for this?

[BobPhoenix]

Originally Posted by DarkWolf77

So I have a new tuner (the HD Homerun), and found that the recordings, though they look great, are huge files, so I decided to start using mediashrink again to get them shrunken down to a more manageable size and let it play more nicely with my streaming devices as an added bonus. However, for some reason with Sage v9, I found that Sage deletes the transcoded files for some reason if I use mediashrink with the /inplace option. It sees the old file is gone then decides to delete the new one as well. Here are the logs:

Mon 8/1 14:37:00.747 [PluginEventQueue@13a4530] CD: sageEvent: MediaFile cleanup successful Channel 10-1
Mon 8/1 14:37:11.162 [ThreadMonitor@a614a4] Top 10 Cumulative CPU(sec) PooledThread:24 16197998@qtp-27218321-2:22 13425866@qtp-27218321-7:12 XcodeStderrConsumer:10 main:5 PooledThread:2 Timer-4:1 Seeker:1 LuceneShowTransactionTask:1 LucenePersonTransactionTask:1
Mon 8/1 14:37:11.163 [ThreadMonitor@a614a4] Top 10 %CPU (last 300s) 16197998@qtp-27218321-2:2% XcodeStderrConsumer:1%
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.aspects
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.autoEncode.(1).log
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.edl
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.log
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.logo.txt
WARN - File deleted: E:\SageTV\20495_10-1_0801_1431-0.mp4

Any ideas for workarounds for this?

Based on the files deleted it looks like you have Commercial Detector setup and that is deleting your files. When you use MediaShrink you could disable it and then enable it after your done with MediaShrink as a work around. Also check that you have .mp4 configured in Commercial Detector as a media file it looks like you don't and just correcting that may fix your problem. At least I think that is a configurable option in Commercial Detector anyway.

[DarkWolf77]

Yeah that was my first thought too, so I ran it by tmiranda, and he said that it looked like something in the Sage core was doing it, and not CD. (Refer:
Comskip Detector deleting converted recordings)

[BobPhoenix]

Originally Posted by DarkWolf77

Yeah that was my first thought too, so I ran it by tmiranda, and he said that it looked like something in the Sage core was doing it, and not CD. (Refer:
Comskip Detector deleting converted recordings)

Sage does NOT delete anything but media files as far as I know. Now Sage could have deleted the media file and then CD deleted the now orphaned other files but based on the order in your post the media file MP4 was the last file to be deleted. So unless you have something else (maybe mediashink itself) deleting files other than the media file it has to be CD doing the non media files at least.

Is this being done on files in a recording folder? If so I would move them to an imported folder FIRST before trying to shrink them. Then the media files should be safe from anything in the core. It only deletes things from recording folders - again as far as I know.

[DarkWolf77]

Originally Posted by BobPhoenix

Sage does NOT delete anything but media files as far as I know. Now Sage could have deleted the media file and then CD deleted the now orphaned other files but based on the order in your post the media file MP4 was the last file to be deleted. So unless you have something else (maybe mediashink itself) deleting files other than the media file it has to be CD doing the non media files at least.

Is this being done on files in a recording folder? If so I would move them to an imported folder FIRST before trying to shrink them. Then the media files should be safe from anything in the core. It only deletes things from recording folders - again as far as I know.

Yeah, the recordings folder. Strangely, I remember it worked fine a while ago then started doing this at some point after moving to v9, but who knows what actually caused it since a lot has changed on the system since then. (v9 isn't the only change).

[phelme]

I'm still using MediaShrink along with SJQ. I happened to look in my MediaShrink folder today and I found thousands of files that have names that start with OCL. Something like this:

OCL4EB2.tmp
OCL2B30.tmp
OCLE82A.tmp

etc.

There appears to be one created for each time I run MediaShrink (I have SJQ compress all new recordings ever night just because). These files are all 0 bytes in size. Based on file dates this started happening back in March of this year. I don't remember changing anything myself to cause this.

Any idea what's creating these? OCL seems very specific to something. Thx.