(Old) MediaShrink - An HTPC focused encoder

[evilpenguin]

Ok, the

------
------

Was what I needed to see, looks like ffmpeg isn't returning any video format data. So you're saying there was a time that this succeeded via SJQ? Have you done any SJQ client/server changes recently?

[ohpleaseno]

no. i'm on 655. what version are you on?

it worked the other day on 655 when the client was on teh same box as the server. i had a win7 box that this behavior happened on for whole time I've been running this. let me update sjq and try again.

[evilpenguin]

Is your SJQ client running on the same box as the server? If so is it a service, if not, what exactly does your setup look like?

[ohpleaseno]

for now, it is running on the same box as the server (my WHS) as a service logging in with the admin password. by "for now" i mean that i eventually want to also run it on my main pc overnight once i get the first client settled.

[evilpenguin]

Originally Posted by dgschoel

Using drag and drop I am also getting video not found.
Attached is a log with using your extra debugging media engine.

That's something completely different, it looks like a problem specific to that video. Try running it through again and while its working going into the work folder and deleting the 'delete.me' file. That will tell mediaShrink to save the logs.

Once it fails open up the handbrake log and see if you can find the error you're getting.

[ohpleaseno]

There are about 12 other recordings doing the same thing though. Here is another.

 Welcome to mediaEngine v2.0 (Built on 17:39:35.64 12-02-2009 )
 Staring Proccesing at 21:07:44 12-2-2009

  + Executable   : D:\shares\Software\sagetv\mediashrinkv2\mediaEngine.exe
  + EXE path     : D:\shares\Software\sagetv\mediashrinkv2
  + Parsing switches
    - optionsString: "/saveLog" "/defaultProfile" "autoEncode" "/findFileRegEx" "avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms" "/inplace
" "/mediaShrink" "fixBug" "\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg" "/inplace" "/batch" "/highProfile" 
        - Replacing quote0: /saveLog
        - Replacing quote1: /defaultProfile
        - Replacing quote2: autoEncode
        - Replacing quote3: /findFileRegEx
        - Replacing quote4: avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms
        - Replacing quote5: /inplace

        - Replacing quote6: /mediaShrink
        - Replacing quote7: fixBug
        - Replacing quote8: \\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg
        - Replacing quote9: /inplace
        - Replacing quote10: /batch
        - Replacing quote11: /highProfile
    - Adding to to options Hash
      + Key: saveLog
    - Adding to to options Hash
      + Key: defaultProfile
      + Value: autoEncode
    - Adding to to options Hash
      + Key: findFileRegEx
      + Value: avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms
    - Adding to to options Hash
      + Key: inplace
    - Adding to to options Hash
      + Key: mediaShrink
      + Value: fixBug
    - Adding Inputfile: \\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg
    - Adding to to options Hash
      + Key: inplace
    - Adding to to options Hash
      + Key: batch
    - Adding to to options Hash
      + Key: highProfile

------------------Profiles--------------------
  + Looking for profiles file...
   - Found = D:\shares\Software\sagetv\mediashrinkv2\mediaEngineProfiles
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineProfiles (profile|func|snip|output|scrape)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineProfiles\encodingProfiles (profile|func|snip|output|scrape)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineProfiles\scrapingProfiles (profile|func|snip|output|scrape)
  + Reading Profiles (36)
    - Found 3 Profiles
  + Seraching for avaialble binaries
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineProfiles (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineProfiles\encodingProfiles (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineProfiles\scrapingProfiles (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\Comskip (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\Curl (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff\ffmpeg (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff\ffmpeg\compiling (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff\libAften (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff\libFlac (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff\libMatrix (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff\libSsrc (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff\libSsrc\Sources (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\legal stuff\r8brain (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\plugins (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\ffmpeg (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\ffmpeg\FFmpeg-svn-16596 (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\ffmpeg\FFmpeg-svn-16596\docs (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\HandBrake 9.4 (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\HandBrake 9.4\doc (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\data (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\doc (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\doc\images (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\examples (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale\de (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale\de\LC_MESSAGES (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale\ja (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale\ja\LC_MESSAGES (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale\zh_CN (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale\zh_CN\LC_MESSAGES (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale\zh_TW (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\locale\zh_TW\LC_MESSAGES (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mp4box (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311 (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\codecs (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\docs (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\fonts (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\fonts\conf.avail (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\fonts\conf.d (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\mplayer (exe)
    - Scanning Directory: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\tsMuxeR (exe)
      + ccextractorwin.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\ccextractorwin.exe
      + edl2vprj.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\edl2vprj.exe
      + mp4creator.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mp4creator.exe
      + mtee.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mtee.exe
      + touch.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\touch.exe
      + wget.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\wget.exe
      + comskip.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\Comskip\comskip.exe
      + curl.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\Curl\curl.exe
      + eac3to.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\eac3to\eac3to.exe
      + ffmpeg.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\ffmpeg\ffmpeg.exe
      + ffmpeg_SVN.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\ffmpeg\FFmpeg-svn-16596\ffmpeg_SVN.exe
      + HandBrakeCLI.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\HandBrake 9.4\HandBrakeCLI.exe
      + mkvextract.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\mkvextract.exe
      + mkvinfo.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\mkvinfo.exe
      + mkvmerge.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\mkvmerge.exe
      + mkvpropedit.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\mkvpropedit.exe
      + mmg.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mkvtoolnix\mmg.exe
      + MP4Box.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\mp4box\MP4Box.exe
      + mencoder.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\mencoder.exe
      + mplayer.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\mplayer.exe
      + vfw2menc.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\MPlayer-rtm-svn-28311\vfw2menc.exe
      + tsMuxeR.exe	: D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins\tsMuxeR\tsMuxeR.exe
  + Seraching for input files (avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms)
    - Found File: (\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg)
------------ Processing ----------------
  + Adding per run options: (/inputFile "\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg" /profile autoEncode)(/inputFile "\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg" /profile autoEncode)
    + Parsing switches
      - optionsString: /inputFile "\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg" /profile autoEncode
        - Replacing quote0: \\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg
      - Adding to to options Hash
        + Key: inputFile
        + Value: \\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg
      - Adding to to options Hash
        + Key: profile
        + Value: autoEncode
  + Processing: inputFile = ThisOldHouse-NewtonCentreProject-1251091-0
  + Looking for profile: autoEncode
    - Found "autoencode"
  + Making Work Directory: (mkdir "\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.workFolder)
    - Making delete.me file: (\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.workFolder\delete.me)
    - Adding temp dir to delete list(\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.workFolder)
  + Using Options
     - batch()
     - binfolder(D:\shares\Software\sagetv\mediashrinkv2\mediaEngineBins)
     - defaultprofile(autoEncode)
     - exepath(D:\shares\Software\sagetv\mediashrinkv2)
     - findfileregex(avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms)
     - highprofile()
     - inplace()
     - inputfile(\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg)
     - inputmain(\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg)
     - mediaenginebins(HASH(0x134cf44))
     - mediashrink(fixBug)
     - numcommands(1)
     - original(\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg)
     - passlogfile(\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.workFolder\passLogFile.log)
     - path(D:\shares\Software\sagetv\mediashrinkv2)
     - profile(autoEncode)
     - profilefolder(D:\shares\Software\sagetv\mediashrinkv2\mediaEngineProfiles)
     - quote(")
     - savelog()
     - scratchname(ThisOldHouse-NewtonCentreProject-1251091-0.scratch)
     - scratchpath(\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.workFolder)
     - thetvdbapikey(5645B594A3F32D27)
     - usingcommands(ARRAY(0x8b11ec))
     - usingprofile(autoencode)
     - usingtargets(ARRAY(0x134c03c))
     - workdir(D:\shares\Software\sagetv\mediashrinkv2)
  + Getting Video Info: (\\SERVER\RECORDED TV\ThisOldHouse-NewtonCentreProject-1251091-0.mpg)(667744)
------
------
  ! Unable to detect video info, skipping to next video

[ohpleaseno]

nevermind, you weren't replying to me

[evilpenguin]

Originally Posted by ohpleaseno

nevermind, you weren't replying to me

No worries, I know you've got an issue. Now that I know where the issue is i'll try and crank out a better debugging tool for you some time later this week. On you're end you could try running SJQ Client not as a service and seeing if that helps (check the SJQ manual for details).

[ohpleaseno]

same result in non-service mode.

i'll drag/drop the few things that i definitely want to get done now anyway. i need the space back from the National Parks series I haven't watched yet. they're 13gigs each, so it will take a few days to get those done anyway.

[ohpleaseno]

you're positive it is a mediashrink and not a SJQ issue?

[evilpenguin]

I'm pretty sure its a SJQ issue, but I need to do some digging to see exactly what's happening.

[ohpleaseno]

is your recorded tv folder in sage set up as a network drive or a direct drive letter path or \\localhost?

[ChaOConnor]

Originally Posted by evilpenguin

Do you really want to rename your shows once you've encoded them? I prefer to leave them named as they are so Sage will still track them as the original recordings.

My reason is this: I record a lot of kid's shows, and after they're watched, I generally like putting them into my TV folder. My setup is on my WHS is:
\\Videos\SageTV (this is where recordings go)
\\Videos\Movies (stuff I've ripped)
\\Videos\TV (stuff I've ripped)

I wanted to compress the kid shows and put them in the TV folder because I've ripped other episodes of said mentioned shows. Basically it's just to keep everything together that's related.

Is there a better way to organize this?

[Slugger]

Since upgrading to the latest version, when I call mediaShrink via an SJQ command line, the task immediately finishes with a return code of 0 (so SJQ marks it as successful) and this is the output captured by SJQ:

Fri Dec 04 16:23:18 EST 2009: Starting task with priority 1/1/10
Executing command line: C:/mediashrink/mediashrink.exe "D:\tv\NightCourt-AttachmentsIncluded-1199775-0.mpg" /batch /onePass
Executing command: "C:\mediashrink\mediaEngine.exe"  /saveLog /defaultProfile autoEncode /findFileRegEx "avi|mpg|mkv|mp4|mpeg|VIDEO_TS|ts|ogm|divx|mpts|dvr-ms" /mediashrink fixBug "D:\tv\NightCourt-AttachmentsIncluded-1199775-0.mpg" "/batch" "/onePass"
Exiting Code: (0)

NOTE: First two lines above are generated by SJQ, the other two were captured from the output of mediaShrink.

But no mkv is created and in the recording dir sits an ERR file with this content:

  ! Unable to detect video info, skipping to next video

Dragging the file onto mediaShrink manually seems to be working fine. Any ideas?

Thanks.

Just noticed someone else has reported the same issue; posting anyway since I've got some extra output that may or may not be useful?

[evilpenguin]

Interesting, I'm on Server 661 with 665 non-service and i'm not having any issues. I was gonna do a SJQ upgrade this weekend to see what's happening, but my first guess is that somehow the file handles are getting messed up and STDOUT is getting redirected away from mediaShrink (video info is read off of STDOUT, but its coming back empty right now even though the fffmpeg command always has output, even when it fails).

Have you made any SJQ changes recently that might have caused this?

[Slugger]

Nope, the task client hasn't changed in weeks... and that's what triggers the command and deals with the output received.

[evilpenguin]

Just checking, i'll do some debugging this weekend.

[Slugger]

Would it be possible to add an option to specify the working directory but still have it copy the final mkv back to where it found the original file?

Most of the files I'll be transcoding are already copied to my unRAID NAS and the write perf of it isn't great, I think I'd see a significant time improvement if mediaShrink did its work on the local drive then copied the final mkv back to the NAS (reading from the NAS is fine, the writes aren't b/c of how unRAID does its parity writes). So if I'm passing \\nas\tv\show.ts I'd like to be able to tell mediaShrink to do all its work on the local D: then copy show.mkv back to \\nas\tv\ when it's done.

Also, I've added the internal task _RELINK to SJQ that will relink the airing info from the source recording to the newly created mkv file automatically without the need to trigger a media scan and hoping Sage does what you want it to. I haven't committed the changes yet as I'm waiting for a fix for the bug above so I can give the complete process a test before releasing it in a snapshot build of SJQ. However, I've been running it for a couple days and it's doing quite nicely.

[razrsharpe]

Originally Posted by Slugger

Would it be possible to add an option to specify the working directory but still have it copy the final mkv back to where it found the original file?

unless I am misunderstanding your question the switch you want is /centralWorkFolder

mediashrink.exe %VIDFILE% %OTHERSWITCHES% /centralWorkFolder %PATHTOWORKFOLDER%

add /inPlace to replace the original file with the new one at completion

PS... just checked the usage post (2nd post of this thread) and did not see the /centralWorkFolder switch documented there

[Slugger]

That's perfect. Didn't see that option documented. Tried --help and -help and -h and nothing would dump the supported args. That would also be helpful.