Plugin: Sage Job Queue (SJQ) v3

[ChaOConnor]

Unusual request, but could someone take the current SJQ3 Manual that's posted at Google Docs and save it as a PDF and either post it here or email it to me? I can't access Google Docs due to security restrictions. Thank you!

[Slugger]

Originally Posted by ChaOConnor

Unusual request, but could someone take the current SJQ3 Manual that's posted at Google Docs and save it as a PDF and either post it here or email it to me? I can't access Google Docs due to security restrictions. Thank you!

I won't do this after every doc change, I usually just create the PDF towards end of support b/c I'm always editing/tweaking the docs, but here's a snapshot as of a few moments ago in PDF format. The doc is published as a public web doc so you shouldn't be denied access to it, unless you're behind a corp firewall or something that's restricting access to Google Docs domain?

[ChaOConnor]

Originally Posted by Slugger

I won't do this after every doc change, I usually just create the PDF towards end of support b/c I'm always editing/tweaking the docs, but here's a snapshot as of a few moments ago in PDF format. The doc is published as a public web doc so you shouldn't be denied access to it, unless you're behind a corp firewall or something that's restricting access to Google Docs domain?

Slugger, wouldn't ask you to edit it each time. But thank you for this. Yes, it's a corp policy b/c it see's Google Docs as a web app. Thanks again!

[ohpleaseno]

SJQ looks like a great program. I've been trying to come up with a solution for the following use case. I think SJQ is what I need, but before I go through the hassle of the constant trial and error, I wanted to make sure this was possible to do.

1) Have something monitor my recorded TV folder and look for an existing .edl file.

2) If no .edl file that corresponds to a .mpg, run comskip

3) once that is done, have it monitor for .mpg files with a corresponding .edl file and run Media Shrink to convert to .mkv, but only files recorded in the last 3 days (I have 6 months worth of recordings and am weeding through them manually to convert the keepers and delete the others. if I programatically do it, then I'm wasting CPU cycles on stuff I don't want converted.)

Is this the best program for this or am I better off with DirMon2? DirMon2 was giving me quite a few headaches.

[Slugger]

SJQ can definitely handle exactly what you want to do. Is Dirmon2 better for the task? I can't say, I've never used it, plus I'm a little biased towards SJQ (you know, since I wrote it and all).

[ohpleaseno]

So far I've set up comskip. I'm watching he queue and it seems to take very little time on files that already have an .edl, so I'm assuming that comskip or sjq will recognize that and skip over it? Do I need to put a process condition in there to make it ignore .mpgs with an .edl?

[Slugger]

Originally Posted by ohpleaseno

So far I've set up comskip. I'm watching he queue and it seems to take very little time on files that already have an .edl, so I'm assuming that comskip or sjq will recognize that and skip over it? Do I need to put a process condition in there to make it ignore .mpgs with an .edl?

Yes, you definitely have to tell SJQ to ignore files with edls, otherwise it's just going to reprocess them unnecessarily. Unfortunately, it's 2am in the east and I have meetings at 9am so I can't write many examples right now, but grab the User Guide, look at the examples and then add conditions to them to have SJQ skip recordings with edl files (you'll want to use the FileExists test in conjunction with the media variables to test for the existence of edl files).

Good luck, post questions here if needed. You will probably want to empty the current queue and rework your rules so SJQ isn't running comskip on recordings you've already done it for.

[ohpleaseno]

Found it. Thanks!

Now to add the media shrink and I'm all good!

[evilpenguin]

Originally Posted by ohpleaseno

Found it. Thanks!

Now to add the media shrink and I'm all good!

Here's my setup:

Ruleset: Live Comskip and run Mediashink on any recording older than 30 days

if [IsObjMediaFile == true && $.IsTVFile{} == true && $.IsNotManualOrFavorite{} == false && FileExists != "%d%/%p%.edl" && Filename =$ ".mpg"]
{
   :PRIORITY 10
   COMSKIP
}

if [IsObjMediaFile == true && $.IsTVFile{} == true && MediaAge > "30D" && Filename =$ ".mpg"] 
{
   MEDIASHRINKHQ
}

Client: Run up to 4 Comskips at once all the time and run only one Mediashink only between 2am and 10am Mon-Fri

COMSKIP {
   :RESOURCES 25
   :RETURNCODE 1
   "C:/Program Files/SageTV/SageTV/Comskip_orig/comskip.exe \"--ini=C:\\Program Files\\SageTV\\SageTV\\comskip_orig\\comskip.ini\" \"%c%\""
}

MEDIASHRINKHQ
{
   :CPU "LOW"
   :OFFHOUR "0-2, 10-23"
   :OFFDAY "1, 7"
   :MAX 1
   :RESOURCES 50
   "D:/mediaScraper/mediaShrink.exe \"%c%\""
}

Edit: Fixed some bugs

[Slugger]

@evilpenguin :CPU BELOWNORMAL is not a valid value. "LOW", "NORMAL", "HIGH" (double quoted, case sensitive) are the only valid values. Anything else is reset to "NORMAL".

[ChaOConnor]

Point of clarification as I'm new to SJQ: If I install SJQ Server on my WHS box, do i also install SJQ Client on the WHS box so I can execute those tasks? I could install SQJ Client on my Win 7 box upstairs to do some of the work, but it's not on all the time like the WHS one.

Thanks!

[ohpleaseno]

What can I do to troubleshoot client connections? I'm using the NT service on a WHS and a Win7 box. Both services are active in the control panel.

edit: sorry, hit post too soon.

Both show the service as active in each respective control panel, but only the WHS box shows on the SJQ client list and it isn't getting assigned to a task.

[ohpleaseno]

okay, go this on the WHS client log

HTTP ERROR 500


Problem accessing /sjq/SJQ. Reason:

    Unexpected '?' encountered on line 16
Caused by:

java.lang.RuntimeException: Unexpected '?' encountered on line 16
at com.google.code.sagetvaddons.sjq.server.ClientParser.readTask(ClientParser.java:375)
at com.google.code.sagetvaddons.sjq.server.ClientParser.<init>(ClientParser.java:234)
at com.google.code.sagetvaddons.sjq.server.SJQServlet.doPost(SJQServlet.java:170)
at com.google.code.sagetvaddons.sjq.server.SJQServlet.doGet(SJQServlet.java:95)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:389)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417)
at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534)
at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:864)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:52

[Slugger]

Need to see the client config for that client. It's not liking something on line 16 of the client config.

[ohpleaseno]

Which file, wrapper.conf?

[Slugger]

Nope, the client config. Click on Clients in the GUI, select the client, click Configure, paste the output.

[ohpleaseno]

# Run up to 4 Comskip at a time
COMSKIP {
   :MAX 2
   :RESOURCES 25
   :RETURNCODE 1
   "D:/shares/Software/sage tv/comskip80_027/comskip.exe \"--ini=D:/shares/Software/sage tv/comskip80_027/comskip.ini\" \"%c%\""
}

# Run at most 1 mediashink job from 2am - 10am Monday - Friday
MEDIASHRINKHQ
{
   :CPU NORMAL
   :OFFHOUR "0-2, 14-23"
   :RESOURCES 100
   "D:/shares/Software/sage tv/media shrink/mediaShrink.exe \"%c%\""

This?

[ohpleaseno]

I basically just copied and pasted from EP's and modded it a bit. I guess I modded it into a broken state.

[ohpleaseno]

I just realized that I didn't close the process with a }

here is the latest log

HTTP ERROR 500


Problem accessing /sjq/SJQ. Reason:

    Unexpected '#' on line 1
Caused by:

java.lang.RuntimeException: Unexpected '#' on line 1
at com.google.code.sagetvaddons.sjq.server.ClientParser.<init>(ClientParser.java:241)
at com.google.code.sagetvaddons.sjq.server.SJQServlet.doPost(SJQServlet.java:170)
at com.google.code.sagetvaddons.sjq.server.SJQServlet.doGet(SJQServlet.java:95)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:389)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417)
at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534)
at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:864)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:520)

[Slugger]

Remove the comment on line one, I believe there's a bug that causes a syntax error if line one is a comment.