Plugin: Sage Job Queue (SJQ) v3

[razrsharpe]

Originally Posted by woribhabor

Am i writing something wrong? Its the title that the debugger keeps telling me it fails on. Is there a different title variable for DVD's? Also where would i find a list of variables/functions such as $.GetShowTitle

Try GetMediaTitle instead of GetShowTitle. All the functions are documented in the sagetv api. I believe slugger as implemented the MediaFile, Airing, and Show API methods (maybe some others).

[Slugger]

razrsharpe is right, all the method calls come from the Sage API. More details are in the user guide as to which APIs are exposed, etc. (it's all in the "available tests" section of the SJQv3 guide). I think for DVDs you're going to have to use the MediaTitle test or maybe even the subtitle, not sure.

[ewelin]

Items not getting added to the queue. I noticed today that my queue was empty. I then was goign to watch a recent recording and it had not been processed by comskip. Upon further investigation it appears that SJQ isn't adding anything to the queue anymore. If I restart my computer, SJQ will run as expected and will add items to the queue, but it doesn't update. I even tried manually running the MediaFileQueueLoader and nothing. Any suggestions on where I can start to resolve this issue.

[Slugger]

Logs... look for exceptions in the server logs (sjq.log in root sagetv install dir). It sounds like the SJQ server is crashing, but hard to confirm that based on your provided description alone. Do jobs stop queuing or do jobs queue up, but are never run (i.e. stuck in waiting state)? If the former then look in sjq.log for exceptions. If the latter, then look in the task client logs to see if the task client is the crashing.

[lanmat]

Some (hopefully) quick questions which are kind of getting in the way of me troubleshooting other issues still:

1)I'd like to clear out the server log, but can't when the SageTV service is running. I stop the service, but then after pressing 'clear logs', the message at the top is red and says "Log deletion:". So I try reloading the page and it asks for my password, but then says "Invalid password". Once I start the SageTV service again, I can log in but the server log is the same as it started. GOTO 1)

2) It seems like even though I've installed (to the best of my abilities) the NT SJQTaskClient service, rebooting finds it's not started up automatically. It's listed in the 'services' tab in msconfig, but not the 'startup' tab, even though it's startup type is set to 'Automatic' under computer management\services . And periodically, I click on the client tab and see no clients. I try 'net start' but it says it's already started. Net stop then net start again seems to pop it back in the Client list.

[Slugger]

Originally Posted by lanmat

Some (hopefully) quick questions which are kind of getting in the way of me troubleshooting other issues still:

1)I'd like to clear out the server log, but can't when the SageTV service is running. I stop the service, but then after pressing 'clear logs', the message at the top is red and says "Log deletion:". So I try reloading the page and it asks for my password, but then says "Invalid password". Once I start the SageTV service again, I can log in but the server log is the same as it started. GOTO 1)

You have stop SageTV then go to the root install dir and delete the sjq.log file if you want to wipe the logs out completely. The log4j package locks the log file while SJQ is running and therefore I have no way to prune/purge/delete the log file unless SageTV is stopped (and you, of course, have to delete the file manually). You get all the errors because once you stop SageTV then you also have implicitly stopped Jetty, which means you've stopped SJQ and so any actions in the web browser will fail because the web server is no longer running to respond to those actions.

2) It seems like even though I've installed (to the best of my abilities) the NT SJQTaskClient service, rebooting finds it's not started up automatically. It's listed in the 'services' tab in msconfig, but not the 'startup' tab, even though it's startup type is set to 'Automatic' under computer management\services . And periodically, I click on the client tab and see no clients. I try 'net start' but it says it's already started. Net stop then net start again seems to pop it back in the Client list.

This will happen if the task client starts before the SJQ server. In this case the task client will fail to connect to the server (since it hasn't started yet) and will then try again in 5 minutes. The quickest way to force the task client to connect is to ensure the SJQ server is running (i.e. can you load the web interface) and then do a 'net stop SJQTaskClient' followed by a 'net start SJQTaskClient' (as you've already discovered). Alternatively, just waiting 5 minutes should also pop the client back onto the list.

[btrcp2000]

Server is running, jobs are queued, but the task client won't start.

Here is my sjqc.properties:

host=localhost *i have also replaced this with the actual ip add, no help
port=8080 *same port i am running the mobile web server on, if it matters
buffer=199000
sleep=300
is_ssl=false


Here is the line I added to wrapper.conf so I could keep everything in the sage directory:

wrapper.app.parameter.2=C:\Program Files\SageTV\SageTV\SJQ

When I either "net start" from cmd or start the SJQTaskClient from the services console, I get an "error code 1"

What other info can I provide?

[Slugger]

Either replace the back slashes in the path with double back slashes or flip them around to single forward slashes.

C:\\Program Files\\SageTV\\SageTV\\SJQ

OR

C:/Program Files/SageTV/SageTV/SJQ

[lanmat]

So, here's the latest update on my ongoing month-long quest now to get jobs off 'WAITING':

I got rid of that underscore in my task name, but that still didn't get them starting. I haven't been able to replicate it, but once I found all the jobs in the 'failed tasks' list because it didn't like the space in my batch file path (so I put a second layer of extra quotes around everything). But like I said, I haven't been able to get the jobs to start again and so haven't seen if that was beneficial.

So I went back to my first post and followed all your instructions a second time. Jobs still all at 'WAITING', and no mention of a [ClientParser] line in the log. Here's my debug log again and my client task rule.


TRANSCODENORMAL {
:RESOURCES 80
:CPU "LOW"
""C:\\Program Files\\SageTV\\SageTV\\PostProcessing.bat" \"%c%\""
}

[Slugger]

Originally Posted by lanmat

So, here's the latest update on my ongoing month-long quest now to get jobs off 'WAITING':

I got rid of that underscore in my task name, but that still didn't get them starting. I haven't been able to replicate it, but once I found all the jobs in the 'failed tasks' list because it didn't like the space in my batch file path (so I put a second layer of extra quotes around everything). But like I said, I haven't been able to get the jobs to start again and so haven't seen if that was beneficial.

So I went back to my first post and followed all your instructions a second time. Jobs still all at 'WAITING', and no mention of a [ClientParser] line in the log. Here's my debug log again and my client task rule.


TRANSCODENORMAL {
:RESOURCES 80
:CPU "LOW"
""C:\\Program Files\\SageTV\\SageTV\\PostProcessing.bat" \"%c%\""
}

The logs show that a thread is taking two connections, but only returning one. Presumably, the thread is crashing before it returns the second. I also see that logs are being dumped to the db. Check your client logs (go to the client list, click on your client then view the logs). Is there anything there? Something is going somewhere. If the client logs are empty then I'm at a loss without direct access to the system for further debugging.

[btrcp2000]

Fixed the slashes, still not working. Any other thoughts?

thanks again

[Slugger]

Originally Posted by btrcp2000

Fixed the slashes, still not working. Any other thoughts?

thanks again

Go to the dir where you installed the client. In that dir there should be a logs subdir. In there should be a file called wrapper.log. Have a look in there for a clue as to what the problem is. My next guess is that java.exe is not available on your system path. But have a look in the wrapper.log file first.

[btrcp2000]

That got it. Needed quotes around the path because of the space in "Program Files"

thanks!

[lanmat]

The client log from the SJQ page is empty. Grr... Let's see...what other logs might have information on this? Is it possible something's wrong w/ the Jetty install? If this helps at all, here's a section from the wrapper.log that seems like there was an error:

STATUS | wrapper | 2010/03/14 15:02:40 | Launching a JVM...
INFO | jvm 1 | 2010/03/14 15:02:40 | WrapperManager: Initializing...
INFO | jvm 1 | 2010/03/14 15:02:40 | SJQ Task Client v3.0.1.705
INFO | jvm 1 | 2010/03/14 15:02:40 | Using 'C:/sjqc' as location for configuration file...
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp:
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: Encountered an error running main:
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: java.lang.RuntimeException: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:8500/sjq/SJQ?proto=4&cmd=writeLog
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at com.google.code.sagetvaddons.sjqc.TaskClient.log(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at com.google.code.sagetvaddons.sjqc.TaskClient.log(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at com.google.code.sagetvaddons.sjqc.TaskClient.pop(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at com.google.code.sagetvaddons.sjqc.TaskClient.run(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at com.google.code.sagetvaddons.sjqc.TaskClient.main(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at java.lang.reflect.Method.invoke(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at org.tanukisoftware.wrapper.WrapperSimpleApp.run(WrapperSimpleApp.java:236)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at java.lang.Thread.run(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:8500/sjq/SJQ?proto=4&cmd=writeLog
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: at sun.net.http://www.protocol.http.HttpURLConn...Stream(Unknown Source)
INFO | jvm 1 | 2010/03/14 15:07:40 | WrapperSimpleApp: ... 11 more
STATUS | wrapper | 2010/03/14 15:07:42 | <-- Wrapper Stopped
STATUS | wrapper | 2010/03/14 16:15:28 | --> Wrapper Started as Service

[Slugger]

That error is the problem, it's causing the task client to crash. The fix is to decrease the buffer value in your sjqc.properties file to 65000 (from the default 199000) and/or reconfig Jetty to accept larger post requests (this process is described in the installation section of the online user's guide).

Alternatively, stop the task client, delete your sjqc.properties file and upgrade to the latest snapshot build of the task client (3.0.2.771), which will also properly set the recommended default buffer value back below 66666 (though the above should be sufficient to address the issue).

[ewelin]

resolved my other issue... looks like some of my home automation stuff had locked up and caused havoc on my system. All sorted out now.

I do have a quick coding question. Any idea of a way to automatically rename the shows episode title to include the season and episode number? I'm guessing it's probably beyond the scope of this plugin, but thought I'd ask.

[Slugger]

Originally Posted by ewelin

I do have a quick coding question. Any idea of a way to automatically rename the shows episode title to include the season and episode number? I'm guessing it's probably beyond the scope of this plugin, but thought I'd ask.

You can use SJQ to identify the recordings you want to rename, but there is no internal function in SJQ that will allow you to perform the actual rename. You'll have to write an external script or program to do the rename and then call that script as a task in SJQ. Use the remote API plugin and write a script against it to do the rename, shouldn't be too difficult to achieve the desired results.

[Islander]

Is there a way to have SJQ monitor the media library folders and update the database whenever a new file or folder is added to any of them. To clarify, I am not looking for it to run a full media scan of the imported but rather just perhaps modify wiz.bin (is it?) for the one media that was just added.

I would like to have imported media or ripped dvd's available for playback soon after the process is finished.

Thanks.

[razrsharpe]

Originally Posted by Islander

Is there a way to have SJQ monitor the media library folders and update the database whenever a new file or folder is added to any of them. To clarify, I am not looking for it to run a full media scan of the imported but rather just perhaps modify wiz.bin (is it?) for the one media that was just added.

I would like to have imported media or ripped dvd's available for playback soon after the process is finished.

Thanks.

no... youd have to use some other folder monitoring process like dirmon2 and call bmt from the commandline to collect metadata/fanart and update the db...

[Islander]

I see. Thanks, will look into dirmon2 and using bmt from a command line.