Plugin: Sage Job Queue (SJQ) v3

[Peter_h]

Hi Slugger,

For some reason I can no longer log into SJQ. I'm running SageTV7.

I upgraded Jetty via the plugins manager and then upgraded SRE (Thanks for the help on that), BMT, and the web interface via the plugin manager. All of them are working fine and I can log into them without issue.

I did not change username and password credentials and jetty picked them up just fine. However, I can not log into SJQ, it keeps telling me incorrect password.

I then went into the jetty config screen and reentered username and password fields and still I can not log into SJQ.

What is the next step to troubleshoot?

Thanks,
Peter

[Slugger]

SJQ does not use the Jetty id/pwd, it uses its own. What ever it was before, that's what it is now. If you are using a new database with SJQ then it's the default password, which is sjqadmin.

[QueOnda]

Originally Posted by Slugger

Download the sjqc client package from the project web site (as outlined in the user guide).

http://code.google.com/p/sagetv-addons/downloads/list

Thanks Slugger. When I was reading the user guide, link I found sent me to this page and I got confused. Thanks!!!!

[Peter_h]

Originally Posted by Slugger

SJQ does not use the Jetty id/pwd, it uses its own. What ever it was before, that's what it is now. If you are using a new database with SJQ then it's the default password, which is sjqadmin.

Thanks,

Looks like i somehow lost the database so everything is back to a clean default install.

Where is the database file stored? I have a backup from a few days ago of the entire sagetv directory. How would I go about restoring it?

[QueOnda]

I created a sjqc.properties file as in the documentation. I run the .bat and don't know what the window says cuz it flashes sooooo fast and disappears.

But when I go into sjq and under clients, nothing is listed.

[Slugger]

Originally Posted by Peter_h

Thanks,

Looks like i somehow lost the database so everything is back to a clean default install.

Where is the database file stored? I have a backup from a few days ago of the entire sagetv directory. How would I go about restoring it?

It would be in the root SageTV\ dir and it's called sjq.sqlite. Stop Sage, copy that file back into the same location (C:\Program Files\SageTV\SageTV), restart Sage and SJQ will pick up the db file.

[Slugger]

Originally Posted by QueOnda

I created a sjqc.properties file as in the documentation. I run the .bat and don't know what the window says cuz it flashes sooooo fast and disappears.

But when I go into sjq and under clients, nothing is listed.

That means the task client is not running. If it's configured properly the window will stay open indefinitely when started via the bat file. There are [MS Windows] options to prevent the command window from closing on program termination. You'll want to set that up to see the errors (I don't remember how off the top of my head, but Google is your friend).

[QueOnda]

PAUSE (I edited and added pause at the end of the .bat. If you think other people will come across the same problem, please add it.

I get this message.

'Java' is not recognized as a internal or external command, inoperable program or batch file.

So, googled and found this:

Compiler Problems

Common Error Messages on Microsoft Windows Systems

'javac' is not recognized as an internal or external command, operable program or batch file

If you receive this error, Windows cannot find the compiler (javac).

Here's one way to tell Windows where to find javac. Suppose you installed the JDK in C:\jdk6. At the prompt you would type the following command and press Enter: C:\jdk6\bin\javac HelloWorldApp.java If you choose this option, you'll have to precede your javac and java commands with C:\jdk6\bin\ each time you compile or run a program. To avoid this extra typing, consult the section in the JDK 6 installation instructions.

Class names, 'HelloWorldApp', are only accepted if annotation processing is explicitly requested

If you receive this error, you forgot to include the .java suffix when compiling the program. Remember, the command is javac HelloWorldApp.java not javac HelloWorldApp.

So, I did a search for JDK6 and found nothing. Is java and JDK6 different?

[graywolf]

you can go to http://www.java.com/en/download/ and ddownload the latest Java if you need it.

It could also mean that where Java is located is not in your PATH.

For debudding, click on START, then RUN, then put in CMD and hit enter

That should bring up a DOS window. Cd to the directory that you have the sjqc.bat file, then execute/run it from there. This way the window does not close when the bat file ends.

[QueOnda]

Originally Posted by graywolf

you can go to http://www.java.com/en/download/ and ddownload the latest Java if you need it.

It could also mean that where Java is located is not in your PATH.

I do have the latest JAVA but the error message says 'javac' which means

javac – the compiler, which converts source code into Java bytecode

Do, I need to download something separate.

I have:

Verified Java Version
Congratulations!
You have the recommended Java installed (Version 6 Update 20).

[Slugger]

You do not need the java compiler (javac) to run sjqc (or any Java program). You just need to make sure that java.exe is in your system path.

If you have java 1.6.0_20 installed on your system then you have everything you need to run sjqc. Just make sure java.exe is in your system path then it should be good to go.

[Peter_h]

Originally Posted by Slugger

It would be in the root SageTV\ dir and it's called sjq.sqlite. Stop Sage, copy that file back into the same location (C:\Program Files\SageTV\SageTV), restart Sage and SJQ will pick up the db file.

This worked great. Thanks.

[QueOnda]

Originally Posted by Slugger

You do not need the java compiler (javac) to run sjqc (or any Java program). You just need to make sure that java.exe is in your system path.

If you have java 1.6.0_20 installed on your system then you have everything you need to run sjqc. Just make sure java.exe is in your system path then it should be good to go.

Ok, I just moved the sjqc files in the java directory and it ran. Now I'm getting

Connection Refused: connect

I had host=localhost
and also the ipaddress of my computer

I'm running both server and client on the same computer. The sjqc.properties in the in c:\sjqc\

[Slugger]

Make sure the server is running. Can you access the web site? If not, then the SJQ server is not running. If you can, then there may be firewall issues preventing the task client from connecting.

[ewelin]

I can no longer login to SJQ... I pull up the SJQ webpage, enter in my password and it just sits there, never loading the interface. I have cleared my browsers cache, switched to IE and chrome, all with the exact same result. I've restarted the SageTV service and the computer and still the same thing happens. No matter what I do, I can't login.

I did check the sjq.log file and it seems to be somewhat working... as the file update time is the current time. When viewing the file i see the following error in the log:

2010-06-01 07:51:36,578 INFO  [SystemMessageQueueLoader]: Run completed [3094ms]
2010-06-01 07:51:36,843 INFO  [MediaFileQueueLoader]: Run completed [4797ms]
2010-06-01 07:51:36,843 INFO  [DataStore]: Thread 'SJQ-VacuumCleaner' is seeking an exclusive DataStore connection!
2010-06-01 07:51:36,843 INFO  [DataStore]: Thread 'SJQ-VacuumCleaner' has received an exclusive DataStore connection! [WAIT=0ms]
2010-06-01 07:51:36,859 INFO  [DataStore]: Thread 'SJQ-LogCleaner' is seeking an exclusive DataStore connection!
2010-06-01 07:51:36,859 INFO  [DataStore]: Thread 'SJQ-LogCleaner' is waiting for an exclusive DataStore connection! [AVAIL=4; MAX=5; WAIT=0ms]
2010-06-01 07:52:06,859 WARN  [DataStore]: DataStore pool timeout expired! 'SJQ-VacuumCleaner' did not return connection within 30 seconds!  Adding a replacement connection to the pool.
2010-06-01 07:52:10,109 FATAL [DataStore]: SQL error
java.sql.SQLException: database is locked
    at org.sqlite.DB.throwex(DB.java:288)
    at org.sqlite.NativeDB.prepare(Native Method)
    at org.sqlite.DB.prepare(DB.java:114)
    at org.sqlite.Stmt.executeQuery(Stmt.java:89)
    at com.google.code.sagetvaddons.sjq.server.DataStore.loadDDL(DataStore.java:301)
    at com.google.code.sagetvaddons.sjq.server.DataStore.<init>(DataStore.java:154)
    at com.google.code.sagetvaddons.sjq.server.DataStore.<init>(DataStore.java:53)
    at com.google.code.sagetvaddons.sjq.server.DataStore$1.run(DataStore.java:186)
    at java.util.TimerThread.mainLoop(Unknown Source)
    at java.util.TimerThread.run(Unknown Source)
2010-06-01 07:52:36,531 ERROR [DataStore]: SQL error
java.sql.SQLException: database or disk is full
    at org.sqlite.DB.execute(DB.java:275)
    at org.sqlite.DB.executeUpdate(DB.java:281)
    at org.sqlite.Stmt.executeUpdate(Stmt.java:103)
    at com.google.code.sagetvaddons.sjq.server.DataStore.freeDiskSpace(DataStore.java:1118)
    at com.google.code.sagetvaddons.sjq.server.VacuumCleaner.run(VacuumCleaner.java:31)
    at java.lang.Thread.run(Unknown Source)
2010-06-01 07:52:36,531 WARN  [DataStore]: Thread 'SJQ-VacuumCleaner' attempted to return a timed out connection!  Dropping connection.
2010-06-01 07:52:36,531 INFO  [DataStore]: Thread 'SJQ-LogCleaner' is waiting for an exclusive DataStore connection! [AVAIL=4; MAX=5; WAIT=59672ms]

Any suggestions?

[ewelin]

I did just check the size of my sjq.sqlite file and it's almost 8GB!

[rmac321]

Slugger,

I've run into an issue several times in the last couple days. Occasionally, it seems it is taking too long for my client task to report a successful start back to the sjq server, so the server marks the process as failed, but the process (MediaShrink) is actually running. Since SJQ marks the process as failed, it starts a new process and now that client is running 2 MediaShrink processes.

here is the text of the failed task:

Mon May 31 06:35:51 CDT 2010: Starting task with priority 5/1/10
Killed because tasks cannot remain in STARTED state for more than 60 seconds!
Executing command line: C:/BatchFiles/sjq_mediaShrink.bat  "//<server>/<path-to-video>/Fringe-OverTherePart1-804315-0.mpg"

[Slugger]

Originally Posted by ewelin

I did just check the size of my sjq.sqlite file and it's almost 8GB!

8GB db shouldn't cause the problem, so I'm guessing the disk is full? That would cause a problem.

However, your SJQ db should never get to 8GB unless you're running tasks that dump very large amounts of data and even then, 8GB of text output is a lot of text. Either way, the issue is the SQLite driver could no longer read/write the db file so once that happens all bets are off. Your best best may be to rename the current db file and restart with a fresh/empty db file. Or check the free space on the drive. However, an 8GB db file is going to perform terribly with some of the cleanup methods used in SJQ. Even if you got SJQ to load and use that 8GB db, you'll likely run into file lock errors from SQLite anyway so I would really suggest saving that db file to somewhere (if necessary) and starting over.

[ewelin]

There is about 1.5gb of free space on that particular drive. Is there any way to open the sqlite file to extract the jobs

[Slugger]

Originally Posted by rmac321

Slugger,

I've run into an issue several times in the last couple days. Occasionally, it seems it is taking too long for my client task to report a successful start back to the sjq server, so the server marks the process as failed, but the process (MediaShrink) is actually running. Since SJQ marks the process as failed, it starts a new process and now that client is running 2 MediaShrink processes.

here is the text of the failed task:

Mon May 31 06:35:51 CDT 2010: Starting task with priority 5/1/10
Killed because tasks cannot remain in STARTED state for more than 60 seconds!
Executing command line: C:/BatchFiles/sjq_mediaShrink.bat  "//<server>/<path-to-video>/Fringe-OverTherePart1-804315-0.mpg"

Two problems:

First, have a look at the jetty request log and look for the task client's attempt to signal back that it started the task. Is that failing (i.e. 500 status code)?

Second, SJQ is killing the first bat file, but whatever that bat file is starting (mediashrink, I assume) is not properly stopping when the bat file is stopping. OR... the bat file is not actually being killed even though SJQ thinks it did kill it. OR... the bat file is starting mediashrink in the background, which means all bets are off when SJQ tried to kill it - it will only kill the bat file and never any processes spawned from it.

Fix issue #1 and you're good to go. Help me figure out what's going on with #2 and we can maybe talk to EP to see why mediashrink isn't playing nice when told to die (if that's the actual case).