Plugin: SJQv4

[Slugger]

Originally Posted by bikesquid

Here's the logs from the client sjqagent/logs directory, looks like there are errors here, but it's all foreign to me....

It says unable to execute, but doesn't say why... around 11:32:24. Of coarse the drive letter is not the same, so this goes back to the question I had regarding the drive mapping in the SJQ4_PATH and how to redirect it to the unc?... don't think I ever saw a response to that one.

Any suggestions?

2010-12-15 11:32:21,298 ERROR [192_168_1_110-23347-45]: Unable to execute 'C:\Program Files\comskip\comskip\exe'; marking task as FAILED!

Shouldn't that be 'C:\Program Files\comskip\comskip.exe' (instead of ...comskip\exe)? The executable is set wrong, that's why it's failing to launch comskip.

[Slugger]

Originally Posted by bikesquid

so this goes back to the question I had regarding the drive mapping in the SJQ4_PATH and how to redirect it to the unc?... don't think I ever saw a response to that one.

Currently, you'd have to wrap the call to comskip.exe in a script and manually remap the SJQ4_PATH as desired. There is an open ticket to add support for doing this automatically. I will attempt to address this in the next build. For an easy situation, you could just hardcode the path on the task client. So instead of passing "$SJQ4_PATH\$SJQ4_LAST_SEGMENT" to comskip, replace it with "\\myserver\path\$SJQ4_LAST_SEGMENT"

This is only useful if you only have one path where recordings are stored. If there's more than one recording directory then you obviously can't hardcode the path.

[bikesquid]

Originally Posted by Slugger

2010-12-15 11:32:21,298 ERROR [192_168_1_110-23347-45]: Unable to execute 'C:\Program Files\comskip\comskip\exe'; marking task as FAILED!

Shouldn't that be 'C:\Program Files\comskip\comskip.exe' (instead of ...comskip\exe)? The executable is set wrong, that's why it's failing to launch comskip.

Wholly ^%$& Batman! How many times have I looked at that and not seen it? I've also gotten woozy reworking and reworking.... now to try the mapping fix....

I try to check my spelling and such before calling out for help. Thanks to you and tmiranda for finding that typo!

[bikesquid]

regarding multisegment recordings, using this hdcomskip example it pushes the last segment, but not all the segments, how would I go about sending all segments of a recording through the process without undo testing/failing?

[Slugger]

Originally Posted by bikesquid

regarding multisegment recordings, using this hdcomskip example it pushes the last segment, but not all the segments, how would I go about sending all segments of a recording through the process without undo testing/failing?

For tasks queued on RecordingStarted events, it will handle multiple segments as they're created (because RecordingStarted also handles RecordingSegmentAdded events in the background as well). For RecordingStopped events and for manually triggered comskips (from the recording details screen), a wrapper script will have to be created. All the file segments are in the env vars (SJQ4_SEGMENT_0, SJQ4_SEGMENT_1, etc.). Basically a wrapper has to be checked to loop through those segments and run comskip on each one.

[bikesquid]

Originally Posted by Slugger

Currently, you'd have to wrap the call to comskip.exe in a script and manually remap the SJQ4_PATH as desired. There is an open ticket to add support for doing this automatically. I will attempt to address this in the next build. For an easy situation, you could just hardcode the path on the task client. So instead of passing "$SJQ4_PATH\$SJQ4_LAST_SEGMENT" to comskip, replace it with "\\myserver\path\$SJQ4_LAST_SEGMENT"

This is only useful if you only have one path where recordings are stored. If there's more than one recording directory then you obviously can't hardcode the path.

SUCCESS! That did it, thank you sir! Now everything should be groovy till I move it to a new sage server this weekend!

[Slugger]

Originally Posted by bikesquid

regarding multisegment recordings, using this hdcomskip example it pushes the last segment, but not all the segments, how would I go about sending all segments of a recording through the process without undo testing/failing?

Originally Posted by Slugger

For tasks queued on RecordingStarted events, it will handle multiple segments as they're created (because RecordingStarted also handles RecordingSegmentAdded events in the background as well). For RecordingStopped events and for manually triggered comskips (from the recording details screen), a wrapper script will have to be created. All the file segments are in the env vars (SJQ4_SEGMENT_0, SJQ4_SEGMENT_1, etc.). Basically a wrapper has to be checked to loop through those segments and run comskip on each one.

Here's something to get you started (untested)...

String cmd = "C:\\Program Files\\comskip\\comskip.exe"
boolean failed = false;
for(int i = 0; i < SJQ4_METADATA["SJQ4_MAX_SEGMENT_INDEX"].toInteger(); ++i) {
   String segment = SJQ4_METADATA["SJQ4_SEGMENT_${i}"]
   String[] exe = [cmd, segment]
   println "** Running ${exe}... **"
   Process p = exe.execute()
   p.waitFor()
   int rc = p.exitValue()
   println p.out.text
   println p.err.text
   if(rc < 0 || rc > 1) // Task failed, but run against the rest of the segments anyways...
      failed = true
   println "** DONE SEGMENT **"
}
if(failed)
   return 1
return 0

[phunny]

Originally Posted by Slugger

Check the SageTVPlugins.xml file in your SageTV base directory. Search for sjq-agent. Which version of the plugin is in that file? If it's 1320 only then your plugin list is not being updated by Sage. You would need to force an update of that file (not sure how to do that). If 1325 is in that file then there's something wrong with the Sage plugin manager that's preventing you from upgrading.

Slugger it looks ok? Here is from my XML file
</SageTVPlugin>
- <SageTVPlugin>
<Name>Sage Job Queue Agent (Task Client)</Name>
<Identifier>sjq-agent</Identifier>
<Description>SJQv4 agent (task client).</Description>
<Author>Slugger</Author>
<CreationDate>2010.11.03</CreationDate>
<ModificationDate>2010.12.13</ModificationDate>
<Version beta="true">4.0.0.1325</Version>
<ResourcePath>plugins/sjq-agent</ResourcePath>
<Webpage>http://sagetv-addons.googlecode.com</Webpage>
- <Dependency>
<JVM />

[Slugger]

And the plugin manager shows you have version 1320 installed, but won't give you an option to upgrade? If that's the case then you'll have to contact Sage support to find out what's wrong. Once you're able to upgrade the task client to 1325 then SJQ will start working again.

[AlphaCrew]

Originally Posted by Slugger

When you create a task for a task client, just use the .bat file as the executable name.

Command line options are specified using the Command Arguments option. If you want access to the SJQ variables then they are available as environment variables. Access to the env vars is discussed here.

Thank you slugger,

So....., would it be possible to add more Variables? I would love to have separate variables for PathOnly, FileNameOnly, and FileNameExtensionOnly.

Would make handling processes in a Windows bat file a million times easier for me..

ALSO:

Is there anyway to allow windows copy and paste functions in the Task Creation page??

[Slugger]

Originally Posted by AlphaCrew

Thank you slugger,

So....., would it be possible to add more Variables? I would love to have separate variables for PathOnly, FileNameOnly, and FileNameExtensionOnly.

Would make handling processes in a Windows bat file a million times easier for me..

PathOnly already exists: SJQ4_PATH
The other two are possible. Open a ticket on the project web site for it. I planned on adding more vars based on feedback.

ALSO:

Is there anyway to allow windows copy and paste functions in the Task Creation page??

I don't think the STV supports it, but that's tmiranda's department. Another ticket isn't a bad idea so he'll see it when he's back from vacation.

[ryttingm]

Since this thread seems to be focused on issues, I figure I'd share my experience. I switched over to SJQv4 and the install went pretty smooth. Had to spend a little time figuring out how to get everything up, but after that it's working as advertised. I'm very pleased with the new system. I love the flexibility. Keep up the great work.

[phelme]

Even though I have the comskip tasks running on recordings under SJQv4, I'm still getting the occasional IOError in sjq.log that I can't figure out. How are some of you getting all that great info in your sjqagent.log files? all I get is this:

2010-12-17 12:52:49,450 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'
2010-12-17 13:38:19,684 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'
2010-12-17 13:40:42,637 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'
2010-12-17 13:42:48,809 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'
2010-12-17 14:00:23,465 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'

I'm running the task client as a service if that makes any difference. (and maybe it does?)

[Slugger]

Originally Posted by phelme

Even though I have the comskip tasks running on recordings under SJQv4, I'm still getting the occasional IOError in sjq.log that I can't figure out. How are some of you getting all that great info in your sjqagent.log files? all I get is this:

2010-12-17 12:52:49,450 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'
2010-12-17 13:38:19,684 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'
2010-12-17 13:40:42,637 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'
2010-12-17 13:42:48,809 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'
2010-12-17 14:00:23,465 INFO  [Config]: Watching 'C:\sjqagent\bin\..\conf'

I'm running the task client as a service if that makes any difference. (and maybe it does?)

Those aren't errors (the 'INFO' level of the messages also indicates that). That's just saying that the task client is monitoring that dir for changes to the .properties config file for the task client. When the file is changed it is processed by the agent and the settings updated immediately.

[PosterBoy]

Hi Slugger

Any idea what this means in my log?


2010-12-17 23:00:21,077 INFO [TaskQueue]: Assigned task 5 of type 'COMSKIPHD' to Client[host=SageSeer:23344,state=ONLINE,lastUpdate=Fri Dec 17 23:00:21 MST 2010]
2010-12-17 23:00:21,077 INFO[ListenerClient]: Disconnected from SageSeer:23344
2010-12-17 23:00:21,376 INFO[Listener]: Received connection from: /192.168.50.30
2010-12-17 23:00:22,306 ERROR [Handler]: IOError
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.refill(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.read(Unknown Source)
at java.io.DataInputStream.readUnsignedShort(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.readUnsignedShort(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.readUTF(Unknown Source)
at java.io.ObjectInputStream.readUTF(Unknown Source)
at com.google.code.sagetvaddons.sjq.listener.Handler.run(Handler.java:62)
at java.lang.Thread.run(Unknown Source)
2010-12-17 23:00:22,309 INFO[Listener]: Received connection from: /192.168.50.30
2010-12-17 23:00:22,309 INFO [Handler]: CMD: LOGTEST :: PEER: /192.168.50.30
2010-12-17 23:00:22,319 INFO [Handler]: CMD: QUIT :: PEER: /192.168.50.30
2010-12-17 23:00:24,411 INFO[Listener]: Received connection from: /192.168.50.30
2010-12-17 23:00:24,411 INFO [Handler]: CMD: UPDATE :: PEER: /192.168.50.30
2010-12-17 23:00:24,419 INFO [TaskQueue]: Scheduling queue processor for ~8 seconds from now!
2010-12-17 23:00:24,419 INFO [Handler]: CMD: QUIT :: PEER: /192.168.50.30


Thanks

Kent

[Slugger]

Nothing wrong. The connection reset errors can be ignored. It's just the task client closing its connection with the server before the server finished processing the 'QUIT' command that it received from the client.

[billmedia]

I have sjq4 running, using sage client plugin, and enjoying the potential. Working on my groovy scripts now. In my early attempts to create tasks on the client, I created a task which I cannot remove. It does not show when I open the client and click supported tasks. Nothing shows in chron tab either. However, this task keeps popping in the queued tasks - waiting for client. I tried uninstalling the plugins, and reinstall, yet the tasks remain. How can I remove this task, can I open the h2 db? If so how.
Go figure, I have been trying to sort this out for days, all the while removing the tasks from the queued tasks. I finally decide to make a post, and now it is resolved. I am still interested in where the tasks were coming from, if created as chron tasks, is that stored in db or chrontab file? If event triggered, where is that persisted?

[phelme]

Originally Posted by Slugger

Those aren't errors (the 'INFO' level of the messages also indicates that). That's just saying that the task client is monitoring that dir for changes to the .properties config file for the task client. When the file is changed it is processed by the agent and the settings updated immediately.

Sorry for the confusion, I know those aren't errors, the errors are in the sjq.log file, like this:

12-17 19:39:15,153 INFO  [TaskQueue]: Scheduling queue processor for ~8 seconds from now!
2010-12-17 19:39:15,153 INFO  [Handler]: CMD: QUIT :: PEER: /10.0.1.35
2010-12-17 19:39:23,153 INFO  [TaskQueue]: Running queue processor now!
2010-12-17 19:39:23,168 INFO  [TaskQueue]: Assigned task 26 of type 'SDCOMSKIP' to Client[host=10.0.1.35:23344,state=ONLINE,lastUpdate=Fri Dec 17 19:39:23 PST 2010]
2010-12-17 19:39:23,168 INFO[ListenerClient]: Disconnected from 10.0.1.35:23344
2010-12-17 19:39:25,778 INFO[Listener]: Received connection from: /10.0.1.35
2010-12-17 19:39:28,106 ERROR [Handler]: IOError
java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(Unknown Source)
	at java.net.SocketInputStream.read(Unknown Source)
	at java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.refill(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.read(Unknown Source)
	at java.io.DataInputStream.readUnsignedShort(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.readUnsignedShort(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.readUTF(Unknown Source)
	at java.io.ObjectInputStream.readUTF(Unknown Source)
	at com.google.code.sagetvaddons.sjq.listener.Handler.run(Handler.java:62)
	at java.lang.Thread.run(Unknown Source)
2010-12-17 19:39:28,106 INFO[Listener]: Received connection from: /10.0.1.35
2010-12-17 19:39:28,106 INFO  [Handler]: CMD: LOGTEST :: PEER: /10.0.1.35

what I'm not sure is what is causing the IOError and there seems to be little indication as to the cause from that log file. I thought maybe there would be something in the sjqagent.log file that might help, but nothing much happens there as you can see.

[wayner]

I am just getting up and running now on V4 on a new server. Sorry if I missed this, but how do you do internal tasks the way that you did in previous versions, specifically starting a conversion to a different format where the output file is in a different folder and is renamed with the episode title?

Or should I use an external task to do the transcode, like the Mediashrink? In some instances I may want to also run Comskip as well before transcoding.

[jbuszkie]

Originally Posted by Slugger

Tasks with no metadata is a bit puzzling. I'm not able to reproduce this. Tasks with no metadata (that use the comskip_test.groovy file for their test) will never succeed. I have no idea how to reproduce this if the task was queued from the recording details screen - I just tried every conceivable way I could think of to reproduce.


Tasks with no metadata is a bit puzzling. I'm not able to reproduce this. Tasks with no metadata (that use the comskip_test.groovy file for their test) will never succeed. I have no idea how to reproduce this if the task was queued from the recording details screen - I just tried every conceivable way I could think of to reproduce.

I'm getting this too.. my guess is it's trying to run on a file that's already been deleted. How do we fix this.. the queue won't seem to proceed when this error is there...

Jim