SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV Customizations

Notices

SageTV Customizations This forums is for discussing and sharing user-created modifications for the SageTV application created by using the SageTV Studio or through the use of external plugins. Use this forum to discuss customizations for SageTV version 6 and earlier, or for the SageTV3 UI.

Closed Thread
 
Thread Tools Search this Thread Display Modes
  #301  
Old 01-18-2009, 01:22 PM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by perfessor101 View Post
ps -- I still have the sjq.sqllite file that was confusing the parser
Can you please send me the sjq.sqlite file? I want to take a peek inside it and see if I can't find and squish the parser bug.

I will investigate the split recording processing after I shovel the foot of snow out of my driveway. I've been staring at the driveway since 9am and now it's nearly 2:30 and the snow didn't manage to melt itself.
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
  #302  
Old 01-18-2009, 05:03 PM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Server snapshot 186 contains the fix for incorrect media variable expansion on all file segments after the first one (*-1.*, *-2.*, etc.). perfessor101 (and anyone else willing to help out), can you please test the fix and report back on its effectiveness?
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
  #303  
Old 01-19-2009, 08:26 AM
edbmdave edbmdave is offline
Sage Aficionado
 
Join Date: Apr 2004
Location: Dallas
Posts: 365
Talking

Happy to test it.

Can tell me how to accomplish this?

Originally Posted by Slugger:
"With SJQ you can even use external transcoding programs/scripts as well as the SageTV internal transcoder as needed."

How do you do that within SJQ? and continue to have sage recognize the file? How do you get it to run an external transcoding?

I would love to have Handbrake run all my transcoding... and still keep all the files in Sage.

Last edited by edbmdave; 01-19-2009 at 10:17 AM.
  #304  
Old 01-19-2009, 10:56 AM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by edbmdave View Post
Happy to test it.

Can tell me how to accomplish this?

Originally Posted by Slugger:
"With SJQ you can even use external transcoding programs/scripts as well as the SageTV internal transcoder as needed."

How do you do that within SJQ? and continue to have sage recognize the file? How do you get it to run an external transcoding?

I would love to have Handbrake run all my transcoding... and still keep all the files in Sage.
You simply create rules that run external programs against your media files.

Load the queue:
Code:
if [IsTV == true && IsActivelyRecording == false && IsWatched == false] {
   EXTTRANS
}
Configure client(s) to run those queued jobs:
Code:
EXTTRANS {
   "C:/handbrake/handbrake.exe \"%c%\""
}
Other SJQ users are more experienced with running external transcode jobs via SJQ and can confirm this, but as long as the transcoded file contains the encoded airing id in the file name, SageTV should be able to pick it up and make the replacement. Personally, I don't transcode my content or on the very, very rare occasion I have then I've always used the internal SageTV transcoder, which handles all the reregistration of the files automatically.
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
  #305  
Old 01-23-2009, 06:59 PM
scott2020 scott2020 is offline
Sage Advanced User
 
Join Date: Jun 2008
Posts: 128
Is it possible to use SJQ to run compression jobs off of the main server? I have my server auto compressing my selected series recordings, but it takes a long time on my older server. It would be great to be able to tell SJQ to run the compress job on another client like we do for comskip.
Scott
__________________
Server - Intel Pentium 3.2 - 3 GB RAM - WinXP SP3 - Headless
80GB system drive - 500GB Recordings - 2TB NAS
(1) HVR-2250 Analog Cable & Clear QAM (1) HD Homerun clear QAM
(1) KWorld 115 ATSC Tuner OTA
(1) HD200 HDMI to Samsung 50" Plasma
(1) MediaMVP to 19" in bedroom

SageTV 7.0.23 release
  #306  
Old 01-24-2009, 10:27 AM
CollinR CollinR is offline
Sage Icon
 
Join Date: Dec 2004
Location: Tulsa, OK
Posts: 1,304
There is still an issue of deleted files gumming up the works.

How do you force a client to stop processing a file? I have a client tring to comskip a deleted show, it will not process anything else until it's completed and it'll never complete as it doesn't exist. Stopping/starting the service both server/client don't seem to remedy it's listed as active and started and assigned.

Is there something I can put in my task so it will check to ensure the media is there before running it?

It seems my config the time it takes to catch up from something like this will force this to happen again a couple times in the next few days unless I do something. Or maybe something in the rules so it a started task takes more then X amount of time just mark it failed and go on.

The client log shows:
Code:
Date: Sat Jan 24 02:31:13 CST 2009

HTTP ERROR: 500
INTERNAL_SERVER_ERROR
RequestURI=/sjq/SJQ

Caused by:
java.lang.NullPointerException
	at com.google.code.sagetvaddons.sjq.server.ClientParser$ClientTask.toJSONObject(Unknown Source)
	at com.google.code.sagetvaddons.sjq.server.SJQServlet.doPost(Unknown Source)
	at com.google.code.sagetvaddons.sjq.server.SJQServlet.doGet(Unknown Source)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:362)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:729)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:405)
	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:206)
	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:320)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:505)
	at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:829)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:513)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:211)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:380)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:395)
	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:488)

Last edited by CollinR; 01-24-2009 at 10:39 AM.
  #307  
Old 01-24-2009, 10:37 AM
Beefcake550 Beefcake550 is offline
Sage Expert
 
Join Date: Oct 2004
Posts: 706
Please help, I think I'm 9/10 of the way there but I don't know what I'm doing...

I've got SJQ installed (v2.1) and sjqc. It looks like it is doing something becuase I can see the web pages and edit server/client rules. I'm looking to be able to setup comskip to be run on the TV shows I've already recorded in SageTV.

Here's my rules:
//Comskip on MPEG
if [IsTV == "true" && FileExists == "%d%\\%p%.mpg" && FileExists != "%d%\\%p%.edl" && IsActivelyRecording == "false"] {
COMSKIPMPEG
}

Client:
// Running Comskip on MPEG files (much quicker than TS files)
COMSKIPMPEG {
:CPU "NORMAL" # optional; one of NORMAL, HIGH, LOW
:MAX 1 # Run no more than one instance of this task at a time on this client
"C:/Comskip/comskip.exe -n \"%c%\"" # The %c% is expanded to the full path of the file to be processed
}

I haven't done anything else but this.

I'm not seeing anything happen. I don't know how to tell whats happening or what I'm doing wrong. I've read about some log files, but I don't see anything anywhere.

Can someone please help me out?

-B

Last edited by Beefcake550; 01-24-2009 at 10:38 AM. Reason: Fixed a typo I found
  #308  
Old 01-24-2009, 10:43 AM
CollinR CollinR is offline
Sage Icon
 
Join Date: Dec 2004
Location: Tulsa, OK
Posts: 1,304
Beefcake, copy paste this.

Server Rules:
Code:
//ComSkipSD
if [IsTV == "true" && IsHD == "false" && FileExists != "%d%\\%p%.edl" && Filename =$ ".mpg" && IsActivelyRecording == "false" && ChannelNumber != "0|1|1400" && IsScheduledRecording == "true"]
{
COMSKIPSD
}
//CompressSD
if [IsTV == "true" && IsHD == "false" && FileExists == "%d%\\%p%.edl" && Filename =$ ".mpg" && IsArchived == "true" && TranscodeQueueSize <= "5" && TimeOfDay <= "02:00"]
{
:TRANSCODEOPTS "MPEG4-High Quality Deinterlaced AVI" "false"
_TRANSCODE
}
if [IsTV == "true" && IsHD == "false" && FileExists == "%d%\\%p%.edl" && Filename =$ ".mpg" && MediaAge >= "30D" && TranscodeQueueSize <= "5" && TimeOfDay <= "02:00"]
{
:TRANSCODEOPTS "MPEG4-High Quality Deinterlaced AVI" "false"
_TRANSCODE
}
Client Tasks:
Code:
//Client options
:MAXPROCS 1
// TASK definition
COMSKIPSD {  
:CPU LOW
:MAX 1    
"C:\\Comskip\\comskip.exe -n \"%c%\""
}

That will do your comskip as well as compress any SD mpgs that are either older then 30 days or have been marked as archived to xvid HQ.

Have fun.

EDIT:
The problem was the slashes in your PATH\\TO/comskip.exe
  #309  
Old 01-24-2009, 10:45 AM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by CollinR View Post
There is still an issue of deleted files gumming up the works.

How do you force a client to stop processing a file? I have a client tring to comskip a deleted show, it will not process anything else until it's completed and it'll never complete as it doesn't exist. Stopping/starting the service both server/client don't seem to remedy it's listed as active and started and assigned.

Is there something I can put in my task so it will check to ensure the media is there before running it?

It seems my config the time it takes to catch up from something like this will force this to happen again a couple times in the next few days unless I do something. Or maybe something in the rules so it a started task takes more then X amount of time just mark it failed and go on.
Which server version (as reported on the bottom right corner of the GUI) are you running? This issue was fixed in v2.1.0. Starting in v2.1.0 the server checks that the media exists just before it assigns the task to a client. Now there is a slight chance that the media is deleted during the second or two after the server checks and before the client starts the assigned task, but that should almost be a one in a million shot. If you're running v2.0.0 then upgrade to v2.1.0 (or a snapshot) and let me know if you're still having problems.
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
  #310  
Old 01-24-2009, 10:56 AM
Beefcake550 Beefcake550 is offline
Sage Expert
 
Join Date: Oct 2004
Posts: 706
CollinR:
Thanks for the quickest response I've ever seen!

Unfortunately, I still don't see anythign happening. I think the first step is to see jobs getting added to the queue, right? How can I see that? I've tried clicking on "data->active" on the webpage, but there is nothing listed.

Thanks.
  #311  
Old 01-24-2009, 11:03 AM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by Beefcake550 View Post
CollinR:
Thanks for the quickest response I've ever seen!

Unfortunately, I still don't see anythign happening. I think the first step is to see jobs getting added to the queue, right? How can I see that? I've tried clicking on "data->active" on the webpage, but there is nothing listed.

Thanks.
After you update the server rules you won't see anything added to the queue until the QueueLoader thread runs again (which could be up to six hours if using the default settings). To force a manual run, click on the time of the next scheduled run in the lower right corner, wait until the last run time stamp updates, then check the active queue again (if already loaded then give it 10-15 seconds to update).
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
  #312  
Old 01-24-2009, 11:09 AM
Beefcake550 Beefcake550 is offline
Sage Expert
 
Join Date: Oct 2004
Posts: 706
ok, did that ...no luck.. .

Let me double check my thoughts.....Do I have to have a client connected in order for the "active queue" to get populated? I would think no, since there is a column labeled "assigned client". Is this true?

Also, when installing jetty, there was something about a default user/pass of sage/frey I never had to enter that anywhere....what was that for? Any clues?

-B
  #313  
Old 01-24-2009, 11:24 AM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by Beefcake550 View Post
ok, did that ...no luck.. .

Let me double check my thoughts.....Do I have to have a client connected in order for the "active queue" to get populated? I would think no, since there is a column labeled "assigned client". Is this true?

Also, when installing jetty, there was something about a default user/pass of sage/frey I never had to enter that anywhere....what was that for? Any clues?

-B
You do not need a client setup to have the queue populated, but without a client setup then the queue will, of course, never empty out. But we need to get your queue filled up first.

SJQ does not use the Jetty authentication, it uses its own. If you install other apps in Jetty they may or may not use the Jetty authentication, which is what that id/pwd is for.

Ok, next for you is to go to the settings tab, enable debugging, then manually trigger another run of the QueueLoader thread. Depending on the size of your media library, this is going to dump a massive amount of data to the logs, but it's also going to tell us why nothing is getting into the queue. After the QueueLoader runs go to the server logs and study the output, if you're not sure what you're reading, paste it in here (be sure to surround it in a "code" block in this thread for easier reading). After you run it once, be sure to turn off debug output or else you're going to swell your SJQ database to a crazy size rather quickly.
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
  #314  
Old 01-24-2009, 11:33 AM
Beefcake550 Beefcake550 is offline
Sage Expert
 
Join Date: Oct 2004
Posts: 706
ok, sorry to be such a newb, but I dont know how to enable debug logging. I foudn the settings tab, but there is just an empty list and I don't see how to add anything.
  #315  
Old 01-24-2009, 11:35 AM
CollinR CollinR is offline
Sage Icon
 
Join Date: Dec 2004
Location: Tulsa, OK
Posts: 1,304
Quote:
Originally Posted by Slugger View Post
If you're running v2.0.0 then upgrade to v2.1.0 (or a snapshot) and let me know if you're still having problems.
That was it , thanks man!
  #316  
Old 01-24-2009, 11:38 AM
Beefcake550 Beefcake550 is offline
Sage Expert
 
Join Date: Oct 2004
Posts: 706
ok, sorry to be such a newb at this. I go the setting tabs and I just see an empty list and no apparent way to add an item. How do I turn on debug logging?

also, where would the log file be placed?

-B
  #317  
Old 01-24-2009, 11:44 AM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by Beefcake550 View Post
ok, sorry to be such a newb, but I dont know how to enable debug logging. I foudn the settings tab, but there is just an empty list and I don't see how to add anything.
You should be seeing an options grid as in the screen shot attached. Bring up the settings submenu, click settings, then flip the debug switch. Be sure to flip it back after you run the QueueLoader once. (As I write this, I realize I should maybe rename one of those buttons.)
Attached Images
File Type: png sjq_help.PNG (45.9 KB, 117 views)
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
  #318  
Old 01-24-2009, 11:49 AM
Beefcake550 Beefcake550 is offline
Sage Expert
 
Join Date: Oct 2004
Posts: 706
oh.. very interesting...I'm not seeing that. I am using IE7 in vista......I wonder what's wrong.
  #319  
Old 01-24-2009, 11:53 AM
Beefcake550 Beefcake550 is offline
Sage Expert
 
Join Date: Oct 2004
Posts: 706
snap....I was using 127.0.0.1 as the ip address and for some reason when I switch it to my servers 192.x.x.x IP, it works. Go figure...

Thanks all...I'll post back if I have more problems.
  #320  
Old 01-24-2009, 08:39 PM
Wheemer's Avatar
Wheemer Wheemer is offline
Sage Icon
 
Join Date: Dec 2004
Location: Deer Lake, NL, Canada
Posts: 1,493
How can I make multiple copies of comskip run on each client?

I also would like to have the captions processed at the same time as the commercials...

An example of how that might be done would be great.

This plugin rocks... can have any of the spare computers I have on my network do some of the processing work.

Also how do I get it to fire off the commands as soon as it starts recording?

Last edited by Wheemer; 01-24-2009 at 09:20 PM.
Closed Thread


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Plugin: Sage Job Queue (SJQ) v3 Slugger SageTV Customizations 1355 07-25-2013 07:44 AM
Sage Job Queue (SJQ) new release notifications Slugger Customization Announcements 3 12-17-2009 09:59 AM
Sage Job Queue Completed tasks problem raffmanlt SageTV Customizations 2 08-18-2009 07:34 PM
Comskip Monitor VS Sage Job Queue SJQ personalt SageTV Customizations 6 03-02-2009 10:27 AM
Plugin: SJQ v1.1.0RC1 Available - Testers Needed Slugger SageTV Customizations 35 04-21-2008 08:12 AM


All times are GMT -6. The time now is 10:50 PM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.