SageTV Community

SageTV Community (http://forums.sagetv.com/forums/index.php)
-   SageTV v7 Customizations (http://forums.sagetv.com/forums/forumdisplay.php?f=47)
-   -   Plugin: Sage Recording Extender 4 (SREv4) (http://forums.sagetv.com/forums/showthread.php?t=57364)

Slugger 10-27-2011 08:46 PM

Plugin: Sage Recording Extender 4 (SREv4)
 
This is more of a preview/warning for those who may be considering an SREv3 only license. Please be aware that I am actively developing SREv4. No release date is available, but I'm aiming for "before Christmas holidays."

What's new?
  • A complete rewrite of the monitoring engine (and the reason for a new major point release)
  • New: Support for monitoring of "live" events only
  • New: Allow active monitors to have overrides added/removed/modified even while the recording is in progress

Planned, but not started and may not make it to v4:
  • Integration of the web UI into the web server plugin

Lost features:
  • The current SRE STVi will not work without an update from tmiranda

It is early - I don't even have a build of v4 running on my test server yet and I'm really not that close, but felt this was worth a post in case there are some who are considering an SREv3 license since it will not work with v4 - as per my project's policy. I don't want people upset if they buy a v3 license today only to have it invalidated within a few weeks to a couple months. This is that warning.

drewg 10-28-2011 07:15 AM

Do you have any plans to support moving recordings scheduled after live sports to compensate for overruns? For example, CBS never allows enough time for NFL Football on Sunday night, and all shows scheduled after football are typically delayed 30 or more minutes. Having a way to dynamically shift those recordings would be nice..

Drew

jbrandon 10-28-2011 07:21 AM

I too would like to see this feature...

Quote:

Originally Posted by drewg (Post 519067)
Do you have any plans to support moving recordings scheduled after live sports to compensate for overruns? For example, CBS never allows enough time for NFL Football on Sunday night, and all shows scheduled after football are typically delayed 30 or more minutes. Having a way to dynamically shift those recordings would be nice..

Drew


Slugger 10-28-2011 07:53 AM

Quote:

Originally Posted by drewg (Post 519067)
Do you have any plans to support moving recordings scheduled after live sports to compensate for overruns? For example, CBS never allows enough time for NFL Football on Sunday night, and all shows scheduled after football are typically delayed 30 or more minutes. Having a way to dynamically shift those recordings would be nice..

Drew

Quote:

Originally Posted by jbrandon (Post 519070)
I too would like to see this feature...

Sorry, this feature is just not as easy as it sounds to implement. I've discussed the reasons why I don't attempt this feature here.

Slugger 10-28-2011 08:05 AM

Quote:

Originally Posted by drewg (Post 519067)
Do you have any plans to support moving recordings scheduled after live sports to compensate for overruns? For example, CBS never allows enough time for NFL Football on Sunday night, and all shows scheduled after football are typically delayed 30 or more minutes. Having a way to dynamically shift those recordings would be nice..

Drew

Quote:

Originally Posted by jbrandon (Post 519070)
I too would like to see this feature...

Quote:

Originally Posted by Slugger (Post 519074)
Sorry, this feature is just not as easy as it sounds to implement. I've discussed the reasons why I don't attempt this feature here.

With that said, I am considering implementing a modification of this request as discussed here. Instead of trying to identify and extend recordings affected by sports run overs, I'm going to identify those recordings and try to reschedule them for a future airing.

So if your recording schedule is set to record 60 Minutes on CBS Sunday at 19:00 ET, but NFL Football is airing in front of it, SREv4 would identify that football precedes 60 Minutes and will look for another airing of 60 Minutes in the future and choose to record it instead. In this case, it would look for the airing on a west coast feed of CBS (for satellite/cable users), if it were available. If not, then SRE would do nothing and just leave the schedule as it is. Probably of no use to OTA/basic cable only users, but should help for satellite/digital cable users who have access to multiple time zone feeds of network stations.

Even this approach isn't as easy as it sounds to implement and may not make it to SREv4 depending on how testing goes.

drewg 10-28-2011 08:42 AM

I read that post, and I see what you mean. Since I'm an OTA user, your proposed solution would not be helpful to me, though I can see its merit for Sat viewers.

It seems like EIT might actually be helpful here. I wonder if the EIT data correctly reflects the schedule when the NFL overruns...?

Drew

Slugger 10-28-2011 08:45 AM

Quote:

Originally Posted by drewg (Post 519082)
I read that post, and I see what you mean. Since I'm an OTA user, your proposed solution would not be helpful to me, though I can see its merit for Sat viewers.

It seems like EIT might actually be helpful here. I wonder if the EIT data correctly reflects the schedule when the NFL overruns...?

Drew

Does the EIT data end up in your Sage EPG? If so, then Sage should just adjust accordingly if the EIT data is being updated.

drewg 10-28-2011 09:08 AM

Quote:

Originally Posted by Slugger (Post 519084)
Does the EIT data end up in your Sage EPG? If so, then Sage should just adjust accordingly if the EIT data is being updated.

I have Sage configured to use the normal Sage/Zap2It listings server, since it provides many large advantages over the EIT data (show descriptions, original air dates, etc).

I was just wondering if the EIT was correct, and if it was, if there was any way for an extension to use it..

Drew

Slugger 10-28-2011 10:11 AM

Quote:

Originally Posted by drewg (Post 519086)
I have Sage configured to use the normal Sage/Zap2It listings server, since it provides many large advantages over the EIT data (show descriptions, original air dates, etc).

I was just wondering if the EIT was correct, and if it was, if there was any way for an extension to use it..

Drew

Sage plugins don't have direct access to the tuner hardware and so no direct access to the EIT data. I can only use the data in the Sage EPG. External code could be written to grab the EIT data, but I'm not familiar with the requirements to do it nor do I have OTA tuners/data to even try it if I wanted to so it won't happen for this plugin.

Slugger 12-18-2011 08:12 PM

First release this week!
 
The first release of SREv4 is expected this coming week. Here are the key highlights:
  • Complete rewrite of the monitoring engine; lots of improvements both to functionality and performance
  • Support for modification of overrides while a recording is in progress. This allows you to modify the override for a recording after it has started or to change it during the recording. In v3, the override was locked into a recording once it started and could not be changed.
  • Support for monitoring only airings that have the 'Live' attribute set. This feature requires the licensed version of the plugin. Monitoring replays/tape delays of games can confuse SRE greatly. By telling SRE to only monitor 'live' airings you eliminate this headache. This feature requires that your EPG data provides the Live attribute and that it's accurate - this isn't always the case. Because of this, the feature is disabled by default.
  • Post game show padding (licensed version only): With the licensed version you can tell SRE to tack on a configured amount of padding to the end of a successfully monitored recording. This allows for recording of post game type shows/coverage.
  • Integration into nielm web UI: The separate web UI for SRE is no more. Instead, monitor status and override edits are dealt with in the nielm web UI (v2.32+). This provides a more integrated environment when dealing with SRE.
  • STVi updates available: tmiranda has graciously updated the STVi for SRE to support v4. The update should be available at the same time as the engine release.

This thread becomes the official support thread for SREv4. Please also note that effective immediately, SREv3 is no longer supported.

tmiranda 12-19-2011 07:01 AM

STVi highlight: You will have the ability to hide the timeline for recordings that were monitored by SRE. I always found it annoying that you could more or less predict if the game was going into OT by looking at the time remaining in the timeline. Now you can simply turn the timeline off.

vividweb 12-19-2011 09:43 AM

Quote:

Originally Posted by tmiranda (Post 522831)
STVi highlight: You will have the ability to hide the timeline for recordings that were monitored by SRE. I always found it annoying that you could more or less predict if the game was going into OT by looking at the time remaining in the timeline. Now you can simply turn the timeline off.

Yes but if your team was losing it would give you hope they would come back, and I've seen a lot of losing lately.

cat6man 12-19-2011 10:36 AM

hi slugger,

i don't use SRE until baseball season but i'll be happy to test/debug in a leisurely mode before spring.

glad to see SRE4 is coming along nicely..........i'm looking forward to it.

cheers

p.s. i think i'd rather see darvish on the rangers that the jays............he could be very very good and the AL east is getting crazy strong.

tmiranda 12-19-2011 12:42 PM

Quote:

Originally Posted by vividweb (Post 522843)
Yes but if your team was losing it would give you hope they would come back, and I've seen a lot of losing lately.

You can leave the timeline on (default behavior), turning it off is purely optional. I've been testing for a couple of weeks and I really like the disabled timeline :)

Slugger 12-21-2011 03:46 PM

First SREv4 beta now available
 
The first SREv4 beta is now in the repository. Please go over the plugin configuration carefully after installing/upgrading. All settings will revert to default values and will ignore any previous SREv3 settings.

The web UI is now integrated into the nielm web UI. Click on a recording (active or scheduled) to see/edit override information. This requires the v2.32 web UI update (just released along side this SRE update).

Please note that the old STVi for SREv3 will not work with v4. Expect an update from tmiranda later this evening. (We were suppose to release together later this evening, but I have to head out of town unexpectedly this evening.)

Enjoy...

tmiranda 12-21-2011 04:27 PM

The SRE UI update has just been posted.

One new addition is the ability to hide the OSD timeline for shows that were monitored by SRE. You have the ability to change the behavior in either the SRE options menu or the OSD options menu.

Merry Christmas,

Tom

cat6man 12-21-2011 05:35 PM

slugger + tmiranda,

thanks a lot for all your work on SRE. it's much appreciated in this household.

happy holidays to everyone and have a merry GooglySage new year.


update: got it all loaded and ready to play. anyone know what the web address is now for the web browser access to
SRE?

i was using
http://192.168.xxxx.xxx:8500/sre/SRE3.html which no longer works, but replacing SRE3 with SRE4 didn't work either.

update2: typical of an engineer......read the instructions last...........the SRE UI no longer exists and i need to update nielm's UI...........
now to hunt for that

tmiranda 12-21-2011 07:22 PM

Look in the plugin manager for the "SageTV Web Interface".

Just an FYI - If you install the SRE UI Mod plugin you don't need the Web Interface.

razrsharpe 12-21-2011 07:22 PM

Quote:

Originally Posted by cat6man (Post 522944)
update2: typical of an engineer......read the instructions last...........the SRE UI no longer exists and i need to load nielm's UI.
where do i find thie nielm UI?

its the normal webui... so something like http://ipaddress : port/sage/Home

cat6man 12-21-2011 07:35 PM

Quote:

Originally Posted by tmiranda (Post 522946)
Look in the plugin manager for the "SageTV Web Interface".

Just an FYI - If you install the SRE UI Mod plugin you don't need the Web Interface.

ok.................turns out i had the updates, was using the webUI (for years), but didn't see anything until i recorded a SRE-able sporting event.........shows up fine on TV screen (yea!), SRE status in webUI says it is being monitored (yea!) but i get a 404 error when i try to edit it in the webUI.

404 not found
http://192.168.xxx.xxxx:8080/sage/sr...dit&id=6032001

so it looks like it works for me except for override/edit

update: override works fine from STVi on tv set.................neither edit nor delete works in webUI for me

Slugger 12-21-2011 11:28 PM

Quote:

Originally Posted by cat6man (Post 522948)
ok.................turns out i had the updates, was using the webUI (for years), but didn't see anything until i recorded a SRE-able sporting event.........shows up fine on TV screen (yea!), SRE status in webUI says it is being monitored (yea!) but i get a 404 error when i try to edit it in the webUI.

404 not found
http://192.168.xxx.xxxx:8080/sage/sr...dit&id=6032001

so it looks like it works for me except for override/edit

update: override works fine from STVi on tv set.................neither edit nor delete works in webUI for me

Can you check the sagetv_0.txt log file for any exceptions? Is anyone else able to reproduce this? I'm not, but I see a possible packaging error, which could be responsible for something like this.

Also check SageTV\jetty\webapps\nielm_sagewebserver\webapp\ for the file sre4.groovy (along with some *.gsp files). Do they exist?

EDIT: The packaging error was only on my test server, it does not exist in the war file uploaded to the repository so there is no issues with the packaging. I'm not not able to reproduce this, hopefully someone else can or you can get me some logs with exceptions, etc.

wayner 12-22-2011 11:30 AM

Quote:

Originally Posted by tmiranda (Post 522831)
STVi highlight: You will have the ability to hide the timeline for recordings that were monitored by SRE. I always found it annoying that you could more or less predict if the game was going into OT by looking at the time remaining in the timeline. Now you can simply turn the timeline off.

Brilliant! I have had the same issue, particularly with hockey playoffs. Thank you very much for implementing.

wayner 12-22-2011 11:45 AM

@slugger - there are some plugins called live pvrdata4j and livepvrdata-shared. Are these still used?

Slugger 12-22-2011 12:06 PM

Quote:

Originally Posted by wayner (Post 522972)
@slugger - there are some plugins called live pvrdata4j and livepvrdata-shared. Are these still used?

Yes, they're listed as dependencies of SREv4 and definitely are needed.

tmiranda 12-22-2011 02:59 PM

Quote:

Originally Posted by wayner (Post 522972)
@slugger - there are some plugins called live pvrdata4j and livepvrdata-shared. Are these still used?

If you want to eliminate unnecessary plugins, I created a plugin called "Remove Plugin and Dependencies". You can install that and then run through all of the plugins you have installed to see if they are needed. :)

wayner 12-22-2011 05:54 PM

Quote:

Originally Posted by Slugger (Post 522973)
Yes, they're listed as dependencies of SREv4 and definitely are needed.

OK great - I thought that they might have been from previous versions as I remember you saying that the livepvr project kind of died.

tmiranda 12-22-2011 06:02 PM

Quote:

Originally Posted by wayner (Post 522990)
OK great - I thought that they might have been from previous versions as I remember you saying that the livepvr project kind of died.

Slugger brought it back from the dead.

cat6man 12-23-2011 02:06 PM

Quote:

Originally Posted by Slugger (Post 522953)
Can you check the sagetv_0.txt log file for any exceptions? Is anyone else able to reproduce this? I'm not, but I see a possible packaging error, which could be responsible for something like this.

Also check SageTV\jetty\webapps\nielm_sagewebserver\webapp\ for the file sre4.groovy (along with some *.gsp files). Do they exist?

sre4.groovy is there, along with set_tvdb.groovy and sre4_edit.gsp

didn't see a sagetv_0.txt file dated after november, so need to turn logging on next.

cat6man 12-23-2011 03:12 PM

1 Attachment(s)
does this help?

Slugger 12-23-2011 03:22 PM

Have you restarted Sage since upgrading? When you upgraded the web UI you may not have been told you had to restart Sage by the core. Because of the way I changed how the war file is packaged, Sage must be restarted after each update, but the core may think it can avoid it the first time - incorrectly. That's all I've got because there are no SRE nor WebUI exceptions in that log file. Perhaps up the logging level on the Jetty web server next?

spacecadet 12-24-2011 07:15 AM

Quote:

Originally Posted by Slugger (Post 523045)
Have you restarted Sage since upgrading? When you upgraded the web UI you may not have been told you had to restart Sage by the core. Because of the way I changed how the war file is packaged, Sage must be restarted after each update, but the core may think it can avoid it the first time - incorrectly. That's all I've got because there are no SRE nor WebUI exceptions in that log file. Perhaps up the logging level on the Jetty web server next?

I'm probably being daft, but where in the Web UI do I find the SRE configuration stuff? I've poked around and I can't seem to find it. I'm running all the latest software. The sre4.groovy file is located in the webapp directory as you pointed out above.

Only oddity I can see is that if I go to http://server:port/apps, the Web UI reports that I am running v 2.32.1729. But if I go to the Web UI home page at http://server:port/sage/Home, the version at the bottom of the page is still 2.31.

Any thoughts?

spacecadet 12-24-2011 07:19 AM

Quote:

Originally Posted by spacecadet (Post 523077)
I'm probably being daft, but where in the Web UI do I find the SRE configuration stuff? I've poked around and I can't seem to find it. I'm running all the latest software. The sre4.groovy file is located in the webapp directory as you pointed out above.

Only oddity I can see is that if I go to http://server:port/apps, the Web UI reports that I am running v 2.32.1729. But if I go to the Web UI home page at http://server:port/sage/Home, the version at the bottom of the page is still 2.31.

Any thoughts?

Nevermind, I found it. I was expecting to see the new hooks on the left hand menu when I viewed an upcoming recording, but they were hidden at the bottom of the box containing the program description.

However, I'm still not sure where to go to edit SRE configuration options (how long to pad by default, etc).

Slugger 12-24-2011 07:30 AM

Quote:

Originally Posted by spacecadet (Post 523078)
Nevermind, I found it. I was expecting to see the new hooks on the left hand menu when I viewed an upcoming recording, but they were hidden at the bottom of the box containing the program description.

I think my plan is to eventually move them here, maybe. Does the edit link work for you? So far only one person is reporting problems, it seems no one else can reproduce the failure.

Quote:

However, I'm still not sure where to go to edit SRE configuration options (how long to pad by default, etc).
You have to go to the plugin configuration screen in the STV, for now. A future update will add the config ability to the web.

spacecadet 12-24-2011 07:31 AM

Quote:

Originally Posted by spacecadet (Post 523078)
Nevermind, I found it. I was expecting to see the new hooks on the left hand menu when I viewed an upcoming recording, but they were hidden at the bottom of the box containing the program description.

However, I'm still not sure where to go to edit SRE configuration options (how long to pad by default, etc).

Nevermind, I've now found the configuration, too.

Here are the helpful for the other n00bs (like me):

1. After upgrading, you'll need to configure the plugin using the Sage TV UI:
* From the Main Menu, Navigate to Setup -> SageTV Plugins -> Installed Plugins
* In the top bar, highlight General and select Sage Recording Extender (SRE) from the list of installed plugins
* Choose Configure Plugin from the popup dialog

2. In the Web UI, you can check the SRE status of an upcoming recording, edit and delete your overrides by navigating to the detail of an in-progress or upcoming recording. The SRE options are available in box containing the program description, just below the Show ID. See attached screen shot.

http://kuder.dyndns.org:8080/sre_webui.png

spacecadet 12-24-2011 08:04 AM

Quote:

Originally Posted by Slugger (Post 523080)
I think my plan is to eventually move them here, maybe. Does the edit link work for you? So far only one person is reporting problems, it seems no one else can reproduce the failure.

Yes, the edit link worked for me, but i haven't actually tried to create an override yet.

Quote:

Originally Posted by Slugger (Post 523080)
You have to go to the plugin configuration screen in the STV, for now. A future update will add the config ability to the web.

Yes, thanks. I finally figured that out. I'm not used to going there to configure plugins, so I had forgotten this feature existed.

So, I think I'm all set for now... at least until 1:00 when the games start and the monitoring begins!

Thanks! :goodjob:

cat6man 12-24-2011 07:27 PM

Quote:

Originally Posted by spacecadet (Post 523083)
Yes, the edit link worked for me, but i haven't actually tried to create an override yet.
:

:confused:

well, i guess it's just me getting a 404 page not found on edit/delete.
maybe i messed up the installation some how.........

Slugger 12-24-2011 07:30 PM

Quote:

Originally Posted by cat6man (Post 523111)
:confused:

well, i guess it's just me getting a 404 page not found on edit/delete.
maybe i messed up the installation some how.........

Did you up the jetty logging and try to reproduce?

What happens if you just go to http://w.x.y.z/sage/sre4_edit.gsp or http://w.x.y.z/sage/sre4.groovy

spacecadet 12-26-2011 05:19 AM

Got an error yesterday on the Celtics/Knicks game and the recording did not extend. In the system messages, there was an info message at 2:30: "Partial Recording Due to Conflict. The recording of "NBA Basketball" on TNTHD at Sun 12/25 12:00 was not completed because of conflicts recording on other tuners. A partial recording of that program has been saved." Prior to this happening, the UI was showing a green checkmark indicating that the game was being monitored.

The recording ended at 2:30 and was not extended. There were no other recordings going on at the time (so I am not sure what the nature of the conflict would be).

I have debug logging turned on for Sage, but I don't see anything odd around 2:30 yesterday in the sagetv log file. I don't see any SRE messages in this log, so I am not sure if I have the SRE logging turned on (or if I am looking in the right file for them). I would be happy to send you what I have, just let me know.

I'll try a couple more recordings today. SRE would seem to otherwise (green checkmarks in the UI, etc.

Brian

Slugger 12-26-2011 09:15 AM

Have a look in SageTV\plugins\sre4\sre.log, but that system message is not from SRE, but from the core. For some reason, the core decided to stop the recording at 2:30 because it felt it needed to record something else. The sagetv_0.txt log should at least tell you what it felt it needed to start recording at 2:30. The SRE log file might provide some additional info as well.

spacecadet 12-26-2011 11:55 AM

Quote:

Originally Posted by Slugger (Post 523152)
Have a look in SageTV\plugins\sre4\sre.log, but that system message is not from SRE, but from the core. For some reason, the core decided to stop the recording at 2:30 because it felt it needed to record something else. The sagetv_0.txt log should at least tell you what it felt it needed to start recording at 2:30. The SRE log file might provide some additional info as well.

Yup I understood that this was a core message. But since the SRE monitored recording was the only activity going on (and having just upgraded SRE), I was suspicious.

So, I found the SRE.log. For those watching at home, the log is in %SAGETV_HOME%/SageTV/plugins/sre4/sre.log.

Based on the SRE.log, this definitely looks like an SRE problem related to enabling the option for "Ignore back to back recordings", which I have set to True. Even though the Celtics game was being recorded as a favorite, I was watching live for awhile and then turned the game off with about 1/2 hour to go. When I came back to the game, I found the recording had been stopped at 2:30. Because I had been watching live, it looks like SRE mistakenly (or correctly?) thought the next program was going to record and did not monitor the game. That seems like new behavior in v4, since I also used this option in v3 and do not remember this happening.

I'll just disable that feature for now, since it's primary use is for Sunday afternoon football and there's only 1 week left.

Here is the excerpt from the SRE log:

Code:

2011-12-25 14:26:00,003 INFO : 18268573/NBA Basketball: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 14:28:00,003 INFO : 18268573/NBA Basketball: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 14:30:00,003 INFO : 18268573/NBA Basketball: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 14:59:30,222 INFO : 18268562/Men in Black II: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 15:00:00,003 INFO : 18268562/Men in Black II: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 15:02:00,003 INFO : 18268562/Men in Black II: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.

The same issue occurred later in the day for the Packers/Bears game. I had that one set up as a manual recording and was watching it live. The game ended on time, but it seems from the log that it also would not have extended due to the "back to back" flag.

Code:

2011-12-25 23:25:00,013 INFO : 18282618/NFL Football: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 23:27:00,013 INFO : 18282618/NFL Football: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 23:29:00,013 INFO : 18282618/NFL Football: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 23:30:00,247 INFO : 18282610/7 News: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 23:32:00,013 INFO : 18282610/7 News: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.
2011-12-25 23:34:00,013 INFO : 18282610/7 News: Monitor disabled because ignore back to back is enabled and the next airing is scheduled to record.

Hope this helps and thanks as always!

Brian


All times are GMT -6. The time now is 02:03 AM.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.