Plugin: Schedules Direct EPG (not for v9)

[Ghildebr]

Here you go Slugger. Thanks for looking.
Gary

[Slugger]

Ok... so every epg update you tried before 14:51 failed, usually with this error:

Exception in thread "main" java.nio.file.AccessDeniedException: C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\sdjson.epg

You'll see that last at 14:45. And that's why you never got the data to show up. So, ok, this is a bit of a known issue. Known in that I've seen it, but unable to reproduce it. I know why you get that error (the plugin fails to close the file due to an unexpected error), but I'm unable to pin point where I'm not closing the file properly. So when you see that exact error (AccessDeniedException), indeed, you need to stop the Sage service and restart it (and to be extra safe, I'd just delete the sdjson.epg cache file and let the plugin create a new one). So yeah, in this case, you'd need to restart Sage, but only if you see that exact error. This error is why you couldn't just copy the file while Sage was running (usually you should be able to, but sometimes the plugin opens the file and never closes it).

[Ghildebr]

Thanks for the explanation. If there is anything I can do to assist in troubleshooting, just ask. I always try and help if I can.
Gary

[Slugger]

Well your log file forced me to spend an hour or so analyzing it and tracing thru the code. Pretty sure I've finally identified the reason for all of this. I describe that and the proposed fix in the new ticket I created for the issue. Have a read if you're interested.

The trick is getting me out of summer mode and back into my open source coding routine. I'm not quite there yet as my baseball season isn't quite over (just returning from a broken finger and separated shoulder so actually looking forward to getting a few games in before the season's over), the weather's still nice, etc., etc. So I think it's going to be a few weeks still before I get the urge to write code outside of the work day. Anyway, you've at least helped me identify the likely problem and a possible solution so that's a good start!

[TechBill]

I bookmarked the your sourceforge page but are you still plan keeping the website alive after Google discontinue SageTV EPG or this forum?

I am still using SageTV EPG however wanted to be able to make the switch when it ends if the instruction still around or should I make the switch now?

Bill

[Slugger]

I think the project site will exist until Source Forge dies. If Sage dies, I have no reason to take it down. I may stop working on it, but whatever state it ends up in should remain. So I guess the short answer is no, I won't kill the project site (or the downloads) just because Sage yanks the forums.

So do you need to migrate today? Absolutely not. If you're absolutely paranoid about suddenly losing access to all plugins, etc., I have the proverbial dooms day script floating around the forum somewhere that will download and create a mirror of the plugin repository. With that script, one could host the entire plugin repository from a local server on the LAN.*

* The script would need a few mods because what I actually wrote only mirrors what's hosted by SageTV's servers, but it isn't much to mod it so it mirrors everything. But now I digress, start a new thread if you're really interested in going that route.

[TechBill]

One thing I do noticed lately with SageTV is that many of the old shows reruns are coming back as not watched.

Now every week, I have to check the scheduling to see if any of those reruns are set to be recorded and set them watched manually to prevent it being recorded again.

Is the network programming is changing the show ID on the rerun shows or is it the EPG?

Will alternative EPG reduces this issue? Or it it pretty much all the same no matter who provide the EPG?


Thank you

Bill

[Slugger]

Not exactly sure what the issue is with the Sage listings, but moving to sdepg will actually cause more of the same in all likelihood. The reasons are discussed in the sdepg user's guide.

[panteragstk]

something odd is going on with my install. when I try to configure a lineup in the web interface i get an error 500 invalid user even though the web interface shows my SD account info on the status page.

I'm also not getting any lineup info in sage. no channels show up.

in the log I get an error "2014-09-12 19:38:38,584 ERROR [EpgDownloader]: stderr:
Exception in thread "main" java.lang.IllegalArgumentException: Illegal character in path at index 16: file:/C:/Program Files (x86)/SageTV Server/SageTV/plugins/sdepg/sdjson.epg
at com.sun.nio.zipfs.ZipFileSystemProvider.uriToPath(ZipFileSystemProvider.java:78)
at com.sun.nio.zipfs.ZipFileSystemProvider.newFileSystem(ZipFileSystemProvider.java:98)
at java.nio.file.FileSystems.newFileSystem(Unknown Source)
at java.nio.file.FileSystems.newFileSystem(Unknown Source)
at org.schedulesdirect.grabber.Grabber.updateZip(Grabber.java:476)
at org.schedulesdirect.grabber.Grabber.execute(Grabber.java:807)
at org.schedulesdirect.grabber.Grabber.main(Grabber.java:914)
Caused by: java.net.URISyntaxException: Illegal character in path at index 16: file:/C:/Program Files (x86)/SageTV Server/SageTV/plugins/sdepg/sdjson.epg
at java.net.URI$Parser.fail(Unknown Source)
at java.net.URI$Parser.checkChars(Unknown Source)
at java.net.URI$Parser.parseHierarchical(Unknown Source)
at java.net.URI$Parser.parse(Unknown Source)
at java.net.URI.<init>(Unknown Source)
at com.sun.nio.zipfs.ZipFileSystemProvider.uriToPath(ZipFileSystemProvider.java:76)
... 6 more

2014-09-12 19:38:38,587 ERROR [EPGImportPluginSchedulesDirect]: Download of EPG data failed!"

Log file is attached.

[Slugger]

Is this a new install or has this been working and this just started? Looks like you're running a relatively old version of Java 7 and you've hit a bug with the ZipFileSystemProvider implementation. If this is a new install, I would upgrade to the latest Java 7. What version are you running?

[Ghildebr]

Well here it is again, another Sunday, and I cannot get the guide data to download for the DirecTV 700 Sunday Ticket channels. Is there any way that someone at Schedules Direct could update the guide data, let's say a week in advance, so that I have a few days to troubleshoot any issues with guide data updates. Plus that would assist in the ability to set up and record a game. It's kinda hard to set up and record something that is not in the guide data.
Gary

[rkulagow]

I actually thought that the data was in the system a few days ago, but a "guard" routine that I wrote didn't protect the data from over write, so it was replaced with generic data. I put the data back in earlier this morning and updated the "lastUpdated" timestamp, so if you refreshed you would have picked up the games at 1P and 4P EDT.

I will put in data on 2014-09-15 for the games on 2014-09-21 so that you can figure out what's happening with your system and so that I can check what's happening with my code.

[Ghildebr]

Thanks
I don't seem to be having issues with the main channel lineups. I have guide data going out through 9/27 so I believe my end is working correctly. The only issue I have noticed is the Sunday Ticket games.
Gary

[rkulagow]

When you look into the raw data, are you seeing the game in the appropriate stationID? That will help determine if it's not being downloaded, or just not being inserted.

[Ghildebr]

I may not be doing this correct but what I believe your are asking for me to do is to unzip my sdjson.epg and then look at the text files for the particular ShowID. When I look down my channel list for all of the 704 through 718 channels for the 3:00 PM CST guide data, I have the exact same ShowID for all of those programs, SH010913610000. When I look inside the expanded zip I do not find a text file with that ShowID. I don't know if that is an issue with the guide or if that is an issue with the program. I hope this explanation helps.
Gary

[Slugger]

So channel 718 maps to a callsign (like STNFL1 or whatever) and that callsign maps to a station id - let's say it's 12345 (the actual one can be found using the web ui or in the stv by viewing your lineup or by looking in your lineup inside the zip file). You need that station id.

With that station id, you then go into the schedules dir from that zip file and look for a txt file with that station id and open it. Search for SP because actual game data will have a program id starting with SP. No SPs in the schedule, no game data. If the SP ids are showing up in the schedule files for the channels but aren't showing up in Sage then my plugin isn't processing the epg download properly and then you need to get me logs so I can try to figure out why. If there are SP program ids in the schedule then Schedules Direct isn't providing the game data so there's nothing for me to do on the sagetv end.

[Ghildebr]

Using your example and looking at channel 705 (HDNFL2) I show that it goes to the station ID of 61408. Then looking in the 61408.txt file I do not see anything with "SP". Is this an upgrade problem? I know rkulagow said that he was going to put next weeks games in today. I just did an update and still do not see guide data for next weeks games. Here is the logs and the files I used in this example. I do not see the AccessDeniedException that I was getting last week. I hope this helps figure things out.
Gary

[Slugger]

If there are no program ids in the schedule file starting with SP then the data isn't in the feed. Need to ask Robert if he's inserted it yet. The data never made it in for my lineup either yesterday, there was a bug in the server side processing. Robert will have to update us when he has a chance.

[rkulagow]

Slugger found an issue, which I need to fix before inserting the data again. I will let you know once that's done.

[rkulagow]

NFL schedules for DirecTV should be in the data now. Please do whatever you need to force a download, then let me know if it's appearing in the EPG.