Plugin: Schedules Direct EPG (not for v9)

[jt4242]

You've made me look more carefully at my output and it is not in the form s04e21 but 421.

I did find this info in the xml file generated by the grabber (I'm pasting tomorrow night's episode of Person of Interest at the bottom of this posting)

It does show a couple of categories and the season/episode as 421 and it shows in my listings in the PC client as:
Person of Interest (2015) Tuesday 10:01pm
"Asylum - e421" WCAXDT1

<programme start="20150428220100 -0400" stop="20150428230000 -0400" channel="I3.1.44991.schedulesdirect.org">
<title lang="en">Person of Interest</title>
<sub-title lang="en">Asylum</sub-title>
<desc lang="en">Fusco and Reese are caught in a rivalry between two crime bosses, Elias (Enrico Colantoni) and Dominic (Winston Duke); a clue regarding Shaw's location may result in Root and Finch being caught in a trap.</desc>
<credits>
<actor>Jim Caviezel</actor>
....... (cut)
<director>Fred Toye</director>
</credits>
<date>20150428</date>
<category lang="en">Crime drama</category>
<category lang="en">Series</category>
<episode-num system="onscreen">421</episode-num>
<episode-num system="dd_progid">EP01419847.0089</episode-num>
<video>
<aspect>16:9</aspect>
<quality>HDTV</quality>
</video>
<audio>
<stereo>dolby</stereo>
</audio>
<new />
<subtitles type="teletext" />
</programme>

[nyplayer]

Originally Posted by jt4242

You've made me look more carefully at my output and it is not in the form s04e21 but 421.

I did find this info in the xml file generated by the grabber (I'm pasting tomorrow night's episode of Person of Interest at the bottom of this posting)

It does show a couple of categories and the season/episode as 421 and it shows in my listings in the PC client as:
Person of Interest (2015) Tuesday 10:01pm
"Asylum - e421" WCAXDT1

<programme start="20150428220100 -0400" stop="20150428230000 -0400" channel="I3.1.44991.schedulesdirect.org">
<title lang="en">Person of Interest</title>
<sub-title lang="en">Asylum</sub-title>
<desc lang="en">Fusco and Reese are caught in a rivalry between two crime bosses, Elias (Enrico Colantoni) and Dominic (Winston Duke); a clue regarding Shaw's location may result in Root and Finch being caught in a trap.</desc>
<credits>
<actor>Jim Caviezel</actor>
....... (cut)
<director>Fred Toye</director>
</credits>
<date>20150428</date>
<category lang="en">Crime drama</category>
<category lang="en">Series</category>
<episode-num system="onscreen">421</episode-num>
<episode-num system="dd_progid">EP01419847.0089</episode-num>
<video>
<aspect>16:9</aspect>
<quality>HDTV</quality>
</video>
<audio>
<stereo>dolby</stereo>
</audio>
<new />
<subtitles type="teletext" />
</programme>

Unfortunately Sage does not use that to name the files PersonofInterest(2015).S04E21.Asylum That is only on the OSD. But it is an Option.

[rdefino]

I installed the latest plugin and now I;m getting this watchdog error. I tried deleting the cache file also.

2015-04-28 11:06:02,815 ERROR [Plugin]: Error in Watchdog
java.nio.file.FileSystemNotFoundException: C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\sdjson.epg
at com.sun.nio.zipfs.ZipFileSystem.<init>(ZipFileSystem.java:120)
at com.sun.nio.zipfs.ZipFileSystemProvider.newFileSystem(ZipFileSystemProvider.java:117)
at java.nio.file.FileSystems.newFileSystem(Unknown Source)
at java.nio.file.FileSystems.newFileSystem(Unknown Source)
at org.schedulesdirect.api.ZipEpgClient.<init>(ZipEpgClient.java:148)
at org.schedulesdirect.api.ZipEpgClient.<init>(ZipEpgClient.java:212)
at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.lang.reflect.Constructor.newInstance(Unknown Source)
at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:77)
at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrapNoCoerce.callConstructor(ConstructorSite.java:102)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:190)
at sagex.epg.schedulesdirect.plugin.Plugin$_startWatchdog_closure2.doCall(Plugin.groovy:174)
at sagex.epg.schedulesdirect.plugin.Plugin$_startWatchdog_closure2.doCall(Plugin.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233)
at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:272)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:906)
at groovy.lang.Closure.call(Closure.java:415)
at groovy.lang.Closure.call(Closure.java:409)
at groovy.lang.Closure.run(Closure.java:493)
at java.lang.Thread.run(Unknown Source)

[Slugger]

That error is caused by deleting the cache file (and can be ignored, usually). Force an epg update, which should regenerate the cache file and that'll make Barky (the watchdog -- yeah I know) happy.

If the error persists after forcing an epg update then there's reason for concern.

[rdefino]

I see this in the log now:

2015-04-28 11:24:28,121 ERROR [EPGImportPluginSchedulesDirect]: Cannot process an empty lineup map!
2015-04-28 11:24:28,122 INFO [EPGImportPluginSchedulesDirect]: Performed lineup map configuration in 11559ms
2015-04-28 11:24:33,203 ERROR [EPGImportPluginSchedulesDirect]: Error processing EPG zip data!
org.schedulesdirect.api.exception.InvalidJsonObjectException: Program[SP003182260000]: JSONArray[1] is not a JSONObject.
at org.schedulesdirect.api.Program.<init>(Program.java:749)
at org.schedulesdirect.api.ZipEpgClient.fetchProgram(ZipEpgClient.java:301)
at org.schedulesdirect.api.ZipEpgClient.fetchSchedule(ZipEpgClient.java:270)
at org.schedulesdirect.api.ZipEpgClient.fetchSchedules(ZipEpgClient.java:319)
at org.schedulesdirect.api.Lineup.fetchDetails(Lineup.java:139)
at org.schedulesdirect.api.ZipEpgClient.getLineups(ZipEpgClient.java:360)
at org.schedulesdirect.api.ZipEpgClient.getLineupByUriPath(ZipEpgClient.java:460)
at org.schedulesdirect.api.ZipEpgClient$getLineupByUriPath.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
at sagex.epg.schedulesdirect.EPGImportPluginSchedulesDirect.doUpdate(EPGImportPluginSchedulesDirect.groovy:373)
at sagex.epg.schedulesdirect.EPGImportPluginSchedulesDirect.updateGuide(EPGImportPluginSchedulesDirect.groovy:210)
at sage.ae.y(Unknown Source)
at sage.a2.e(Unknown Source)
at sage.a9.dK(Unknown Source)
at sage.ae.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: org.json.JSONException: JSONArray[1] is not a JSONObject.
at org.json.JSONArray.getJSONObject(JSONArray.java:296)
at org.schedulesdirect.api.Program.<init>(Program.java:725)
... 17 more
2015-04-28 11:24:33,205 INFO [AiringGenerator]: Processed airing generators in 0ms
2015-04-28 11:24:33,206 INFO [SeriesInfoLoader]: Generated series info entries for 0 objects in 0ms!

[rkulagow]

The JSON on the server for that program looks like this: (assuming that the error is something about this program

{
"programID": "SP003182260000",
"titles": [
{
"title120": "College Baseball"
}
],
"eventDetails": {
"venue100": "Cliff Hagan Stadium",
"teams": [
{
"name": "Kentucky",
"isHome": true
},
[]
],
"gameDate": "2015-05-12"
},
"descriptions": {
"description1000": [
{
"descriptionLanguage": "en",
"description": "From Cliff Hagan Stadium in Lexington, Ky."
}
],
"description100": [
{
"descriptionLanguage": "en",
"description": "From Cliff Hagan Stadium."
}
]
},
"originalAirDate": "2015-05-12",
"genres": [
"Baseball"
],
"episodeTitle150": "Northern Kentucky at Kentucky",
"showType": "Sports event",
"md5": "yCtAjdH5WXAsmiCxwav2mg"
}

It looks like there's an error in the eventDetails; one of the teams seems to be empty, and that's an upstream error that I will get fixed.

Are you using API 20140530 or 20141201?

[Slugger]

It's api 1201 and the bad team data is the cause. So it's an upstream problem. When that's fixed, blast away the current cache and you should be good to go on a rebuild of the cache.

If you feel like it, please log this as a bug as well. Though the cause is bad upstream data, I probably shouldn't abort the full data load when I hit this problem; seems a more graceful solution would be better.

[rdefino]

Originally Posted by Slugger

It's api 1201 and the bad team data is the cause. So it's an upstream problem. When that's fixed, blast away the current cache and you should be good to go on a rebuild of the cache.

If you feel like it, please log this as a bug as well. Though the cause is bad upstream data, I probably shouldn't abort the full data load when I hit this problem; seems a more graceful solution would be better.

Is this in-regrades to my issue? If so, how do I log a bug? Is it with SD?

also, how do I know when the upstream is fixed?


Thanks

[Slugger]

Yeah so if you want to track the upstream problem with the data, open a ticket at Schedules Direct: https://www.schedulesdirect.org/lineupsupport

That would be for tracking the bad data being provided by SD.

Then to open a bug for me to fix how I handle this situation, open a bug against the sdjson-api:

https://github.com/Slugger/sdjson-api/issues

Then you need to open a bug against the sdepg plugin to update to a version of the api with the above fix in it and do another release:

https://sourceforge.net/p/sagetv-add...?source=navbar

Then you need to bug me to actually fix it all (not the SD data bug, that's not me), and that's going to be your challenge because it's finally in the upper teens/low 20s around here (mid 60s/low 70s for those not using the metric system) and I'm pretty much in shutdown the Eclipse IDE for the summer mode. Your best bet is to pray it rains on a Sunday over the next couple weekends. Otherwise, I'm afraid I won't tackle this kind of bug until the fall. Mind you, once the upstream data is fixed by SD then this bug of mine isn't really an issue (though if it were logged I'd still fix it - eventually).

[rkulagow]

The upstream (Schedules Direct servers) has been fixed, so if you request that programID you should get one that doesn't have the error in it.

I'm still finding out from Gracenote if they're sending us bad data, but if they are we don't pass it along anymore.

[rdefino]

Originally Posted by Slugger

Yeah so if you want to track the upstream problem with the data, open a ticket at Schedules Direct: https://www.schedulesdirect.org/lineupsupport

That would be for tracking the bad data being provided by SD.

Then to open a bug for me to fix how I handle this situation, open a bug against the sdjson-api:

https://github.com/Slugger/sdjson-api/issues

Then you need to open a bug against the sdepg plugin to update to a version of the api with the above fix in it and do another release:

https://sourceforge.net/p/sagetv-add...?source=navbar

Then you need to bug me to actually fix it all (not the SD data bug, that's not me), and that's going to be your challenge because it's finally in the upper teens/low 20s around here (mid 60s/low 70s for those not using the metric system) and I'm pretty much in shutdown the Eclipse IDE for the summer mode. Your best bet is to pray it rains on a Sunday over the next couple weekends. Otherwise, I'm afraid I won't tackle this kind of bug until the fall. Mind you, once the upstream data is fixed by SD then this bug of mine isn't really an issue (though if it were logged I'd still fix it - eventually).

Ok, so i'll open the tickets, but does this mean I won't get any program guide now?

[rkulagow]

If you clear your local cache of programs (either all programs, or just the ones that have an error in them - on the server I did a delete of any program that had %[]% in the JSON) and re-download you'll get fresh copies of the programs and they won't have the [] in them anymore.

[rdefino]

Originally Posted by rkulagow

If you clear your local cache of programs (either all programs, or just the ones that have an error in them - on the server I did a delete of any program that had %[]% in the JSON) and re-download you'll get fresh copies of the programs and they won't have the [] in them anymore.

I do see a particular program having an issue? Are you talking about my issue?

I have this in my log:


Caused by: org.schedulesdirect.api.exception.InvalidJsonObjectException: Program[SP003182260000]: JSONArray[1] is not a JSONObject.
at org.schedulesdirect.api.Program.<init>(Program.java:749)
at org.schedulesdirect.api.ZipEpgClient.fetchProgram(ZipEpgClient.java:301)
at org.schedulesdirect.api.ZipEpgClient.fetchSchedule(ZipEpgClient.java:270)
at org.schedulesdirect.api.ZipEpgClient.fetchSchedules(ZipEpgClient.java:319)
at org.schedulesdirect.api.Lineup.fetchDetails(Lineup.java:139)
at org.schedulesdirect.api.ZipEpgClient.getLineups(ZipEpgClient.java:360)
at org.schedulesdirect.api.ZipEpgClient$getLineups.call(Unknown Source)
at sagex.epg.schedulesdirect.EPGImportPluginSchedulesDirect.getProviders(EPGImportPluginSchedulesDirect.groovy:125)
at sage.EPGImportPlugin$getProviders.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at sage.EPGImportPlugin$getProviders.call(Unknown Source)
at sagex.epg.schedulesdirect.plugin.Plugin.forceEpgRefresh(Plugin.groovy:128)
at sagex.epg.schedulesdirect.plugin.Plugin.forceEpgRefresh(Plugin.groovy)
at sagex.epg.schedulesdirect.plugin.Plugin.refreshEpgData(Plugin.groovy:203)
... 30 more
Caused by: org.json.JSONException: JSONArray[1] is not a JSONObject.
at org.json.JSONArray.getJSONObject(JSONArray.java:296)
at org.schedulesdirect.api.Program.<init>(Program.java:725)
... 43 more
2015-04-28 13:42:14,137 WARN [Plugin]: Failed to handle ButtonClickHandler: 'sdepg/refresh' in class: sagex.epg.schedulesdirect.plugin.Pl

[rkulagow]

Right, but on the server that particular programID has been deleted, so if your client requests it again, it will force the server to rebuild it, and it will be built without the error.

[rdefino]

Originally Posted by rkulagow

Right, but on the server that particular programID has been deleted, so if your client requests it again, it will force the server to rebuild it, and it will be built without the error.

Ok cool. So do you want me to delete the sdjson.epg file and rebuild it?

[rkulagow]

That's a slugger question...

[Slugger]

Yes, delete the cache and force an epg update.

[rkulagow]

I just found one more place where the data was being built improperly, and it looks like you just did a refresh (and so you'll still get the bad data.)

Once it errors out please give me a few minutes and I'll get it fixed.

[rkulagow]

OK, I've confirmed that the data doesn't have the empty "team".

{
"programID": "SP003182260000",
"titles": [
{
"title120": "College Baseball"
}
],
"eventDetails": {
"venue100": "Cliff Hagan Stadium",
"teams": [
{
"name": "Kentucky",
"isHome": true
}
],
"gameDate": "2015-05-12"
},
"descriptions": {
"description1000": [
{
"descriptionLanguage": "en",
"description": "From Cliff Hagan Stadium in Lexington, Ky."
}
],
"description100": [
{
"descriptionLanguage": "en",
"description": "From Cliff Hagan Stadium."
}
]
},
"originalAirDate": "2015-05-12",
"genres": [
"Baseball"
],
"episodeTitle150": "Northern Kentucky at Kentucky",
"showType": "Sports event",
"md5": "2cBwzNG0BEbEitDZOZnlNA"
}

If you refresh you should be OK.

[AzJazz]

Hi, Slugger - I am having a new problem with the SD EPG plug-in.

A few weeks ago, there must have been an update to the plug-in. I started to see a yellow installation failure error with the SD EPG plug-in:

So, I uninstalled the SD EPG plug-in and attempted to reinstall it.

Unfortunately, no luck. I couldn't reinstall the SD plug-in.

I had to leave on a business trip, and just got back. I'm attacking the problem again.

One thing that I see that could be a clue. There are about a half-dozen "Plugin Missing Installed File" errors on the System Messages screen. Here a a few:

Any ideas on why the plugin installation keeps failing, and is there a solution? I hope I don't have to reinstall my channel line-up again. It sure was a pain-in-the rear to get it configured right.

Thanks,

AzJazz