Plugin: Schedules Direct EPG (not for v9)

[Slugger]

Originally Posted by JerryB

I use Verizon FIOS.

After updating the plugin, I no longer download the epg file from SD.

Here are the log files.

I seemed to have broken the force refresh button even more than it already was. You need to delete the sdjson.epg file from SageTV\plugins\sdepg\ then manually force an EPG update by other means (either via the web UI or by enable/disable a channel in one of your lineups from the STV). The force button is broken in the plugin options screen for now.

[JerryB]

I forced and epg download through the Web UI and I'm back to where I was earlier today with the SDEPG plugin not processing the downloaded epg file.

Here are the log files.

[Slugger]

Originally Posted by JerryB

I forced and epg download through the Web UI and I'm back to where I was earlier today with the SDEPG plugin not processing the downloaded epg file.

Here are the log files.

Delete the sdjson.epg file from plugins/sdepg/ dir. Then force the EPG update again (from web UI). If the log has the same error & stack trace just reply and let me know that then I'll dig into it some more. I'd like to see you download a fresh epg file with the latest client build to see if that fixes things.

[Slugger]

Originally Posted by JerryB

I forced and epg download through the Web UI and I'm back to where I was earlier today with the SDEPG plugin not processing the downloaded epg file.

Here are the log files.

Originally Posted by Slugger

Delete the sdjson.epg file from plugins/sdepg/ dir. Then force the EPG update again (from web UI). If the log has the same error & stack trace just reply and let me know that then I'll dig into it some more. I'd like to see you download a fresh epg file with the latest client build to see if that fixes things.

Nevermind, I see the problem. New build later tonight.

[rdefino]

So the comcast line seems to be working fine (thank you), but the OTA shows no data in the guide for my locals channels.

[Slugger]

New build available that fixes NPE with program language determination (JerryB's stack trace fixed).

[Slugger]

Originally Posted by rdefino

So the comcast line seems to be working fine (thank you), but the OTA shows no data in the guide for my locals channels.

OTA... so my guess now is that your OTA channels are not mapped to the SD channel ids.

In Sage, go to your tuner config. Select your OTA lineup. Edit your channels. Pick a few channels. What is the reported station id for them? If they're below 10000 then it's a mapping issue as discussed in the SageTV user guide. This is not a unique problem to using my plugin for EPG data. Scanned in OTA channels (usually) need to be mapped to the EPG's station ids if not using EIT data. Assuming I'm right, you need to manually remap the station ids to the proper numbers. The "proper" numbers can be found inside the sdjson.epg file (it's just a zip file so open it with your favourite zip viewer).

[rdefino]

I just check a few and for instance I have:

station, wbzdt, ID: 20431

station wcvbdt, idL 19586


The channels play fine, just no data.

[JerryB]

I want to confirm that the latest build fixes the problem I was having with processing epg data. I forced an manual download of program data using the Web UI and the plugin processed the data and assigned the correct program language without needing the airing filter that I was previously using.

The only residual issue at my end is the inability to force an epg update from the plugin configuration screen and this isn't a major problem since, outside of testing purposes, I never force an epg update and even then I can force the update using the Web UI.

[rdefino]

So the ID's match what's in the sdjson.epg file, and they are above 10000.

Any other thoughts?

[Slugger]

Open the sdjson.epg file with a zip viewer. Go to the schedules dir inside the zip. Are there files for those station ids in there?

[rdefino]

Yes, there are txt files matching the ids.

[Slugger]

Something's not mapped right between your lineup and the station ids. Since the station schedules are in the epg file, my plugin is definitely loading that data into wiz.bin unless there are different/new errors in the sdepg.log file?

If you run the web ui plugin and you're willing to give me access to it, there are things I can check out rather quickly.

Alternatively, I can write some debug scripts to dump info to a file for me to look at. The debug scripts will take me time to write. Maybe I have time tomorrow morning, maybe not. If not, then it won't be until Sunday night before I'll have a chance.

[rdefino]

How would I do "you run the web ui plugin and you're willing to give me access to it"?

Never ran the web ui before.

[Slugger]

Originally Posted by rdefino

How would I do "you run the web ui plugin and you're willing to give me access to it"?

Never ran the web ui before.

Nope, sorry. Firewalls and all that fun stuff come into play. Not worth the aggravation for either of us. I'll work on some debug scripts that you can run to capture some output. But be warned, I can't spend much more time here tonight -- out the door by 8:30. I'm away tomorrow, not home until Sunday. I can't even start writing the scripts until Sunday night realistically.

In the meantime, I'm still convinced that your OTA channels aren't properly mapped to the Schedules Direct station ids, which is why you have no data. I would recheck those mappings to be sure. If that looks good, check the sdepg.log file for error messages from your last EPG data load.

[rdefino]

no problem. Thanks for the help so far.

Here is some of the last entries on the log file:

2013-07-12 18:18:24,221 WARN  [Plugin]: Missing PluginProperty: sdepg/sdjsonThreads
2013-07-12 18:18:24,221 WARN  [Plugin]: Missing PluginProperty: sdepg/sdjsonUrl
2013-07-12 18:18:24,221 WARN  [Plugin]: Missing PluginProperty: sdepg/sdjsonProgChunk
2013-07-12 18:18:24,221 WARN  [Plugin]: Missing PluginProperty: sdepg/sdjsonSchedChunk
2013-07-12 18:18:24,221 WARN  [Plugin]: Missing PluginProperty: sdepg/grabberLogLvl
2013-07-12 18:18:24,256 WARN  [Plugin]: Missing PluginProperty: sdepg/cacheTTL
2013-07-12 18:19:06,073 INFO  [ProgramGenerator]: Processed show generators in 1ms
2013-07-12 18:19:06,085 INFO  [EpgDownloader]: -f flag inserted via user refresh request!
2013-07-12 18:19:06,086 INFO  [EpgDownloader]: [C:\Program Files (x86)\Java\jre7\bin\java, -Xmx512m, -jar, C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\tools\sdjson.jar, -c, grab, -u, rdefino, -p, *****, -o, C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\sdjson.epg, -a, sagetv-sdepg/0.0.4.1 (Windows 7 x86 6.1), -t, 200, -b, https://data2.schedulesdirect.org, -pc, 50000, -sc, 1000, -l, INFO, -g, C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\ignore.txt, -f]
2013-07-12 18:21:17,358 INFO  [EPGImportPluginSchedulesDirect]: Performed EPG download in 131285ms
2013-07-12 18:21:17,947 INFO  [ChannelGenerator]: Processed channel generators in 5ms
2013-07-12 18:21:17,949 INFO  [EPGImportPluginSchedulesDirect]: Performed channel processing in 591ms
2013-07-12 18:21:18,474 INFO  [EPGImportPluginSchedulesDirect]: Performed lineup map configuration in 525ms
2013-07-12 18:21:19,640 ERROR [EPGImportPluginSchedulesDirect]: Error processing EPG zip data!
java.lang.NullPointerException
	at org.schedulesdirect.api.Program.<init>(Program.java:365)
	at org.schedulesdirect.api.ZipEpgClient.fetchProgram(ZipEpgClient.java:220)
	at org.schedulesdirect.api.ZipEpgClient.fetchSchedule(ZipEpgClient.java:193)
	at org.schedulesdirect.api.Station.downloadProgramsAndAirings(Station.java:223)
	at org.schedulesdirect.api.Station.getAirings(Station.java:198)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90)
	at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233)
	at groovy.lang.MetaClassImpl$GetBeanMethodMetaProperty.getProperty(MetaClassImpl.java:3481)
	at org.codehaus.groovy.runtime.callsite.GetEffectivePojoPropertySite.getProperty(GetEffectivePojoPropertySite.java:61)
	at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callGetProperty(AbstractCallSite.java:227)
	at sagex.epg.schedulesdirect.EPGImportPluginSchedulesDirect$_doUpdate_closure7.doCall(EPGImportPluginSchedulesDirect.groovy:302)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90)
	at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233)
	at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:272)
	at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:906)
	at groovy.lang.Closure.call(Closure.java:415)
	at groovy.lang.Closure.call(Closure.java:428)
	at org.codehaus.groovy.runtime.DefaultGroovyMethods.each(DefaultGroovyMethods.java:1326)
	at org.codehaus.groovy.runtime.DefaultGroovyMethods.each(DefaultGroovyMethods.java:1298)
	at org.codehaus.groovy.runtime.dgm$148.invoke(Unknown Source)
	at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:271)
	at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:53)
	at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
	at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
	at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
	at sagex.epg.schedulesdirect.EPGImportPluginSchedulesDirect.doUpdate(EPGImportPluginSchedulesDirect.groovy:299)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:272)
	at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:52)
	at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:137)
	at sagex.epg.schedulesdirect.EPGImportPluginSchedulesDirect.updateGuide(EPGImportPluginSchedulesDirect.groovy:164)
	at sage.ae.y(Unknown Source)
	at sage.a2.e(Unknown Source)
	at sage.a9.dK(Unknown Source)
	at sage.ae.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
2013-07-12 18:21:19,648 INFO  [AiringGenerator]: Processed airing generators in 5ms

[Slugger]

Did you upgrade to the very latest version of the plugin? I fixed that error in that latest build.

The plugin should be at v0.0.4.2

[rdefino]

yes, I'm running version 0.0.4.2 beta

[Slugger]

Are you sure? Look at the previous post:

2013-07-12 18:19:06,086 INFO [EpgDownloader]: [C:\Program Files (x86)\Java\jre7\bin\java, -Xmx512m, -jar, C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\tools\sdjson.jar, -c, grab, -u, rdefino, -p, *****, -o, C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\sdjson.epg, -a, sagetv-sdepg/0.0.4.1 (Windows 7 x86 6.1), -t, 200, -b, https://data2.schedulesdirect.org, -pc, 50000, -sc, 1000, -l, INFO, -g, C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\ignore.txt, -f]

You may have upgraded, but did you restart SageTV after upgrading it?

[rdefino]

It shows under my installed plugins.

I'll give the server a reboot.