Plugin: Schedules Direct EPG (not for v9)

[UgaData]

Originally Posted by Fuzzy
If you have numbers in your password, it may not have entered correctly (due to the 'phone dialer' input method sage uses).

Quote:trk2
That's very interesting. Will this still be an issue when Schedules Direct support is integrated into the core?

It isn't that difficult to deal with, once you realize how it works. But it will have you banging your head until you figure it out .

[rdefino]

Originally Posted by UgaData

@rdfino - have you "told" Schedules Direct what line-up you want to use? It looks like it can't find a line-up or that no line-up exists.

I never used SD with SageTV7, only with SageTV9, I am presuming that both are using the newer JSON method. If so, you need to let SD know what line-up(s) you want use. There is more than one way to do this but it is not done on the Schedules Direct website.
It can be done thru the Sage webserver (after the SDEPG plugin is installed) or if you haven't loaded the webserver you can use EPG123 (it can be found at TheGreenButton website).

There seems to be some confusion on this portion of the SDEPG setup. Selecting the line-ups only needs to be done once. If you use or play with other "Media Center" programs (WMC, MythTV, NextPvr, etc) and have already setup SD you don't or won't need to do it again. Unless you move to a different zipcode or change providers, etc.

I just forced a EPG refresh and I see the lineup in there. But I see a failed to handle error. Not sure what that means. Not sure if this means its working or not. I do see 14days of lineup now in Sage.


2016-09-01 10:29:09,996 WARN [Plugin]: Failed to handle ConfigValueChanged event: 'sdepg/grabberLogLvl' in class: sagex.epg.schedulesdirect.plugin.Plugin
2016-09-01 10:29:22,738 INFO [Plugin]: EPG refresh started for Comcast Georgetown - Digital Haverhill (Cable)
2016-09-01 10:29:22,740 INFO [Plugin]: EPG refresh forced by user!
2016-09-01 10:29:40,241 INFO [ProgramGenerator]: Processed show generators in 1ms
2016-09-01 10:29:40,538 INFO [EpgDownloader]: Backed up local cache file [plugins\sdepg\sdjson.epg]
2016-09-01 10:29:40,542 INFO [EpgDownloader]: Requesting 329 channels
2016-09-01 10:29:40,542 INFO [EpgDownloader]: --force-download flag inserted via user refresh request!
2016-09-01 10:29:40,543 INFO [EpgDownloader]: JVM options: [-Xmx512m, -Dsdjson.fs.capture="C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\capture\grabber", -Dsdjson.capture.json-errors, -Dsdjson.capture.encode-errors, -Dsdjson.capture.http, -Dsdjson.capture.http.content]
2016-09-01 10:29:40,543 INFO [EpgDownloader]: [C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\tools\grabber\bin\sdjson-grabber.bat, --username, rdefino, --password, *****, --user-agent, sagetv-sdepg/0.0.8.1 (Windows 7 x86 6.1), --max-threads, 200, --url, https://json.schedulesdirect.org, --grabber-log-level, INFO, grab, --target, C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\sdjson.epg, --max-prog-chunk, 5000, --max-sched-chunk, 250, --stations, C:\Program Files (x86)\SageTV\SageTV\plugins\sdepg\stations.txt, --force-download]
2016-09-01 10:29:51,609 INFO [EPGImportPluginSchedulesDirect]: Performed EPG download in 11368ms
2016-09-01 10:30:00,035 INFO [ChannelGenerator]: Processed channel generators in 0ms
2016-09-01 10:30:00,036 INFO [EPGImportPluginSchedulesDirect]: Performed channel processing in 8427ms
2016-09-01 10:30:13,083 INFO [EPGImportPluginSchedulesDirect]: Performed lineup map configuration in 13047ms
2016-09-01 10:30:31,613 INFO [EPGImportPluginSchedulesDirect]: Performed EPG data load in 18530ms
2016-09-01 10:30:31,613 INFO [AiringGenerator]: Processed airing generators in 0ms
2016-09-01 10:30:31,616 INFO [SeriesInfoLoader]: Generated series info entries for 0 objects in 2ms!

[Slugger]

Delete the sdjson.epg cache file and force an epg update. It appears you're running an older version of the plugin (for v7). There are some bugs in that version around the handling of the cache file, which you seem to have hit. Once your lineup is set and working, you should be fine, but until then, you may have to delete that cache file and force an update a few times.

Alternatively, you seem to be capturing all of the raw data from the sd servers so you can confirm my theory by inspecting those log files as well. But the quickest solution if you just want to try something is to just delete the cache file and force an epg update.

[rdefino]

Originally Posted by Slugger

Delete the sdjson.epg cache file and force an epg update. It appears you're running an older version of the plugin (for v7). There are some bugs in that version around the handling of the cache file, which you seem to have hit. Once your lineup is set and working, you should be fine, but until then, you may have to delete that cache file and force an update a few times.

Alternatively, you seem to be capturing all of the raw data from the sd servers so you can confirm my theory by inspecting those log files as well. But the quickest solution if you just want to try something is to just delete the cache file and force an epg update.

Thanks Slugger, doing it now. How do I get the latest version of plugin?

thanks again

[Slugger]

Latest builds of the plugin only work with Sage v9.

[EnterNoEscape]

Originally Posted by trk2

That's very interesting. Will this still be an issue when Schedules Direct support is integrated into the core?

I wouldn't describe this as an issue. It's a good thing to be able to enter this information using a remote control. I'm not sure if there's a better way to manage this, but it would likely be a global change in how text input dialogs are displayed, could break things for some setups and a little out of the scope of my changes.

The dialog asking for the username, then the dialog asking for the password show the number text entry keyboard if you're using an extender or placeshifter; when you see that on screen keyboard, that's when pressing a number a certain number of times correlates with letters. If you're using the Windows Client, you won't see it by default.

[Tiki]

Originally Posted by EnterNoEscape

I wouldn't describe this as an issue. It's a good thing to be able to enter this information using a remote control. I'm not sure if there's a better way to manage this, but it would likely be a global change in how text input dialogs are displayed, could break things for some setups and a little out of the scope of my changes.

The dialog asking for the username, then the dialog asking for the password show the number text entry keyboard if you're using an extender or placeshifter; when you see that on screen keyboard, that's when pressing a number a certain number of times correlates with letters. If you're using the Windows Client, you won't see it by default.

There are several ways to address this, but it's up to the author of the STVi.
One way is to provide a setup or button to toggle whether numbers are treated as numbers or text codes.
Another way is to allow the password to be seen when entering instead of masking with ***. It's not particularly secure the way it's handled now anyway (stored as plaintext in the properties file).

[EnterNoEscape]

Thanks for the suggestions. In my particular case, I'm working with the default STV, so I'm not going to be changing anything that would potentially clash with the general flow of everything else. I have been using standard well established menu styles/themes and dialogs.

I understand your concern about the password. In the core implementation, it is stored as a sha1 hash which is just as insecure from a being able to authentic perspective, but at least it obfuscates things a little better and even if it's reversed, the password will likely not be the exact one you're using to log into the website.

[rdefino]

Hi guys, After getting my EPG working I just had a drive failure and needed to restore from a backup image. But I see an issue with the EPG, getting the error below. Any thoughts on what is happening?

thanks for any help




2016-09-03 22:38:26,606 ERROR [EPGImportPluginSchedulesDirect]: Download of EPG data failed!
java.io.IOException: download failed! [rc=1]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.lang.reflect.Constructor.newInstance(Unknown Source)
at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:77)
at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:71)
at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:81)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:190)
at sagex.epg.schedulesdirect.io.EpgDownloader.download(EpgDownloader.groovy:138)
at sagex.epg.schedulesdirect.io.EpgDownloader$download.call(Unknown Source)
at sagex.epg.schedulesdirect.EPGImportPluginSchedulesDirect.doUpdate(EPGImportPluginSchedulesDirect.groovy:349)
at sagex.epg.schedulesdirect.EPGImportPluginSchedulesDirect.updateGuide(EPGImportPluginSchedulesDirect.groovy:210)
at sage.ae.y(Unknown Source)
at sage.a2.e(Unknown Source)
at sage.a9.dK(Unknown Source)
at sage.ae.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)

[Dave Beddows]

I lost the regular SAGE EPG today so I have been frantically trying to get this to work after giving up on the regular Sage EPG.

I followed all the instructions and successfully registered my lineups through command prompt anf verified they were there with the info flag.

However, I cannot get the system to creat a sdjson.epg file. I get anIllegal Character error in the logs

Please help!



2016-10-11 00:21:33,724 DEBUG [EPGImportPluginSchedulesDirect]: Returning lineups: [[159466172, TELUS Optik TV - Digital Vancouver/Whistler (Cable)], [1438510759, Local Over the Air Broadcast V4P1C4 (Antenna)]]
2016-10-11 00:21:33,724 INFO [Plugin]: EPG refresh forced by user!
2016-10-11 00:21:38,412 DEBUG [Plugin]: Cleared the plugin visibility property!
2016-10-11 00:21:39,428 DEBUG [EPGImportPluginSchedulesDirect]: Returning lineups: [[159466172, TELUS Optik TV - Digital Vancouver/Whistler (Cable)], [1438510759, Local Over the Air Broadcast V4P1C4 (Antenna)]]
2016-10-11 00:21:39,428 INFO [Plugin]: EPG refresh forced by user!
2016-10-11 00:21:49,537 DEBUG [Plugin]: Cleared the plugin visibility property!
2016-10-11 00:26:12,756 DEBUG [Plugin]: Checking for new EPG data...
2016-10-11 00:26:12,756 ERROR [Plugin]: Error in Watchdog
java.lang.IllegalArgumentException: Illegal character in path at index 16: file:/C:/Program Files/SageTV/SageTV/plugins/sdepg/sdjson.epg
at com.sun.nio.zipfs.ZipFileSystemProvider.uriToPath(ZipFileSystemProvider.java:87)
at com.sun.nio.zipfs.ZipFileSystemProvider.newFileSystem(ZipFileSystemProvider.java:107)
at java.nio.file.FileSystems.newFileSystem(Unknown Source)
at java.nio.file.FileSystems.newFileSystem(Unknown Source)
at org.schedulesdirect.api.ZipEpgClient.<init>(ZipEpgClient.java:148)
at org.schedulesdirect.api.ZipEpgClient.<init>(ZipEpgClient.java:212)
at sun.reflect.GeneratedConstructorAccessor62.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.lang.reflect.Constructor.newInstance(Unknown Source)
at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:77)
at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrapNoCoerce.callConstructor(ConstructorSite.java:102)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:190)
at sagex.epg.schedulesdirect.plugin.Plugin$_startWatchdog_closure2.doCall(Plugin.groovy:174)
at sagex.epg.schedulesdirect.plugin.Plugin$_startWatchdog_closure2.doCall(Plugin.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233)
at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:272)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:906)
at groovy.lang.Closure.call(Closure.java:415)
at groovy.lang.Closure.call(Closure.java:409)
at groovy.lang.Closure.run(Closure.java:493)
at java.lang.Thread.run(Unknown Source)
Caused by: java.net.URISyntaxException: Illegal character in path at index 16: file:/C:/Program Files/SageTV/SageTV/plugins/sdepg/sdjson.epg
at java.net.URI$Parser.fail(Unknown Source)
at java.net.URI$Parser.checkChars(Unknown Source)
at java.net.URI$Parser.parseHierarchical(Unknown Source)
at java.net.URI$Parser.parse(Unknown Source)
at java.net.URI.<init>(Unknown Source)
at com.sun.nio.zipfs.ZipFileSystemProvider.uriToPath(ZipFileSystemProvider.java:85)
... 25 more
2016-10-11 00:27:55,224 DEBUG [EPGImportPluginSchedulesDirect]: Returning lineups: [[159466172, TELUS Optik TV - Digital Vancouver/Whistler (Cable)], [1438510759, Local Over the Air Broadcast V4P1C4 (Antenna)]]
2016-10-11 00:27:55,224 INFO [Plugin]: EPG refresh forced by user!
2016-10-11 00:28:00,162 DEBUG [Plugin]: Cleared the plugin visibility property!

[Fuzzy]

Originally Posted by Dave Beddows

I lost the regular SAGE EPG today so I have been frantically trying to get this to work after giving up on the regular Sage EPG.

I followed all the instructions and successfully registered my lineups through command prompt anf verified they were there with the info flag.

However, I cannot get the system to creat a sdjson.epg file. I get anIllegal Character error in the logs

Please help!



2016-10-11 00:21:33,724 DEBUG [EPGImportPluginSchedulesDirect]: Returning lineups: [[159466172, TELUS Optik TV - Digital Vancouver/Whistler (Cable)], [1438510759, Local Over the Air Broadcast V4P1C4 (Antenna)]]
2016-10-11 00:21:33,724 INFO [Plugin]: EPG refresh forced by user!
2016-10-11 00:21:38,412 DEBUG [Plugin]: Cleared the plugin visibility property!
2016-10-11 00:21:39,428 DEBUG [EPGImportPluginSchedulesDirect]: Returning lineups: [[159466172, TELUS Optik TV - Digital Vancouver/Whistler (Cable)], [1438510759, Local Over the Air Broadcast V4P1C4 (Antenna)]]
2016-10-11 00:21:39,428 INFO [Plugin]: EPG refresh forced by user!
2016-10-11 00:21:49,537 DEBUG [Plugin]: Cleared the plugin visibility property!
2016-10-11 00:26:12,756 DEBUG [Plugin]: Checking for new EPG data...
2016-10-11 00:26:12,756 ERROR [Plugin]: Error in Watchdog
java.lang.IllegalArgumentException: Illegal character in path at index 16: file:/C:/Program Files/SageTV/SageTV/plugins/sdepg/sdjson.epg
at com.sun.nio.zipfs.ZipFileSystemProvider.uriToPath(ZipFileSystemProvider.java:87)
at com.sun.nio.zipfs.ZipFileSystemProvider.newFileSystem(ZipFileSystemProvider.java:107)
at java.nio.file.FileSystems.newFileSystem(Unknown Source)
at java.nio.file.FileSystems.newFileSystem(Unknown Source)
at org.schedulesdirect.api.ZipEpgClient.<init>(ZipEpgClient.java:148)
at org.schedulesdirect.api.ZipEpgClient.<init>(ZipEpgClient.java:212)
at sun.reflect.GeneratedConstructorAccessor62.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.lang.reflect.Constructor.newInstance(Unknown Source)
at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:77)
at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrapNoCoerce.callConstructor(ConstructorSite.java:102)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:190)
at sagex.epg.schedulesdirect.plugin.Plugin$_startWatchdog_closure2.doCall(Plugin.groovy:174)
at sagex.epg.schedulesdirect.plugin.Plugin$_startWatchdog_closure2.doCall(Plugin.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233)
at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:272)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:906)
at groovy.lang.Closure.call(Closure.java:415)
at groovy.lang.Closure.call(Closure.java:409)
at groovy.lang.Closure.run(Closure.java:493)
at java.lang.Thread.run(Unknown Source)
Caused by: java.net.URISyntaxException: Illegal character in path at index 16: file:/C:/Program Files/SageTV/SageTV/plugins/sdepg/sdjson.epg
at java.net.URI$Parser.fail(Unknown Source)
at java.net.URI$Parser.checkChars(Unknown Source)
at java.net.URI$Parser.parseHierarchical(Unknown Source)
at java.net.URI$Parser.parse(Unknown Source)
at java.net.URI.<init>(Unknown Source)
at com.sun.nio.zipfs.ZipFileSystemProvider.uriToPath(ZipFileSystemProvider.java:85)
... 25 more
2016-10-11 00:27:55,224 DEBUG [EPGImportPluginSchedulesDirect]: Returning lineups: [[159466172, TELUS Optik TV - Digital Vancouver/Whistler (Cable)], [1438510759, Local Over the Air Broadcast V4P1C4 (Antenna)]]
2016-10-11 00:27:55,224 INFO [Plugin]: EPG refresh forced by user!
2016-10-11 00:28:00,162 DEBUG [Plugin]: Cleared the plugin visibility property!

I know you seem to have spent a bunch of time so far getting the plugin installed and running, but if you upgrade the the newest version of sagetv v9, there is a new implementation of schedules direct built in, that may end up working much better for you.

[Slugger]

fwiw, the underlying problem report is a JRE bug. I'm guessing you're using a very old version of Java 7 (like update 3 or 4 or older). Those versions of Java 7 have a known bug with the zipfs implementation that is causing this error. Upgrade to a new Java 7 and that error will go away.

[Dave Beddows]

I just did the version 9 upgrade 32bit machine. It won't start. It just hangs on the SageTV Media Center window at "SageTV Service is initializing"

Tried starting Sage as a service as well with no luck.

Fortunately I moved all my version 7 files to a backup directry 1st.

I did install over the version 7 becuase I was hoping to maintain as many settings as possible.

Can I do a clean install and still import my old wiz file data?

[jusjoken]

Originally Posted by Dave Beddows

I just did the version 9 upgrade 32bit machine. It won't start. It just hangs on the SageTV Media Center window at "SageTV Service is initializing"

Tried starting Sage as a service as well with no luck.

Fortunately I moved all my version 7 files to a backup directry 1st.

I did install over the version 7 becuase I was hoping to maintain as many settings as possible.

Can I do a clean install and still import my old wiz file data?

If you used the Windows Installer, try running it a second time and select repair. Make sure the service is NOT running.

k

[Fuzzy]

Also realize that on first run, it will take quite a while to start, as it updates the database to the v9 format.

[Dave Beddows]

Tried repair. It has been stuck on the opening screen "Object Database Backup is Initializing" now for 2 hours. Will let it sit the day.

Running XP becuase it was working great as just a Sage machine on Sage version 7. I have the install disk for windows 7 32bit. Thinking of doing that upgrade tonight. Could blow away old Sage stuff but I would like to keep the data in wiz. Is there a way to import that later?

Want to stay 32 bit due to urt & media cards. Not sure if they are all 64 bt compatible. Could blow the machine away for a clean windows install.

Might have to install win 7 then sage 7. Put the wiz & other setting files over then do a sage 9 update.

[Fuzzy]

Yes, you can go ahead and move the wiz.bin out of there (it should have made a backup copy of it with the 7.1.9.256 version tacked on before starting the upgrade anyway) and see if it will start up cleanly making a new wiz.bin. If it does work doing so, and everything else seems good, then make sure debug logging is turned on, then fully shut sage down, drop the old wiz.bin in there, restart the service, and see what happens. The logs should indicate what's holding up the process if for some reason it doesn't complete. When I said it will take a long time to upgrade, I'm talking like 10-15 minutes, not hours.

[Dave Beddows]

So i tried that and I still hanging on the "Object Database Backup is Initializing" for over an hour without any wiz files in the directory. Hard to turn on debug if it won't start. Going to use uninstall to remove any trace of sage and try fresh install next unless you have a better idea. I am assuming I can copy my old wiz file in afterwards and it will convert it for me.

[jusjoken]

Originally Posted by Dave Beddows

So i tried that and I still hanging on the "Object Database Backup is Initializing" for over an hour without any wiz files in the directory. Hard to turn on debug if it won't start. Going to use uninstall to remove any trace of sage and try fresh install next unless you have a better idea. I am assuming I can copy my old wiz file in afterwards and it will convert it for me.

Try a full clean install of v9 and then copy in the wiz file and start it up to see what happens.

k

[Fuzzy]

Originally Posted by Dave Beddows

So i tried that and I still hanging on the "Object Database Backup is Initializing" for over an hour without any wiz files in the directory. Hard to turn on debug if it won't start. Going to use uninstall to remove any trace of sage and try fresh install next unless you have a better idea. I am assuming I can copy my old wiz file in afterwards and it will convert it for me.

It is hanging on the database backup with no wiz.bin in the folder?