Schedules Direct EPG (integrated BETA)

[EnterNoEscape]

Originally Posted by pjwerdna

Ive worked out what my problem with SD aparently not working was.

Seems SD fills in the Channel list with a differant numbering and naming of channels to those from a channel scan.

In the attached the ones highlighted are the Schedules Direct entries that Ive manually changed the physical channel on. The unselected ones are the channels added as a result of SageTVs channel scan which will tune but have no guide data.

After reviewing the channel list Ive had to disable all channels and go through them one at a time enabling and reampping all the Schedules Direct channels.

Basically the same process mapping channel names to numbers from the frq file as was required for the XML giudes Ive tried. The program list does seem more detailed though so it may be worth it long term.

I explored your situation in a little more detail. I failed to notice the two lineup entries that were exactly the same text. It might be the second selection would have been a perfect match. I'll need to redo the code a little to further separate these exceptions.

Update: After examining the two "different" lineups with the same name, it doesn't look like there is any meaningful difference between the two and neither better matches what I see in your screenshot.

[rickgillyon]

Originally Posted by pjwerdna

Seems SD fills in the Channel list with a differant numbering and naming of channels to those from a channel scan.

I found I needed to add a lineup, no guide, and do a channel scan to generate a FRQ; remove the lineup (I think I removed from sage.properties too), re-add with SD, don't scan, and map numbers in lineup to physical numbers in FRQ.

IIRC you can't scan and use SD on the same lineup.

[pjwerdna]

Originally Posted by rickgillyon

IIRC you can't scan and use SD on the same lineup.

Actually you can as Ive always run SageTV that way although with an XML based guide unti now.

Everything works, however SageTV seems to scan the broadcast program guide for all DVBT channels in its list even if theyre disabled. Searching for additional airings using the web server shows matchs for channels I dont have in the guide but that existing in the channel list.

[technazz]

Im trying to add a Canadian Line up. I tried 4 different postal codes and the dont work, I get "You must provide a valid postal code...... " Error

L2N6A2
L2N 6A2
L0R1C0
L0R 1C0

Can somebody check to see if this works. I was able to add a USA and UK lineup no problem.

Here is a snippet of a the log

ed 12/28 15:49:43.638 [PooledThread@962720] SDEPG Getting the property 'PostalCodeValidate' with the parameter 'Canada|M9W5T5'
Wed 12/28 15:49:43.638 [PooledThread@962720] SDEPG Returning regex matching '/[A-Z]{1}[\d]{1}[A-Z]{1}[\d]{1}[A-Z]{1}[\d]{1}/gm' to 'M9W5T5' is false
Wed 12/28 15:49:43.639 [PooledThread@962720] sage.epg.sd.SDException: INVALID_PARAMETER_POSTALCODE
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.epg.sd.SDRipper.getValidateRegexForPostalCode(SDRipper.java:751)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.epg.sd.SDRipper.getProperty(SDRipper.java:308)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.EPG.getProperty(EPG.java:1625)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.api.Global$21.runSafely(Global.java:357)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.PredefinedJEPFunction.run(PredefinedJEPFunction.java:110)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.Catbert.evaluateAction(Catbert.java:1663)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.SageTVConnection.recvAction(SageTVConnection.java:1398)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.SageTVConnection.recvMessageImpl(SageTVConnection.java:3226)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.SageTVConnection.access$100(SageTVConnection.java:23)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.SageTVConnection$4.run(SageTVConnection.java:3133)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.Pooler$PooledThread.run(Pooler.java:253)

Thanks

Chris

[EnterNoEscape]

Originally Posted by technazz

Im trying to add a Canadian Line up. I tried 4 different postal codes and the dont work, I get "You must provide a valid postal code...... " Error

L2N6A2
L2N 6A2
L0R1C0
L0R 1C0

Can somebody check to see if this works. I was able to add a USA and UK lineup no problem.

Here is a snippet of a the log

ed 12/28 15:49:43.638 [PooledThread@962720] SDEPG Getting the property 'PostalCodeValidate' with the parameter 'Canada|M9W5T5'
Wed 12/28 15:49:43.638 [PooledThread@962720] SDEPG Returning regex matching '/[A-Z]{1}[\d]{1}[A-Z]{1}[\d]{1}[A-Z]{1}[\d]{1}/gm' to 'M9W5T5' is false
Wed 12/28 15:49:43.639 [PooledThread@962720] sage.epg.sd.SDException: INVALID_PARAMETER_POSTALCODE
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.epg.sd.SDRipper.getValidateRegexForPostalCode(SDRipper.java:751)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.epg.sd.SDRipper.getProperty(SDRipper.java:308)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.EPG.getProperty(EPG.java:1625)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.api.Global$21.runSafely(Global.java:357)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.PredefinedJEPFunction.run(PredefinedJEPFunction.java:110)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.Catbert.evaluateAction(Catbert.java:1663)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.SageTVConnection.recvAction(SageTVConnection.java:1398)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.SageTVConnection.recvMessageImpl(SageTVConnection.java:3226)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.SageTVConnection.access$100(SageTVConnection.java:23)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.SageTVConnection$4.run(SageTVConnection.java:3133)
Wed 12/28 15:49:43.639 [PooledThread@962720] at sage.Pooler$PooledThread.run(Pooler.java:253)

Thanks

Chris

I had a feeling that sometimes the regex provided by Schedules Direct might not always play nicely. The following link shows you how to disable it:
https://github.com/google/sagetv/wik...x-verification

It also looks like they changed things a little bit based on what I'm seeing from your log. They added an option to match multiple lines for some reason. The code reformats the verification string slightly because the regex provided is formatted for JavaScript.

[technazz]

Originally Posted by EnterNoEscape

I had a feeling that sometimes the regex provided by Schedules Direct might not always play nicely. The following link shows you how to disable it:
https://github.com/google/sagetv/wik...x-verification

It also looks like they changed things a little bit based on what I'm seeing from your log. They added an option to match multiple lines for some reason. The code reformats the verification string slightly because the regex provided is formatted for JavaScript.

Ok that worked, thanks.

Is there a way to 'Merge' from my 3 lineups into the one tuner? I have about 20 or 30 channels from US and UK that are coming from the same source.

Thanks

Chris

[mrcandu]

Happy to report this is working well for me using digital terrestrial in the UK.
The meta data all looks good and there definitely is more detail on film credits compared to Digiguide - the inclusion of the cover art for films is nice too.
Thanks for your work on this!

I use tsreader and a custom script to generate the frq files outside of sagetv. The main reason for doing this is that I can use the correct logical channel numbers in the frq file, which means no remapping to do - I was pleasantly surprised that the Schedules Direct listing exactly matched the frq file after disabling channels in the lineup that I didn't need.

With a separate EPG source there is always going to be an element of ongoing manual channel mapping, but if we could modify the Sage channel scan to use the logical channel numbers that are in the network information table of the DVB source, that would reduce the initial headache of mass channel remapping.
This would also be a nice touch for any newbies on DVB that might start off by using the EPG embedded in the broadcast.

Mat.

[Fuzzy]

Originally Posted by mrcandu

Happy to report this is working well for me using digital terrestrial in the UK.
The meta data all looks good and there definitely is more detail on film credits compared to Digiguide - the inclusion of the cover art for films is nice too.
Thanks for your work on this!

I use tsreader and a custom script to generate the frq files outside of sagetv. The main reason for doing this is that I can use the correct logical channel numbers in the frq file, which means no remapping to do - I was pleasantly surprised that the Schedules Direct listing exactly matched the frq file after disabling channels in the lineup that I didn't need.

With a separate EPG source there is always going to be an element of ongoing manual channel mapping, but if we could modify the Sage channel scan to use the logical channel numbers that are in the network information table of the DVB source, that would reduce the initial headache of mass channel remapping.
This would also be a nice touch for any newbies on DVB that might start off by using the EPG embedded in the broadcast.

Mat.

I am actually in the process of working through the channel scan logic in sage (the bit that tries to match scan results up to epg source stations). I'd need examples of the DVB scan results to see if there are ways to improve it. If you could do a scan in sage, with debug logging turned on, and post up the log (for simplicity, and to make for a smaller log, it'd be nice if you could restart the service before and after the scan, so there is less in the log aside from the scan itself), I can take a look and see what can be done.

[EnterNoEscape]

Originally Posted by technazz

Ok that worked, thanks.

Is there a way to 'Merge' from my 3 lineups into the one tuner? I have about 20 or 30 channels from US and UK that are coming from the same source.

Thanks

Chris

This can be done, but I don't think there's an easy way to do this. It would involve using an existing lineup, disabling all of the channels you are not interested in and then adding a lot of manual channel entries with correct TMS IDs so that they would continue to receive new guide data. The reason you need to use an existing lineup provided by Schedules Direct is if you don't you'll stop getting new guide data due to a "bug" in how SageTV does it's guide data updates. There also might be some upkeep with this approach (IDs might change, though I don't think that's normal) and it is unlikely that channel logos will be downloaded for the manually created channels since the URLs come from the lineup as provided by Schedules Direct.

[mrcandu]

Originally Posted by Fuzzy

I am actually in the process of working through the channel scan logic in sage (the bit that tries to match scan results up to epg source stations). I'd need examples of the DVB scan results to see if there are ways to improve it. If you could do a scan in sage, with debug logging turned on, and post up the log (for simplicity, and to make for a smaller log, it'd be nice if you could restart the service before and after the scan, so there is less in the log aside from the scan itself), I can take a look and see what can be done.

Fuzzy - be great if we can do something to improve this

debug log of dvb-t channel scan attached.

I've also attached an export from tsreader of the Network Information Table that contains the logical channel numbers for each transport stream. Its actually an html file, so you'll need to change the extension to render it readable.
I'm not sure how TSreader re-formats the data in these tables, but hopefully it will be useful.
Let us know if you need more info - could also look into setting up a box with a dvb tuner for remote development purposes if thats what it'll take to crack this.

Cheers

[Fuzzy]

Can you also post up Native.log as well?

[mrcandu]

Originally Posted by Fuzzy

Can you also post up Native.log as well?

Here you go.

Also ... some potentially useful info on LCNs:
https://tvheadend.org/issues/138

[Fuzzy]

Originally Posted by mrcandu

Here you go.

Also ... some potentially useful info on LCNs:
https://tvheadend.org/issues/138

Thanks. One last thing (I think) so I can compare those scan results with the sdepg data - what specific postal code and lineup are you selecting for schedules direct?

[mrcandu]

Originally Posted by Fuzzy

Thanks. One last thing (I think) so I can compare those scan results with the sdepg data - what specific postal code and lineup are you selecting for schedules direct?

I think I entered ..
TW12
Youview London

[wayner]

This was a bit of an awkward process for me, here is what I had to do:

1. Upgrade Sage V9 to the latest version as my version wasn't comatible.
2. Try to add a new source but I couldn't see the SDEPG option. So I had to go and switch from Gemstone to the default UI.
3. Try to set up the source, but no matter what postal code I entered it didn't like it. So I want to SD and added my lineups there. I couldn't find a way to back out of the Add New Source so I had to the kill SageTV application.
4. I tried again now that I had a lineup in SD. But it still said that it couldn't find any lineups so it wanted me to add one. And I still couldn't enter a postal code so I had to kill Sage again.
5. I came to this thread and saw the post about the postal code.
6. I edited sage.properties.
7. Started Sage and I was finally able to configure the SDEPG lineup.
8. Switch UI back to Gemstone.

[jusjoken]

Given the announcement, perhaps there should be a new SD EPG forum.

[EnterNoEscape]

Originally Posted by wayner

This was a bit of an awkward process for me, here is what I had to do:

1. Upgrade Sage V9 to the latest version as my version wasn't comatible.
2. Try to add a new source but I couldn't see the SDEPG option. So I had to go and switch from Gemstone to the default UI.
3. Try to set up the source, but no matter what postal code I entered it didn't like it. So I want to SD and added my lineups there. I couldn't find a way to back out of the Add New Source so I had to the kill SageTV application.
4. I tried again now that I had a lineup in SD. But it still said that it couldn't find any lineups so it wanted me to add one. And I still couldn't enter a postal code so I had to kill Sage again.
5. I came to this thread and saw the post about the postal code.
6. I edited sage.properties.
7. Started Sage and I was finally able to configure the SDEPG lineup.
8. Switch UI back to Gemstone.

For what country were you unable to enter your postal code?

Edit: I'm asking because the issue you're describing is likely already fixed and a new version of SageTV just needs to be released.

[trallyus]

Just wanted to say thanks for the Schedules Direct addition to sage tv as I been waiting as long as possible to switchover to schedules direct but have been paying for it for about a year or 2 now worried it may be too hard to switch over.

Only thing I was unsure of was whether to use the basic programming or extended basic programming when I set up my schedules direct and just decided to choose basic programming as I read somewhere when in doubt to use it, but it seems to be working great.

I only get over the air programming on sage tv and had it set up on schedules direct with my programming already when I experimented with Nextpvr.

Thanks so much for making it so easy.

[wayner]

Originally Posted by EnterNoEscape

For what country were you unable to enter your postal code?

Edit: I'm asking because the issue you're describing is likely already fixed and a new version of SageTV just needs to be released.

Canada, eh? Sorry I thought you would assume that from my location filed on the forum.

[EnterNoEscape]

Originally Posted by wayner

Canada, eh? Sorry I thought you would assume that from my location filed on the forum.

Yeah, it was early. Sorry about that. I swear I know my countries. Canada was one of the ones affected, but the next release will make your situation a non-issue.