Updated XMLTV Plugin with compile steps

[nyplayer]

Originally Posted by hvymetal

Do you have what the proper mapping should be.....The show is bad or good?

I manually mapped it. I was checking the lineup and that one stood out. Should have mapped to 6034 not 24.5

[hvymetal]

Originally Posted by nyplayer

I manually mapped it. I was checking the lineup and that one stood out. Should have mapped to 6034 not 24.5

Not sure what is going wrong here....I cleaned up the log file to better understand. This is the data right before it is inserted into the guide for SageTV. You can see the ID and Numbers are correct. I am sure there is bug somewhere but not sure where

18-01-2022 00:07:33,964 ID: 24.5                           Short: POSTV                          Long: KNMTDT5                        Numbers: [24.5]               Names: [KNMTDT5, POSTV] 
18-01-2022 00:07:33,990 ID: 32.1                           Short: CW                             Long: KRCWLD                         Numbers: [32.1]               Names: [KRCWLD, CW]    
18-01-2022 00:07:34,153 ID: 32.2                           Short: ANTENNA                        Long: KRCWLD2                        Numbers: [32.2]               Names: [KRCWLD2, ANTENNA] 
18-01-2022 00:07:34,502 ID: 32.3                           Short: COURT                          Long: KRCWDT3                        Numbers: [32.3]               Names: [KRCWDT3, COURT] 
18-01-2022 00:07:34,534 ID: 32.4                           Short: TBD                            Long: KRCWDT4                        Numbers: [32.4]               Names: [KRCWDT4, TBD]  
18-01-2022 00:07:34,593 ID: 47.3                           Short: CHARGE                         Long: KUNPLD3                        Numbers: [47.3]               Names: [KUNPLD3, CHARGE] 
18-01-2022 00:07:34,797 ID: 49.1                           Short: MNT                            Long: KPDXDT                         Numbers: [49.1]               Names: [KPDXDT, MNT]   
18-01-2022 00:07:34,917 ID: 49.2                           Short: MYS                            Long: KPDXDT2                        Numbers: [49.2]               Names: [KPDXDT2, MYS]  
18-01-2022 00:07:35,180 ID: 49.3                           Short: BOUNCE                         Long: KPDXDT3                        Numbers: [49.3]               Names: [KPDXDT3, BOUNCE] 
18-01-2022 00:07:35,232 ID: 49.4                           Short: GRIT                           Long: KPDXDT4                        Numbers: [49.4]               Names: [KPDXDT4, GRIT] 
18-01-2022 00:07:35,341 ID: 6007                           Short: CSPAN                          Long: CSPANHD                        Numbers: [6007]               Names: [CSPANHD, CSPAN] 
18-01-2022 00:07:35,364 ID: 6008                           Short: CSPAN2                         Long: CSPN2HD                        Numbers: [6008]               Names: [CSPN2HD, CSPAN2] 
18-01-2022 00:07:35,407 ID: 6009                           Short: CSPAN3                         Long: CSPN3HD                        Numbers: [6009]               Names: [CSPN3HD, CSPAN3] 
18-01-2022 00:07:35,425 ID: 6011                           Short: CCP                            Long: CCHDP                          Numbers: [6011]               Names: [CCHDP, CCP]    
18-01-2022 00:07:36,643 ID: 6013                           Short: MTVP                           Long: MTVPHD                         Numbers: [6013]               Names: [MTVPHD, MTVP]  
18-01-2022 00:07:36,736 ID: 6015                           Short: VH1P                           Long: VH1PHD                         Numbers: [6015]               Names: [VH1PHD, VH1P]  
18-01-2022 00:07:36,829 ID: 6017                           Short: CMTP                           Long: CMTVP                          Numbers: [6017]               Names: [CMTVP, CMTP]   
18-01-2022 00:07:36,903 ID: 6019                           Short: BETP                           Long: BETHDP                         Numbers: [6019]               Names: [BETHDP, BETP]  
18-01-2022 00:07:37,186 ID: 6021                           Short: TVLANDP                        Long: TVLDPHD                        Numbers: [6021]               Names: [TVLDPHD, TVLANDP] 
18-01-2022 00:07:37,363 ID: 6022                           Short: PARAMOUNT                      Long: PARHD                          Numbers: [6022]               Names: [PARHD, PARAMOUNT] 
18-01-2022 00:07:37,557 ID: 6025                           Short: LOGOP                          Long: LOGOPHD                        Numbers: [6025]               Names: [LOGOPHD, LOGOP] 
18-01-2022 00:07:37,707 ID: 6029                           Short: NICKJRP                        Long: NICJPHD                        Numbers: [6029]               Names: [NICJPHD, NICKJRP] 
18-01-2022 00:07:37,985 ID: 6030                           Short: CNN                            Long: CNNHD                          Numbers: [6030]               Names: [CNNHD, CNN]    
18-01-2022 00:07:38,052 ID: 6031                           Short: HLN                            Long: HLNHD                          Numbers: [6031]               Names: [HLNHD, HLN]    
18-01-2022 00:07:38,158 ID: 6034                           Short: TBSP                           Long: TBSHDP                         Numbers: [6034]               Names: [TBSHDP, TBSP]  

[hvymetal]

Originally Posted by nyplayer

It is working on my windows Install with Java 8 but getting this XMLTV error but guide is populating ... no error on my linux install.

17-01-2022 10:28:42,885 java.lang.NullPointerException
	at javax.imageio.ImageIO.write(Unknown Source)
	at xmltv.XMLTVImportPlugin.addChannelToGuide(XMLTVImportPlugin.java:2009)
	at xmltv.XMLTVImportPlugin.endElement(XMLTVImportPlugin.java:1652)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.endNamespaceScope(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.handleEndElement(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.endElement(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
	at xmltv.XMLTVImportPlugin.updateGuide(XMLTVImportPlugin.java:1415)
	at xmltv.XMLTVImportPlugin.updateGuide(XMLTVImportPlugin.java:1326)
	at sage.EPG.pluginExtractGuide(EPG.java:1625)
	at sage.WarlockRipper.extractGuide(WarlockRipper.java:973)
	at sage.EPGDataSource.expand(EPGDataSource.java:709)
	at sage.EPG.run(EPG.java:732)
	at java.lang.Thread.run(Unknown Source)
17-01-2022 10:28:42,928 java.lang.NullPointerException
	at javax.imageio.ImageIO.write(Unknown Source)
	at xmltv.XMLTVImportPlugin.addChannelToGuide(XMLTVImportPlugin.java:2009)
	at xmltv.XMLTVImportPlugin.endElement(XMLTVImportPlugin.java:1652)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.endNamespaceScope(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.handleEndElement(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.endElement(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
	at xmltv.XMLTVImportPlugin.updateGuide(XMLTVImportPlugin.java:1415)
	at xmltv.XMLTVImportPlugin.updateGuide(XMLTVImportPlugin.java:1326)
	at sage.EPG.pluginExtractGuide(EPG.java:1625)
	at sage.WarlockRipper.extractGuide(WarlockRipper.java:973)
	at sage.EPGDataSource.expand(EPGDataSource.java:709)
	at sage.EPG.run(EPG.java:732)
	at java.lang.Thread.run(Unknown Source)

This latest release fix this . This was caused by channel name having characters that cannot be used for file names.


9186 Cats 24/7
9187 Dogs 24/7

God help us

[hvymetal]

Originally Posted by nyplayer

I also have 1 Channel that is mapping wrong .....

This is also fixed with the latest release. This was caused by the original author's method for calculation the channel ID. Since the method did not result in unique ID there where collisions. Read the the release note for the updated method. The new limit limits the Provider ID to 998.

[nyplayer]

Originally Posted by hvymetal

This is also fixed with the latest release. This was caused by the original author's method for calculation the channel ID. Since the method did not result in unique ID there where collisions. Read the the release note for the updated method. The new limit limits the Provider ID to 998.

Everything mapped correctly this time ... Thank You.


For those using ChannelsDVR and SageTV on a UBUNTU Server these are my cronjobs for auto update in SageTV. It updates SageTV every 3 hours due to Pluto having limited guide data.

0 * * * * sudo curl http://127.0.0.1:8089/devices/ANY/guide/xmltv?duration=1209600 -o /opt/sagetv/server/epgdata.xml
15 0-23/3 * * * curl http://sage:frey@127.0.0.1:8080/sage/GlobalCommand?command=ForceEpgUpdate

[nyplayer]

This worked out better than I thought I was able to activate the eastern feeds on TVE with correct mapping and guide data.

[boukmandutty]

Originally Posted by nyplayer

This worked out better than I thought I was able to activate the eastern feeds on TVE with correct mapping and guide data.

Yeap. It sure did. Thanks again @hvymetal.

Just a heads up. I missed some favorites recordings this week and thought it was because the year was being added to the titles of the shows in the guide. It turned out that it was merely because the name of the channels I had specified in the favorites menu had changed from the local designation they had when using schedules direct. (So KFORDT became simply NBC).

[hvymetal]

Originally Posted by boukmandutty

Just a heads up. I missed some favorites recordings this week and thought it was because the year was being added to the titles of the shows in the guide. It turned out that it was merely because the name of the channels I had specified in the favorites menu had changed from the local designation they had when using schedules direct. (So KFORDT became simply NBC).

This can be fixed if read the first post examples. It lets you specify which is used for the Short name. The Short name is what SageTV uses for the naming of the channel in the guide. If no entries are found in the .properties file it will guess and use the shortest name found.

[boukmandutty]

Originally Posted by hvymetal

This can be fixed if read the first post examples. It lets you specify which is used for the Short name. The Short name is what SageTV uses for the naming of the channel in the guide. If no entries are found in the .properties file it will guess and use the shortest name found.

Ahhh I see. I decided to keep the short names. Thanks again.

[hvymetal]

##2.08 01/28/2022
1.  Filter if desc tag is from channel section.  This would crash the plugin if not done.
2.  Add show if it is up to 8 hours previous. Fixes on first import no data problem
3.  Add setting this.show.showId on <episode-num system="pluto"> tag
4.  Fixed freeFormEpisodeNumber on <episode-num system="onscreen"> and <episode-num system="common"> tags
5.  Add new classs to hold all the init. variables from .properties file
6.  Added xmltv.channel.NumberOffset to offset channel numbers on import.
7.  Added if *.xmltv.properties is found in server directory use it as properties without requirement of configurations= in xmltv.properties file
*/

[nyplayer]

Originally Posted by hvymetal

##2.08 01/28/2022
1.  Filter if desc tag is from channel section.  This would crash the plugin if not done.
2.  Add show if it is up to 8 hours previous. Fixes on first import no data problem
3.  Add setting this.show.showId on <episode-num system="pluto"> tag
4.  Fixed freeFormEpisodeNumber on <episode-num system="onscreen"> and <episode-num system="common"> tags
5.  Add new classs to hold all the init. variables from .properties file
6.  Added xmltv.channel.NumberOffset to offset channel numbers on import.
7.  Added if *.xmltv.properties is found in server directory use it as properties without requirement of configurations= in xmltv.properties file
*/

Is it possible to add the HDTV tag ... I had Channels developers add it to the XML but SageTV still does not recognize it to be able to filter it ....

<programme start="20220406170000 +0000" stop="20220406180000 +0000" channel="2.1">
<title>The View</title>
<desc>
Guest co-host Stephanie Grisham; author Lilly Singh.
</desc>
<category>Episode</category>
<category>Series</category>
<category>Talk</category>
<icon src="http://tmsimg.fancybits.co/assets/p184466_b_h6_ah.jpg"/>
<series-id system="tms">184466</series-id>
<date>20220406</date>
<episode-num system="tms">EP002253955837</episode-num>
<episode-num system="onscreen">S25E140</episode-num>
<episode-num system="xmltv_ns">24.139.</episode-num>
<new/>
<credits>
<director>Sarah de la O</director>
<actor>Whoopi Goldberg</actor>
<actor>Joy Behar</actor>
<actor>Sunny Hostin</actor>
</credits>
<video>
<quality>HDTV</quality>
</video>
</programme>

[hvymetal]

Originally Posted by nyplayer

Is it possible to add the HDTV tag ... I had Channels developers add it to the XML but SageTV still does not recognize it to be able to filter it ....

Can you post example along with CMT Metadata for the show. This should be working and is stored in the bonus content stored as a string. I'm not sure how Sagetv stores the HDTV tag. The orginal author allowed for it to be added to the title of the show.

[hvymetal]

I found where the data should be stored. The orginal author was only storing the main parts of the show and the rest of the parsed data in the bonus section of the show. There is additional fuction that allows storing other parts of the show into the proper meta data for SageTV. I will try to make the updates later this week which also fix other meta data to be stored correctly.

  /*
   * Call this to add an Airing to the database. An Airing is time-channel-show correlation.
   * extID - refers to the GUID of a Show previously added with addShowPublic
   * stationID - referes to the stationID GUID of a Channel previously added with addChannelPublic
   * startTime - the time this airing starts, a long from java.util.Date
   * duration - the length of this airing in milliseconds
   *
   * Returns true if this Airing was successfully updated/added to the database. The database will
   * automatically ensure that there are no inconsistencies in the Airings, if you add one that
   * overlaps with the station-time-duration of another. The one(s) that were in the database before
   * the call will be removed and the new one added. It will also fill in any gaps with "No Data" sections
   * for you automatically.
   */
  public boolean addAiringPublic(String extID, int stationID, long startTime, long duration);

  /*
   * Call this to add an Airing to the database. An Airing is time-channel-show correlation.
   * extID - refers to the GUID of a Show previously added with addShowPublic
   * stationID - referes to the stationID GUID of a Channel previously added with addChannelPublic
   * startTime - the time this airing starts, a long from java.util.Date
   * duration - the length of this airing in milliseconds
   * partNumber - if it is a multipart show this is the part number, otherwise this should be 0
   * totalParts - for multipart TV shows, this is the total number of parts otherwise this should be zero
   * parentalRating - the parental rating for the show, should be a localized value from "TVY", "TVY7", "TVG", "TVPG", "TV14", "TVM" or the empty string
   * hdtv - true if it's an HDTV airing, false otherwise
   * stereo - true if it's a stereo recording, false otherwise
   * closedCaptioning - true if the airing has closed captioning, false otherwise
   * sap - true if the Airing has a Secondary Audio Program (SAP), false otherwise
   * subtitled - true if the Airing is subtitled, false otherwise
   * premierFinale - should be the empty string or a localized value from the list "Premier", "Channel Premier", "Season Premier", "Series Premier", "Season Finale", "Series Finale"
   *
   * Returns true if this Airing was successfully updated/added to the database. The database will
   * automatically ensure that there are no inconsistencies in the Airings, if you add one that
   * overlaps with the station-time-duration of another. The one(s) that were in the database before
   * the call will be removed and the new one added. It will also fill in any gaps with "No Data" sections
   * for you automatically.
   */
  public boolean addAiringDetailedPublic(String extID, int stationID, long startTime, long duration, int partNumber, int totalParts,
      String parentalRating, boolean hdtv, boolean stereo, boolean closedCaptioning, boolean sap, boolean subtitled, String premierFinale);

[nyplayer]

the tags that are currently added are below ... I have asked the chanels devs to also add the tag Premiere ..

Live
New
Season Premiere
Series Premiere

Is it possible that this can be done in the xmltv.properties ?

[hvymetal]

Originally Posted by nyplayer

the tags that are currently added are below ... I have asked the chanels devs to also add the tag Premiere ..

Live
New
Season Premiere
Series Premiere

Is it possible that this can be done in the xmltv.properties ?

SageTV's guide API does not allow for Live and New. From your request I can provide the ones in blue. See below what I can attach to the show in red. Also I need an sample XMLTV files as the version I have do not have the metadata. Please provide a the longest duration sample XMLTV file with updated metadata.


* title - the title of the show (use for reruns)
* primeTitle - the title of the show (use for first runs)
* episodeName - the name of the episode
* desc - a description of this show
* duration - not used, set to 0
* category - name of a category for this show
* subCategory - name of a subCategory for this show
* people - names of people/actors in this show
* roles - must be same length as people array, uses the X_ROLE constants in this file to specify what each is
* rated - rating of a show, i.e. PG, G, R, etc.
* expandedRatings - additional rating information, i.e. Violence, Nudity, Adult Content
* year - the year it was produced, for movies
* parentalRating - not used, set to null
* bonus - additional information about the show
* language - the language the show is in
* originalAirDate - the original airing date of this show, it's a long value from java.util.Date
* startTime - the time this airing starts, a long from java.util.Date
* duration - the length of this airing in milliseconds
* partNumber - if it is a multipart show this is the part number, otherwise this should be 0
* totalParts - for multipart TV shows, this is the total number of parts otherwise this should be zero
* parentalRating - the parental rating for the show, should be a localized value from "TVY", "TVY7", "TVG", "TVPG", "TV14", "TVM" or the empty string
* hdtv - true if it's an HDTV airing, false otherwise
* stereo - true if it's a stereo recording, false otherwise
* closedCaptioning - true if the airing has closed captioning, false otherwise
* sap - true if the Airing has a Secondary Audio Program (SAP), false otherwise
* subtitled - true if the Airing is subtitled, false otherwise
* premierFinale - should be the empty string or a localized value from the list "Premier", "Channel Premier", "Season Premier", "Series Premier", "Season Finale", "Series Finale"

[nyplayer]

Thanks that looks good I am awaiting a release from Channels DVR on the Premiere tag.

[hvymetal]

Originally Posted by nyplayer

Thanks that looks good I am awaiting a release from Channels DVR on the Premiere tag.

Do you still want this fixed....I would need a sample guide to test.

[nyplayer]

Originally Posted by hvymetal

Do you still want this fixed....I would need a sample guide to test.

Here is the new guide data containing the HDTV tag ...



https://drive.google.com/file/d/1XwT...ew?usp=sharing

[hb4]

It looks like this is now preferred over the Schedules Direct guide for ChannelsDVR-TVE. If one (me) is using Schedules direct TVE guide with just one TVE provider (Fubo, for now), what are the advantages/disadvantages of using the XMLTV Plugin?

[nyplayer]

Originally Posted by hb4

It looks like this is now preferred over the Schedules Direct guide for ChannelsDVR-TVE. If one (me) is using Schedules direct TVE guide with just one TVE provider (Fubo, for now), what are the advantages/disadvantages of using the XMLTV Plugin?

THE XMLTV self maintains Channels ... no mapping needed ... no disabling or enabling of channels as this is done by the XMLTV ... no unnecessary extra channels in the guide only the ones that are enabled in Channels DVR. Guide data for Pluto and any other IPTV you have enabled in Channels DVR.