SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations > Batch Metadata Tools
Reload this Page broken metadata download ?
Forum Rules FAQs Community Downloads Today's Posts Search

Notices

Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV.

Reply
Page 1 of 2 1 2
 
Thread Tools Search this Thread Display Modes
  #1  
Old 04-06-2011, 02:47 AM
hoep hoep is offline
Sage Advanced User
  
Join Date: Sep 2004
Posts: 197
broken metadata download ?
when downloading images of tv series i get only "broken images" with a file size of 1kb each, no matter which series i download. noticed this problem, with the latest version of BMT (4.9.12)
In the log i found a java error during restart of the sage server (attached below)

java.lang.NullPointerException at sagex.phoenix.metadata.search.FileMatcherManager$FileMatcherXmlBuilder.endElement(FileMatcherManager.java:77) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at javax.xml.parsers.SAXParser.parse(Unknown Source) at javax.xml.parsers.SAXParser.parse(Unknown Source) at sagex.phoenix.metadata.search.FileMatcherManager.buildMatchers(FileMatcherManager.java:97) at sagex.phoenix.metadata.search.FileMatcherManager.visitConfigurationFile(FileMatcherManager.java:194) at sagex.phoenix.common.SystemConfigurationFileManager.visitFiles(SystemConfigurationFileManager.java:100) at sagex.phoenix.common.SystemConfigurationFileManager.accept(SystemConfigurationFileManager.java:73) at sagex.phoenix.metadata.search.FileMatcherManager.loadConfigurations(FileMatcherManager.java:207) at sagex.phoenix.Phoenix.initServices(Phoenix.java:261) at sagex.phoenix.Phoenix.<clinit>(Phoenix.java:71) at sagex.phoenix.plugin.PhoenixPlugin.<init>(PhoenixPlugin.java:70) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at sage.plugin.a.a(Unknown Source) at sage.plugin.a.if(Unknown Source) at sage.plugin.a.for(Unknown Source) at sage.plugin.a.<init>(Unknown Source) at sage.plugin.a.int(Unknown Source) at sage.SageTV.run(Unknown Source) at java.lang.Thread.run(Unknown Source)

Any ideas what goes wrong here ?
regards
hoep
__________________
Server: AMD Phenomen IIX4 965 Black Edition, 4 GB, 2x Hauppauge HVR-3000, 2x PCTV DiB BDA - native, Terratec S7, Cine S2 (Dual DVBS2), WinTV-Nova usb via DVBLogic, xmltv, 20TB disk arrays

Clients: 3 x MediaMVP, 2 x HD-300, 4 x SageTV Client
Reply With Quote
  #2  
Old 04-06-2011, 04:29 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by hoep View Post
when downloading images of tv series i get only "broken images" with a file size of 1kb each, no matter which series i download. noticed this problem, with the latest version of BMT (4.9.12)
In the log i found a java error during restart of the sage server (attached below)

java.lang.NullPointerException at sagex.phoenix.metadata.search.FileMatcherManager$FileMatcherXmlBuilder.endElement(FileMatcherManager.java:77) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at javax.xml.parsers.SAXParser.parse(Unknown Source) at javax.xml.parsers.SAXParser.parse(Unknown Source) at sagex.phoenix.metadata.search.FileMatcherManager.buildMatchers(FileMatcherManager.java:97) at sagex.phoenix.metadata.search.FileMatcherManager.visitConfigurationFile(FileMatcherManager.java:194) at sagex.phoenix.common.SystemConfigurationFileManager.visitFiles(SystemConfigurationFileManager.java:100) at sagex.phoenix.common.SystemConfigurationFileManager.accept(SystemConfigurationFileManager.java:73) at sagex.phoenix.metadata.search.FileMatcherManager.loadConfigurations(FileMatcherManager.java:207) at sagex.phoenix.Phoenix.initServices(Phoenix.java:261) at sagex.phoenix.Phoenix.<clinit>(Phoenix.java:71) at sagex.phoenix.plugin.PhoenixPlugin.<init>(PhoenixPlugin.java:70) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at sage.plugin.a.a(Unknown Source) at sage.plugin.a.if(Unknown Source) at sage.plugin.a.for(Unknown Source) at sage.plugin.a.<init>(Unknown Source) at sage.plugin.a.int(Unknown Source) at sage.SageTV.run(Unknown Source) at java.lang.Thread.run(Unknown Source)

Any ideas what goes wrong here ?
regards
hoep
As for the first issue... could you attach the the 1k file? Typically if you are getting 1k files, it means the tvdb server returned something other than a file.

The second issue appears to be an invalid xml file for your MediaTitles. It appears that you have <regex> element that is not inside a <match> element. If you post your xml contents, I can take a look.
Reply With Quote
  #3  
Old 04-06-2011, 05:26 AM
hoep hoep is offline
Sage Advanced User
  
Join Date: Sep 2004
Posts: 197
stuckless - thank you for your support. i noticed the issue with the mediatitles.xml and fixed it, the problem with the 1k download remains. i attach 2 files here.. one for the episode and one for a background picture file.
i changed the extension to .txt as the uploader noticed a broken image file - the original files were ".jpg"
content of the file is some hmtl code.. i have no idea what causes this..

thanks for any hint in the right direction.
Attached Files
File Type: txt 02d45a06ed59ec3040460c79994797d3-72546-23.jpg.txt (178 Bytes, 221 views)
File Type: txt 0019.jpg.txt (178 Bytes, 208 views)
__________________
Server: AMD Phenomen IIX4 965 Black Edition, 4 GB, 2x Hauppauge HVR-3000, 2x PCTV DiB BDA - native, Terratec S7, Cine S2 (Dual DVBS2), WinTV-Nova usb via DVBLogic, xmltv, 20TB disk arrays

Clients: 3 x MediaMVP, 2 x HD-300, 4 x SageTV Client
Reply With Quote
  #4  
Old 04-06-2011, 06:19 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by hoep View Post
stuckless - thank you for your support. i noticed the issue with the mediatitles.xml and fixed it, the problem with the 1k download remains. i attach 2 files here.. one for the episode and one for a background picture file.
i changed the extension to .txt as the uploader noticed a broken image file - the original files were ".jpg"
content of the file is some hmtl code.. i have no idea what causes this..

thanks for any hint in the right direction.
Thanks for the files. It would appear that the urls that the fanart provider is giving us are redirect urls. My code doesn't follow the redirect, so, I end up downloading the "html" that is sent back.

I think I'll need to make some adjustments to the download manager to ensure that it follows redirects.
Reply With Quote
  #5  
Old 04-06-2011, 06:44 AM
hoep hoep is offline
Sage Advanced User
  
Join Date: Sep 2004
Posts: 197
thanks for that info - but i noticed that this appears with the day, when i updated the plugin, so it might be a new issue..

as i understand it's not a misconfiguration issue..

thank you for your help
hoep
__________________
Server: AMD Phenomen IIX4 965 Black Edition, 4 GB, 2x Hauppauge HVR-3000, 2x PCTV DiB BDA - native, Terratec S7, Cine S2 (Dual DVBS2), WinTV-Nova usb via DVBLogic, xmltv, 20TB disk arrays

Clients: 3 x MediaMVP, 2 x HD-300, 4 x SageTV Client
Reply With Quote
  #6  
Old 04-06-2011, 06:46 AM
fac13 fac13 is offline
Sage Advanced User
  
Join Date: Feb 2008
Location: UK
Posts: 199
It isn't just BMT, I googled this problem and other metadata tools are having problems with thetvdb.com since changes at the weekend. And I'm not sure simply following the redirects will cure this, from threads on thetvdb.com's own forums it seems some of the redirects may be looping: -

Here's an example thread.

Edit: Incidentally, for reasons which are clear from that thread, I first started seeing problems with banners, but now it's everything.
Last edited by fac13; 04-06-2011 at 06:48 AM.
Reply With Quote
  #7  
Old 04-06-2011, 06:54 AM
hoep hoep is offline
Sage Advanced User
  
Join Date: Sep 2004
Posts: 197
thanks for the info.. did not notice that..
__________________
Server: AMD Phenomen IIX4 965 Black Edition, 4 GB, 2x Hauppauge HVR-3000, 2x PCTV DiB BDA - native, Terratec S7, Cine S2 (Dual DVBS2), WinTV-Nova usb via DVBLogic, xmltv, 20TB disk arrays

Clients: 3 x MediaMVP, 2 x HD-300, 4 x SageTV Client
Reply With Quote
  #8  
Old 04-06-2011, 06:57 AM
fac13 fac13 is offline
Sage Advanced User
  
Join Date: Feb 2008
Location: UK
Posts: 199
With a bit of luck they'll regress the change.
Reply With Quote
  #9  
Old 04-06-2011, 07:31 AM
hoep hoep is offline
Sage Advanced User
  
Join Date: Sep 2004
Posts: 197
hopefully .. let's wait and see
__________________
Server: AMD Phenomen IIX4 965 Black Edition, 4 GB, 2x Hauppauge HVR-3000, 2x PCTV DiB BDA - native, Terratec S7, Cine S2 (Dual DVBS2), WinTV-Nova usb via DVBLogic, xmltv, 20TB disk arrays

Clients: 3 x MediaMVP, 2 x HD-300, 4 x SageTV Client
Reply With Quote
  #10  
Old 04-09-2011, 01:55 PM
pat_smith1969 pat_smith1969 is offline
Sage Aficionado
  
Join Date: Jan 2007
Posts: 305
is there any workaround for this issue yet? I just installed BMT and it looks really promising but with TVDB creating broken files, and IMDB providing links and no actual images I get no fan art except for what My Movies downloaded the last time I used that in my movies area (about a year ago now).

So suffice it to say, I have some old posters that are present in my movies folders, some art that gets downloaded into userdata/phoenix/fanart/movies... but nothing that is useable for recordings (userdata/phoenix/fanart/tv).

Looking for a workaround, any other service to use?
Reply With Quote
  #11  
Old 04-09-2011, 11:40 PM
pat_smith1969 pat_smith1969 is offline
Sage Aficionado
  
Join Date: Jan 2007
Posts: 305
Speak and the gods listen...
It looks like the fanart issue is resolved now. I am getting real fanart once again.
Reply With Quote
  #12  
Old 04-10-2011, 02:22 AM
hoep hoep is offline
Sage Advanced User
  
Join Date: Sep 2004
Posts: 197
i have still the 1k downloads... so for me it's not working
__________________
Server: AMD Phenomen IIX4 965 Black Edition, 4 GB, 2x Hauppauge HVR-3000, 2x PCTV DiB BDA - native, Terratec S7, Cine S2 (Dual DVBS2), WinTV-Nova usb via DVBLogic, xmltv, 20TB disk arrays

Clients: 3 x MediaMVP, 2 x HD-300, 4 x SageTV Client
Reply With Quote
  #13  
Old 04-10-2011, 06:11 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by hoep View Post
i have still the 1k downloads... so for me it's not working
There hasn't been a new release to address the issue yet. I'm not even sure there is anything i can do.
Reply With Quote
  #14  
Old 04-10-2011, 06:57 AM
hoep hoep is offline
Sage Advanced User
  
Join Date: Sep 2004
Posts: 197
i understood - the hope was that tvdb went back to not redirecting... as it seems that a lot of fanart tools seem to have problems with the new rewrite mechanism of tvdb
__________________
Server: AMD Phenomen IIX4 965 Black Edition, 4 GB, 2x Hauppauge HVR-3000, 2x PCTV DiB BDA - native, Terratec S7, Cine S2 (Dual DVBS2), WinTV-Nova usb via DVBLogic, xmltv, 20TB disk arrays

Clients: 3 x MediaMVP, 2 x HD-300, 4 x SageTV Client
Reply With Quote
  #15  
Old 04-10-2011, 09:56 AM
Gustovier Gustovier is offline
Sage Aficionado
  
Join Date: Nov 2010
Location: Chicago
Posts: 460
Quote:
Originally Posted by stuckless View Post
There hasn't been a new release to address the issue yet. I'm not even sure there is anything i can do.

How are you going about getting the images via http? Your right in that whatever it is, it's not following the redirects correctly. Maybe I can help figure out something but I need to understand how it's working now.
Reply With Quote
  #16  
Old 04-10-2011, 11:39 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by hoep View Post
i have still the 1k downloads... so for me it's not working
Quote:
Originally Posted by Gustovier View Post
How are you going about getting the images via http? Your right in that whatever it is, it's not following the redirects correctly. Maybe I can help figure out something but I need to understand how it's working now.
It's pretty simple really. In the xml, they give me an http link to images... I open a HttpUrlConnection to the image, and download. Java has automatic follow redirects, so if they are sending back a 301, then java should just reconnect to the new location. It could be that the follow redirects has been disabled, so in the new code, I'm explicitly setting the follow redirects per connection.
Reply With Quote
  #17  
Old 04-10-2011, 05:35 PM
Gustovier Gustovier is offline
Sage Aficionado
  
Join Date: Nov 2010
Location: Chicago
Posts: 460
Quote:
Originally Posted by stuckless View Post
It's pretty simple really. In the xml, they give me an http link to images... I open a HttpUrlConnection to the image, and download. Java has automatic follow redirects, so if they are sending back a 301, then java should just reconnect to the new location. It could be that the follow redirects has been disabled, so in the new code, I'm explicitly setting the follow redirects per connection.
Ok so you are doing "conn.setInstanceFollowRedirects(true); " then, so did that resolve the problem in your new code base?
Reply With Quote
  #18  
Old 04-10-2011, 07:01 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by Gustovier View Post
Ok so you are doing "conn.setInstanceFollowRedirects(true); " then, so did that resolve the problem in your new code base?
That's what the code is setting now... but I haven't tested this yet in my work area. I've busy with other non-sage related things lately

If someone can provide a show that definately fails, then that'll make it quicker.. right now, I'd have to do trial and error until I find one
Reply With Quote
  #19  
Old 04-10-2011, 07:30 PM
Gustovier Gustovier is offline
Sage Aficionado
  
Join Date: Nov 2010
Location: Chicago
Posts: 460
Quote:
Originally Posted by stuckless View Post
That's what the code is setting now... but I haven't tested this yet in my work area. I've busy with other non-sage related things lately

If someone can provide a show that definately fails, then that'll make it quicker.. right now, I'd have to do trial and error until I find one

Sons of Anarchy definately fails for me..
Reply With Quote
  #20  
Old 04-11-2011, 04:42 AM
gplasky's Avatar
gplasky gplasky is offline
SageTVaholic
  
Join Date: Jul 2003
Location: Howell, MI
Posts: 9,203
The Killing (2011) fails and gets the 1kb redirects. Just tried again manually to get it.

Gerry
__________________
Big Gerr
_______
Server - WHS 2011: Sage 7.1.9 - 1 x HD Prime and 2 x HDHomeRun - Intel Atom D525 1.6 GHz, Acer Easystore, RAM 4 GB, 4 x 2TB hotswap drives, 1 x 2TB USB ext Clients: 2 x PC Clients, 1 x HD300, 2 x HD-200, 1 x HD-100 DEV Client: Win 7 Ultimate 64 bit - AMD 64 x2 6000+, Gigabyte GA-MA790GP-DS4H MB, RAM 4GB, HD OS:500GB, DATA:1 x 500GB, Pace RGN STB.
Reply With Quote
Reply
Page 1 of 2 1 2

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
7.1.4 download links broken? jpaddock3000 SageTV Beta Test Software 1 03-11-2011 01:06 PM
How to manually download fanart/metadata for a TV movie via SageTV STV w/o recording? mkanet Batch Metadata Tools 12 01-18-2011 07:05 AM
Download problems from sagetv.com/download.html popechild SageTV Software 4 10-30-2009 10:36 AM
Is the 20090505 Firmware download broken? GCS2000 SageTV Media Extender 3 09-10-2009 10:24 PM
Clean out old metadata created by My Movies before creating new metadata for SageTV? Texas-Hansen SageTV Customizations 0 02-12-2009 10:31 AM


All times are GMT -6. The time now is 01:33 PM.

Contact Us - SageTV, LLC - Archive - Privacy Statement - Top

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.