SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations > Batch Metadata Tools

Notices

Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV.

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 03-29-2013, 05:19 PM
adone36 adone36 is offline
Sage Advanced User
 
Join Date: Nov 2007
Posts: 142
Why is IMDB broken in BMT but not other plugins.

I was having many problems with BMT not retrieving movie data until Sean pointed out IMDB was having a lot of issues. I could look up titles in the gui mostly ok but auto lookup seemed to be iffy. Changing search order to the movie db as primary, fixed most of the probs. The only problem is that many titles are not listed in mvdb. Then I noticed WMCE add ons using IMDB still work fine as does CMT in Sage. I went back into BMT and it will find the movie title data instantly on IMDB but when you go to retrieve it says "cannot d/l metadata". Is there a fix for this?
Reply With Quote
  #2  
Old 03-30-2013, 05:13 AM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
It's not that IMDB 'broke'. It's that with their constant changes to the web site, IMDB scraping is taking constant maintenance changes to keep functioning. TMDB, on the other hand, actually uses an API, so it, once implemented, takes much less effort to maintain. As such, stuckless made the decision to simply drop IMDB support from IMDB, and focus movie lookups on TMDB instead.

If you find TMDB, being community maintained, to be lacking a particular movie - it would, at least to me, indicate that you should add that movie to it.
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room
Reply With Quote
  #3  
Old 04-01-2013, 03:36 PM
Tiki's Avatar
Tiki Tiki is offline
Sage Icon
 
Join Date: Feb 2005
Location: Southwest Florida, USA
Posts: 1,805
Quote:
Originally Posted by adone36 View Post
Then I noticed WMCE add ons using IMDB still work fine as does CMT in Sage.
Just for the record, these other plugins (including CMT) have had to frequently release updates to keep them working properly. As Fuzzy mentioned, these plugins are not using a published API to access information from IMDB - they are using scrapers (custom scripts they wrote to search the web pages for key information). Scrapers tend to be fragile, so if a web site changes its layout, the scrapers often break.
__________________
Server: Athlon II X4 630 CPU, Gigabyte MA770T-UD3P (AM3) Motherboard, VisionTek Radeon HD4670 PCIe w/ Component output to 50" CRT Rear-Projection HDTV (Mitsubishi), Win7-64Bit (Home Premium), 4GB RAM
Capture Devices (8 tuners): Colossus (x1), HD-PVR (x1), HDHR Prime (x2)
,USBUIRT (multi-zone)
Source:
Comcast Cable
Primary Client: Server Other Clients: (1) HD200, (1) HD300
Retired Equipment: MediaMVP, PVR150 (x2), PVR150MCE,
HDHR, HVR-2250
Reply With Quote
  #4  
Old 04-12-2013, 08:44 PM
MitchSchaft MitchSchaft is offline
Sage Expert
 
Join Date: Jan 2008
Posts: 717
Here goes Sage leaving us. Can't be bothered to update a few lines of code. Eventually everyone else will do the same thing. booooooo. Now we have to manually do it ourselves.
Reply With Quote
  #5  
Old 04-12-2013, 09:52 PM
Dargason Dargason is offline
Sage Expert
 
Join Date: Oct 2003
Posts: 516
Quote:
Originally Posted by MitchSchaft View Post
Here goes Sage leaving us. Can't be bothered to update a few lines of code. Eventually everyone else will do the same thing. booooooo. Now we have to manually do it ourselves.
I'm not sure if you can blame the Sage people for this -- I don't think they ever provided any support for IMDB.
Reply With Quote
  #6  
Old 04-13-2013, 09:11 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,539
Quote:
Originally Posted by MitchSchaft View Post
Here goes Sage leaving us. Can't be bothered to update a few lines of code. Eventually everyone else will do the same thing. booooooo. Now we have to manually do it ourselves.
If by "Sage" you mean independent and unpaid developers working on Sage, then you might be on to something. (Although I'm by no means "leaving" since I actively work on Phoenix)

As the maintainer of the BMT/Phoenix Tools, I opted to no longer support IMDB in the current fashion, since I don't have time to play cat and mouse with the site. As Fuzzy noted, imdb doesn't have an open api, and as such, the imdb data has to be parsed out of the HTML pages, which I can assure you is more than "just a few lines of code". The last time I updated IMDB I spent over 30 hours fixing those "few lines of code".

If Phoenix didn't have another source for movie data (ie, TheMovieDB), then I would have taken the time to figure the IMDB fixes. But, Phoenix/BMT does have another Movie provider, and it has an open API for accessing data, so I didn't need to fix imdb.

My time is very limited... and as such, I have to prioritize what I can work on But, there nothing stopping you from adding back in the IMBD support.. I'll happily accept the patch.

At some point in time, I'll look at adding in imdb via a 3rd party library (ie, current sageimdb.jar) but not until I know I have at least 30-40 hours that I dedicate to it.
Reply With Quote
  #7  
Old 04-13-2013, 10:50 AM
rnadeau's Avatar
rnadeau rnadeau is offline
Sage Expert
 
Join Date: Jun 2006
Location: Maine
Posts: 500
Quote:
Originally Posted by MitchSchaft View Post
Here goes Sage leaving us. Can't be bothered to update a few lines of code. Eventually everyone else will do the same thing. booooooo. Now we have to manually do it ourselves.
Sage may have left us behind but there are many talented developers in this forum that are still doing everything they can to enhance sage and I for one thank all of them and will continue to use sage as long as I can. These developers also realize sage is the best thing out there and they still use it so I think we'll be set for a while.
__________________
Sage Tv Server-Amd 4200FX quad core, Asus Nvidia EN610 Hdmi out , 8 Gig Ram ,(3) HVR-1800, 3.5 terrabyte storage, Windows 8 Pro on sage 9.09 system . Media Server- 6 Terabytes on 5 drives, Amd x2 6000 8 useable gig ram on win 7 32 bit media server.
Reply With Quote
  #8  
Old 04-25-2013, 12:48 PM
silkshadow's Avatar
silkshadow silkshadow is offline
Sage Expert
 
Join Date: Oct 2004
Location: Philippines
Posts: 550
Came over to see what was up, totally understand Sean. Guess I'll be working out a new filtering scheme this weekend . Also, firing off an angry email to IMDB, not that it will do much. They really must offer an API for free software devs or a licensing scheme at least. The internet is becoming less open the farther we get into this century .
Reply With Quote
  #9  
Old 04-25-2013, 01:16 PM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
Quote:
Originally Posted by silkshadow View Post
Came over to see what was up, totally understand Sean. Guess I'll be working out a new filtering scheme this weekend . Also, firing off an angry email to IMDB, not that it will do much. They really must offer an API for free software devs or a licensing scheme at least. The internet is becoming less open the farther we get into this century .
Their advertisements don't work via an API though. That's the advantage of little community based projects like TMDB, over big corporate pages like amazon's IMDB. TMDB just have to get enough donations to keep the servers powered up. IMDB has to market enough targeted advertisements to keep the amazon bosses happy.
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room
Reply With Quote
  #10  
Old 04-25-2013, 01:56 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,539
Quote:
Originally Posted by Fuzzy View Post
Their advertisements don't work via an API though. That's the advantage of little community based projects like TMDB, over big corporate pages like amazon's IMDB. TMDB just have to get enough donations to keep the servers powered up. IMDB has to market enough targeted advertisements to keep the amazon bosses happy.
FYI... This weekend I'll be releasing a whole new Phoenix update (api, core, and UI). In terms of the "core"...

- I'm now using nielm's IMDB library, so imdb will be restored
- TheMovieDB is using another 3rd party library, and I'm doing alot more work to avoid non-english posters
- I'm updating the automatic updater, to pull in TVDB information even if Preserve Original Metadata is checked, WHEN the original metadata is empty. ie, if the EPG description is emty, then it will use the TVDB, but it will not overwrite the description, if it exists.

THere are a number of other smaller changes as well, but I've been focuses the last week or so on this.

FYI... related to IMDB... IMDB does make the data available (at least they used to), but it's done via a bunch of separate text files that DO NOT contain the imdb id. I've looked at this in the past.

Last edited by stuckless; 04-25-2013 at 01:58 PM.
Reply With Quote
  #11  
Old 04-26-2013, 12:16 AM
silkshadow's Avatar
silkshadow silkshadow is offline
Sage Expert
 
Join Date: Oct 2004
Location: Philippines
Posts: 550
Wow, I said it before but I will say it again: I love you .
Reply With Quote
  #12  
Old 04-26-2013, 06:25 AM
AtariJeff's Avatar
AtariJeff AtariJeff is offline
Sage Aficionado
 
Join Date: Nov 2005
Location: Ontario, Canada
Posts: 276
Quote:
Originally Posted by stuckless View Post
FYI... This weekend I'll be releasing a whole new Phoenix update (api, core, and UI). In terms of the "core"...

- I'm now using nielm's IMDB library, so imdb will be restored
- TheMovieDB is using another 3rd party library, and I'm doing alot more work to avoid non-english posters
- I'm updating the automatic updater, to pull in TVDB information even if Preserve Original Metadata is checked, WHEN the original metadata is empty. ie, if the EPG description is emty, then it will use the TVDB, but it will not overwrite the description, if it exists.

THere are a number of other smaller changes as well, but I've been focuses the last week or so on this.

FYI... related to IMDB... IMDB does make the data available (at least they used to), but it's done via a bunch of separate text files that DO NOT contain the imdb id. I've looked at this in the past.
Can't wait to try it out. As always, the FREE development by talented people on THEIR OWN TIME is greatly appreciated
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
IMDB gone? pjpjpjpj SageTV v7 Customizations 39 07-02-2014 08:20 PM
broken plugins after restoring from backup mp328 SageTV v7 Customizations 1 10-14-2010 05:15 PM
How do plugins get into the list of plugins? michaeldjcox SageTV v7 Customizations 4 06-12-2010 03:05 AM
imdb Hans SageTV Customizations 0 07-10-2009 11:41 AM
IMDB search broken? saltlyck SageTV Customizations 4 12-23-2004 04:29 AM


All times are GMT -6. The time now is 05:44 AM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.