SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations > Batch Metadata Tools

Notices

Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV.

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 11-12-2020, 08:08 PM
jptheripper jptheripper is offline
Sage Fanatic
 
Join Date: Dec 2007
Location: Florida
Posts: 956
TVDB done March 2021

Looks like TVDB will be done in 6 months

Quote:
Hello,

There are some big changes coming for TheTVDB that will affect both developers and our end users, most notably our brand new API (“v4”). With the launch of this new API fast approaching, we wanted to give an overview of all of these changes.

Two Models for API Access
There are now two ways to access TheTVDB API. Each company, platform, or project will have the ability to select their preferred method of access. This decision will ultimately be up to the developers of the projects themselves, so if you are an end user, you'll need to wait for the platform/software you use to announce any changes regarding your access.
Licensed

This is the way things work now. Companies and projects enter into a contract with us and are given an API key. License fees are based primarily on usage, company size, and how the data is used.

Example: Mobile apps & websites
User-Supported

This is new. Some companies can’t or don’t want to license API access directly, and have requested that we pass along any cost to end users. We have determined an approach that will keep this affordable and accessible for all, detailed below.

Example: Synology Video Station
A note for Plex users: TheTVDB is in ongoing active discussions with Plex. Please stay tuned for more information if you are an end user of Plex.
User Subscriptions
User subscriptions are global, and not tied to a specific API key. This means that if, as an end user, you use three projects that make use of TheTVDB API, your subscription will grant access for any of them that choose the user-supported model.


Important Notes

A subscription is required ONLY if the project/software you're using has indicated so — although we’d love for you to support the site anyway.
Subscribing will grant you a unique PIN, which will be entered into the software you use.
User subscriptions will be $11.99/year.
Subscriptions will also include an ad-free site experience, a warm fuzzy feeling in your heart, and future incentives that we’re planning.

While we believe this to be a reasonable subscription fee, we understand that some of you may prefer another approach. With that in mind, we’ll also allow users to earn a free annual subscription by contributing quality data to the site, like missing IDs, translations, and artwork. We’ll provide additional details concerning this model in the coming months.


Learn more about user subscriptions
v4 API Launch
Our relaunch of the site last October included a completely restructured database, and we’ve been adding features and functionality to it ever since. Our current and previous APIs are based on the old version of the database, and as a result are not only costly to operate, but don’t expose most of the new features. The v4 API fixes that and gives access to everything.


Important Notes

The v4 API will launch the week of 11/9.
All previous API versions will be deprecated approximately 6 months later, at the end of March 2021. This will allow projects time to convert.
Later in 2021, we’ll be adding writable interfaces to the API, allowing projects to push data back into the site.
Developers will need to create a new key for v4, which can be done from your TheTVDB dashboard under API Keys.
The v4 API is NOT backwards compatible.
New Features and Functionality
While some of these features have been available on the site since last October, they haven't been available in our API until now.
Tagging & Taxonomy

Our new flexible tagging system includes a hierarchy of data that is more useful than free-form tagging, and currently includes information like time era, series structure, social issues, character professions, and more. Tags can be recommended by users on the site so this offering will quickly expand.
Expanded Search Functionality

Unified search for movies, series, people, characters, franchises, companies — all allowing fuzzy matching to improve results.
Flexible Seasons

Supporting DVD and absolute orders as we’ve always done, but also supporting multiple official popular orders (for example, Money Heist being completely recut for Netflix).


Awards

We’re now tracking popular awards for both series and movies, including both nominees and winners.

Lists and Franchises

Fully translatable and sorted, allowing access to official franchises like MCU and Arrowverse.

Expanded Company Support

Companies will be expanded from studio, production company, and network to also include other relevant info like special effects studio. Plus company relationships, rebrands, and the ability to store co-productions on series and movies.
Expanded Content Ratings


Content ratings, previously displayed as parental guidelines, are now expanded from the US rating systems to all official international systems.

Also…
Many more features have been added and will be available in the v4 API. We’ve launched a new ticketing system in an effort to deprecate our forums. This will streamline responses from our moderators, prevent requests from being overlooked or handled incorrectly, and give better insight into potential improvements on the site itself. The ticketing system also holds our comprehensive Knowledgebase, which will be referenced throughout the site. Additionally, we have implemented UserReport, a software where you can upvote and make improvement suggestions to the site.
Next Steps for You
Project Developers

Start taking a look at which data licensing model works for your project moving forward — directly licensed or user-supported. Once you’ve decided, you’ll need to register for a new v4 API key (your old key will continue to work until the old APIs are turned off at the end of March 2021).
You can register for a new key on your dashboard by navigating to TheTVDB, selecting Dashboard from the dropdown in the upper right, and then clicking on API Keys.
The v4 API is accessible at https://api4.thetvdb.com/v4/, with documentation here. You can also view a current list of known issues here, and we'll be updating this list throughout the launch of the API.

End Users

Stay tuned to your respective projects to find out whether you'll need to sign up for an individual subscription or not. If you want to support our project regardless of what your programs do, or just want to remove ads on the site right away, we’d love for you to subscribe.
Subscribe Now
Thank You
We’re so appreciative of your continued support. We love our community and look forward to hearing from you with any questions, concerns, or ideas. Have a wonderful week!
TheTVDB Team
__________________
Gigabyte GA-MA770-DS3/4gb DDR2/AMD Phenom 955 3.2ghz Quad Core
Windows 7 64bit Home Premium
Hauppauge 1600/1850/2250/colossus/2650(CableCard 2 tuner)
8tb RAID5 storage/media/other &3tb RAID5 backup storage on a HighPoint RocketRaid 2680
1tb 3 disk Recording Pool
all in a beautiful Antec 1200
SageMyMovies/Comskip/PlayON/SageDCT/SRE
HD100/HD300 extenders
Reply With Quote
  #2  
Old 11-12-2020, 08:13 PM
jptheripper jptheripper is offline
Sage Fanatic
 
Join Date: Dec 2007
Location: Florida
Posts: 956
I have no idea what it would take to get a new key and port the project
__________________
Gigabyte GA-MA770-DS3/4gb DDR2/AMD Phenom 955 3.2ghz Quad Core
Windows 7 64bit Home Premium
Hauppauge 1600/1850/2250/colossus/2650(CableCard 2 tuner)
8tb RAID5 storage/media/other &3tb RAID5 backup storage on a HighPoint RocketRaid 2680
1tb 3 disk Recording Pool
all in a beautiful Antec 1200
SageMyMovies/Comskip/PlayON/SageDCT/SRE
HD100/HD300 extenders
Reply With Quote
  #3  
Old 11-13-2020, 07:27 AM
EnterNoEscape's Avatar
EnterNoEscape EnterNoEscape is offline
SageTVaholic
 
Join Date: Jun 2010
Location: Harrisburg, PA
Posts: 2,654
I would tackle this if I didn't have a baby on the way in a few weeks. I've been working on a few things the group might find exciting, but this wasn't on my radar. I ported BMT to use the v3 API (clearly wasted time now) and it's unlikely we'll see any ready to use libraries written in Java for v4 very soon, so I would need to write the whole thing from the ground up like I did for Schedules Direct support in SageTV. I will circle back in February and look at what it's going to take unless someone else starts working on this in the mean time.
__________________
SageTV v9 Server: ASRock Z97 Extreme4, Intel i7-4790K @ 4.4Ghz, 32GB RAM, 6x 3TB 7200rpm HD, 2x 5TB 7200rpm HD, 2x 6TB 7200rpm HD, 4x 256GB SSD, 4x 500GB SSD, unRAID Pro 6.7.2 (Dual Parity + SSD Cache).
Capture: 1x Ceton InfiniTV 4 (ClearQAM), 2x Ceton InfiniTV 6, 1x BM1000-HDMI, 1x BM3500-HDMI.

Clients: 1x HD300 (Living Room), 1x HD200 (Master Bedroom).
Software: OpenDCT :: WMC Live TV Tuner :: Schedules Direct EPG
Reply With Quote
  #4  
Old 11-13-2020, 10:47 AM
wayner wayner is online now
SageTVaholic
 
Join Date: Jan 2008
Location: Toronto, ON
Posts: 7,199
When you hit the V4 API URL of https://api4.thetvdb.com/v4/ you get:

Code:
{"message":"Not Found"}
__________________
New Server - Sage9 on unRAID 2xHD-PVR, HDHR for OTA
Old Server - Sage7 on Win7Pro-i660CPU with 4.6TB, HD-PVR, HDHR OTA, HVR-1850 OTA
Clients - 2xHD-300, 8xHD-200 Extenders, Client+2xPlaceshifter and a WHS which acts as a backup Sage server
Reply With Quote
  #5  
Old 11-13-2020, 11:32 AM
KeithAbbott KeithAbbott is online now
Sage Icon
 
Join Date: Oct 2009
Location: Southeastern Michigan
Posts: 1,220
So I'm trying to understand what functionality/capabilities I would be missing if this change is not accommodated in the SageTV ecosystem. I am thinking that the metadata for a show recorded by SageTV is provided by the Schedules Direct epg. Imported movie data would be retrieved from TMDB or IMDB. So where does TVDB come into play?
__________________
Server: MSI Z270 SLI Plus ATX Motherboard, Intel i7-7700T CPU, 32GB Memory, unRAID 6.9.2, SageTV (java11) & OpenDCT Dockers
Tuners: 2 x SiliconDust HDHomeRun Prime Cable TV Tuners, SiliconDust HDHomeRun CONNECT 4K OTA Tuner
Clients: Multiple HD300 Extenders, Multiple Fire TV Stick 4K w/MiniClient
Miscellaneous: Multiple Sony RM-VLZ620 Universal Remote Controls
Reply With Quote
  #6  
Old 11-13-2020, 12:36 PM
wayner wayner is online now
SageTVaholic
 
Join Date: Jan 2008
Location: Toronto, ON
Posts: 7,199
I believe TVDB will give you Fanart and perhaps more detailed show information around description, actors, etc for TV shows.
__________________
New Server - Sage9 on unRAID 2xHD-PVR, HDHR for OTA
Old Server - Sage7 on Win7Pro-i660CPU with 4.6TB, HD-PVR, HDHR OTA, HVR-1850 OTA
Clients - 2xHD-300, 8xHD-200 Extenders, Client+2xPlaceshifter and a WHS which acts as a backup Sage server
Reply With Quote
  #7  
Old 03-08-2021, 09:26 AM
graywolf's Avatar
graywolf graywolf is offline
Sage Icon
 
Join Date: Oct 2009
Location: NC
Posts: 1,326
Quote:
Originally Posted by EnterNoEscape View Post
I would tackle this if I didn't have a baby on the way in a few weeks. I've been working on a few things the group might find exciting, but this wasn't on my radar. I ported BMT to use the v3 API (clearly wasted time now) and it's unlikely we'll see any ready to use libraries written in Java for v4 very soon, so I would need to write the whole thing from the ground up like I did for Schedules Direct support in SageTV. I will circle back in February and look at what it's going to take unless someone else starts working on this in the mean time.
ENE - Have you had a chance to look at this and if you would have the time/inclination to take this on? Maybe using TVMaze instead of TheTVDB?

I use this frequently and it appears many others do also.

Would hate to have the WAF plummet come the end of March when BMT fetch metadata breaks
Reply With Quote
  #8  
Old 03-08-2021, 11:10 AM
wayner wayner is online now
SageTVaholic
 
Join Date: Jan 2008
Location: Toronto, ON
Posts: 7,199
I guess the other thing is looking into TVDB and seeing if you could get a reasonable paid license. But that doesn't sound promising if you read this thread on the Jellyfin reddit site:

https://www.reddit.com/r/jellyfin/co...censing_model/

Notice that there is a post from a person from TVMaze:

Quote:
tvmaze
3 months ago
-Even if it means building a new service from the ground up,

Hi Jan here, just wanted to say.. No need for that, that's exactly what we did in 2014. A bunch of us got together and have been running independently and without any hickups since then.
If you have the time, you're welcome to check us out. www.tvmaze.com
We're a friendly community and are always open to feedback on how to improve what we do. Which is focus on TV meta data.
So it sounds like TVMaze is friendly to use purposes like SageTV
__________________
New Server - Sage9 on unRAID 2xHD-PVR, HDHR for OTA
Old Server - Sage7 on Win7Pro-i660CPU with 4.6TB, HD-PVR, HDHR OTA, HVR-1850 OTA
Clients - 2xHD-300, 8xHD-200 Extenders, Client+2xPlaceshifter and a WHS which acts as a backup Sage server
Reply With Quote
  #9  
Old 03-08-2021, 11:14 AM
wayner wayner is online now
SageTVaholic
 
Join Date: Jan 2008
Location: Toronto, ON
Posts: 7,199
Actually here is a thread on the kodi sub-reddit where TVDB seems more reasonable: https://www.reddit.com/r/kodi/commen...cf0/?context=2

I wonder where this all stands today?

Quote:
TheTVDB
3 months ago
One of the biggest complaints among our users is that our moderators have been toxic in the past. The forums were a large part of that, since users refused to abide by our rules (which are complicated, but necessary and thoughtfully assembled over the past 15 years) and directly attack our moderators constantly. Our new ticketing system has canned responses, which prevents toxicity from our side in the exchange. It also allows us to properly keep track of everything. We had almost 80 pages of unhandled requests in the forums before.

So the forums won't be back. However, I will be implemented meta-discussions directly on series and movie pages. This should allow a bit more of the productive discussion that we admit is necessary, but I will be finding ways to reduce/eliminate toxicity in both directions.

The costs involved with running the API are immense. When running at full capacity and before optimizations, we've hit $30k in a month (correction: max was $30k in a DAY. Average now is closer to $30k in a month). Thankfully our new API is more statically rendered, but there are still significant costs. The benefit to the new system is that the API isn't really cached anymore; it's updated directly and stored statically when records on the site are updated.

And on top of that, we now also have internal paid staff and some contractors working on data quality. Over time this has not only improved the quality of the data itself, but also the quality of the experience and sought to find ways to improve our relationship with the community.

Yes, it will take time for this to show. Yes, $12 was selected as a reasonable price point, since we actually don't know how much the API will cost per user. Having been a long time Kodi, Sonarr, Plex, Radarr, and Usenet user myself, I believed $12/year was a fair price to target. I'm definitely open to any and all feedback that people want to give, as long as it's productive and seeks to improve things for everyone.
__________________
New Server - Sage9 on unRAID 2xHD-PVR, HDHR for OTA
Old Server - Sage7 on Win7Pro-i660CPU with 4.6TB, HD-PVR, HDHR OTA, HVR-1850 OTA
Clients - 2xHD-300, 8xHD-200 Extenders, Client+2xPlaceshifter and a WHS which acts as a backup Sage server
Reply With Quote
  #10  
Old 03-10-2021, 08:42 AM
EnterNoEscape's Avatar
EnterNoEscape EnterNoEscape is offline
SageTVaholic
 
Join Date: Jun 2010
Location: Harrisburg, PA
Posts: 2,654
Quote:
Originally Posted by graywolf View Post
ENE - Have you had a chance to look at this and if you would have the time/inclination to take this on? Maybe using TVMaze instead of TheTVDB?

I use this frequently and it appears many others do also.

Would hate to have the WAF plummet come the end of March when BMT fetch metadata breaks
Because I use Android TV everywhere in my house, I've switched to Emby for everything that isn't recorded TV. The experience is just so many leaps ahead of SageTV. I'm sorry to say that it's unlikely I'll be tackling this.
__________________
SageTV v9 Server: ASRock Z97 Extreme4, Intel i7-4790K @ 4.4Ghz, 32GB RAM, 6x 3TB 7200rpm HD, 2x 5TB 7200rpm HD, 2x 6TB 7200rpm HD, 4x 256GB SSD, 4x 500GB SSD, unRAID Pro 6.7.2 (Dual Parity + SSD Cache).
Capture: 1x Ceton InfiniTV 4 (ClearQAM), 2x Ceton InfiniTV 6, 1x BM1000-HDMI, 1x BM3500-HDMI.

Clients: 1x HD300 (Living Room), 1x HD200 (Master Bedroom).
Software: OpenDCT :: WMC Live TV Tuner :: Schedules Direct EPG
Reply With Quote
  #11  
Old 03-10-2021, 01:41 PM
NetworkGuy NetworkGuy is offline
Sage Fanatic
 
Join Date: Dec 2009
Location: Central NJ
Posts: 855
Quote:
Originally Posted by EnterNoEscape View Post
Because I use Android TV everywhere in my house, I've switched to Emby for everything that isn't recorded TV. The experience is just so many leaps ahead of SageTV. I'm sorry to say that it's unlikely I'll be tackling this.
How does Emby compare with PLEX?
__________________
Hardware: Intel Core i5-3330 CPU; 8GB (2 x 4GB); 2-4TB WD Blue SATA 6.0Gb/s HDD; Windows 7
Servers: ChannelsDVR, Plex, AnyStream, PlayOn,
Tuner: HDHomeRun Connect Quatro
Tuner: HDHomeRun Connect Duo
Sources: OTA, Sling Blue, Prime, Disney+,
Clients: ShieldTV (2), Fire TV Stick 4K (4)
Reply With Quote
  #12  
Old 03-11-2021, 03:53 PM
nyplayer nyplayer is offline
SageTVaholic
 
Join Date: Sep 2005
Posts: 4,605
Quote:
Originally Posted by EnterNoEscape View Post
Because I use Android TV everywhere in my house, I've switched to Emby for everything that isn't recorded TV. The experience is just so many leaps ahead of SageTV. I'm sorry to say that it's unlikely I'll be tackling this.
I have switched to Channels DVR as my goto DVR ... I use EMBY to View my collection of Movies ... I probably will be switching to just using ChannelsDVR as they now make it that you can import movies and Series.

As A bonus I get to record TVE and Pluto in Channels DVR.... Also remote viewing in Channels DVR is outstanding.
__________________
Windows 10 I3 Dual Core 3.0 Server, SageTV9... OpenDCT with 2 HDHRPrimes and 4 HDHRconnects for a total of 14 Tuners.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
TVDB lookup exceptions xjim1 SageTV v9 Customizations 0 10-15-2020 08:42 PM
The TVDB Metadata Processing Suggestions EnterNoEscape Phoenix 3.0 3 03-10-2020 04:27 AM
BMT Issue downloading images for TVDB jvl711 Batch Metadata Tools 7 10-04-2017 04:21 AM
Is BMT striking out with TVDB more often? Spectrum Batch Metadata Tools 2 04-02-2011 06:57 PM
tvdb and Camelot jusjoken Batch Metadata Tools 2 04-02-2011 12:02 PM


All times are GMT -6. The time now is 08:37 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.