SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV Customizations

Notices

SageTV Customizations This forums is for discussing and sharing user-created modifications for the SageTV application created by using the SageTV Studio or through the use of external plugins. Use this forum to discuss customizations for SageTV version 6 and earlier, or for the SageTV3 UI.

Reply
 
Thread Tools Search this Thread Display Modes
  #121  
Old 09-27-2008, 05:42 PM
roxy99 roxy99 is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 516
As it turns out I was busy doing some php projects. I miss programming in Python and I miss my hobby.

So next things to look at:
1) TV com new format and broken screen scraper
2) Use sageTv show ID as a means to determine the season/episode correctly.

Bear with me I am little rusty. You guys now know the program better than me and I wrote the dang thing. I'll keep you posted.
__________________
http://www.hydranterouge.com
Reply With Quote
  #122  
Old 09-27-2008, 08:44 PM
roxy99 roxy99 is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 516
Yup upgrades on TV.com have rendered this version of the scraper obsolete. I am going through each section one at a time...
__________________
http://www.hydranterouge.com
Reply With Quote
  #123  
Old 09-27-2008, 10:27 PM
megamojo's Avatar
megamojo megamojo is offline
Sage Advanced User
 
Join Date: Apr 2006
Posts: 179
Quote:
Originally Posted by roxy99 View Post
2) Use sageTv show ID as a means to determine the season/episode correctly.
If this is just an additional means of detecting the season/episode that is great, but if that were to replace the existing amazing logic it would break it for me, since my files don't have the sage filenames and are just in their own import folder with names like Showname 1x03 Epname.avi for season 1, ep 3 for example. I'm eagerly awaiting your update since my viewing experience is just not the same with out it. Thanks for getting back to us!
Reply With Quote
  #124  
Old 09-28-2008, 08:49 AM
roxy99 roxy99 is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 516
Quote:
Originally Posted by megamojo View Post
If this is just an additional means of detecting the season/episode that is great, but if that were to replace the existing amazing logic it would break it for me, since my files don't have the sage filenames and are just in their own import folder with names like Showname 1x03 Epname.avi for season 1, ep 3 for example. I'm eagerly awaiting your update since my viewing experience is just not the same with out it. Thanks for getting back to us!
And thank you for your support. I promise I won't break anything - famous last words.
__________________
http://www.hydranterouge.com
Reply With Quote
  #125  
Old 09-30-2008, 01:16 PM
roxy99 roxy99 is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 516
The changes are extensive. Every html tag is changed in the TV.com website. Also, they are now making heavy use of CSS classes. So an update may be a couple of weeks away.

I want to start thinking about version 2 of this scraper- what is your wish list for this scraper? XBMC is using a similar scraper but I don't know what features it sports. As a command line utility, what core features are missing in your opinion.

If I migrate this to gui, what should the gui be like?

These are the questions I'm asking myself.
__________________
http://www.hydranterouge.com
Reply With Quote
  #126  
Old 09-30-2008, 02:22 PM
megamojo's Avatar
megamojo megamojo is offline
Sage Advanced User
 
Join Date: Apr 2006
Posts: 179
The only thing that's really bugged me so far is the inability to use it with some shows that have odd character's in their titles. Terminator: The Sarah Connor Chronicles is what I'm talking about. I tend to exchange : for - in that situation, other programs use a period instead of a colon. I'm not saying either of those is the solution, just that the issue remains that no matter what I name the folder, I've never been able to use the scraper for that show.

I'm personally a little leery of going to a gui, or if you do I would request that you still make it scriptable since that's how I use it. It drives me crazy when handy utilities like this can only be used through a gui.
Reply With Quote
  #127  
Old 09-30-2008, 06:30 PM
dvd_maniac's Avatar
dvd_maniac dvd_maniac is offline
Sage Icon
 
Join Date: Mar 2004
Location: New England
Posts: 1,899
How about returning a list of possible matches to make sure the right show is used without the need to create a showid.txt file? Kinda like IMDB search works in Sage...
__________________
If this doesn't work right, Then:
"I'm going to blow up the Earth!"
Reply With Quote
  #128  
Old 10-01-2008, 11:31 AM
roxy99 roxy99 is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 516
Quote:
Originally Posted by dvd_maniac View Post
How about returning a list of possible matches to make sure the right show is used without the need to create a showid.txt file? Kinda like IMDB search works in Sage...
The problem with that approach is then the user needs to intervene whenever the utility finds ambiguous matches. For eg: Knight Rider 1986 vs Knight Rider 2008. If the utility finds a video file named justs Knight_Rider_EpName.mpg, it has to stop in the middle and ask the user - which one you mean.

I could make it so that it does all the non-ambigious matches first and then for the ambiguous ones prompt the user, more than one shows match videname.mpg:

Press (A) Knight Rider 1986
(B) Knight Rider 2008

I guess a gui is low on the prioirity scale.

Megamo,
Even when you rename the tilte without the : it doesn't work?
Thanks
__________________
http://www.hydranterouge.com
Reply With Quote
  #129  
Old 10-01-2008, 11:40 AM
Brent Brent is offline
SageTVaholic
 
Join Date: May 2006
Location: KC, Missouri
Posts: 3,695
I thought I remembered talk about a coming TV.com API. Anyone else no anything about that? It could really help out in the development of this plugin.
Reply With Quote
  #130  
Old 10-01-2008, 12:41 PM
roxy99 roxy99 is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 516
All the necessary plugins are there already. The my plugin in Sage is all that's needed. I only need to modify this utility to run in the background as a monitoring app from any new recordings, execute the tv.com scraper (like comskip monitor by Steep).
Unless you mean Sage is developing their own TV.com scraper to be incorporated into the core product. That would be cool then my utility would not be needed.

What I really need to add is the ability to determine the proper productionid from the Sage mpg recording and then get the exact url from TV.com to scrape the my data.

I found out why Terminator: The Sarah Connor chronicles does not parse. TV.com has the series filed under 'S' for Sarah. The utlity is expecting to find the Terminator episode in the T's.
__________________
http://www.hydranterouge.com

Last edited by roxy99; 10-01-2008 at 01:34 PM.
Reply With Quote
  #131  
Old 10-01-2008, 03:48 PM
megamojo's Avatar
megamojo megamojo is offline
Sage Advanced User
 
Join Date: Apr 2006
Posts: 179
Quote:
Originally Posted by roxy99 View Post
The problem with that approach is then the user needs to intervene whenever the utility finds ambiguous matches. For eg: Knight Rider 1986 vs Knight Rider 2008. If the utility finds a video file named justs Knight_Rider_EpName.mpg, it has to stop in the middle and ask the user - which one you mean.

I could make it so that it does all the non-ambigious matches first and then for the ambiguous ones prompt the user, more than one shows match videname.mpg:

Press (A) Knight Rider 1986
(B) Knight Rider 2008

I guess a gui is low on the prioirity scale.

Megamo,
Even when you rename the tilte without the : it doesn't work?
Thanks
I think asking about ambiguous matches is exactly what I would want it to do. That is much better behavior than either ignoring the file or going with the wrong information. Doing all the non-ambiguous files first and then asking would be absolutely wonderful. Another option is to make it automatic most of the time, and then if you pass it an optional parameter, it asks about every show just to be sure. This is how the automatic scraper for movies with imdb works. This makes it automatic most of the time, and selectable when needed.
Reply With Quote
  #132  
Old 10-23-2008, 02:41 AM
justme justme is offline
Moderator
 
Join Date: Mar 2003
Location: Greater Baltimore/Washington Metropolitan area
Posts: 1,481
redirect output to user specified directory

Quote:
The changes are extensive... So an update may be a couple of weeks away....
Just glad to hear you are willing to keep this great tool alive. Thanks for all the effort and time you've put in to this.
Quote:
I want to start thinking about version 2 of this scraper- what is your wish list for this scraper?
I'm almost certain I mentioned this request before, so please forgive me if I did. It's been a long time since my last post, though I do watch the forums almost daily. Anyway...

The thing that springs to my mind, other than TV.com to have not broken your scraper , is the ability to redirect output to a different location. Something like a simple command line parameter(-o seems logical and available) that when invoked caused the resulting ".my" files and "videolist.txt" to be placed in the specified location. Of course, if not invoked the app would act just like before.
IE. videometadata.exe -p T:\foo -o C:\bar\metadata
Would run on the files in T:\foo and instead of putting the results there, put the resulting .my files and videolist in to C:\bar\metadata. I don't need you to be able to preserve(recreate in the output location) the subdir structure, if any exists, of the scanned dir although that might be nice. I'm fine with a flat dump of all .my files and the videolist.txt going to one flat dir.

The reasons for this request is for 2 different situations I've run into. Both are really the result of the same basic issue, as you'll quickly see. 1) Running it on files I've archived/burnt off to DVD. 2) Running it on shares that lack write privileges for that account/PC, on my network.

I realize I can work around the network write privilege, but the DVD one is a Huge bummer. I've get many DVDs I burnt before I started to include .my files. I don't want to have to re-burn these DVDs just to add .my file and use discs and time, since I'm lazy. Since there are tools/plug-ins that allow metadata in subdirs and user specified dirs to be used by Sage, I just need your tool to write the metadata.

Thanx for your time,
/justme
Reply With Quote
  #133  
Old 11-28-2008, 09:17 PM
Halstead Halstead is offline
Sage Advanced User
 
Join Date: Jul 2005
Location: Portland, Or
Posts: 183
Any word on an update? I really miss this excellent utility!
__________________
Halstead York

HTPC/Server: A8 3850; Win 7 Home x86 + Java 1.6.0_26; Sage 7.1.9; Driving Epson 8500 pj @ 1080p | Office: Core2Duo E8500 w/ EFI-X running OS X 10.5 & Win 7 Pro x64 (dual boot) + Java 1.6.0_20; Sage 7.0.23; Driving 30" Samsung 1900x1200 monitor
Reply With Quote
  #134  
Old 12-22-2008, 01:59 PM
alijiwani alijiwani is offline
Sage Advanced User
 
Join Date: Feb 2005
Posts: 118
bump! any word on this? I loved this scraper when it worked!
__________________
SageTV 6.5.4+Webserver 2.21+SageMC 6.3.8a, P4-2.8 Ghz, 1GB RAM, 120GB HD, 1.5TB HD, 500GB HD, PVR-150, PVR-350, AverMedia A180, ATI x1600 512MB AGP, Audigy Platinum EX, connected to an Sony 46XBR6 LCD via DVItoHDMI and Sony STR-DA2400ES receiver via 5.1 analog.
Reply With Quote
  #135  
Old 12-23-2008, 09:50 PM
MasonMan MasonMan is offline
Sage User
 
Join Date: Dec 2008
Posts: 13
This is the item that i'm looking for. let us know if we can help somehow to get this app back working. Thanks for all the work!

MasonMan
Reply With Quote
  #136  
Old 01-01-2009, 10:10 PM
bialio's Avatar
bialio bialio is offline
SageTVaholic
 
Join Date: May 2007
Location: Frisco, TX
Posts: 3,445
Hey roxy99 - it'd be nice once this import is working again for it to look for .ts files also. Just another somewhat common video format now that the HD-PVR is out there recording shows like that!

btl.
__________________
PHOENIX 3 is here!
Server : Linux V9, Clients : Win10 and Nvidia Shield Android Miniclient
Reply With Quote
  #137  
Old 10-16-2010, 07:45 AM
roxy99 roxy99 is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 516
Logn time no see

Hi guys,

Been out the scene for a long time and I don't even use SageTV anymore but I'm trying to see if I can revitalize the utility etc. I think I'll start from scratch.

I need some guidance from the users though.

What should the goal be?

The start is take a filename-> ascertain its series-> ascertain episode-> scrape from TV.com-> output to some file format.

The user interface needs a gui providing more customization instead of command line parameters.

I'll try not to drop the ball on the project again this time.
Thanks
__________________
http://www.hydranterouge.com
Reply With Quote
  #138  
Old 10-16-2010, 08:57 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by roxy99 View Post
Hi guys,

Been out the scene for a long time and I don't even use SageTV anymore but I'm trying to see if I can revitalize the utility etc. I think I'll start from scratch.

I need some guidance from the users though.

What should the goal be?

The start is take a filename-> ascertain its series-> ascertain episode-> scrape from TV.com-> output to some file format.

The user interface needs a gui providing more customization instead of command line parameters.

I'll try not to drop the ball on the project again this time.
Thanks
Roxy - I'll just throw this out there.... I work on BMT (batch metadata tools) which is metadata lookup facility that currently supports imdb, themoviedb, dvdprofiler, and tvdb. You might consider writing your tv.com provider as a bmt provider and take advantage of some other things that bmt has to offer...

* Automatic metadata fetching when movies/tv is added to the collection
* Web UI for searching/browsing/editing
* You just need to provide the parser implementations, and bmt will do the searching/matching filename scraping, etc.
* Direct updating of the Sage database

Anyways, I'm just throwing it out there, since I'll never create a tv.com parser myself... but I'd happily accept some else's as an add-on
Reply With Quote
  #139  
Old 10-16-2010, 09:38 AM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
With thetvdb's tv.com scraping, I'm not sure this is really even needed. thetvdb.com will already grab data from tv.com automatically, and then with BMT's thetvdb provider, it's pretty much taken care of.
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room
Reply With Quote
  #140  
Old 10-16-2010, 10:00 AM
roxy99 roxy99 is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 516
Cool. been out the loop for a while. I'll need to look at BMT.

Edit: BMT - wow! Great job. If only I knew Java. If there is any way I can assist, let me know. Just let me know what format my output needs to be in or how these tools can mesh.
__________________
http://www.hydranterouge.com

Last edited by roxy99; 10-16-2010 at 10:09 AM.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
TV.Com to .My File Generator (MyScraper) pdavis SageTV Customizations 18 02-07-2008 10:50 PM
Automatic and integrated IMDB info for DVD on SageMC mkanet SageMC Custom Interface 0 04-30-2007 12:02 PM
TV.com import Info like IMDB Search jbilich SageTV Customizations 1 08-10-2006 12:16 AM
Automatic refresh? afinemetsfan SageTV Studio 3 06-30-2006 09:29 PM


All times are GMT -6. The time now is 08:28 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.