SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations > Batch Metadata Tools
Reload this Page Original Air Date scraping
Forum Rules FAQs Community Downloads Today's Posts Search

Notices

Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV.

Reply
Page 1 of 2 1 2
 
Thread Tools Search this Thread Display Modes
  #1  
Old 11-15-2010, 10:08 AM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
Original Air Date scraping
I've seen a few mentions of this capability in the forums, but am not clear about how to make this happen. For shows like Conan or The Daily Show, is there a way to scrape against the filename that only includes the show name and original air date? What format would that need to be in?
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Reply With Quote
  #2  
Old 11-15-2010, 12:42 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by ohpleaseno View Post
I've seen a few mentions of this capability in the forums, but am not clear about how to make this happen. For shows like Conan or The Daily Show, is there a way to scrape against the filename that only includes the show name and original air date? What format would that need to be in?
I can't check right now... but I think, it would be, "SeriesName YYYY-MM-DD".
Reply With Quote
  #3  
Old 11-15-2010, 12:43 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
Are Dashes (-) interchangeable with dots (.)?
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Reply With Quote
  #4  
Old 11-15-2010, 01:18 PM
evilpenguin's Avatar
evilpenguin evilpenguin is offline
SageTVaholic
  
Join Date: Aug 2003
Location: Seattle, WA
Posts: 3,696
Right now the dashes are required, but you can change that by opening up

Code:
SageTV\STVs\Phoenix\scrapers\xbmx\tvfilenames\Title-AiredDate.xml
And overwriting it to be this...

Code:
<?xml version="1.0" encoding="UTF-8"?>
<!-- 
   TV Filename Scraper.  Used to Scrape Show Name and Aired Date from a filename
   $$1 is always the complete file uri
-->
<scraper name="title-airedDate" content="filename" thumb="thumb.png">
	<!-- 	input: 		$1=complete file uri -->
	<!-- 	returns: 	series name -->
	<GetShowName dest="3">
		<RegExp input="$$1" output="\1" dest="3">
			<expression>.*[/\\](.*) ([0-9]{4}[-.][0-9]{1,2}[-.][0-9]{1,2})</expression>
		</RegExp>
	</GetShowName>

	<!-- 	input: 		$1=complete file uri -->
	<!-- 	returns: 	AiredDate YYYY-MM-DD -->
	<GetAiredDate dest="3">
		<RegExp input="$$1" output="\2" dest="3">
			<expression>.*[/\\](.*) ([0-9]{4}[-.][0-9]{1,2}[-.][0-9]{1,2})</expression>
		</RegExp>
	</GetAiredDate>
</scraper>
Then your 2009.10.11 type dates should work.
__________________
Clients: 1xHD200 Connected to 50" TH-50PZ750U Plasma
Server : Shuttle SFF SSH55J2 w/ Win7 Home, SageTV v7, Core i3 540, 2GB RAM, 30GB SSD for OS, 1.5TB+2x1TB WDGP for Recordings, BluRay, 2xHDHR, 1xFirewire
SageTV : PlayOn, SJQ, MediaShrink, Comskip, Jetty, Web Client, BMT

Having a problem? Don't forget to include a log! (Instructions for: PlayOn For SageTV v1.5, MediaShrink)
Reply With Quote
  #5  
Old 11-15-2010, 10:33 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
Here is my folder structure

Code:
\The Tonight Show With Conan O'Brien\Conan.O.Brien.2010.01.21.Robin.Williams\conan.o.brien.2010.01.21.robin.williams.mkv
Here is the entry from the MediaTitles.xml file

Code:
<match>

     <regex>[\\/]Conan.O.Brien[\\/]</regex>
     <metadata type="tv" name="tvdb">85285</metadata>	


	
</match>
This combined with the updated xml file to scrape OAD should populate the metadata correctly, right?
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Reply With Quote
  #6  
Old 11-15-2010, 10:39 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
And even though this is for a different file, it's the same issue with the same naming convention. Here is the bmt.log for one of the missed scrapes.

Code:
2010-11-15 22:20:47,236 [10817185@qtp-14636877-2] WARN  org.jdna.bmt.web.server.BrowsingServicesImpl - WebUI Search failed for: SearchQuery; Type: TV; YEAR:0;SEASON:0;QUERY:The Tonight Show With Conan O'Brien/Conan.O.Brien.2010.01.19.Quentin.Tarantino.720p.HDTV.x264-BAJSKORV/conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;EPISODE:0;EPISODE_TITLE:conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;
MetadataException [query=SearchQuery; Type: TV; YEAR:0;SEASON:0;QUERY:The Tonight Show With Conan O'Brien/Conan.O.Brien.2010.01.19.Quentin.Tarantino.720p.HDTV.x264-BAJSKORV/conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;EPISODE:0;EPISODE_TITLE:conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;, ]
	at sagex.phoenix.metadata.MetadataManager.search(MetadataManager.java:384)
	at org.jdna.bmt.web.server.BrowsingServicesImpl.searchForMetadata(BrowsingServicesImpl.java:404)
	at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:562)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:207)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:243)
	at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:389)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417)
	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:879)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:747)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Reply With Quote
  #7  
Old 11-16-2010, 07:06 AM
adone36 adone36 is offline
Sage Advanced User
  
Join Date: Nov 2007
Posts: 142
It would be much easier just to use the preferred naming convention. Use a directory/file renaming tool to convert your files to proper format w/o periods. You can do hundreds of files in seconds and end the hassles.
Reply With Quote
  #8  
Old 11-16-2010, 07:43 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by ohpleaseno View Post
And even though this is for a different file, it's the same issue with the same naming convention. Here is the bmt.log for one of the missed scrapes.

Code:
2010-11-15 22:20:47,236 [10817185@qtp-14636877-2] WARN  org.jdna.bmt.web.server.BrowsingServicesImpl - WebUI Search failed for: SearchQuery; Type: TV; YEAR:0;SEASON:0;QUERY:The Tonight Show With Conan O'Brien/Conan.O.Brien.2010.01.19.Quentin.Tarantino.720p.HDTV.x264-BAJSKORV/conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;EPISODE:0;EPISODE_TITLE:conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;
MetadataException [query=SearchQuery; Type: TV; YEAR:0;SEASON:0;QUERY:The Tonight Show With Conan O'Brien/Conan.O.Brien.2010.01.19.Quentin.Tarantino.720p.HDTV.x264-BAJSKORV/conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;EPISODE:0;EPISODE_TITLE:conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;, ]
	at sagex.phoenix.metadata.MetadataManager.search(MetadataManager.java:384)
	at org.jdna.bmt.web.server.BrowsingServicesImpl.searchForMetadata(BrowsingServicesImpl.java:404)
	at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:562)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:207)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:243)
	at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:389)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417)
	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:879)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:747)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
Based on your filename, it would appear that you are scraping based on the date, but it's not scraping out the date.

Here's your parsed query...
SearchQuery; Type: TV; YEAR:0;SEASON:0;QUERY:The Tonight Show With Conan O'Brien/Conan.O.Brien.2010.01.19.Quentin.Tarantino.720p.HDTV.x264-BAJSKORV/conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;EPISODE:0;EPISODE_TITLE:conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;,

I can see 3 issues here...
1. The QUERY that gets sent to TVDB will be The Tonight Show With Conan O'Brien/Conan.O.Brien.2010.01.19.Quentin.Tarantino.720p.HDTV.x264-BAJSKORV/conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv (this will fail)
2. There EPISODE TITLE is conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv (This is what will be used to match the episode name, if the title date does not exist, so this will fail, even if the QUERY worked)
3. There isn't a parsed date, so it will not not do a lookup based on date.

I don't have a scraper that will match a filename like this, conan.o.brien.2010.01.19.quentin.tarantino.720p.hdtv.x264-bajskorv;, out of the box.

My Recommended TV format for a show like this would be
Conan O Brian 2010.01.19

Or you can try to tweak a scraper to do the matching based on the file names that you provide.
Reply With Quote
  #9  
Old 11-21-2010, 08:31 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
Is there any way to make BMT ignore all the junk after the original air date. I'm trying to automate the finding of metadata for these shows, but it just can't seem to find the info because of the extra junk at the end.
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Reply With Quote
  #10  
Old 11-21-2010, 09:04 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by ohpleaseno View Post
Is there any way to make BMT ignore all the junk after the original air date. I'm trying to automate the finding of metadata for these shows, but it just can't seem to find the info because of the extra junk at the end.
There's always a way... unfortunately, it would probably involve you writing a very specific filename scraper for you files. I prove some standard ones, but if people need something different, then they'll have to add a scraper to the scraper area.

If you post some of your filenames, then I can try to help.
Reply With Quote
  #11  
Old 11-27-2010, 10:10 AM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
Quote:
Originally Posted by evilpenguin View Post
Right now the dashes are required, but you can change that by opening up

Code:
SageTV\STVs\Phoenix\scrapers\xbmx\tvfilenames\Title-AiredDate.xml
...

Can somebody copy and paste the content of Title-AiredDate.xml as it exists as default? I figured a way to have all my stuff be in - instead of . and want to try the default again.

Thanks
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Reply With Quote
  #12  
Old 11-27-2010, 10:51 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Here's a link to all the tv scrapers.
Reply With Quote
  #13  
Old 11-28-2010, 07:55 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
I'm still having issues with this, so I could use a little help please.

I have the TV Airings scraper back to the default .xml.

I have an import folder called

Code:
\\WHS\Dumpster\done\Talk Shows
In that folder I have a file

Code:
Chelsea Lately 2010-11-16.avi
It is not in it's own subfolder for the show.

BMT doesn't seem to be using the Air Date scraper. Here is the phoenix-metadata.log that gets generated for this show when I hit the "Update Metadata" button within BMT

Code:
2010-11-28 20:08:13,318 - ERROR; \\WHs\dumpster\done\Talk Shows\Chelsea Lately 2010-11-16.avi; Chelsea Lately 2010-11-16; 3546467; No metadata for: SageMediaFile [sageId=3546467, sageObject=MediaFile[id=3546467 A[3546470,3546468,"Chelsea Lately 2010-11-16",0@1127.04:26,22] mask=V host=task encodedBy= format=AVI 0:22:09 1099 kbps [#0 Video[MPEG4-Video 29.97 fps 624x352 39:22 progressive]#1 Audio[MP3 44100 Hz 2 channels 128 kbps idx=1]] \\WHs\dumpster\done\Talk Shows\Chelsea Lately 2010-11-16.avi, Seg0[Sat 11/27 4:26:25.838-Sat 11/27 4:48:35.328]]]
Here is what bmt.log spits out as well.

Code:
2010-11-28 20:54:33,284 [8818915@qtp-28038832-6] WARN  org.jdna.bmt.web.server.BrowsingServicesImpl - WebUI Search failed for: SearchQuery; Type: TV; QUERY:Chelsea Lately 2010-11-16;EPISODE:null;EPISODE_TITLE:null;SEASON:null;YEAR:0;
MetadataException [query=SearchQuery; Type: TV; QUERY:Chelsea Lately 2010-11-16;EPISODE:null;EPISODE_TITLE:null;SEASON:null;YEAR:0;, ]
	at sagex.phoenix.metadata.MetadataManager.search(MetadataManager.java:384)
	at org.jdna.bmt.web.server.BrowsingServicesImpl.searchForMetadata(BrowsingServicesImpl.java:404)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:562)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:207)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:243)
	at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:389)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417)
	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:879)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:747)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:520)
Can't quite figure out how to make this work.
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Last edited by ohpleaseno; 11-28-2010 at 08:07 PM.
Reply With Quote
  #14  
Old 11-29-2010, 08:11 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
It doesn't look like the scraper is being used, since I can see that it is saying the query is the title + date. I need to examine this at home, but it may just be that the format file isn't matching what the scraper expects.

I'll try to do some testing tonight with this filename and the scrapers to see what I can come up with.
Reply With Quote
  #15  
Old 11-29-2010, 06:50 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by ohpleaseno View Post
I'm still having issues with this, so I could use a little help please.

I have the TV Airings scraper back to the default .xml.

I have an import folder called

Code:
\\WHS\Dumpster\done\Talk Shows
In that folder I have a file

Code:
Chelsea Lately 2010-11-16.avi
It is not in it's own subfolder for the show.

BMT doesn't seem to be using the Air Date scraper. Here is the phoenix-metadata.log that gets generated for this show when I hit the "Update Metadata" button within BMT

Code:
2010-11-28 20:08:13,318 - ERROR; \\WHs\dumpster\done\Talk Shows\Chelsea Lately 2010-11-16.avi; Chelsea Lately 2010-11-16; 3546467; No metadata for: SageMediaFile [sageId=3546467, sageObject=MediaFile[id=3546467 A[3546470,3546468,"Chelsea Lately 2010-11-16",0@1127.04:26,22] mask=V host=task encodedBy= format=AVI 0:22:09 1099 kbps [#0 Video[MPEG4-Video 29.97 fps 624x352 39:22 progressive]#1 Audio[MP3 44100 Hz 2 channels 128 kbps idx=1]] \\WHs\dumpster\done\Talk Shows\Chelsea Lately 2010-11-16.avi, Seg0[Sat 11/27 4:26:25.838-Sat 11/27 4:48:35.328]]]
Here is what bmt.log spits out as well.

Code:
2010-11-28 20:54:33,284 [8818915@qtp-28038832-6] WARN  org.jdna.bmt.web.server.BrowsingServicesImpl - WebUI Search failed for: SearchQuery; Type: TV; QUERY:Chelsea Lately 2010-11-16;EPISODE:null;EPISODE_TITLE:null;SEASON:null;YEAR:0;
MetadataException [query=SearchQuery; Type: TV; QUERY:Chelsea Lately 2010-11-16;EPISODE:null;EPISODE_TITLE:null;SEASON:null;YEAR:0;, ]
	at sagex.phoenix.metadata.MetadataManager.search(MetadataManager.java:384)
	at org.jdna.bmt.web.server.BrowsingServicesImpl.searchForMetadata(BrowsingServicesImpl.java:404)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:562)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:207)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:243)
	at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:389)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417)
	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:879)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:747)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:520)
Can't quite figure out how to make this work.
I've updated the phoenix-api to 2.3.5, which fixes this issue. Apparantly this must have been broken for a very long time (if not forever), since the code to do a date lookup was not correct. I did a test using the new 2.3.5 build and your filename, it does work now.

Note, when you update the phoenix-api you will need to restart sagetv (it will probably ask).
Reply With Quote
  #16  
Old 11-29-2010, 08:56 PM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
Quote:
Originally Posted by stuckless View Post
I've updated the phoenix-api to 2.3.5, which fixes this issue. Apparantly this must have been broken for a very long time (if not forever), since the code to do a date lookup was not correct. I did a test using the new 2.3.5 build and your filename, it does work now.

Note, when you update the phoenix-api you will need to restart sagetv (it will probably ask).
Thanks for looking at this. I'm still having an issue though.

The WebUI shows 2.3.5, but if I drill down to showing the episode that is Chelsea Lately 2010-11-16 an click on "Update Metadata", nothing is found.

Do I need to do a Library Refresh ? I've updated the episode so that the Show Title and the Original Air Date show the appropriate information. Clicking "Find Metadata" in the individual episode page gives me nothing as well.

Here is bmt.log

Code:
2010-11-29 21:50:39,472 [15092351@qtp-16156579-8] WARN  org.jdna.bmt.web.server.BrowsingServicesImpl - WebUI Search failed for: SearchQuery; Type: TV; EPISODE:0;YEAR:0;EPISODE_TITLE:Chelsea Lately 2010-11-26;SEASON:0;QUERY:Chelsea Lately 2010-11-26;
MetadataException [query=SearchQuery; Type: TV; EPISODE:0;YEAR:0;EPISODE_TITLE:Chelsea Lately 2010-11-26;SEASON:0;QUERY:Chelsea Lately 2010-11-26;, ]
	at sagex.phoenix.metadata.MetadataManager.search(MetadataManager.java:384)
	at org.jdna.bmt.web.server.BrowsingServicesImpl.searchForMetadata(BrowsingServicesImpl.java:404)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:562)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:207)
	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:243)
	at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:389)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417)
	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:879)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:747)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:520)
and the other log

Code:
2010-11-29 21:50:10,945 - ERROR; \\WHs\dumpster\done\Talk Shows\Chelsea Lately 2010-11-26.mkv; Chelsea Lately 2010-11-26; 3546471; No metadata for: SageMediaFile [sageId=3546471, sageObject=MediaFile[id=3546471 A[3546474,3546472,"Chelsea Lately 2010-11-26",0@1127.13:49,22] mask=V host=task encodedBy= format=MATROSKA 0:22:09 384 kbps [#0 Audio[AC3 48000 Hz 2 channels 384 kbps idx=0]#1 Video[H.264 29.97 fps 1280x720 16:9 progressive]] \\WHs\dumpster\done\Talk Shows\Chelsea Lately 2010-11-26.mkv, Seg0[Sat 11/27 13:49:23.986-Sat 11/27 14:11:33.326]]]
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Reply With Quote
  #17  
Old 11-29-2010, 09:44 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
That's too bad The issue fixed made it work when the automatic plugin was enabled, ie, when new files are added to sagetv, which was how I tested it was well. I didn't test using the web ui, but I try to test that tomorrow.
Reply With Quote
  #18  
Old 11-30-2010, 07:02 AM
ohpleaseno ohpleaseno is offline
Sage Aficionado
  
Join Date: Apr 2009
Location: South Florida
Posts: 464
The automatic plugin worked perfectly. I moved the other files so they should show up correctly as well.

Let me know if I can send any more logs to help you fix the Web UI.

thanks for you help!
__________________
Server: WHS with 11TB of storage
Clients:1) HD-200 to a Samsung 32" Slimfit CRT HDTV 2) HD-200 to a Pioneer 26" X1 LCD
Tuners: 1) HD-Homerun 2) Avermedia USB ATSC
Twitter: ohpleaseno
Reply With Quote
  #19  
Old 11-30-2010, 08:07 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by ohpleaseno View Post
The automatic plugin worked perfectly. I moved the other files so they should show up correctly as well.

Let me know if I can send any more logs to help you fix the Web UI.

thanks for you help!
That's good to know. The web ui is supposed to use the same code as the automatic plugin, but I'm guessing somewhere it is not I should be able to duplicate this in my environment.
Reply With Quote
  #20  
Old 11-30-2010, 06:58 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
  
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
@ohpleaseno - I tested this tonight from my browser, both using Find Metadata on the item and Update Metadata on the folder. Both worked. You may have a cache issue. YOu can try to delete the files in the cache/url/ directory in the sage home and then try again from the web ui to see if that works.
Reply With Quote
Reply
Page 1 of 2 1 2

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Record based on original air date? lazysean SageTV Software 2 11-12-2010 05:50 PM
How to Display Recordings by Recording Date & Original Air Date joe123 SageTV Customizations 25 02-16-2010 05:28 AM
original air date gilded07 SageTV Software 4 10-20-2007 11:45 PM
Sort series by original air date? eobiont SageTV Customizations 2 07-07-2007 05:45 AM
Show Original Air Date in Program Guide? joe123 SageTV Beta Test Software 7 04-08-2006 11:39 PM


All times are GMT -6. The time now is 08:06 PM.

Contact Us - SageTV, LLC - Archive - Privacy Statement - Top

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.