|
Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV. |
|
Thread Tools | Search this Thread | Display Modes |
#1241
|
|||
|
|||
Ok. I think I've isolated the problem. I got both of the movies I was having problems with to successfully process by renaming them so they get a proper hit from themoviedb.org. This meant renaming "National Lampoon's Vacation" to "Vacation" and "Star Wars I The Phantom Menace" to "Star Wars Episode I The Phantom Menace".
This indicates it may be a lack of suitable hits from themoviedb.org lookup that is causing the null pointer exception. I also noticed that the DVDProfiler local index is not properly indexing the Original Title either.
__________________
Server - WHS, AMD X2 4850e, 3TB, 2 HD-PVRs w/ D11 DirecTV STBs Client 1 - HD200 Client 2 - XP Home, AMD X2 5200+ w/ 8400GS Client 3 - XP Pro, AMD X2 3800+ w/ 8400GS |
#1242
|
|||
|
|||
Quote:
On mine, only the middle column (Metadata Tools) errors out. It happened with version 3 beta 3, so I updated to beta 4 before any more testing. After the update to beta 4, the status appeared normal. I then initiated a scan from SageMC. When the scan was done, I clicked on status so it would update and that is when my middle column errored out. I tried restarting the sage service (not the server) but that didn't help. I decided to check out the backup/testing server which never had version 2 on it. The only BMT install on that server was 3 beta 3. After enabling the service, I was able to bring up the status page. I ran a scan via SageMC which took way too little time. After the scan I clicked status to update and lo and behold the center column errored out. I updated to beta 4 and the UI status page appeared normal. I started a scan which this time took much longer. After the scan was done I clicked on status and all 3 columns updated, but the Metadata Tools column still indicated that I had not done a scan since 1969. Now as I type this I just checked the status and it has now errored out the center column again. Restarting the Sage Service does not restore the center column. edit: Since disabling and re-enabling the Sage service one more time on the backup server, I can't seem to kill the UI now. I've initiated library scans from the UI, from the HD200 extender, from a client session on the server and from the MVP, and the UI always displays a good 3 column status screen now. I have no clue what has changed except for the disable and re-enable. I'll switch back to the main server later and see if I can repeat this. more to come... (end update) I haven't spent enough time looking at the logs to understand much of what the logs are telling me. If you guys want to point me to a specific type of entry in a log, I'll go take a peek. If you want to see my logs for yourselves, let me know which one(s). Here's my info: Code:
What bmt version? 3.0 beta 3 & 4 What SageTV version? 6.5.18.214 SageMC or default STV? SageMC SageMC version? 6.3.9a_46 Java version? 1.6_11 Phoenix version? 1.33 Java Heap Sizes 127MB/258MB/533MB SageTV setup: Is central FanArt folder enabled? yes Is central FanArt folder local or a network share? network share Do you have SageTV set up to do automatic scans? yes If yes, how often? 2 hours Do the scans import new videos? yes BMT setup: Command Line Tool: Have you successfully used the command line tool? No, I already use MediaScraper so I haven't tried it yet. On-demand Tool: Have you imported the on-demand plugin (stvi of xml)? yes, xml Do you have the on-demand plug-in enabled? yes (also tried disabling) Does the on-demand tool work properly? Yes Automatic Tool: Do you have these 2 properties set in sage.properties? yes mediafile_metadata_parser_plugins=org.jdna.sage.MetadataUpdaterPlugin custom_metadata_properties=UserRating;EpisodeNumber;EpisodeTitle;MediaTitle;MediaType;OriginalAirDate;SeasonNumber;MediaProviderDataID;DiscNumber Does the automatic Tool work properly? As near as I can tell it doesn't do anything. No properties files are being created and no additional fanart is appearing anywhere. I use MediaScraper to put everything in its proper place and properly name all my files. I have MediaScraper setup to NOT create properties files. This allows me to monitor BMT to see if it has created a properties file for any given media file.
__________________
SageTV v9.1.10.479 on Ubuntu (testing v9.1.10.479 on Debian and Win10) Last edited by rmac321; 07-08-2009 at 06:26 PM. Reason: added symptoms |
#1243
|
|||
|
|||
I added more items in bold. You are of course welcome to add or delete as you see fit. Do I have the log info correct?
Code:
What bmt version 2.x (stable) or 3.x (beta)? What SageTV version? SageMC or default STV? SageMC version? Java version? Phoenix version? Java heap sizes? (xxxMB/xxxMb/xxxMB) SageTV setup: Is central FanArt folder enabled? Is central FanArt folder local or a network share? Do you have SageTV set up to do automatic scans? If yes, how often? Do the scans import new videos? Is SageTV debug logging enabled? Command Line Tool: Have you successfully used the command line tool? Do you use the Command Line Tool from a batch file? Do you Drag and Drop onto the .exe or a shortcut to the .exe? Do you use all the defaults or have you made changes? Describe your modifications: On-demand Tool: Have you imported the On-Demand plugin (stvi of xml)? Do you have the On-Demand plug-in enabled? Is On-Demand Tool working properly? Do you use the default setup, or have you modified the settings? Describe your modifications: Automatic tool: Do you have these 2 properties set in sage.properties? mediafile_metadata_parser_plugins=org.jdna.sage.MetadataUpdaterPlugin custom_metadata_properties=UserRating;EpisodeNumber;EpisodeTitle;MediaTitle;MediaType;OriginalAirDate;SeasonNumber;MediaProviderDataID;DiscNumber Is the Automatic Tool working properly? Do you use the default settings or have you made modifications? Describe your modifications: I have attached my Sage log (sagetv_0.txt) enclosed in a code box. I have attached my BMT log (mailcheck.log) enclosed in a code box. Please give a description of the steps to reproduce your issue:
__________________
SageTV v9.1.10.479 on Ubuntu (testing v9.1.10.479 on Debian and Win10) |
#1244
|
|||
|
|||
Quote:
The only thing I can add is the snippet from the SageTV debug log that shows the related jetty BMT error: Code:
Wed 7/8 19:02:25.443 (org.mortbay.log) <DEBUG> REQUEST /bmt/bmtweb/status on org.mortbay.jetty.HttpConnection@102ab48 Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> sessionManager=org.mortbay.jetty.servlet.HashSessionManager@c93509 Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> session=null Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> servlet=status Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> chain=null Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> servlet holder=status Wed 7/8 19:02:25.445 (org.mortbay.log) <DEBUG> REQUEST /bmt/bmtweb/status on org.mortbay.jetty.HttpConnection@d5cfd6 Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> sessionManager=org.mortbay.jetty.servlet.HashSessionManager@c93509 Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> session=null Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> servlet=status Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> RESPONSE /bmt/bmtweb/status 200 Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> chain=null Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> servlet holder=status Wed 7/8 19:02:25.446 Status Failed! Wed 7/8 19:02:25.448 (/bmt) <ERROR> Exception while dispatching incoming RPC call Wed 7/8 19:02:25.448 com.google.gwt.user.server.rpc.UnexpectedException: Service method 'public abstract java.util.List org.jdna.bmt.web.client.ui.status.StatusServices.getStatusInfo(java.lang.String)' threw an unexpected exception: java.lang.NoClassDefFoundError: Could not initialize class com.google.gwt.user.client.Window Wed 7/8 19:02:25.448 at com.google.gwt.user.server.rpc.RPC.encodeResponseForFailure(RPC.java:360) Wed 7/8 19:02:25.448 at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:546) Wed 7/8 19:02:25.448 at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:166) Wed 7/8 19:02:25.448 at com.google.gwt.user.server.rpc.RemoteServiceServlet.doPost(RemoteServiceServlet.java:86) Wed 7/8 19:02:25.448 at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) Wed 7/8 19:02:25.448 at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) Wed 7/8 19:02:25.449 at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487) Wed 7/8 19:02:25.449 at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:362) Wed 7/8 19:02:25.449 at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) Wed 7/8 19:02:25.449 at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181) Wed 7/8 19:02:25.449 at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:729) Wed 7/8 19:02:25.449 at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:405) Wed 7/8 19:02:25.449 at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:206) Wed 7/8 19:02:25.449 at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) Wed 7/8 19:02:25.449 at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) Wed 7/8 19:02:25.449 at org.mortbay.jetty.Server.handle(Server.java:320) Wed 7/8 19:02:25.450 at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:505) Wed 7/8 19:02:25.450 at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:843) Wed 7/8 19:02:25.450 at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:647) Wed 7/8 19:02:25.450 at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:211) Wed 7/8 19:02:25.450 at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:380) Wed 7/8 19:02:25.450 at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:395) Wed 7/8 19:02:25.450 at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:488) Wed 7/8 19:02:25.450 Caused by: java.lang.NoClassDefFoundError: Could not initialize class com.google.gwt.user.client.Window Wed 7/8 19:02:25.450 at org.jdna.bmt.web.client.util.Log.error(Log.java:15) Wed 7/8 19:02:25.450 at org.jdna.bmt.web.server.StatusServicesImpl.getStatusInfo(StatusServicesImpl.java:97) Wed 7/8 19:02:25.451 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Wed 7/8 19:02:25.451 at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) Wed 7/8 19:02:25.451 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) Wed 7/8 19:02:25.451 at java.lang.reflect.Method.invoke(Unknown Source) Wed 7/8 19:02:25.451 at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:527) Wed 7/8 19:02:25.451 ... 21 more Wed 7/8 19:02:25.451 (org.mortbay.log) <DEBUG> RESPONSE /bmt/bmtweb/status 500 Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> REQUEST /bmt/bmtweb/status on org.mortbay.jetty.HttpConnection@102ab48 Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> sessionManager=org.mortbay.jetty.servlet.HashSessionManager@c93509 Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> session=null Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> servlet=status Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> chain=null Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> servlet holder=status Wed 7/8 19:02:25.612 (org.mortbay.log) <DEBUG> RESPONSE /bmt/bmtweb/status 200
__________________
--Jason Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 2.83GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250 29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs). Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u241, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5. Clients: 3xHD300s, 2xHD100, 2xPlaceshifters |
#1245
|
|||
|
|||
Quote:
__________________
SageTV v9.1.10.479 on Ubuntu (testing v9.1.10.479 on Debian and Win10) |
#1246
|
||||
|
||||
ccourtney, rmac321, robogeek, thanks for the great info.
robogeek, based the exception that you posted, I was able to track down an issue. I've uploaded a beta6 that captures the root issue and logs it. So while I can't actually fix the issue yet, the next time it happens, I should have a better idea as to why it is happening.
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#1247
|
|||
|
|||
Ignore These Folders
Sean,
What's the expected format for the "Ignore These Folders" field? \\server\folder, //server/folder, "\\server\folder", \\\\server\\folder, or something else? How should each entry be seperated? commas, semicolons, other? I note a few errors in my logs from that field. Thanks
__________________
SageTV v9.1.10.479 on Ubuntu (testing v9.1.10.479 on Debian and Win10) |
#1248
|
|||
|
|||
Quote:
Originally Posted by stuckless View Post I think that there is a bug in my jetty context file (jetty/contexts/bmt.xml). Edit the file and look for these lines and make sure both are set to true. Code: <Set name="extractWAR">true</Set> <Set name="copyWebDir">true</Set> Then in the jetty/webapps/ dir delete the bmt dir and restart sage server. That should extract the web application properly. Don't delete the bmt.war, just the bmt dir. |
#1249
|
|||
|
|||
Quote:
__________________
--Jason Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 2.83GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250 29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs). Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u241, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5. Clients: 3xHD300s, 2xHD100, 2xPlaceshifters |
#1250
|
||||
|
||||
Quote:
Code:
Test|Dummy Code:
\\server\Test \\server\somedir\Test \\server\MyTestFolder Code:
//server/Test|//server/Dummy EDIT: I'll have to verify that this is still used in 3.x... I may not be implemented yet. But it is implemented in the 2.x builds
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient Last edited by stuckless; 07-09-2009 at 07:56 AM. |
#1251
|
||||
|
||||
Not sure about everyone else, but my problems were resolved with beta6.
Thanks Sean!! |
#1252
|
|||
|
|||
I can't seem to figure out, between reading the documentation, and the install instructions, whether I do, indeed, need Jetty. The last time I installed this it was , I believe, just an import of the stvi (even though Im running sagemc?). But this was before it could handle metadata through the gui. (So I know there is some STV integration... which begs the question.. why would I need jetty)
Can someone clarify for me? thanks Cory |
#1253
|
|||
|
|||
Quote:
|
#1254
|
|||
|
|||
Sean,
There are several DVDProfiler fields being used by SageTV users that you should take into account: 1. DVD Title - this is the title displayed under the Videos Library. The name is also often the name of the folder the movie is stored under (but it doesnt have to be stored under this - see #2) 2. Original Title - this is not used for display. It can be used as the name of the folder storing the movie -- this allows the folder name to be different from the DVD Title (often used to make sure folder names do not have special characters in them, which the title can) 3. Discs - this is used to store box sets in directories. i.e. "Lord of the Rings Fellowship of the Ring - Disc 1" in the collections.xml look for the xml format: <DVD> <Title>Lord of the Rings Fellowship of the Ring</Title> <Discs> <Disc> <DescriptionSideA>Disc 1</DescriptionSideA> <DescriptionSideB/> ... </Disc> <Disc> <DescriptionSideA>Disc 2</DescriptionSideA> <DescriptionSideB/> ... </Disc> </Discs> This indicates that the movie is stored on 2 discs under a directory called "Lord of the Rings Fellowship of the Ring". The subdirectories are called "Lord of the Rings Fellowship of the Ring - Disc 1" and "Lord of the Rings Fellowship of the Ring - Disc 2" respectively. You will need to know these titles to match box sets and to write the meta data so that SageTV will display the box sets correctly --> the meta data title needs to be "Lord of the Rings Fellowship of the Ring - Disc 1" and "Lord of the Rings Fellowship of the Ring - Disc 2" respectively. With the DVDPro2Sage plugin installed these show up correctly as box sets in SageTV. Let me know if you have any questions -- I hope my explanation is somewhat clear) |
#1255
|
||||
|
||||
Quote:
Maybe something like: If ${filename} search returns null search based on ${title} Fancy coding right? But you get the idea... Maybe it does this already, but I am thinking it doesn't, since movies that I recorded in Sage are not matching anything, but when I use SageMC's IMDB lookup, they match 95% of the time. |
#1256
|
|||
|
|||
I installed the latest beta yesterday. I tried and tried, but I can't get the jetty status page to fail out again like it did before. I'm still rearranging my DVDs, imported movies, and recordings and updating metadata and fanart. So if the jetty status page gives any failures, I'll report them here.
__________________
--Jason Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 2.83GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250 29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs). Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u241, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5. Clients: 3xHD300s, 2xHD100, 2xPlaceshifters |
#1257
|
||||
|
||||
@sflamm - Thanks for the DVDprofiler info. I am actually considering just using the DVDProf2Sage class, and skip the index/search model that bmt uses, since for BMT, it would appear that everying will be an exact match anyways. I just have to see if DVDProf2Sage supports accepting a File or Uri for the video file.
Quote:
I made a recent change in the phoenix api to set the media type of Movie for recorded movies. This was done so that fanart could be assigned correctly to recorded movies. I need to pull that logic into the core bmt search factory as well. @robogeek - glad it's working
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#1258
|
|||
|
|||
I've installed this following the instructions as closely as I could,
and, while I've used the command line tool for a long tiem successfully, I'm not getting anything out of trying to use it in 'automatic mode'. (I note that I'm not using Jetty). I've imported and re-imported video library files, and no metadata shows up for them. I've tried through the UI, in sagemc, doing (from video info), "Options" , "Metadata/Fanart", which brings up a "MetaData/Fan Art Search" dialog, but which only has the option of 'close'. I assume this means something is not working, but Im not sure what its supposed to look like and/or how to manually test. Can somebody point me in the right direction? thanks Cory |
#1259
|
||||
|
||||
Quote:
What BMT version are you running? What SageTV version are you running? When you installed it, did you install sagemc, and then install the bmt package? Are you testing this from a client or placeshifter? if a client, do you have bmt installed and configured on the client?
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#1260
|
|||
|
|||
Hi all,
Well I took your advice stuckless and started playing around with the command line options, getting much better results now, thanks for the tip. I have set it to run on one drive which has about 330 DVD Rips in it. It went through and completed about 250 of them and seems to have stopped and reports "processing failed" see log for details.. I have had a bit of hunt around but I have been unable to find the log files?? Any pointers on where to look? |
Currently Active Users Viewing This Thread: 2 (0 members and 2 guests) | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
STV Import: Read & Write Metadata files for Default STV 5/6 (v2.2.9 18/Feb./2010) | JREkiwi | SageTV Customizations | 251 | 10-09-2019 11:11 AM |
Automated VideoRedo (DOS batch files) | grauchy | SageTV Customizations | 3 | 09-08-2011 10:01 PM |
Simple utility to control multiple USB or Serial HD DirecTV STBs | jchiso | Hardware Support | 15 | 02-19-2009 06:27 PM |
DVB-S setup with Digiguide EPG Grabber & XMLTV importer | MCE-Refugee | SageTV United Kingdom | 27 | 09-08-2008 09:10 AM |
Keeping custom metadata for imports via AddShow() | Opus4 | SageTV Studio | 9 | 02-20-2008 06:35 PM |