![]() |
|
Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV. |
![]() |
|
Thread Tools | Search this Thread | Display Modes |
#1
|
|||
|
|||
BMT data corruption for russian shows
Hello,
Quite frequently I face a problem when populating metadata information for Russian TV shows (it may also occur in some other cases; not sure, ). What happens is that I go to BMT Web interface, select a show, fill in all necessary details (name of the show, season, episode) and click "search". The show is located correctly; all information from TVDB is displayed in Russian; all looks fine. I save the metadata. However, at later stage (sometimes immediately after I save; sometimes in a few hours), if I browse for the same show, it suddenly has corrupted information. In some cases, the name of the show is still correct, and only actors names are scrambled, in other cases, the name if the show is also corrupted. I have attached two screenshots; one - of a correctly discovered Russian sitcom; the other one - how the same show looks after couple of hours. Thanks, Yuly |
#2
|
||||
|
||||
Keep in mind that once bmt updates a show, it never updates it again, unless you manually do it yourself from the web ui.
So, if you are seeing where bmt saves the data... all is well (even for a few minutes) and then things get corrupted... then BMT is not doing this, since it never touches your metadata once you save it (unless you manually request it again). I see a lot of complaints lately of people complaining the "bmt is wrecking my metadata several hours/days/months after I've updated it"... and this is not the case, since BMT does not re-update metadata after it has been saved. That being said... There are 3 things that might be going on here... 1. BMT doesn't properly send down the unicode data for the russian character set, and as such, it gets corrupted during save, and you'll notice this immediately after saving the data, since once your save, bmt then reloads the saved data, and sends it back to the UI, so that you can see in real time, what the current state of your metadata looks like. 2. The sagetv apis for reading/writing metadata is not handling the unicode characters correctly. 3. Some other process is mucking with your metadata. Do you have .properties files lying around for these shows? (they'll be in the same directory as the media files and named the same with a .properties extension). If so, then open them, and see if you see proper russian characters in those files? Or,if you have one lying aruond, then post it here, so that I can take a look at the file.
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#3
|
|||
|
|||
Hello,
I have attached one such .properties file, for a show that yesterday I updated it and it looked fine in the BMT WebUI, and now it all garbage. Since the show file name is in russian, the . properties is in russian too. I have added the .txt extension to it. For me, the .properties file looks just fine. I also attached the screenshot of how it looks in the BMT. yuly |
#4
|
||||
|
||||
Quote:
It seems that there was a recent change in SageTV so it now periodically does a refresh of metadata from the media file and the .properties file. When it does this, it is loading the bad data from the .properties file and overwriting the good data. John |
#5
|
||||
|
||||
@jrekiwi - thank John, that's my findings as well.
On a related note... It would appear that SageTV is not using the standard java apis for saving properties, but they are using the standard java apis for reading them. If you can read the russian text in your .properties then that is an issue, because .properties as basically Latin1 character encoded files (which doesn't suppport russian), and as a result all unicode character sets need to be specially encoded so that the java .properties reader can correctly build the data coming back in. Typically in a .properties file, you'll see a bunch of "\u#####" entries to represent the unicode character, which is what I would have expected to see in your code. Since SageTV is doing its own .properties writer, they'll need to convert unicode characters into \u#### characters instead. If you are submitting a bug, you can pass along this URL, since it shows how one might go about "escaping" those characters.
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#6
|
|||
|
|||
Hello all,
I do not have insides on the java encoding things and artifacts obviously. However, I did another test: I downloaded a russian movie, and made a fresh metadata update through BMT WebUI. I have attached the BMT-generated .properties file. It is readable and I can see proper russian fonts via Windows notepad, so, probably, there is more to it here... |
#7
|
||||
|
||||
Quote:
![]() ![]() Keep in mind... BMT is NOT creating those .properties files, and as such, there is nothing I can do to resolve this.
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#8
|
|||
|
|||
Quote:
When I select a title from BMT UI - where does the information comes from (after the title was recognized)? Does it not come from the .properties file? |
#9
|
||||
|
||||
Quote:
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#10
|
||||
|
||||
I posted a bug with sagetv... it's fixed, and it should be in the 7.1.18 release.
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#11
|
|||
|
|||
Thanks!
|
#12
|
||||
|
||||
Quote:
![]()
__________________
Batch Metadata Tools (User Guides) - SageTV App (Android) - SageTV Plex Channel - My Other Android Apps - sagex-api wrappers - Google+ - Phoenix Renamer Downloads SageTV V9 | Android MiniClient |
#13
|
|||
|
|||
I figured; thanks again
![]() |
![]() |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Russian Language (need help) | RU_user | SageTV Europe (Miscellaneous) | 7 | 10-18-2010 03:53 AM |
MS Posts Update to WHS Data Corruption KB | DOS64K | SageTV Software | 1 | 03-10-2008 01:49 PM |
EPG shows 'no data' beyond Dec 15th | brewston | SageTV United Kingdom | 4 | 12-26-2006 05:40 PM |
Sage TV shows no data!! | teeel | SageTV United Kingdom | 25 | 10-22-2004 01:44 PM |
Wiz.bin corruption and lost shows questions | PaulModz | SageTV Software | 4 | 07-21-2003 05:38 PM |