Plex Scanner and BMT Agent for SageTV

[panteragstk]

Originally Posted by PiX64

you could always build a metadata agent for my movies :-)

It's so much easier to let other people do stuff like that for you...

[WellThen]

Thanks, with the latest scanner you sent me, it looks like all of my recordings scanned in. I sent you the last log by email.

I'm still using the Personal Media Shows metadata agent, as you had suggested a while back. Can I switch over to trying the BMT agent, or is there further stuff you'd like me to try first. Also, is there some way to force the BMT agent to be used without deleting and re-creating the section?

Thanks again.

[PiX64]

Originally Posted by WellThen

Thanks, with the latest scanner you sent me, it looks like all of my recordings scanned in. I sent you the last log by email.

I'm still using the Personal Media Shows metadata agent, as you had suggested a while back. Can I switch over to trying the BMT agent, or is there further stuff you'd like me to try first. Also, is there some way to force the BMT agent to be used without deleting and re-creating the section?

Thanks again.

Yup switch it over and then youll be good to go.

[WellThen]

Originally Posted by PiX64

Yup switch it over and then youll be good to go.

Yes! It's picking up metadata as we speak.

A general question about Plex, for anyone who might know. I want to have Plex run on the server under a different account, is there anyway to change it to run under another account? Or is that a re-install of Plex?

[PiX64]

Originally Posted by WellThen

Yes! It's picking up metadata as we speak.

A general question about Plex, for anyone who might know. I want to have Plex run on the server under a different account, is there anyway to change it to run under another account? Or is that a re-install of Plex?

Fantastic!

and im not sure sorry would have to play with it.

New code will be available in the next release for anyone else having issues.

[PiX64]

Just as an update we are testing out new scanner features which fixed several peeps issues.

We are also checking out some MAJOR changes/imporvements to the BMT Agent thanks to Brian!

Once we get the kinks figured out we will do another code release.

[Jason]

Originally Posted by PiX64

Just as an update we are testing out new scanner features which fixed several peeps issues.

We are also checking out some MAJOR changes/imporvements to the BMT Agent thanks to Brian!

Once we get the kinks figured out we will do another code release.

What are some of the changes you are working on?

-Jason

[LehighBri]

Originally Posted by Jason

What are some of the changes you are working on?

-Jason

The most notable change is to the agent based on a deeper understanding of how it should work. In the older version of the agent, the metadata for only the latest episode in each season of a show was updating. The new agent, combined with the new scanner, now successfully update the episode-specific metadata for ALL episodes in all seasons of a show.

[PiX64]

Originally Posted by Jason

What are some of the changes you are working on?

-Jason

The scanner includes better logic for faster scanning, more robust error handling and condition checking which solved several users issues with scans not completing.

It doesn't include the syncing of status back to sage... Sorry haven't had time to look into this fully. I saw your post earlier in this thread and briefly looked at it, but haven't been able to play/test things out yet. Hopefully soon.

[Dargason]

Any news?

[PiX64]

Originally Posted by Dargason

Any news?

Yeah sorry. I forgot one major piece that Darci asked me to work on which allows for recordings broken into mutliple files by Sage to be added to plex as 1 media object. This ended up taking a lot of time and research. I got the logic down now and am in the process of testing it. I hope to have the code over to Brian and darci to test.

Sorry for the delay.

[zoop]

Originally Posted by PiX64

ill take a look for ya now.

What os are you running this on?

Also make sure you are running the most version of SageTV, BMT, and sagex. I saw a similiar issue when i first started using the custom .js file that would NOT allow me to call the file which is what looks like is happening. Make sure all that stuff is up to date, and then make sure to restart sage/service. Also please remove the import directory in plex, restart plex, then readd. Post your new logs...

after installing the new code and removing/re-importing i am unfortunately getting the same error...

Feb 26, 2012 13:24:35 [0x7f0038cc0740] DEBUG - Adding file for scanner: /var/media/tv/TheBigBangTheory-S04E02-TheCruciferousVegetableAmplification-15103899-0.edl
Feb 26, 2012 13:24:35 [0x7f0038cc0740] DEBUG - Adding file for scanner: /var/media/tv/LawOrderSpecialVictimsUnit-S10E12-Hothouse-15103418-0.edl
Feb 26, 2012 13:24:36 [0x7f0038cc0740] ERROR - Error in Python: Running scanner:
Traceback (most recent call last):
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/SageTV Scanner.py", line 151, in Scan
    mf = getMediaFileForFilePath(urllib.quote(file + ext))
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/SageTV Scanner.py", line 86, in getMediaFileForFilePath
    return executeSagexAPICall(url, 'MediaFile')
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/SageTV Scanner.py", line 97, in executeSagexAPICall
    resp = unicodeToStr(json.JSONDecoder().decode(fileData))
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/decoder.py", line 402, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/decoder.py", line 418, in raw_decode
    obj, end = self.scan_once(s, idx)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/scanner.py", line 71, in scan_once
    return _scan_once(string, idx)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/scanner.py", line 42, in _scan_once
    _scan_once, object_hook, object_pairs_hook, memo)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/decoder.py", line 230, in JSONObject
    value, end = scan_once(s, end)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/scanner.py", line 42, in _scan_once
    _scan_once, object_hook, object_pairs_hook, memo)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/decoder.py", line 230, in JSONObject
    value, end = scan_once(s, end)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/S
Feb 26, 2012 13:24:36 [0x7f0038cc0740] ERROR - We got an error scanning in /var/media/tv
Feb 26, 2012 13:24:36 [0x7f0038cc0740] ERROR - There were errors scanning location: /var/media/tv
Feb 26, 2012 13:24:36 [0x7f0038cc0740] DEBUG - Since it was an incomplete scan, we are not going to whack missing media.
Feb 26, 2012 13:24:36 [0x7f0038cc0740] DEBUG - Refreshing section 19 of type: 2

this is on ubuntu 10.04, not sure if anyone else here has tried using the scanner/agent on linux or not... i do see it hitting sagex succesfully:

Sun 2/26 13:24:36.296 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=TheDailyShowWithJonStewart-BruceBartlett-15064994-0.ts&encoder=json@13174aaa] ::DEBUG: servlet holder=sagex.remote.SagexServlet-323354251
Sun 2/26 13:24:36.359 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=TheDailyShowWithJonStewart-BruceBartlett-15064994-0.ts&encoder=json@13174aaa] ::DEBUG: RESPONSE /sagex/api  200
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: REQUEST /sagex/api on org.mortbay.jetty.HttpConnection@1e0c1fc6
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: Credentials: Basic amhhcnRtMjpmaXJlMXVw
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: servlet=sagex.remote.SagexServlet-323354251
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: chain=null
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: servlet holder=sagex.remote.SagexServlet-323354251
Sun 2/26 13:24:36.425 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: RESPONSE /sagex/api  200

any thoughts?

thx much

/jer

[PiX64]

Originally Posted by zoop

after installing the new code and removing/re-importing i am unfortunately getting the same error...

Feb 26, 2012 13:24:35 [0x7f0038cc0740] DEBUG - Adding file for scanner: /var/media/tv/TheBigBangTheory-S04E02-TheCruciferousVegetableAmplification-15103899-0.edl
Feb 26, 2012 13:24:35 [0x7f0038cc0740] DEBUG - Adding file for scanner: /var/media/tv/LawOrderSpecialVictimsUnit-S10E12-Hothouse-15103418-0.edl
Feb 26, 2012 13:24:36 [0x7f0038cc0740] ERROR - Error in Python: Running scanner:
Traceback (most recent call last):
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/SageTV Scanner.py", line 151, in Scan
    mf = getMediaFileForFilePath(urllib.quote(file + ext))
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/SageTV Scanner.py", line 86, in getMediaFileForFilePath
    return executeSagexAPICall(url, 'MediaFile')
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/SageTV Scanner.py", line 97, in executeSagexAPICall
    resp = unicodeToStr(json.JSONDecoder().decode(fileData))
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/decoder.py", line 402, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/decoder.py", line 418, in raw_decode
    obj, end = self.scan_once(s, idx)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/scanner.py", line 71, in scan_once
    return _scan_once(string, idx)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/scanner.py", line 42, in _scan_once
    _scan_once, object_hook, object_pairs_hook, memo)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/decoder.py", line 230, in JSONObject
    value, end = scan_once(s, end)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/scanner.py", line 42, in _scan_once
    _scan_once, object_hook, object_pairs_hook, memo)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Scanners/Series/simplejson/decoder.py", line 230, in JSONObject
    value, end = scan_once(s, end)
  File "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/S
Feb 26, 2012 13:24:36 [0x7f0038cc0740] ERROR - We got an error scanning in /var/media/tv
Feb 26, 2012 13:24:36 [0x7f0038cc0740] ERROR - There were errors scanning location: /var/media/tv
Feb 26, 2012 13:24:36 [0x7f0038cc0740] DEBUG - Since it was an incomplete scan, we are not going to whack missing media.
Feb 26, 2012 13:24:36 [0x7f0038cc0740] DEBUG - Refreshing section 19 of type: 2

this is on ubuntu 10.04, not sure if anyone else here has tried using the scanner/agent on linux or not... i do see it hitting sagex succesfully:

Sun 2/26 13:24:36.296 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=TheDailyShowWithJonStewart-BruceBartlett-15064994-0.ts&encoder=json@13174aaa] ::DEBUG: servlet holder=sagex.remote.SagexServlet-323354251
Sun 2/26 13:24:36.359 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=TheDailyShowWithJonStewart-BruceBartlett-15064994-0.ts&encoder=json@13174aaa] ::DEBUG: RESPONSE /sagex/api  200
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: REQUEST /sagex/api on org.mortbay.jetty.HttpConnection@1e0c1fc6
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: Credentials: Basic amhhcnRtMjpmaXJlMXVw
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: servlet=sagex.remote.SagexServlet-323354251
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: chain=null
Sun 2/26 13:24:36.361 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: servlet holder=sagex.remote.SagexServlet-323354251
Sun 2/26 13:24:36.425 [320293546@qtp-320470203-1 - /sagex/api?c=plex:GetMediaFileForName&1=file.ts&encoder=json@13174aaa] ::DEBUG: RESPONSE /sagex/api  200

any thoughts?

thx much

/jer

Not sure which version of the scanner you are currently using, but I have release a few version since the last ZIP file...currently i just finished adding the ability to havea recording with mutliple files (as sage does on occassion) attached to the same media object in plex. With this comes some much needed logic for error checking which should without a doubt protect against the type of error you are seeing. I don't want to post the file yet as it is still eing tested/debugged. If you would like to try it PM me with your email, and I will email you the most recent scanner that i just finished enhancing last night.

[PiX64]

@zoop - is your BMT password protected? if so you will need to make sure that both the agent properties file found in the BMT Agent directory of plex is set to use the username and password, as well as the line of code at the top of the Plex Scanner... I know you mentioned tha tyou can hit the BMT url

http://x.x.x.x: port/sagex/api?c=plex:GetMediaFileForName&1=SaturdayNightLive-12401836-1.mp4

for example (of course replacing the name of the file above with one that is actually on your system.

but if you have accessed BMT before and entered the username and password, the above url MAY work wihtout asking you to login again.

if bmt is password protected you can either
1) change sagex access inside of plugins to be NOT password protected..can't remember exactly how to do it but its in the sage plugins section under the sagex plugin
2) Modify all of the places i mentioned above in the sage plex code with your usernameass@x.x.x.x: port

[zoop]

Originally Posted by PiX64

@zoop - is your BMT password protected? if so you will need to make sure that both the agent properties file found in the BMT Agent directory of plex is set to use the username and password, as well as the line of code at the top of the Plex Scanner... I know you mentioned tha tyou can hit the BMT url

http://x.x.x.x: port/sagex/api?c=plex:GetMediaFileForName&1=SaturdayNightLive-12401836-1.mp4

for example (of course replacing the name of the file above with one that is actually on your system.

but if you have accessed BMT before and entered the username and password, the above url MAY work wihtout asking you to login again.

if bmt is password protected you can either
1) change sagex access inside of plugins to be NOT password protected..can't remember exactly how to do it but its in the sage plugins section under the sagex plugin
2) Modify all of the places i mentioned above in the sage plex code with your usernameass@x.x.x.x: port

ya, both places have been modified successfully... i tested it by changing the PW in the file and noting the sagex errors on the sagetv side.

thx

/jer

[PiX64]

so far all signs point to go on the newest scanner..just waiting for some additional feedback. Hopefully an update tomorrow.

[PiX64]

I have just uploaded the newest version of all code found in the repository to the downloads section on google.

The newest version of the scanner allows for sage recordings which have been broken up by sage into mutliple files to be scanned, and added to the same single media object in plex. BEfore you would end up with mutliple files for each part in plex. Now you will have a single item which will automatically play the parts in the correct order, seemless to the end user.

Brian also made several enhancments to the way the bmt agent works...mainly that ALL metadata is not pulled in and attached to the media objects for an entire series, and all of the sub elements of a series (episodes)

please let us know if you run into any issue.

Thanks Brian for testing, and for all your hard working ont he AGENT!


Thanks Darci for your continued support testing and doing your thing with documentation :-)

http://code.google.com/p/sagetv-for-...downloads/list

[darcilicious]

Originally Posted by PiX64

Thanks Brian for testing, and for all your hard working ont he AGENT!

Ditto!

And thanks for all your great work on this as well -- I'm really happy with how this has turned out and look forward to accessing my SageTV content via Plex -- it's very slick!

[Dargason]

What's your favorite Win7 tool for unpacking rar files?

[darcilicious]

7zip is my personal favorite.