Sage is relying on its cached metadata too much

[bastafidli]

I have noticed this with 6.4.5

I have created mp4 clip and uploaded it to Sage server. Sage discovered it and noticed it was 1 hour 21 minutes long. When looking at it I noticed it has no thumbnail and then I discovered the clip was incorrect. I recreated it and uploaded it to the server. The new clip was 1 hour 30 minutes long but when I looked at the detail, Sage thought it was still only 1:21. I didn't specify to refresh media.

Problem 1: Sage relies on cache rather than on the media. It is dirty cheap (in terms of CPU power) to verify that the clip still matches the cache (size of file, timestamps) and if not then recreate the cached info. Even if the cached info is recreated every time the media is accessed it would still not represent any problem.

Then I started playing the clip. To my surprise after 1 hour and 21 minutes Sage stopped playing the clip. I had to hit play again to see the rest of it. Of course sage was displaying that it is playing 1:22 - 1:30 of clip which is only 1:21 long.

Problem 2: Sage seems to be relying on the cached info when to stop playing the media rather than on the actual media.

After I made sage refresh the imported media, sage now correctly sees that the clip is 1:30 long and created thumbnail for it.

Problem 3: I should not have to do this manually. I copy media to my storage server on my PC but watch them on my HD extender later. I should not have to go from one place to another to make sure Sage sees the latest changes, Sage should do it automatically and at least for that 1 media clip (of not for that 1 currently accessed folder) it makes sure that the cache matches the reality.

[GKusnick]

Sage does have the ability to periodically rescan imported media, but perhaps you have that turned off. Check this property:

seeker/periodically_scan_library=true

One reason many people turn this off is that it can prevent disks from spinning down when idle. It's a tradeoff: instant detection of changes entails continuous disk activity. (CPU power is not the issue.)

I agree, though, that once you've selected a media file for playback, there doesn't seem to be any good reason not to check it for changes and update the database as part of that process.

[CollinR]

Originally Posted by GKusnick

I agree, though, that once you've selected a media file for playback, there doesn't seem to be any good reason not to check it for changes and update the database as part of that process.

x3

[bastafidli]

The setting is on (also in Detailed Setup -> Customize)

[evilpenguin]

I've got a bug report in for this because it also affects TV shows what have had their commercials removed.

Edit: From Sage Support

OK, we've updated it now to do this for the next build:

> Honestly, my preferred method of handing this would be to detect and
> use the new duration

Cheers,

Looks like we should be good in the next build. Whats funny is that I only sent in the bug report this morning.

Sage's New Slogan: Your issue fixed in 30 minutes or its free

[gveres]

That's interesting, because I submitted much the same bug a few months ago and the answer was "Sage doesn't support modifying files that it creates, this is not a bug". What I was doing at the time was running my R5000 created mpgs through VideoReDo's QuickStreamFix to produce a valid mpg file. It turned out that QSF changed it from a TS to a PS (or something like that) and that caused the HD extender to not play it back.

Support did help me set it up so that I now record to a .ts file, then QSF creates an mpg file. When I delete the TS and replace it with the mpg file, sage recognizes it and associates it with the existing show information and rescans the file.

Greg

[elaw]

Wow! I had no idea Sage would end playback based on what's in the database instead of when reaching the end of the file - that seems pretty silly.

Although I'm sure the Sage developers have enough on their plate already, I do think the media-rescan thing could be improved.

What would be really cool would be option to "scan media library for new and changed files" then set when to do it: (never/daily/weekly/monthly) at (day/time). Then another option, "do a full rescan of media library" with similar time settings: (never/daily/weekly/monthly) at (day/time).