SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations

Notices

SageTV v7 Customizations This forums is for discussing and sharing user-created modifications for the SageTV version 7 application created by using the SageTV Studio or through the use of external plugins. Use this forum to discuss plugins for SageTV version 7 and newer.

Reply
 
Thread Tools Search this Thread Display Modes
  #761  
Old 03-29-2019, 05:50 PM
Beaker's Avatar
Beaker Beaker is offline
Sage User
 
Join Date: Oct 2005
Location: Central Iowa
Posts: 65
Quote:
Originally Posted by robogeek View Post
Just a note to let everyone know the YouTube API sorting is fixed and the YouTube plugin appears to be working normally again
It is not working correctly for me. My Wiz.bin still climbs to ludicrous size very quickly. Perhaps this is rolling out slowly to certain individuals?
__________________
"Worry does not empty tomorrow of its sorrow; it empties today of its strength." Corrie Ten Boom

Core-i5 6600k
16GB RAM
Hauppauge WinTV-QuadHD
Win10
Reply With Quote
  #762  
Old 03-29-2019, 10:35 PM
robogeek robogeek is offline
Sage Expert
 
Join Date: Apr 2003
Location: Appleton, WI USA
Posts: 561
In the cases where the plugin still doesn't seem to be working correctly, I suspect the plugin may be picking up the previously queued videos from when the sorting issue first started. You may have to go into the YouTube Recording Engine configuration (Setup->SageTV Plugins->Installed Plugins->General->YouTube Recording Engine->Configure Plugin) and find the option in there to purge the download queue.

<EDIT>
Nevermind, I see what you guys are talking about now. My YouTube favorites seem to be downloading new videos normally. But I see the video lists from within the YouTube (2015) plugin seem to be messed up for some YouTube channels, but not all. Not sure yet about what is going on there. But I think the growing wiz.bin is likely related to the download queue that needs to be purged.

<EDIT 2>
Upon further checking... my messed up looking favorite YouTube channels had the favorite option 'Fetch Watched Videos' set to Disable instead of Enabled, so there were gaps with only a couple of the most recent unwatched videos at the top of the list which were followed by much older unwatched videos. After ensuring the 'Fetch Watched Videos' was set to Enabled for all of my favorite YouTube channels, it appears the plugin is properly fetching the video lists which are properly sorted by date (newest to oldest). My wiz.bin also looks like it's maintaining a stable and expected size between 140MB and 150MB.
__________________
--Jason

Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 3.2GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250
29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs).
Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u201, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5.
Clients: 3xHD300s, 2xHD100, 2xPlaceshifters

Last edited by robogeek; 03-30-2019 at 02:33 AM.
Reply With Quote
  #763  
Old 03-30-2019, 02:48 AM
robogeek robogeek is offline
Sage Expert
 
Join Date: Apr 2003
Location: Appleton, WI USA
Posts: 561
I did notice one other issue with about a dozen YouTube videos from channels that I have set as Favorites. These videos won't download and will drop off of the queue and get queued again later, and they keep repeating that cycle. I don't know if it's a problem with youtube-dl.exe taking too long to get to the video download or if it's a problem with the YouTube plugin not waiting long enough and declaring the job dead and killing it before it starts downloading:

Code:
Sat 3/30 2:00:39.925 [Timer-28@4b8f546a] YT: JobManager.startFirstInQueue: Starting job.
Sat 3/30 2:00:39.926 [Timer-28@4b8f546a] YT: JobManager.startFirstInQueue: Started gS-rVPbVGYk
Sat 3/30 2:00:39.926 [Timer-28@4b8f546a] YT: MonitorJob: Job is done. 2f-gZwdTFyo
Sat 3/30 2:00:39.926 [Thread-113388@32a5f61e] YT: DownloadVideo: Starting new download.
Sat 3/30 2:00:39.926 [Timer-28@4b8f546a] YT: Videos.getVideoInfo: Returning results from cache.
Sat 3/30 2:00:39.926 [Thread-113388@32a5f61e] YT: DownloadVideo.executeDownloadWindows: targetDirectory specified <youtube_downloads\>
Sat 3/30 2:00:39.927 [Timer-28@4b8f546a] YT: Util.getAllDownloadedFiles: No files in directory <C:\Program Files\SageTV\SageTV\youtube_downloads>
Sat 3/30 2:00:39.927 [Timer-28@4b8f546a] YT: MonitorJob.renameAndMoveFile: No files found.
Sat 3/30 2:00:39.931 [Thread-113388@32a5f61e] YT: DownloadVideo.executeDownloadWindows: Command [youtube-dl.exe, --restrict-filenames, --no-part, -f, best, -o"youtube_downloads\%(id)s.%(ext)s", gS-rVPbVGYk]
Sat 3/30 2:00:39.932 [Timer-28@4b8f546a] YT: MonitorJob: renamedFile is null. Exiting.
Sat 3/30 2:00:39.935 [Thread-113383@92d741c] YT: DownloadVideo.executeDownloadWindows: youtube-dl has exited.
Sat 3/30 2:00:42.328 [Thread-113390@786866b1] YT: StreamGetter: stdout: [youtube] gS-rVPbVGYk: Downloading webpage
Sat 3/30 2:01:03.974 [Thread-113390@786866b1] YT: StreamGetter: stdout: [youtube] gS-rVPbVGYk: Downloading video info webpage
Sat 3/30 2:01:09.925 [Timer-28@4b8f546a] YT: MonitorJob: Looking for Client requests.
Sat 3/30 2:01:09.925 [Timer-28@4b8f546a] YT: MonitorJob: Found a runnning job. gS-rVPbVGYk
Sat 3/30 2:01:09.925 [Timer-28@4b8f546a] YT: MonitorJob: Job has not yet completed.
Sat 3/30 2:01:09.925 [Timer-28@4b8f546a] YT: MonitorJob: Job is progressing.
Sat 3/30 2:01:39.925 [Timer-28@4b8f546a] YT: MonitorJob: Looking for Client requests.
Sat 3/30 2:01:39.925 [Timer-28@4b8f546a] YT: MonitorJob: Found a runnning job. gS-rVPbVGYk
Sat 3/30 2:01:39.925 [Timer-28@4b8f546a] YT: MonitorJob: Job has not yet completed.
Sat 3/30 2:01:39.925 [Timer-28@4b8f546a] YT: MonitorJob: Job is not progressing. Stopping it.
Sat 3/30 2:01:39.925 [Timer-28@4b8f546a] YT: DownloadVideo.stop: Stopping.
Sat 3/30 2:01:39.926 [Timer-28@4b8f546a] YT: JobManager.updateUserRecord: jobQueue sise = 9
Sat 3/30 2:01:39.926 [Timer-28@4b8f546a] YT: MonitorJob: Finished job removed from queue gS-rVPbVGYk
If I run the youtube-dl command with the parameters specified in the log snippet above, it does download the video. The only thing is, it takes about 90 to 120 seconds from initiating the command until the video download actually begins. It looks like the YouTube plugin is giving up and killing the youtube-dl process after 60 seconds? I did run youtube-dl with the -U update switch to update to the latest version to see if that would help, but this issue still remains. And I'm not sure why this is only happening to a fairly small portion of videos.
__________________
--Jason

Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 3.2GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250
29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs).
Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u201, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5.
Clients: 3xHD300s, 2xHD100, 2xPlaceshifters
Reply With Quote
  #764  
Old 03-31-2019, 12:47 PM
robogeek robogeek is offline
Sage Expert
 
Join Date: Apr 2003
Location: Appleton, WI USA
Posts: 561
OK, here's what I've been able to figure out...

Most downloads of Favorites work without issue, but some aren't working through the YouTube Download Engine because the youtube-dl program is taking too long to proceed to the actual downloading step and the plugin appears to be interpreting that long delay as a failure and killing the process. (See log snippet in previous post). Playing videos from within the YouTube (2015) plugin works, it's just the favorites and manual recording of the videos that appears to be failing for a certain subset of videos.

I've traced the delay down to the downloading of the DASH manifest that is done by the youtube-dl program. The good news is there is a command line switch (--youtube-skip-dash-manifest) that disables the downloading of the DASH manifest and greatly reduces the delay between the time youtube-dl is started and the time it starts downloading the requested video. Ideally, this command switch would be added to the YouTube Download Engine plugin, or perhaps a new plugin config option added to allow custom youtube-dl command line switches to be specified. Alternatively, instead of adding this command line switch, the YouTube Download Engine could be updated so the youtube-dl watchdog timer is longer or possibly made configurable as a new plugin config option.

Caveat for the following workaround... I don't know if this is or will adversely affect other parts of the YouTube plugin, but everything appears to be working normally with no apparent errors:

Fortunately the youtube-dl program can accept additional command line switches via a config file. (https://github.com/ytdl-org/youtube-...#configuration) Linux should be fairly straight forward. I use Windows so I'll document the Windows stuff here. The documentation on github is slightly incorrect in that the C:\User\..... location specified is incomplete. If you are experiencing this issue of some favorites not being downloaded, create a file called config.txt and put in this command line switch:

--youtube-skip-dash-manifest

Then you need to figure out where to put this config.txt file. Whether you run SageTV (standalone) or SageTVService, you need to know which user account it is running under (the youtube-dl process will start under the same user account the SageTV process is running under). You can find this in the Services control panel or by checking the appropriate SageTV process in the Details tab of the Windows Task Manager. If running under a real user account, the config.txt file would be stored in this directory (create youtube-dl directory if it doesn't exist):

C:\Users\<user account>\AppData\Roaming\youtube-dl

Replace <user account> with the actual name of the user account. If you are running SageTVService under the LocalSystem or some other exotic account type, you'll have to use Google to figure out the appropriate %APPDATA% location for that account, unless someone else contributes that knowledge in a reply here.

Also, in the process of working through this, I have found the Video Format config option in the YouTube Recording Engine plugin always remains set to best. I can't seem to change it from my HD300 extenders or from the plugin manager in the web UI. I can only change it by shutting down the service and manually altering the property in the sage.properties file.
__________________
--Jason

Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 3.2GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250
29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs).
Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u201, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5.
Clients: 3xHD300s, 2xHD100, 2xPlaceshifters
Reply With Quote
  #765  
Old 04-06-2019, 04:25 PM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,798
I received notification from Google that the bug impacting this plugin has been fixed.
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #766  
Old 04-27-2019, 04:23 PM
gary201 gary201 is offline
Sage Advanced User
 
Join Date: Dec 2010
Location: Rochester NY
Posts: 102
This morning I think I noticed a new problem. When you go to watch a video, the plug-in displays "downloading video info webpage" and doesn't proceed any further. It happens to all of my Favorites. I assume Google is mucking around some more on their site again. Does anyone know if this is a temporary thing (another Google mess up) or something where the plug-in will need updating?
Reply With Quote
  #767  
Old 04-28-2019, 04:54 AM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,798
Quote:
Originally Posted by gary201 View Post
This morning I think I noticed a new problem. When you go to watch a video, the plug-in displays "downloading video info webpage" and doesn't proceed any further. It happens to all of my Favorites. I assume Google is mucking around some more on their site again. Does anyone know if this is a temporary thing (another Google mess up) or something where the plug-in will need updating?
Whenever something like this happens the first thing you should do is update youtube-dl. Just replace the one already in your sage directory.

https://ytdl-org.github.io/youtube-dl/
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #768  
Old 04-30-2019, 04:41 PM
gary201 gary201 is offline
Sage Advanced User
 
Join Date: Dec 2010
Location: Rochester NY
Posts: 102
That worked. Thanks!
Reply With Quote
  #769  
Old 07-21-2019, 01:55 PM
Rob23 Rob23 is offline
Sage Advanced User
 
Join Date: Feb 2009
Posts: 100
I've encountered an issue with this plugin in which videos begin playing for five seconds at which time the audio continues as normal, but the video is frozen. I can fast forward and the video will resume for three to five seconds and freezes again with the audio continuing. This only occurs on my HD200 extender. I am able to play videos as normal on my server. I have updated to the latest youtube-dl (2019.07.16) as well as uninstalled the plugin and reinstalled with no change in the video freezing behavior.

Does anyone have any idea what could be causing this?
__________________
Sage Server: Core 2 Quad Q9550 2.83GHz, Windows 7 x64, Hauppauge WinTV-quadHD, AverMedia M780. HD200 Extender.
Reply With Quote
  #770  
Old 07-21-2019, 04:17 PM
SteveW's Avatar
SteveW SteveW is offline
Sage Aficionado
 
Join Date: Oct 2008
Location: Fall River, Nova Scotia, Canada
Posts: 336
Quote:
Originally Posted by Rob23 View Post
I've encountered an issue with this plugin in which videos begin playing for five seconds at which time the audio continues as normal, but the video is frozen. I can fast forward and the video will resume for three to five seconds and freezes again with the audio continuing. This only occurs on my HD200 extender. I am able to play videos as normal on my server. I have updated to the latest youtube-dl (2019.07.16) as well as uninstalled the plugin and reinstalled with no change in the video freezing behavior.

Does anyone have any idea what could be causing this?
Iíve had this happen lately on my HD300s.
__________________
Server: Win 10 Pro 64 Bit, Intel i5, 8 GB, Samsung EVO 850 500 GB for OS, WD Black 4 TB + WD Black 1 TB for Recordings, WD Green 2 TB x 1 and WD Red 6 TB x 2 for DVD/Bluray Rips, Music, Home Movies, etc., Sage 9.1.8.770, HDPVR x 2, BellTV 6131 Receiver x 2, USB-UIRT with 56 KHz Receiver

Clients: PC Client x 2, HD-300 x 4 (1 Using Netgear MoCA Coax Bridges), Placeshifter x 1
Reply With Quote
  #771  
Old 07-22-2019, 03:35 PM
Rob23 Rob23 is offline
Sage Advanced User
 
Join Date: Feb 2009
Posts: 100
Quote:
Originally Posted by SteveW View Post
Iíve had this happen lately on my HD300s.
In the past year, it would happen to me occassionally, but not consistently. Usually, updating the youtube-dl file would resolve the issue. For the past couple of months, it happens on almost every video, and every update to the youtube-dl file I've installed has not resolved the issue.
__________________
Sage Server: Core 2 Quad Q9550 2.83GHz, Windows 7 x64, Hauppauge WinTV-quadHD, AverMedia M780. HD200 Extender.
Reply With Quote
  #772  
Old 07-28-2019, 12:40 PM
Rob23 Rob23 is offline
Sage Advanced User
 
Join Date: Feb 2009
Posts: 100
Can anyone confirm for me that the plugin is working correctly for them? I am trying to determine if it is something on my end or an issue with the current youtube-dl.
__________________
Sage Server: Core 2 Quad Q9550 2.83GHz, Windows 7 x64, Hauppauge WinTV-quadHD, AverMedia M780. HD200 Extender.
Reply With Quote
  #773  
Old 07-29-2019, 02:39 PM
MattHelm MattHelm is offline
Sage Icon
 
Join Date: Jun 2005
Location: Chicago, IL
Posts: 1,180
Quote:
Originally Posted by Rob23 View Post
Can anyone confirm for me that the plugin is working correctly for them? I am trying to determine if it is something on my end or an issue with the current youtube-dl.
I'm having the same issue that you describe above.
__________________
Server #1= AMD A10-5800, 8G RAM, F2A85-M PRO, 12TB, HDHomerun Prime, HDHR, Colossus (Playback - HD-200)
Server #2= AMD X2 3800+, 2G RAM, M2NPV-VM, 2TB, 3x HDHR OTA (Playback - HD-200)
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 2 (0 members and 2 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Plex Hacked July 1, 2015 tvmaster2 General Discussion 5 07-08-2015 02:43 AM
Will 2015 leap second effect SageTV? Paul H SageTV Software 10 01-16-2015 07:43 AM
Merry Christmas & Happy New Year 2015 SHS General Discussion 25 01-01-2015 08:59 PM
Plugin request for SageTV Windows Client: Autofrequency plugin mkanet SageTV v7 Customizations 3 11-12-2011 09:33 AM
MediaPlayer Plugin/STV Import: Winamp Media Player Plugin deria SageTV Customizations 447 12-11-2010 07:38 PM


All times are GMT -6. The time now is 07:35 PM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.