SageTV Community  

Go Back   SageTV Community > General Discussion > General Discussion

Notices

General Discussion General discussion about SageTV and related companies, products, and technologies.

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 06-21-2011, 11:24 AM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Can anyone host a mirror of SageTV hosted plugins?

I've written the script to mirror all plugins hosted on download.sage.tv and it also auto edits the SageTVPlugins.xml file to reference the new links. It's working, I'm running the mirror on my personal server, but I cannot host it for all, I simply do not have the bandwidth to even pretend I could.

The script is a Groovy script, which probably doesn't help most, but I could probably port it to PHP or Perl or whatever with little effort. Alternatively, I'd be willing to run the script myself and rsync the repository with a public server, if someone has one and are willing and able to host a repository mirror.

PM me if you're willing and able to host this repository. I'll probably just keep mirroring it locally for now and if the need arises then we'd need to copy the mirror somewhere and provide the new SageTVPlugins.xml file.
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
Reply With Quote
  #2  
Old 06-21-2011, 11:28 AM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,851
Quote:
Originally Posted by Slugger View Post
I've written the script to mirror all plugins hosted on download.sage.tv and it also auto edits the SageTVPlugins.xml file to reference the new links. It's working, I'm running the mirror on my personal server, but I cannot host it for all, I simply do not have the bandwidth to even pretend I could.

The script is a Groovy script, which probably doesn't help most, but I could probably port it to PHP or Perl or whatever with little effort. Alternatively, I'd be willing to run the script myself and rsync the repository with a public server, if someone has one and are willing and able to host a repository mirror.

PM me if you're willing and able to host this repository. I'll probably just keep mirroring it locally for now and if the need arises then we'd need to copy the mirror somewhere and provide the new SageTVPlugins.xml file.
Why not keep it on google code? I would love the irony of that. I'm sure they allow enough discspace to accomodate it.
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #3  
Old 06-21-2011, 12:13 PM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by tmiranda View Post
Why not keep it on google code? I would love the irony of that. I'm sure they allow enough discspace to accomodate it.
If the src for a binary isn't available, you can't store the binary on GC.
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
Reply With Quote
  #4  
Old 06-21-2011, 12:31 PM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,851
Quote:
Originally Posted by Slugger View Post
If the src for a binary isn't available, you can't store the binary on GC.
How about something like DropBox or whatever Microsoft is calling their free web storage solution these days?
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #5  
Old 06-21-2011, 12:39 PM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by tmiranda View Post
How about something like DropBox or whatever Microsoft is calling their free web storage solution these days?
Preferably, someone's got a good old fashioned server that they can run a script from cron to sync with download.sage.tv and then make the links available via HTTP. These free storage solutions usually don't have any way to FTP files (or any automated way) and certainly won't allow cronjobs to sync the files up periodically.
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
Reply With Quote
  #6  
Old 06-21-2011, 12:46 PM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
A few people have inquired about the local mirroring script I created, so here it is:

http://sagetv-addons.googlecode.com/...or_repo.groovy

You'll need to configure the variables at the top as required. Along with downloading the files from Sage's server, it also generates an updated XML file with the links adjusted. In case of disaster, simply replace your current SageTVPlugins.xml file with the repo.xml file this script generates. Once replaced, all the Sage hosted plugins will be downloaded from your local HTTP server.

I'm running this script daily from SJQv4. It is safe to run as frequent as you like - it will only download files if they don't exist in your local mirror or if the MD5 checksum has changed (i.e. a new version of a file has been submitted to SageTV).
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
Reply With Quote
  #7  
Old 06-21-2011, 01:21 PM
graywolf's Avatar
graywolf graywolf is offline
Sage Icon
 
Join Date: Oct 2009
Location: NC
Posts: 1,337
Quote:
Originally Posted by tmiranda View Post
How about something like DropBox or whatever Microsoft is calling their free web storage solution these days?
FYI - dropbox recently screwed up their access rules so that for a period (couple hours?) anyone was able to access anyones account.

http://nakedsecurity.sophos.com/2011...-in-as-anyone/
Reply With Quote
  #8  
Old 06-21-2011, 02:02 PM
will will is offline
Sage Fanatic
 
Join Date: Jul 2009
Location: New York
Posts: 797
Quote:
Originally Posted by Slugger View Post
PM me if you're willing and able to host this repository. I'll probably just keep mirroring it locally for now and if the need arises then we'd need to copy the mirror somewhere and provide the new SageTVPlugins.xml file.
How much storage space is your mirroring taking up and how much monthly bandwidth do you anticipate using (best guess)? I have a few websites (hosted professionally) that may have enough excess bandwidth.
__________________
Will

OS: Windows 7
Hardware: Intel Core i7-920 with 12GB RAM & an Adaptec 5805 with a Chenbro 36-port SAS Expander
Case: Antec 1200 with 4 iStarUSA trayless hot-swap cages (20 drives max)
Drives: 8 Toshiba/Hitachi 2TB drives in a RAID 6 & 7 Toshiba 3TB drives in a RAID 6
Capture Cards: HDHomeRun Connect Quatro 4, Hauppauge 60 HD-PVR
Players: 5 HD300s, 2 HD200s
Reply With Quote
  #9  
Old 06-21-2011, 03:15 PM
graywolf's Avatar
graywolf graywolf is offline
Sage Icon
 
Join Date: Oct 2009
Location: NC
Posts: 1,337
Looks to be under 40 MB? At least for the Sage hosted plugins. Some are hosted elsewhere (ie. Diamond and others)


Bandwidth?? Depends upon how many people hit it.
Would need to hit it to install plugins, upgrade plugins, etc.

A grain of sand isn't much...but a whole bunch of grains of sand could be. Sahara Desert?

Last edited by graywolf; 06-21-2011 at 03:18 PM.
Reply With Quote
  #10  
Old 06-21-2011, 03:20 PM
whurlston whurlston is offline
New Member
 
Join Date: Jun 2011
Posts: 4
Send me an email to this username at oshinetworks.com

I have the storage space and bandwidth to accommodate you.
Reply With Quote
  #11  
Old 06-21-2011, 06:30 PM
null0byte null0byte is offline
New Member
 
Join Date: Apr 2009
Location: Grapevine, TX
Posts: 2
Hey, I've been a lurker here for a couple years but haven't posted much till now. I've got a host with about 1TB each of bandwidth and disk space just itching to have a use ( it's nearly empty right now, just hosting a small site for a friend). Do you need a second mirror? Unfortunately I'm not all that versed in how to set things up but I'm willing to learn and want to help out where I can. PM me if interested.
Reply With Quote
  #12  
Old 06-21-2011, 06:53 PM
Naylia's Avatar
Naylia Naylia is offline
Sage Fanatic
 
Join Date: Feb 2005
Location: Mountain View, CA
Posts: 754
I could repurposed a GoDaddy account that I have paid the next 3 years on if needed. Just PM me...
__________________
You can find me at Missing Remote. Or playing FF XIV. For XLobby users: XLobby MC
Reply With Quote
  #13  
Old 06-21-2011, 06:56 PM
SHS's Avatar
SHS SHS is offline
Moderator
 
Join Date: Mar 2003
Location: Vinita, Oklahoma
Posts: 4,585
Look people there no need worry about this rigth now just wait a few months
Reply With Quote
  #14  
Old 06-21-2011, 07:03 PM
darcilicious's Avatar
darcilicious darcilicious is offline
Sage Icon
 
Join Date: Jul 2009
Location: Venus
Posts: 1,306
Better safe than sorry.

Until a few days ago, I thought I had plenty of time to buy an HD300 too.
__________________
SageTV Server 7.1.x w/Gemstone and Plex Home Theater v1.0.10 w/PlexPass
HD-PVR w/v1.5.6 drivers / Hauppauge IR blaster / FiOS Extreme HD / Motorola QIP6200 / SPDIF+720p Fixed Output
on HP Media Center 8400F (Phenom 9500 QuadCore 2.2GHz, nVidia GeForce 8500 GT)
via Olevia 247TFHD/Onyko TX-SR606/Harmony 550/HP MediaSmart EX490 WHS w/12TB
Plex Media Server v0.9.9.5 on HP Touchsmart Envy 23 d16qd
Sonos Play:3, Connect / SimpleTV v2 / Roku 2 XS+Plex / iPhone 5 / iPad 2
Reply With Quote
  #15  
Old 06-21-2011, 09:49 PM
jhkoenig's Avatar
jhkoenig jhkoenig is offline
Sage Advanced User
 
Join Date: Sep 2005
Location: Pleasanton, CA
Posts: 116
If the earlier offers fall through, PM me.
Reply With Quote
  #16  
Old 06-21-2011, 10:42 PM
Naylia's Avatar
Naylia Naylia is offline
Sage Fanatic
 
Join Date: Feb 2005
Location: Mountain View, CA
Posts: 754
Quote:
Originally Posted by SHS View Post
Look people there no need worry about this rigth now just wait a few months
I think with the lack of information available, people feel better doing something/anything to prepare for the worst case. If you learn a lil about XMLTV and some folks put in place a backup plugin server, everyone will feel like there's a safety net. And if we're just gonna waste time reading Internet forums, then it's not like we can't spare the time
__________________
You can find me at Missing Remote. Or playing FF XIV. For XLobby users: XLobby MC
Reply With Quote
  #17  
Old 06-22-2011, 10:11 PM
hugenbdd hugenbdd is offline
Sage Advanced User
 
Join Date: Feb 2009
Location: Cincinnati, KY
Posts: 81
Quote:
Originally Posted by Slugger View Post
A few people have inquired about the local mirroring script I created, so here it is:

http://sagetv-addons.googlecode.com/...or_repo.groovy

You'll need to configure the variables at the top as required. Along with downloading the files from Sage's server, it also generates an updated XML file with the links adjusted. In case of disaster, simply replace your current SageTVPlugins.xml file with the repo.xml file this script generates. Once replaced, all the Sage hosted plugins will be downloaded from your local HTTP server.

I'm running this script daily from SJQv4. It is safe to run as frequent as you like - it will only download files if they don't exist in your local mirror or if the MD5 checksum has changed (i.e. a new version of a file has been submitted to SageTV).
For those wanting to run this on windows, here are a few tips to get you up and started faster.

1.) Download groovy 1.8.0 http://groovy.codehaus.org/Download
2.) Make sure you set your java_home variable.
3.) Add the file "commons-codec-1.5.jar" to your groovy "libary" generally located here: C:\Program Files\Groovy\Groovy-1.8.0\lib
The file can be found here: http://commons.apache.org/codec/download_codec.cgi
4.) Change the location around line 25.
To: def localOutput = new File('YOURLOCATION.')
Example: def localOutput = new File('C:\\Users\\Dave\\Desktop\\SagePlugins')
*Notice the double \
5.) Change the "URL" to your own webserver. In this case loop back. 127.0.0.1
def targetUrl = 'http://127.0.0.1/repository'
6.) Run from the command line or groovy console.
C:\Users\Dave\Desktop>groovy mirror_repo.groovy


Hopefully this will be hosted in the near future and no one else will have to worry about downloading the plug-ins on their own.

Thanks Slugger for a great script!


Dave
Reply With Quote
  #18  
Old 06-30-2011, 06:12 PM
nyplayer nyplayer is offline
SageTVaholic
 
Join Date: Sep 2005
Posts: 4,653
Shouldn't the contents of this def localOutput = new File('C:\\Users\\Dave\\Desktop\\SagePlugins') be copied over to the webserver targetUrl = 'http://127.0.0.1/repository'

In My case I downloaded all the plugins to C:\nyplayer\SagePlugins... so I should copy them over to targetUrl = 'http://127.0.0.1/repository' ??????

Edit

Better yet where Do I create the repository folder in my Jetty webserver???? So that it can be accessed locally?
__________________
Windows 10 I3 Dual Core 3.0 Server, SageTV9... OpenDCT with 2 HDHRPrimes and 4 HDHRconnects for a total of 14 Tuners.

Last edited by nyplayer; 06-30-2011 at 06:29 PM.
Reply With Quote
  #19  
Old 06-30-2011, 06:49 PM
KJake KJake is offline
Sage Icon
 
Join Date: May 2003
Location: West Michigan
Posts: 1,117
If this actually becomes necessary, I have a linux server with plenty of bandwidth and space. Notice the upload speed (aka how fast people can download from me)...

Reply With Quote
  #20  
Old 06-30-2011, 07:10 PM
Slugger Slugger is offline
SageTVaholic
 
Join Date: Mar 2007
Location: Kingston, ON
Posts: 4,008
Quote:
Originally Posted by nyplayer View Post
Shouldn't the contents of this def localOutput = new File('C:\\Users\\Dave\\Desktop\\SagePlugins') be copied over to the webserver targetUrl = 'http://127.0.0.1/repository'

In My case I downloaded all the plugins to C:\nyplayer\SagePlugins... so I should copy them over to targetUrl = 'http://127.0.0.1/repository' ??????

Edit

Better yet where Do I create the repository folder in my Jetty webserver???? So that it can be accessed locally?
The script assumes the localOutput is the web server folder (i.e. the web server is running on the host you're downloading from). For Jetty, change localOutput to:

def localOutput = new File('C:/Program Files/SageTV/SageTV/jetty/static/repository')

and

def targetUrl = 'http://192.168.2.5:8080/repository'

Change the IP/port in the URL as necessary for your Jetty installation.
__________________
Twitter: @ddb_db
Server: Intel i5-4570 Quad Core, 16GB RAM, 1 x 128GB OS SSD (Win7 Pro x64 SP1), 1 x 2TB media drive
Capture: 2 x Colossus
STB Controller: 1 x USB-UIRT
Software:Java 1.7.0_71; SageTV 7.1.9
Clients: 1 x HD300, 2 x HD200, 1 x SageClient, 1 x PlaceShifter
Plugins: Too many to list now...
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Tips on using Rsync to mirror video folders? jbmia SageTV Linux 5 02-21-2011 08:55 AM
SageTV Graph Plugins babgvant SageTV v7 Customizations 15 08-27-2010 01:15 AM
SageTV V7 plugins and classpaths michaeldjcox SageTV v7 Customizations 1 06-24-2010 09:06 AM
I Need a New Shared Web Host Crashless The SageTV Community 8 06-28-2009 01:15 AM
Can SageTV Linux use same plugins as SageTV XP Windows? TechBill SageTV Linux 3 10-02-2007 12:59 AM


All times are GMT -6. The time now is 03:36 PM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.