Build SageTV (Linux Specific) + GitHub primer

[stuckless]

GIT
Some GIT CheatSheets

• http://www.git-tower.com/blog/git-cheat-sheet/
• https://training.github.com/kit/down...heat-sheet.pdf
• http://overapi.com/git/

Fork It!
If you are going to make contributions to SageTV you will need a github account (free) and you will need to FORK the SageTV repo. IF you are NOT going to make contributions, and you just want to play with the code, then you don't need to fork it, you can simply clone the google repo, locally.

Step 1: Goto https://github.com/google/sagetv
Step 2: Click the "Fork" at the top/right of the screen.

Basically, you cannot actually commit directly to SageTV, instead, you would make changes in your own repo (or be a member of someone else's) and then commit the changes there, and then submit a Pull Request to have those changes merged into the main SageTV repo. This is a standard Open Source practice.

Get the Code
On Ubuntu, you can install the git command line tools

sudo apt-get install git

Once you have git installed, AND you have forked the repo, you can get the code by using...

git clone git@github.com:GITUSER/sagetv.git

where GITUSER is you GitHub userid

For example the sagetv github url is https://github.com/google/sagetv.git

HINT: The GitHub project url is on the right hand side of the GitHub page labelled as "HTTPS Clone URL"

Configure Linux (Ubuntu)

This section assumes that you configuring this manually on your machine, but you can alternatively check out coppit's Docker image or my Vagrant image for ways to automatically provision environments that can be used for development.

First, you need to set the JDK_HOME environment variable to be where your currently installed Java is located. If you are running a 32bit machine, then you NEED the 32bit java. If you are running a 64bit machine then you need the 64bit java.

SageTV requires Java 1.5+. (I'm currently using Java 8)

You can install java 8 in Ubuntu using the following commands.

sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install -y oracle-java8-installer

And then set the JDK_HOME

export JDK_HOME=/usr/lib/jvm/java-8-oracle/

If you are running 32bit linux, then

export JAVA_ARCH=i386

If you are running 64bit linux, then

export JAVA_ARCH=amd64

Install these Ubuntu dependencies

sudo apt-get install libx11-dev libxt-dev libraw1394-dev libavc1394-dev libiec61883-dev libfreetype6-dev yasm autoconf libtool build-essential

Need these for mplayer audio support

sudo apt-get install libaudio-dev libpulse-dev libasound-dev

NOTE: For now, you can ONLY build the 32bit version of SageTV on a 32bit system, and the 64bit version on a 64bit machine. There is no cross compiling, at the moment.

Building SageTV
Building the entire SageTV project is a easy as navigating to the build directory and running the buildall.sh script.

cd build
./buildall.sh

NOTE: If you are running Ubuntu 15.10+, mplayer will fail to build. You need to do the following as per this post.

sudo apt-get install gcc-4.7
cd <build dir>
CC=gcc-4.7 ./buildall.sh

Running SageTV
While you could actually test/run sage by running it from the serverrelease directory, it is not recommeded to do so. A better approach would be to install it using the tar balls and run it from that location.

64 Bit
SageTV is historically a 32bit system. While I compiled it fine on 64bit system, and it did start, I did experience crashes with the MiniClient and the Server (yet to investigate). Jeff feel confident that it should run under 64bit environements, so we'll investigate to see what are the issues.

Keeping Your Forked REPO Up To Date
Make sure you have have Google upstream repo in your remotes

seans@seans-desktop:~/git/sagetv$ git remote -v
origin	git@github.com:stuckless/sagetv.git (fetch)
origin	git@github.com:stuckless/sagetv.git (push)
upstream	https://github.com/google/sagetv.git (fetch)
upstream	https://github.com/google/sagetv.git (push)

If not then add it

git remote add upstream https://github.com/google/sagetv.git

Next merge changes from the upstream

git fetch upstream
git rebase upstream/master

And finally push those changes back into your repo

git push origin master

The following URLs have more detailed explanations about the above commands
https://help.github.com/articles/con...te-for-a-fork/
https://help.github.com/articles/syncing-a-fork/
https://help.github.com/articles/pushing-to-a-remote/

Building using Docker
If you don't fiddle with setting up dependencies, you an also build sagetv using Docker. See this thread for building using a Docker container.

[Narflex]

I'd recommend changing the part about cd'ing into the serverrelease directory and running SageTV directly from there. I didn't intend for that to work that way (although it may)...it's better to install it somewhere else using the tarballs and then run from there.

And I noticed you said it crashed on 64 bit Linux...if you can provide more details on why (on another thread), I'd be more than happy to look into it...I'd like to get it working on 64 bit.

[stuckless]

Originally Posted by Narflex

I'd recommend changing the part about cd'ing into the serverrelease directory and running SageTV directly from there. I didn't intend for that to work that way (although it may)...it's better to install it somewhere else using the tarballs and then run from there.

And I noticed you said it crashed on 64 bit Linux...if you can provide more details on why (on another thread), I'd be more than happy to look into it...I'd like to get it working on 64 bit.

I did very minimal amount of testing, so far, but I'll spend some more time on it and do some cleaner tests. If there are crashes in the JNI layer, is there any logging for that? I'm not too familiar with JNI (I've done some, but I recall troubleshooting it to be very tedious).

[MrD]

Originally Posted by Narflex

And I noticed you said it crashed on 64 bit Linux...if you can provide more details on why (on another thread), I'd be more than happy to look into it...I'd like to get it working on 64 bit.

For me the placeshifter dies on Ubuntu 15.04 64-bit.

Miniclient.log

Starting MiniClient
Tue 8/11 18:57:53.834 Detecting cryptography support...
Tue 8/11 18:57:54.080 Starting SageTVPlaceshifter Client
Tue 8/11 18:57:54.095 Attempting to connect to server at localhost:31099
Tue 8/11 18:57:54.115 Connection accepted by server
Tue 8/11 18:57:54.115 Connected to media server
Tue 8/11 18:57:54.118 Connection accepted by server
Tue 8/11 18:57:54.118 Connected to gfx server
Tue 8/11 18:57:54.230 Loaded
Type size error: sizeof(jint) < sizeof(size_t)
Type size error: sizeof(jint) < sizeof(ssize_t)
Type size error: sizeof(jint) < sizeof(ino_t)
Type size error: sizeof(jint) < sizeof(nlink_t)
Type size error: sizeof(jint) < sizeof(blksize_t)
Type size error: sizeof(jint) < sizeof(nfds_t)
Type size error: sizeof(jint) < sizeof(msgqnum_t)
Type size error: sizeof(jint) < sizeof(msglen_t)
Type size error: sizeof(int) < sizeof(ino_t)
Jtux error: Java native types don't match POSIX/SUS types.
Tue 8/11 18:57:54.243 Creating opengl renderer
Tue 8/11 18:57:54.243 Native order: LITTLE_ENDIAN
Tue 8/11 18:57:54.245 Testing to see if server can do a pull mode streaming connection...
Tue 8/11 18:57:54.245 Server can do a pull-mode streaming connection.

Server.log

Tue 8/11 18:57:54.098 [MiniUIServer@3d481e9f] MiniUI got connection from java.nio.channels.SocketChannel[connected local=/127.0.0.1:31099 remote=/127.0.0.1:56587]
Tue 8/11 18:57:54.114 [MiniUIServerConnection@10f5cab9] MiniPlayer is adding to its map:000c291eb35d
Tue 8/11 18:57:54.115 [MiniUIServer@3d481e9f] MiniUI got connection from java.nio.channels.SocketChannel[connected local=/127.0.0.1:31099 remote=/127.0.0.1:56588]
Tue 8/11 18:57:54.115 [MiniUIServerConnection@10f5cab9] MiniUI is adding to its map:000c291eb35d
Tue 8/11 18:57:54.115 [MiniUIServerConnection@10f5cab9] Creating new UI for client:000c291eb35d
Tue 8/11 18:57:54.116 [MiniUIServerConnection@10f5cab9] Creating-2 new UI for client:000c291eb35d UIManager:localhost@@000c291eb35d-2f346c71
Tue 8/11 18:57:54.244 [MediaServerConnection@51aad373] Error in MediaServerConnection of :java.io.EOFException
Tue 8/11 18:57:54.245 [MediaServerConnection@51aad373] java.io.EOFException
Tue 8/11 18:57:54.245 [MediaServerConnection@51aad373] 	at sage.MediaServer$Connection.readLineBytes(MediaServer.java:239)
Tue 8/11 18:57:54.245 [MediaServerConnection@51aad373] 	at sage.MediaServer$Connection.run(MediaServer.java:956)
Tue 8/11 18:57:54.245 [MediaServerConnection@51aad373] 	at sage.Pooler$PooledThread.run(Pooler.java:252)
Tue 8/11 18:57:54.597 [MiniUIClientReceiver@5f017911] Exception in the MiniUIClientReceiver of: java.io.IOException: Connection reset by peer
Tue 8/11 18:57:54.597 [MiniUIClientReceiver@5f017911] java.io.IOException: Connection reset by peer
Tue 8/11 18:57:54.597 [MiniUIClientReceiver@5f017911] 	at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
Tue 8/11 18:57:54.597 [MiniUIClientReceiver@5f017911] 	at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
Tue 8/11 18:57:54.597 [MiniUIClientReceiver@5f017911] 	at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
Tue 8/11 18:57:54.597 [MiniUIClientReceiver@5f017911] 	at sun.nio.ch.IOUtil.read(IOUtil.java:197)
Tue 8/11 18:57:54.597 [MiniUIClientReceiver@5f017911] 	at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
Tue 8/11 18:57:54.597 [MiniUIClientReceiver@5f017911] 	at sage.MiniClientSageRenderer$MiniUIClientReceiver.run(MiniClientSageRenderer.java:8167)
Tue 8/11 18:57:54.598 [KillUIMgr@51aad373] Killing UIMgr UIManager:localhost@@000c291eb35d-2f346c71
Tue 8/11 18:57:54.598 [KillUIMgr@51aad373] Error calling finishWatch from VF goodbye:java.lang.NullPointerException
Tue 8/11 18:57:54.598 [KillUIMgr@51aad373] Killed VideoFrame
Tue 8/11 18:57:54.598 [KillUIMgr@51aad373] Saving properties file to clients/000c291eb35d.properties
Tue 8/11 18:57:54.599 [KillUIMgr@51aad373] Done writing out the data to the properties file
Tue 8/11 18:57:54.600 [KillUIMgr@51aad373] Disposed Window
Tue 8/11 18:57:59.134 [MiniUIServerConnection@10f5cab9] MiniUI established for 000c291eb35d status=false
Tue 8/11 18:57:59.136 [MiniUIServerConnection@10f5cab9] Splash: Rendering Engine is initializing...
Tue 8/11 18:57:59.136 [MiniUIServerConnection@10f5cab9] UIMgr was asynchronously killed during construction, re-destroy it now that init is done
Tue 8/11 18:57:59.136 [MiniUIServerConnection@10f5cab9] Killing UIMgr UIManager:localhost@@000c291eb35d-2f346c71
Tue 8/11 18:57:59.137 [MiniUIServerConnection@10f5cab9] Error calling finishWatch from VF goodbye:java.lang.NullPointerException
Tue 8/11 18:57:59.137 [MiniUIServerConnection@10f5cab9] Killed VideoFrame
Tue 8/11 18:57:59.638 [FinalRender-000c291eb35d@1daad27e] Terminating the BGResourceLoader for the rendering engine
Tue 8/11 18:57:59.640 [FinalRender-000c291eb35d@1daad27e] deinitMini()
Tue 8/11 18:57:59.640 [PluginEventQueue@1495f45d] Core is about to process the event ClientDisconnected vars={MACAddress=000c291eb35d, IPAddress=127.0.0.1}
Tue 8/11 18:58:01.139 [MiniUIServerConnection@10f5cab9] Killed RootPanel
Tue 8/11 18:58:01.139 [MiniUIServerConnection@10f5cab9] Saving properties file to clients/000c291eb35d.properties
Tue 8/11 18:58:01.142 [MiniUIServerConnection@10f5cab9] Done writing out the data to the properties file
Tue 8/11 18:58:01.142 [MiniUIServerConnection@10f5cab9] Disposed Window
Tue 8/11 18:58:24.137 [MiniUIServer@3d481e9f] Dropping old MiniPlayer connection because it's old from:000c291eb35d

I cannot tell if the cause is server side or client side. I suspect the client side.

NB: I have never used the linux place-shifter and I do not currently have access to any windows clients or extenders.

[Narflex]

The Placeshifter crash I know about. That's because there's .so files for jogl that it's using and it has the 32 bit ones there. Ideally this would be updated to use a different type of JOGL JAR package which contains all the proper native libraries...and I think that's actually available...I just didn't get around to fixing that part....

Anyhoo...to fix your problem, you should just need to download the 64 bit JOGL libraries and replace the ones in the placeshifter folder; then it should work. (I have not verified this myself)

[Taddeusz]

What are the general memory requirements for the Linux version? Currently running on Windows. Planning on creating a VM on my ESXi server for testing.

[wayner]

It looks like all of the discussion is currently about Linux. Should those of us that want to start trying Sage be thinking about a Linux install as it looks like that is the favored platform going forward?

If so, what is Linux support like for devices like the 1212 HD-PVR, and USB-UIRT?

[stuckless]

Originally Posted by Taddeusz

What are the general memory requirements for the Linux version? Currently running on Windows. Planning on creating a VM on my ESXi server for testing.

About the same as windows... My server (not a vm) currently has 16 gigs, but previously I only had 4. You can probably get away with a little less than 4.

Originally Posted by wayner

It looks like all of the discussion is currently about Linux. Should those of us that want to start trying Sage be thinking about a Linux install as it looks like that is the favored platform going forward?

If so, what is Linux support like for devices like the 1212 HD-PVR, and USB-UIRT?

I'm sure you can build sagetv under windows (it's mentioned in the README on github), it's just that I'm a linux user, so that's all I'm really concerned about (for now)

[wayner]

Originally Posted by stuckless

I'm sure you can build sagetv under windows (it's mentioned in the README on github), it's just that I'm a linux user, so that's all I'm really concerned about (for now)

That also appears to be the case for Narflex as well. So if most of the developers are on Linux then that seems to be the platform that is the most supported.

[Tiki]

But, the Linux version doesn't have a regular built-in client, correct?
You can run the server, but then need to use an extender or a placeshifter client for playback right?

[gdippel]

I'm trying to use Place shifter on my Ubuntu box, so far without success. I followed the build instructions and can start the server and connect to it from my HD300 but when I try to connect Place shifter to my windows server, the connection dialogue pops up and when I choose my windows sever nothing happens, no GUI, nothing. I'm running 64 bit Ubuntu 14.04 with java 8, could this be the problem?

[Taddeusz]

Trying to install the server via the deb. It fails to complete the configuration due to a dependency failure for sun-java6-jre.

[stuckless]

Originally Posted by gdippel

I'm trying to use Place shifter on my Ubuntu box, so far without success. I followed the build instructions and can start the server and connect to it from my HD300 but when I try to connect Place shifter to my windows server, the connection dialogue pops up and when I choose my windows sever nothing happens, no GUI, nothing. I'm running 64 bit Ubuntu 14.04 with java 8, could this be the problem?

See Jeff's comment a few posts back (and my comments in the original post about 64bit)

Originally Posted by Narflex

The Placeshifter crash I know about. That's because there's .so files for jogl that it's using and it has the 32 bit ones there. Ideally this would be updated to use a different type of JOGL JAR package which contains all the proper native libraries...and I think that's actually available...I just didn't get around to fixing that part....

Anyhoo...to fix your problem, you should just need to download the 64 bit JOGL libraries and replace the ones in the placeshifter folder; then it should work. (I have not verified this myself)

[stuckless]

Originally Posted by Tiki

But, the Linux version doesn't have a regular built-in client, correct?
You can run the server, but then need to use an extender or a placeshifter client for playback right?

That is correct

Originally Posted by Taddeusz

Trying to install the server via the deb. It fails to complete the configuration due to a dependency failure for sun-java6-jre.

Yeah, we'll have to fix that.

[Taddeusz]

I got a core dump scanning my HDHR for channels.

[stanger89]

Originally Posted by gdippel

I'm trying to use Place shifter on my Ubuntu box, so far without success. I followed the build instructions and can start the server and connect to it from my HD300 but when I try to connect Place shifter to my windows server, the connection dialogue pops up and when I choose my windows sever nothing happens, no GUI, nothing. I'm running 64 bit Ubuntu 14.04 with java 8, could this be the problem?

I assume your Windows server is SageTV 7 or earlier? You won't be able to use SageTV 9 placeshifter with SageTV 7, at least I don't think so.

[Narflex]

Originally Posted by stanger89

I assume your Windows server is SageTV 7 or earlier? You won't be able to use SageTV 9 placeshifter with SageTV 7, at least I don't think so.

V9 placeshifter should work fine with V7 server....we made lots of efforts to ensure compatability with extenders over various versions (and the placeshifter uses the same protocol, so I'd expect it to be just as compatible).

[tmiranda]

I got an error trying to do a build. It built the Sage.jar file then failed building the miniclient. It looks like it is missing jni.h which is a #include in sage_Sage.c.

I'm building on 64 bit ubuntu. I do have JDK_HOME pointing to a 32 bit version of Java.

[Fuzzy]

Originally Posted by tmiranda

I got an error trying to do a build. It built the Sage.jar file then failed building the miniclient. It looks like it is missing jni.h which is a #include in sage_Sage.c.

I'm building on 64 bit ubuntu. I do have JDK_HOME pointing to a 32 bit version of Java.

I have the same issue, says it's missing jni.h

[stuckless]

Originally Posted by tmiranda

I got an error trying to do a build. It built the Sage.jar file then failed building the miniclient. It looks like it is missing jni.h which is a #include in sage_Sage.c.

I'm building on 64 bit ubuntu. I do have JDK_HOME pointing to a 32 bit version of Java.

Originally Posted by Fuzzy

I have the same issue, says it's missing jni.h

Do you have a $JDK_HOME/include/ dir?

ls $JDK_HOME/include/

Also what is you JDK_HOME pointing to...

echo $JDK_HOME

If not, then you are likely only pointing a JRE and you'll need the full SDK.