Kinect V2 Streamer (KV2Streamer) is a library that allows developers to access the new Kinect V2 sensor data and tracking capabilities from a non-Windows OS.
KV2Streamer provides both a server-side application (KV2Server) that can stream out Kinect V2 data, including tracking data, to multiple client-side applications accessing the client-side API (KV2Client) running on non-Windows OS over LAN.
KV2Streamer provides the server-side application that retrieves data from the Kinect sensor and streams it out to some defined multicast IP.
Unlike it's client-side counterpart, KV2Server is an application on its own. Once it is build, you can run the executable from the terminal by supplying a multicast IP argument which will be used to identify the server.
However, you have to run the application from the gstreamer bin directory.
$ cd C:\gstreamer\1.0\x86\bin
$ [executable path] <multicast-IP>, for example:
$ C:\Users\demo\projects\kv2streamer\server\kv2server_VS12\Debug\kv2server_application.exe 22.214.171.124
Follow the steps below to build and run the kv2streamer server application. It is assumed that you have installed the Kinect SDK which you can find here: https://www.microsoft.com/en-us/download/details.aspx?id=44561
Install gstreamer from http://gstreamer.freedesktop.org/data/pkg/windows/:
Install boost: http://www.boost.org/users/history/version_1_56_0.html
Open the Visual Studio Solution file in /server/kv2server_VS12 now and try building. If doesn't work, see below:
Note: The following instructions should have already been setup in the project you cloned, but in case you need to set things up yourself:
kv2server-applications/oscpack (BUT EXCLUDE kv2server-applications/oscpack/ip/posix)
Configuration Properties > C/C++ > General > Additional Include Directories:
Configuration Properties > VC++ Directories > Library Directories:
IP address: 192.168.8.2
Subnet Mask: 255.255.255.0
Default Gateway: 192.168.8.250
You can find the Visual Studio in kv2server-applications/KV2ServerCorrdinateMapperTableGenerator. Run it and you will find instructions on the terminal. Each Kinect V2 camera has its own unique calibration that can be saved as a binary using this application. If you copy that binary and put it in the same directory as your client application executable, you will be able to access that conversion table that is used to map the color image to the depth image, e.g. if you're using the colored-depth streamer on the client.
All the project settings should have been setup, but in case you need to do everything yourself, simply include the Kinect SDK and you should be all set:
Configuration Properties > C/C++ > General > Additional Include Directories
Configuration Properties > VC++ Directories > Library Directories
Configuration Properties > Linker > Input
KV2Streamer also provides the client-side API that developers can use to access data from a specific server once the server is running.
This section describes how you can include the KV2Streamer client-side API in your application which runs on Ubuntu.
You're free to use any libraries/frameworks to render the received images but a sample application is provided in sample-client-applications/codelite. The sample applications uses glfw and run on the Codelite IDE.
To use the client API of KV2Streamer, perform the following steps on your Ubuntu machine:
Setting up your network
Both machines server (windows 8) and client (ubuntu) will be connected to the same switch. On ubuntu: go to > System Settings > Network > choose the right one > Options > IPv4 Settings:
Test by trying to ping each other. Make sure that you're not connected to any other network through the a different network card.
Install boost (1.56.0): http://www.boost.org/doc/libs/1_56_0/more/getting_started/unix-variants.html
Install a modified version of oscpack that you can find in kv2server-applications/oscpack by running "sudo make install".
Install the kv2streamer-lib by using CMake, and don't forget to run "sudo make install" at the end to place the built binaries in /usr/local/lib and the headers in /user/local/include.
In your build environment, include the following header search paths:
Also add the following library search paths in your build environment:
And link to the following libraries:
Finally, include the following in your application:
And you should be all set!
A sample application, which you can find in /sample-client-applications, is provided so that you can test the library quickly. Follow the steps below to run the sample application.
If you decide to create a new projects on codelite from scratch, you must do the steps described above, PLUS you have to link to the following libraries:
libglfw, and include the following header files:
Important note: to run the executable, open the terminal, then:
In short, to use KV2Streamer: