I want to use my Kinect v2 as a webcam for some tools which requires a webcam as an input device as example cheese.
However, I am able to start protonect from libfreenect2 like described at the bottom of this page: https://github.com/OpenKinect/libfreenect2/blob/master/README.md#linux
Protonect will display 4 streams, which is fine, but cheese and other tools tell me there is no device found. The same is true for different other tools I tested like VLC media player.
I read the different guide but most I found seems only to be true for Kinect v1.
According to the openkinect FAQ, the Kinect should be able to use as the webcam with a Kernel above 3.0. Mine is 4.10 while Ubuntu is 17.04 and I use an AMD GPU with newest Pro driver.
Thank you in advance for your help.
Related
I am really new to the whole Kinect world.
I have the XBox One Kinect with the Windows Adapter, have installed the last version of the Kinect SDK sucessfully and recorded some videos with the Kinect Studio v2.0 and got some .xef files, which I cannot use, since I need .oni files for a certain program.
So I tried to record with the OpenNI 2's NIVIEWER program, but it does not recognize the Kinect. I tested the NIVIEWER with the ASUS xtion Pro and it did work. I even reinstalled OPENNi2.2/NITE2/KINECT SDK but it still does not work.
Am I doing something wrong?
Kinect v2 and the kinect for xbox one, doesn't work with OpenNI directly. You have a couple of options:
Work with Kinect v1
Work with Kinect SDK only
Work with experimental drivers such as this one. Note that it only works in windows.
You may try to save the rgb and depth images and create the oni by any other means (I think this option is not that easy)
Hope this helps you
Could anyone get the camera data from the Kinect using a Raspberry Pi ?
We would like to make a wireless Kinect connecting it using Ethernet or WiFi. Otherwise, let me know if you have a working alternative.
To answer your question, yes it is possible to get Image and depth on the raspberry pi!
Here is how to.
If you want to use just video (color, not depth) there is already a driver in the kernel! You can load it like this:
modprobe videodev
modprobe gspca_main
modprobe gspca_kinect
You get a new /dev/videoX and can use it like any other webcam!
If you need depth (which is why you want a kinect), but have a kernel older than 3.17, you need another driver that can be found here: https://github.com/xxorde/librekinect. If you have 3.17 or newer, then librekinect functionality is enabled by toggling the gspca_kinect module's command-line depth_mode flag:
modprobe gspca_kinect depth_mode=1
Both work well on the current Raspbian.
If you can manage to plug your kinect camera to the raspberry Pi, install guvcview first to see if it does works.
sudo apt-get install guvcview
Then, typeguvcview in the terminal and it should open an option panel and the camera control view. If all of that does works and that you want to get the RAW data to do some image treatments, you will need to compile OpenCV (it takes 4 hour of compiling) and after that, you just will need to program whatever you want. To compile it, just search on Google, there are lots of tutorial.
Well, as far as I know there are no successful stories about getting images from Kinect on RaspberryPi.
On github there is an issue in libfreenect repository about such problem. In this comment user zarvox say that RPi haven't enough power to handle data from Kinect.
Personally I tried to connect Kinect with RPi using OpenNI2 and Sensor, but have no success. And that was not a clever decision because it's impossible to work with Microsoft Kinect on Linux using OpenNI2 due to licensing restrictions (Well, actually it is not so impossible. You can use OpenNI2-FreenectDriver + OpenNI2 on Linux to hookup Kinect. But anyway this workaround is not suitable for RaspberryPi, because OpenNI2-FreenectDriver uses libfreenect).
But anyway there are some good tutorials about how to connect ASUS Xtion Live Pro to RaspberryPi: one, two. And how to connect Kinect to more powerfull arm-based CubieBoard2: three.
If you intend to do robotics the simplest thing is to use the Kinect library on ROS Here
Oderwise you can try OpenKinect, They provide the libfreenect library that let you acess to the accelerometers the image & much more
OpenKinect on Github here
OpenKinect Wiki here
Here is a good exemple with code & all the details you need to connect to the Kinect & operate the motors using libfreenect.
You will need a powered USB hub to power the Kinect & to install libusb.
A second possiblity is to use the OpenNI library which provides a SDK to develop midleware libraries to interface to your application there is even an OpenNi lib for processing here.
yes, you can use Kinect with raspberry pi in a small robotic project.
I have done this work with the openkinect library.
my experience is you should check your raspberry pi and monitoring pi voltage, not time does to low voltage.
you should accuracy your coding to use lower processing and run your code faster.
because if your code had got a problem, your image processing would be the slower response to the objects.
https://github.com/OpenKinect/libfreenect https://github.com/OpenKinect/libfreenect/blob/master/wrappers/python/demo_cv2_threshold.py
Is there any posibility of using Kinect as a WebCam? I know that I can do that with KinectCam.ax, but it's only available on OpenNI libraries. I use Microsoft Kinect SDK, because of my project... I tried to find something in Internet... Nothing interesting...
I need a WebCam and it's a stupidity to buy a new one, when I have Kinect o_O
Someone create the drivers to convert your kinect on a webcam. I test it, and works in Skype.
To install the kinect as a webcam download the 3 files (KinectCam.ax,install.bat, unistall.bat) in the Compiled folder here:
https://github.com/wildbillcat/KinectCam/
Execute the install.bat as Administrator. And that's all.
The author say that this works even in Windows 8.
You can get more info on this thread on msdn.
I am using the Kinect for Xbox and I am planning on using the OpenNI framework along with the Point Cloud Library for processing but I am having trouble getting OpenNI to recognize my Kinect for Xbox and I wanted to make sure that it is actually compatible with the device.
For some reason I haven't been able to find any documentation on this exact topic.
PCL does indeed work with OpenNI. I've managed to easily compile the OpenNI Grabber Sample on Windows (using the All In One installer). I must admit I haven't managed the same on osx (had some issues with various versions of VTK being installed on the machine).
By the looks of it the issue doesn't look like it's on the PCL side, but on the OpenNI driver side. Can you run any of the samples ? If not, what error messages are you getting ?
I recommend cleaning up (uninstalling OpenNI, NITE, SensorKinect) and installing the unstable versions, but try installing in this order:
OpenNI 1.5.4.0
Nite 1.5.2.21
Avin's SensorKinect
Which version of OpenNI that you use?
If you use version 1.5.4, I think there is no problem because OpenNI interact directly with your Kinect Xbox.
However, if you use OpenNI version 2.x, it will interact with your device via Kinect SDK (http://social.msdn.microsoft.com/Forums/en-US/kinectsdk/thread/a11ff6d9-7fbe-4636-8ff0-92d6220ac3f8/) Since there is no Kinect SDK on linux, you can't make OpenNI 2 to recognize your device.
Microsoft has recently released Kinect SDK 1.5 and some very neat associated features such as face tracking.
I have a Kinect sensor for XBox 360 and Windows 7 (driver, Kinect studio) do not seem to recognize the device.
Can anyone advise if this is an "operator error" or if SDK 1.5 indeed does not support Kinect for XBox sensor but only Kinect for Windows (I have USB and power adapter for it).
Thank you,
Edmon
As Chris Ortner pointed out, the Kinect for Xbox sensor is compatible with Windows 7 for development purposes only - you need to have the SDK installed.
It might be worth checking to see if the SDK has installed properly.
In Device Manager you should see if it has the following:
Microsoft.Kinect
Microsoft Kinect Audio Array Control
Microsoft Kinect Camera
Microsoft Kinect Security Control
And:
Sound, video and game controllers
Kinect USB Audio
I have read that it is recommended that you do not have the sensor connected when installing the SDK. This is also implied by the msdn article setting up a kinect sensor. I have also read, although unable to provide a reference, having things like OpenNI or libfreenect may cause issues and should be uninstalled before installing the SDK. The link also provides other troubleshooting tips.
One last thing to check, ensure you are plugged into a USB 2.0 or USB 3.0 bus. It is one of the hardware requirements, and I am aware that one of the KinectSensor states is InsufficientBandwidth.
The SDK supports Kinect for Xbox360 as a development device, so this is probably an operator- or hardware error.
Please keep in mind, however, that the SDK must be installed for the Xbox360 version to work - the device is not supported for deployment on machines which have just the driver installed.