PSX-SCENE Forum Discussion for Sony PlayStation/PsOne/PS2/PS3/PSP/PS VITA
  • Video of Microsoft Kinect Working with PS3 - Source Code Released

    An interesting project has popped up today by a coder by the name of Shantanu Goel. He is attempting to get Microsoft's motion controller, the Kinect, to work with the Sony PS3. He has released source code along with video and he appears to be well on his way. The video shows him logging into his PS3, navigating the XMB, starting Killzone 3, and even controlling Killzone 3 all with his body movements which are being captured by his Microsoft Kinect. He does state that the project still needs tweaking to allow for better motion tracking, but this is shaping up to be very cool.





    This post describes my first attempt at making Kinect work with a PS3. Microsoft’s new XBOX 360 accessory, kinect has made a powerful entry into the market, becoming the fastest selling gadget of all time. Looks like their “You are the controller” tagline is working. Of course, Sony’s “similar” accessory Move is selling well too but is far behind kinect adoption probably because nothing beats the lure of making something work with just “The Force” .


    Now, of course, kinect doesn’t work with PS3 obviously but then if we can’t break the rules, we can at least bend them a little towards our way. I’ve created a mashup that allows you to use kinect as an input controller for the PS3.

    Please note that this is pre-alpha quality software currently. I haven’t updated to a lot of recent code for the below libraries and also haven’t done most of the performance/feature improvements yet. The axis performance specially needs lot of tweaking and it works well only while sitting. Putting this out purely as a proof of concept. For the things that I plan to add soon, please see the Todo section below. Follow me at @shantanugoel for latest updates.


    The program makes use of several other programs in order to provide this functionality. To compile/use it, you also need the following programs:
    1. OpenNI Libraries
    2. NITE Libraries
    3. PrimeSense Libraries for kinect
    4. DIYPS3Controller


    Installation/Compilation/Usage
    1. Make sure that the above 4 things are installed on your machine and working fine.
    2. Download the source of this project to the NITE Samples directory. You can even place it anywhere else but you would need to tweak the makefile to account for the changed paths.
    3. Make any changes to the source that you need.
    4. Change the included ps3 controller config xml file and place it in one of the locations where diyps3controller can find it.
    5. Run make -f kinect-ps3.mak
    6. The executable will be available in Samples/Bin directory of NITE.
    7. Run kinect-ps3 (without any arguments)
    8. Run emuclient (from ps3 controller software) and choose the new xml config file
    9. “Become the controller”

    Default Config:
    Menu Profile – This is the default profile that kinect-ps3 starts with and allows to operate the PS3 menus. Moving hand in any direction will move the ps3 menus as if you were using the DPAD with those directions keys pressed. If you run out of the kinect’s watched space, then just do a backward push with your hand, bring your hand to center and then again do the backward push and continue scrolling. This is like you lift your finger up and then start dragging from edges of a laptop’s touchpad.For selecting any item, make two successive push movements with your hand without changing any x-y direction.

    Game Profile – This profile can be switched to by doing 3 successive backward movements of the hand while in Menu profile. Right now I’ve implemented only directional controls in game profile because I’m still struggling with multiple hands detections and skeletal tracking. A full profile will be activated soon enough. Currently, the your hand’s x/y movements and directly translated to right stick x/y movements (e.g. this is looking in different directions in various FPS games). Moving the hand towards or away from kinect (z-axis) translate to left stick y movements (e.g. this is moving fowards or backwards in most FPS games).

    Issues/Queries/Suggestions
    Please direct them to me by commenting here or emailing me at shantanu AT shantanugoel DOT com


    Coming Soon/ToDo
    -Full Menu and Game profiles
    - Skeletal tracking for better game profiles
    - Switching back to menu profiles from game profiles
    - Easier way to specify user custom profiles instead of changing code for the same
    - Performance improvement for game profiles
    Full source code of the project has been released at https://github.com/shantanugoel/Kinect-PS3 under GNU GPL v2.


    Source: Tech.Shantanugoel.com
    Comments 20 Comments
    1. DominatorAzab-PSG's Avatar
      DominatorAzab-PSG -
      CHECKING this out hahaha- Grandy plzz chek the general section
    1. JiGsAw's Avatar
      JiGsAw -
      Really nice.


      great work.
    1. DominatorAzab-PSG's Avatar
      DominatorAzab-PSG -
      I guess sony will be hapy to listen to that maybe if its legal they might releease compatible games- but i guess this will drive Microsoft CRAAZY!
    1. Groovey's Avatar
      Groovey -
      I hope they can do sometime similar for the sixense/razar hydra when it comes out. So I can replace my move with it lol.
    1. perspex's Avatar
      perspex -
      wow, not bad, not bad at all!!!

      lol, why did you write his name without spaces? shantanugoel isnt a dev. name its his real name!! shantanu goel :P, this is one smart indian..hi 5
    1. NEO117-PSG's Avatar
      NEO117-PSG -
      Awesome! Awesome! Awesome! :O Now THIS is what I'm talking about.

      It'd be cool if we could make the Wiimote and nunchuck work with the PS3... hmmm :3~~

      The system already recognizes them.
    1. researcher-PSG's Avatar
      researcher-PSG -
      How do we know that his fellow friend does not interfere with the sisaxis outside from the camera view?
    1. Daioz-PSG's Avatar
      Daioz-PSG -
      Now THIS is what is the most irritating thing ever.
      I mean, it sounds really cool and everything but its use is terribly pointless, obviously it'll never reach a stage where it is an acceptible controller replacement of any kind.

      HOWEVER if this is possible, how the hell noone made something for mouse+keyboard support?
      Or atleast if we are to stay with console accesories, 360 controller support?
      It sounds a lot more simpler to make then connecting and mapping the kinect like this...
    1. NEO117-PSG's Avatar
      NEO117-PSG -
      Quote Originally Posted by Daioz View Post
      Now THIS is what is the most irritating thing ever.
      I mean, it sounds really cool and everything but its use is terribly pointless, obviously it'll never reach a stage where it is an acceptible controller replacement of any kind.

      HOWEVER if this is possible, how the hell noone made something for mouse+keyboard support?
      Or atleast if we are to stay with console accesories, 360 controller support?
      It sounds a lot more simpler to make then connecting and mapping the kinect like this...
      Its done just to have fun and for personal challenge, at least be happy that we know that it can be done.

      Now there should be more people trying to get other stuff to work on the PS3, like the Wiimote (please please LOL) or the 360 pad (I still don't know why would ANYONE prefer that over the Dualshock...).

      Mouse+Keyboard would be beautiful to play dat generic shooter #2530.
    1. xPreatorianx-PSG's Avatar
      xPreatorianx-PSG -
      Quote Originally Posted by Daioz View Post
      Now THIS is what is the most irritating thing ever.
      I mean, it sounds really cool and everything but its use is terribly pointless, obviously it'll never reach a stage where it is an acceptible controller replacement of any kind.

      HOWEVER if this is possible, how the hell noone made something for mouse+keyboard support?
      Or atleast if we are to stay with console accesories, 360 controller support?
      It sounds a lot more simpler to make then connecting and mapping the kinect like this...
      How is it pointless? It will become useable if people work on it. Kinect is being used in all sorts of mods and hacks around the web. The kinect is actually a damn good piece of tech and I've seen countless of video's with innovative use for it.
    1. Blarix-PSG's Avatar
      Blarix-PSG -
      Quote Originally Posted by DominatorAzab View Post
      I guess sony will be hapy to listen to that maybe if its legal they might releease compatible games- but i guess this will drive Microsoft CRAAZY!
      It is actually a good thing for MS. The Kinect sales will go up even more, last time I checked Kinect sold 10 Million world wide already. If PS3 owners pick up Kinect MS would be over the moon.
    1. DominatorAzab-PSG's Avatar
      DominatorAzab-PSG -
      Quote Originally Posted by Blarix View Post
      It is actually a good thing for MS. The Kinect sales will go up even more, last time I checked Kinect sold 10 Million world wide already. If PS3 owners pick up Kinect MS would be over the moon.
      But u might also want to think that way: people who want to play kinect will buy kinect+ PS3 instead of buying KINECT+ XBOx
    1. alzaabi-PSG's Avatar
    1. Kingj13-PSG's Avatar
      Kingj13-PSG -
      This would be great, if we could get full control of games using the kinect!
    1. One2thr456svn's Avatar
      One2thr456svn -
      I have a Kinect, and I use it mostly for ESPN, but if this g keeps in the right direction this could be very cool (it is already) can you see it God Of War 3 & DDR with the Kinect then $ony would be right "It only dose everything"
    1. TheReaper's Avatar
      TheReaper -
      in yo face xbox xD... now we just need a 360 emu
    1. douha's Avatar
      douha -
      and they say 360 is better lol
    1. jneul-PSG's Avatar
      jneul-PSG -
      i dont see the point ps3 already has move which works with hardcore games, good luck making kinect killzone 3 work as good as move:-D
    1. daveth26's Avatar
      daveth26 -
      I agree. Excellent merge of Microsoft & Sony. Sony could have done better then "Move". Microsoft sales for the Kinect could have move up on target. The main point should be only using hands and movements rather than having our "vibrators"...

      May The Force Be With You! Jedi!
    1. Dishank's Avatar
      Dishank -
      This is awesome!
      Hey guys just imagine Ps3 working with Kinect without bugs and problems + Xbox 360 emulateur +Xbox kinect games
      It will be the greatest day of my life if that arrives...