FACE tracking

sheena_yanaisheena_yanai Join Date: 2002-12-23 Member: 11426Members
edited April 2010 in Off-Topic
<div class="IPBDescription">not another head tracking discussion</div>its just a informational post...nothing i expect to see in NS2 ...

ive just found this video about some awesome face tracking software called face API by seeing machines , used to control HL2. this software is so much better and easier to use than freetrack or track ir.

it does not require camera mods.. or wiimotes, or infrared markers / reflectors, and works bloody fast

the commercial version of this API can even crop your face on the fly, and use it as texture on your ingame characters face for example.. (if the game was coded to support this)

this is just awesome

<center><object width="450" height="356"><param name="movie" value="http://www.youtube.com/v/qWkpdtFZoBE"></param><embed src="http://www.youtube.com/v/qWkpdtFZoBE" type="application/x-shockwave-flash" width="450" height="356"></embed></object></center>

you can download torbens HL2 face tracking thingie using face API at his page :
<a href="http://torbensko.com/software/head_tracking/" target="_blank">http://torbensko.com/software/head_tracking/</a>

Instructions.
Software Requirements:

* A Source licence (i.e. HL2, CS:S, Portal, Team Fortress 2, etc)
* Source SDK (free to download through Steam)

Hardware Requirements:

* USB-2 Web camera preferably running at 640x480 @ 30Hz
* Reasonable hardware (e.g. 2Ghz, 1GB RAM) running a dual-core processor

Installing:

* Enter your email below and click on the '>'
* Open the email you receive and download the file from the link provided
* Unzip the file
* Shut down Steam
* Run 'full_setup.exe'
* If the Face API installer does not run automatically, run 'faceapi_setup.exe'
* If the IPP Runtime installer does not run automatically, run 'IPP5.3.3/setup.exe'
* Connect your web camera and place it under your monitor, facing you
* Open Steam, click on 'My Games' and run 'Head Tracking'
* For the best performance, sit about half a meter away from your web camera
Off Topic Disagree Agree Awesome

Comments

  • Renegade.Renegade. Join Date: 2003-01-15 Member: 12313Members, Constellation
    don't waste de- oh nm, conditioned response. +1 for using Source.
    Off Topic Disagree Agree Awesome
  • RobBRobB ＴＵＢＥＳ ＯＦ ＴＨＥ ＩＮＴＥＲＷＥＢ Join Date: 2003-08-11 Member: 19423Members, Constellation, Reinforced - Shadow
    Sweet!1!

    Now I wonder when they release it to their games.
    Off Topic Disagree Agree Awesome
  • ClinkClink Join Date: 2009-06-07 Member: 67728Members
    So I dont hafta spend $150 on an IR system that runs on half a dozen current games? Win. Wonder if i could use this for Arma 2...

    Spanks for the post!
    Off Topic Disagree Agree Awesome
  • sheena_yanaisheena_yanai Join Date: 2002-12-23 Member: 11426Members
    edited April 2010
    there is a free license for it, it only supports the 6DOF head tracking, who needs facial expression recognition ^^ or real time face texture transfer :p
    you have to create a download account on the seeing machine page to get the API software.. i dunno how much c++ coding work is required to get something working for arma, and how to hook this into the game..maybe just using the non encrypted freetrack way..
    and damnit..i dont even have a webcam to test this.. recomended is a cam with 640x480 minimum and 30hz/fps

    <a href="http://www.faceapi.com/" target="_blank">http://www.faceapi.com/</a>
    Off Topic Disagree Agree Awesome
  • Draco_2kDraco_2k Evil Genius Join Date: 2009-12-09 Member: 69546Members
    Finally, a good use for a webcam.

    Seriously though, this IS awesome.
    Off Topic Disagree Agree Awesome
  • Chris0132Chris0132 Join Date: 2009-07-25 Member: 68262Members
    Interesting technology.

    Odd how in the video he apparently turns round and goes from an orange mapped level to lost coast though.
    Off Topic Disagree Agree Awesome
  • RobBRobB ＴＵＢＥＳ ＯＦ ＴＨＥ ＩＮＴＥＲＷＥＢ Join Date: 2003-08-11 Member: 19423Members, Constellation, Reinforced - Shadow
    <!--quoteo(post=1768614:date=Apr 25 2010, 12:16 AM:name=Draco_2k)--><div class='quotetop'>QUOTE (Draco_2k @ Apr 25 2010, 12:16 AM) <a href="index.php?act=findpost&pid=1768614"><{POST_SNAPBACK}></a></div><div class='quotemain'><!--quotec-->Finally, a good use for a webcam.

    Seriously though, this IS awesome.<!--QuoteEnd--></div><!--QuoteEEnd-->
    Those crazy japs began to put something like that in their porn games a while ago, but as far as i've seen its pretty unreliable.
    Off Topic Disagree Agree Awesome
  • ScytheScythe Join Date: 2002-01-25 Member: 46NS1 Playtester, Forum Moderators, Constellation, Reinforced - Silver
    <!--quoteo(post=1768608:date=Apr 25 2010, 06:38 AM:name=sheena_yanai)--><div class='quotetop'>QUOTE (sheena_yanai @ Apr 25 2010, 06:38 AM) <a href="index.php?act=findpost&pid=1768608"><{POST_SNAPBACK}></a></div><div class='quotemain'><!--quotec-->there is a free license for it, it only supports the 6DOF head tracking, who needs facial expression recognition ^^ or real time face texture transfer :p
    you have to create a download account on the seeing machine page to get the API software.. i dunno how much c++ coding work is required to get something working for arma, and how to hook this into the game..maybe just using the non encrypted freetrack way..
    and damnit..i dont even have a webcam to test this.. recomended is a cam with 640x480 minimum and 30hz/fps

    <a href="http://www.faceapi.com/" target="_blank">http://www.faceapi.com/</a><!--QuoteEnd--></div><!--QuoteEEnd-->

    If I can get the source for this, and the source for the freetrack API, good things could happen.

    Phased to OT.

    --Scythe--
    Off Topic Disagree Agree Awesome
  • ScytheScythe Join Date: 2002-01-25 Member: 46NS1 Playtester, Forum Moderators, Constellation, Reinforced - Silver
    I did a bit of digging, I can't find any real info on the freetrack 6DOF API, other than a few pascal files in a SVN repo. :(

    --Scythe--
    Off Topic Disagree Agree Awesome
  • SgtBarlowSgtBarlow Level Designer Join Date: 2003-11-13 Member: 22749Members, NS2 Developer
    Thats fantastic, Id love that, I naturally do those movements anyway (Cosuin laugths at me cause I look round a corner literally lol)
    Off Topic Disagree Agree Awesome
  • sheena_yanaisheena_yanai Join Date: 2002-12-23 Member: 11426Members
    edited April 2010
    <!--quoteo(post=1768643:date=Apr 25 2010, 06:44 PM:name=Scythe)--><div class='quotetop'>QUOTE (Scythe @ Apr 25 2010, 06:44 PM) <a href="index.php?act=findpost&pid=1768643"><{POST_SNAPBACK}></a></div><div class='quotemain'><!--quotec-->I did a bit of digging, I can't find any real info on the freetrack 6DOF API, other than a few pascal files in a SVN repo. :(

    --Scythe--<!--QuoteEnd--></div><!--QuoteEEnd-->


    er..its not made by freetrack..

    its made by seeing machines, ive downloaded a 100 something megabytes big installation from there containing visual c++ project files and wrapper stuff.. coder stuff i cant do anything with :p there are also some compiled demos
    Off Topic Disagree Agree Awesome
  • ScytheScythe Join Date: 2002-01-25 Member: 46NS1 Playtester, Forum Moderators, Constellation, Reinforced - Silver
    <!--quoteo(post=1768648:date=Apr 25 2010, 07:55 PM:name=sheena_yanai)--><div class='quotetop'>QUOTE (sheena_yanai @ Apr 25 2010, 07:55 PM) <a href="index.php?act=findpost&pid=1768648"><{POST_SNAPBACK}></a></div><div class='quotemain'><!--quotec-->er..its not made by freetrack..

    its made by seeing machines, ive downloaded a 100 something megabytes big installation from there containing visual c++ project files and wrapper stuff.. coder stuff i cant do anything with :p there are also some compiled demos<!--QuoteEnd--></div><!--QuoteEEnd-->

    Yes, I have the faceapi, but I also need the freetrack jigger to pass the info into the game.

    --Scythe--
    Off Topic Disagree Agree Awesome
  • CrystalSnakeCrystalSnake Join Date: 2002-01-27 Member: 110Members
    I wonder if this program could be made to recognize lip movements.
    Might help to improve speech recognition software.
    Off Topic Disagree Agree Awesome
  • sheena_yanaisheena_yanai Join Date: 2002-12-23 Member: 11426Members
    edited April 2010
    <!--quoteo(post=1768665:date=Apr 25 2010, 11:04 PM:name=CrystalSnake)--><div class='quotetop'>QUOTE (CrystalSnake @ Apr 25 2010, 11:04 PM) <a href="index.php?act=findpost&pid=1768665"><{POST_SNAPBACK}></a></div><div class='quotemain'><!--quotec-->I wonder if this program could be made to recognize lip movements.
    Might help to improve speech recognition software.<!--QuoteEnd--></div><!--QuoteEEnd-->

    it can track lip movements, but nothing like lip reading, it can even take a screenshot of your face, automaticly crops it and wraps it onto a rough 3 dimensional mask, and animates it with your facial expressions... combined with voice chat this would be friggen brilliant for games.. just imagine making your player model look very angry XD
    Off Topic Disagree Agree Awesome
  • sheena_yanaisheena_yanai Join Date: 2002-12-23 Member: 11426Members
    edited April 2010
    <!--quoteo(post=1768653:date=Apr 25 2010, 08:31 PM:name=Scythe)--><div class='quotetop'>QUOTE (Scythe @ Apr 25 2010, 08:31 PM) <a href="index.php?act=findpost&pid=1768653"><{POST_SNAPBACK}></a></div><div class='quotemain'><!--quotec-->Yes, I have the faceapi, but I also need the freetrack jigger to pass the info into the game.

    --Scythe--<!--QuoteEnd--></div><!--QuoteEEnd-->


    odd.. does the source engine have this? ive tested it today with that source sdk demo torben has put together for downloading and it worked quite well, that camera paning effect looks awesome.. that ps3 camera ive got to play with was a bit crappy though.. even with ideal light conditions the image was very noisy, and the faceapi got a little bit confused
    Off Topic Disagree Agree Awesome
  • ScytheScythe Join Date: 2002-01-25 Member: 46NS1 Playtester, Forum Moderators, Constellation, Reinforced - Silver
    <!--quoteo(post=1768691:date=Apr 26 2010, 04:45 AM:name=sheena_yanai)--><div class='quotetop'>QUOTE (sheena_yanai @ Apr 26 2010, 04:45 AM) <a href="index.php?act=findpost&pid=1768691"><{POST_SNAPBACK}></a></div><div class='quotemain'><!--quotec-->odd.. does the source engine have this? ive tested it today with that source sdk demo torben has put together for downloading and it worked quite well, that camera paning effect looks awesome.. that ps3 camera ive got to play with was a bit crappy though.. even with ideal light conditions the image was very noisy, and the faceapi got a little bit confused<!--QuoteEnd--></div><!--QuoteEEnd-->

    No, the source engine doesn't do freetrack or trackir, so I'd say he's written some custom input stuff.

    --Scythe--
    Off Topic Disagree Agree Awesome
Sign In or Register to comment.