projectnatal
Latest
Life after Kinect: PrimeSense's plans for a post-Microsoft future
When PrimeSense founder Aviad Maizels put a prototype of a 3D sensor on a chip in front of Microsoft in 2006, he had no idea it would lead to the biggest turning point in the Israeli startup's history. Four years later, its partnership with the Redmond giant resulted in Kinect, the motion-sensing camera that made headlines around the world. In 2013, however, Microsoft unveiled an all-new Kinect, the result of years of entirely in-house development -- without PrimeSense's assistance. As fate would have it, the company returned to its chip-making origins a year ago, creating a new product called Capri, a cheaper, lower-power and tinier version of its 3D system-on-a-chip; so tiny, in fact, that it's designed to be embedded inside tablets, laptops, thin displays and smartphones. With 3D use cases that go far beyond Dance Central, the Capri is the latest sign that PrimeSense is ready to break free from its video game roots.
Valve employee spills the hardware beans: wearable computers, ahoy
When Michael Abrash started working for Valve, he expected the higher-ups to hand him a pile of work and tell him to hop to it. They didn't. Instead, he was told to figure out the most valuable thing he could do for the company, and then do it. So, Abrash wound up kicking off an in-house R&D project for wearable computers, and according to a recent blog post, is looking to expand his research team. More than me-too mice and gamepads, indeed. Abrash is quick to put a lid on rumors of "Steam glasses," however, and warns readers not to expect any big reveals at E3 -- this is just an "initial investigation into a very interesting and promising space," he says, and is more "research than development." Rearing to give Google's Project Glass a run for its money? Or maybe you're just itching for a detailed narrative of employee and employer? Either way, you'll find what you're looking at the source link below.
Microsoft Xbox turns X years old today, celebrates decade of console prowess
One decade ago today, on November 15, 2001, the Xbox gaming console was born, hitting stores across North America on the same day. That Pentium III-based black box found its way into tens of millions of living rooms around the world, and wasn't discontinued until after its successor was announced in 2005. Now, halfway through its lifecycle, the Xbox 360 is still selling strong -- perhaps spurred by the company's release of Kinect in 2010 -- with about four years left to go before Microsoft is expected to unleash its nex-gen console. An updated system may be inevitable, but regardless of what's inside, we wouldn't be surprised to see Microsoft's blockbuster game machine don its familiar Xbox handle for decennia to come.%Gallery-139419%
KinectNUI enables Minority Report style interaction in Windows sans gloves (video)
When Microsoft released its Kinect SDK we marveled at the impact it could have on desktop interaction; sure enough, Kevin Connolly's Kinect Natural User Interface has made our geeky pipe-dreams a reality. His inspiration for project? Not surprisingly, the Minority Report UI (aka g-speak). Similar projects like MIT's hack do exist, but it's brilliant knowing that another emulation has been made rather quickly with Redmond's tools. In a brief video using the Kinect on Windows 7, he demos various ways of manipulating on-screen content with hand gestures and body tracking -- neglecting his mouse in the process. It's still a work in progress, but the results are already quite striking, so take that ancient input device and click past the break for the full demo.
Kinect enabled head-tracking previewed in Forza 4 spotlight video, turns heads (video)
Ever since Johnny Chung Lee was snatched up by Microsoft's Project Natal team to work on Kinect, we've been curious to see how his Wii head-tracking skills would come to fruition on the device. This week, an Inside Xbox episode shows us how it will work with Forza 4, and the Kinect enabled head-tracking appears to run fairly smoothly compared to others we've seen (just try getting similar results on Gran Turismo 5 with a PlayStation Eye). There's no word about other titles planning to make use of this new feature, but we'll surely find out more while we're at E3 next week, and possibly get some hands heads-on time while we're at it.
Microsoft to release Kinect for Windows SDK this spring
Looks like we're not the only ones enjoying all those Kinect hacks being dreamed up and implemented by hardworking enthusiasts the world o'er. That's right: it was rumored early this year, and now it's been confirmed -- Microsoft will be releasing the Kinect for Windows SDK. According to Microsoft, "It will be available this spring as a free download, and will give academic researchers and enthusiasts access to key pieces of the Kinect system-such as the audio technology, system application programming interfaces and direct control of the Kinect sensor itself." Commercial licensing details will be made available at some point thereafter. [Thanks to everyone who sent this in]
Kinect support for Windows in the works, SDK release this summer?
WinRumors, citing anonymous sources, reports that the official software developers kit (SDK) for Kinect is currently in the works and will be released in beta some time in the next few months. Apparently, support for the device will become a part of Microsoft's XNA Game Studio and also be integrated into Windows 8 in a big way. These details come hot on the heels of CEO Steve Ballmer's statement at CES that the good folks in Redmond would eventually support the device's use on computers, but he set no timetable for the SDKs release. We can't confirm the story, but given the level of detail in the report and the author's confidence in the info, we won't be surprised if Microsoft gives all you Kinect hackers something to cheer about very soon.
Kinect hack turns you into a punching, waving MIDI controller (video)
If you're looking for an awesome, impractical way to make music with your computer (and who isn't?) please direct your attention to the following Kinect hack. Shinect, the brainchild of a YouTube user named Shinyless, uses motion detection to turn you into a MIDI controller! The current implementation gives the operator two virtual pads that can be activated by the old Jersey Shore fist pump -- and if that ain't enough, the sounds can be pitchshifted by raising / lowering the other arm. Pretty sweet, huh? This thing uses OpenNI, and while he's demonstrating it using FruityLoops it should work with any MIDI device. Things are pretty rough'n ready at the moment, although he promises big things in the future. In the meantime, check out the proof-of-concept in the video after the break.
DIY telepresence robot uses PrimeSense Kinect drivers for extremely awkward push-ups (video)
From enhancing your WoW game to putting you in Tom Hanks's shoes, DIYers the world o'er really do seem to love Kinect. And what do we have here? Taylor Veltrop's Veltrobot remote telepresence 'bot uses the PrimeSense open source Kinect drivers for tracking the user's skeleton, with a modified Kondo KHR-1HV mirroring the operator's movements (which are received via 802.11n WiFi). Right now he is only controlling the arms, but with any luck we should be seeing complete control over all the robot's movements soon enough. Once the thing is finalized, Veltrop plans on releasing an open source development kit. And then? That's right: robot avatars for everyone!
PrimeSense's OpenNI provides the best Kinect drivers yet, from someone who would know
We've been so wrapped up in Kinect hacks lately that we actually missed a Kinect non-hack that emerged last week. PrimeSense, who built the initial Project Natal reference hardware for Microsoft, has released its own open source drivers for the Kinect. PrimeSense is working with Willow Garage (best known for its open source ROS robot operating system), and Side-Kick (a motion gaming startup) through a new OpenNI organization it set up, and the trio will be combining their powers for good. The OpenNI framework will cover low-level hardware support (drivers for actual cameras and other sensors), and high-level visual tracking (turning your body into a 3D avatar that kicks ass in a virtual world). This should be a boon to an already vibrant Kinect hacking community, and if the video above is any indication, we aren't far from Kinect-level interaction and gameplay on our lowly PCs. [Thanks to everyone who sent this in]
Shocker! Clumsy Kinect players make for entertaining viral videos
We knew there was more viral video goodness to be had with Kinect than lots and lots and lots of little green dots. And here you have it: people the world o'er punching each other, falling into things, and just generally making asses of themselves by paying more attention to the TV than whatever objects might exist in the physical world that surrounds them. And you wondered why commercials for the device all featured players in very, very large rooms! Check out a couple of our faves after the break, and be sure to sound off in the comments if you have any of your own.
Visualized: Kinect + night vision = lots and lots and lots of dots (video)
You know what you see when you flip on your Xbox 360, turn out the lights, and don a pair of night vision goggles? Dots. Lots and lots of little dots, courtesy of Kinect's infrared depth sensor. Judging by the videos that have been uploaded to YouTube, this is the kind of thing that will entertain the whole "hackey sack and Rasta hats" crowd for years to come, and to be honest, we're kind of digging it ourselves. Hell, we might even have to dig out that old Bob Marley black light poster. See for yourself after the break.
Microsoft Kinect ripped to pieces, found to contain chips on tiny green boards
If you ever doubted that Microsoft's Kinect was based on PrimeSense technology, you can leave those suspicions at the door -- iFixit's separated the twin-eye motion sensing camera into its constituent parts, and there's definitely PrimeSense silicon on board. To be precise, there's a PrimeSense processor that handles images from the color and infrared CMOS auto-focus imagers, a Marvell SoC to interface with those cameras,64MB of DDR2 memory and 1MB of flash plus an accelerometer of all things. (Perhaps game developers intend to break the fourth wall when you inevitably knock the unit off your TV.) Filled with four different kinds of security screws and a fair bit of glue, Kinect's a tough nut to crack. Seems like a small price to pay, however, when it's so wonderfully robotic underneath. Oh, and speaking of the Kinect -- don't suppose you've read our full review?
Microsoft buys Canesta, continues camera-based domination of our interfaces
It seems that Microsoft's taken the camera to heart following its dismissal of the pen -- the company bought 3DV, collaborated with PrimeSense on Kinect, and today it's apparently finalized a deal to acquire 3D CMOS camera chipmaker Canesta as well. In case you've already forgotten, the latter company is the one that made an paid actor look particularly smug last year, by allowing the gent to control his television with a flick of the wrist. Things have progressed a good bit further than that, however, as you'll see in a demo video after the break, and Canesta president and CEO Jim Spare says he expects the company's stuffs to "see wide adoption across many applications that embody the full potential of the technology" under Microsoft's reign. Press release after the break.
Wired chronicles the (brief) history of Kinect
Got your Instapaper bookmarklet prepped? This is a bit of a long one: Wired UK has put together an in-depth creation history for the soon-to-be-released Kinect. While a "one man against all odds" story might be a little quicker to read, the story of Kinect (or Project Natal, as it's been known for most of its lifetime) is actually a pretty remarkable collaboration. An original demand and vision for the Xbox 360 from Don Mattrick (in pretty obvious response to the Wii), project leadership from Alex Kipman, gameplay creativity from Kudo Tsunoda, camera technology from PrimeSense, computer vision algorithms from Andrew Blake and Jamie Shotton -- and that was just the incubation stage! The vision was cast in 2007, the project really started in 2008, and we'll have the finished product (along with the all-important games of course) in our living rooms in November. While the most immediate battle for Sony, Nintendo, and Microsoft is who can sell the most games and the most motion control hardware, it's clear that Kinect is a major technical achievement with some pretty broad reaching implications for human / machine interaction going forward. Still, we wonder: can it run provide an effective user interface for Doom? Oh, and if you need a little more Kinect in your life, check out our Engadget Show with Kudo Tsunoda where he dives into a bit of the tech and gameplay.
Xbox Live Fall 2010 Dashboard Update preview: ESPN, Netflix search, Kinect, and more! (Update)
Shortly before Kinect hits store shelves on November 4th, Microsoft plans on rolling out the Fall Update to Xbox Live -- even sooner for those who signed up for the preview program. That shouldn't come as much of a surprise, really: even without the numerous leaks, the fall update is a longstanding tradition for the almost five-year-old console, and the company devoted a large chunk of its E3 2010 presentation to talk about the biggest additions. That includes Netflix search (finally!), Zune music, and an entertainment hub for a certain worldwide sports broadcaster... ESPN. We've had a chance to spend some time at home with the Fall Update, follow us after the break for our full impressions! Update: As both Joystiq and a number of tipsters have alerted us, Microsoft has pulled the large, wooden lever in its dark underground lair that allows for the Fall Update to trickle out and assimilate itself into the consoles of those smart enough to sign up for the preview program. If you receive a prompt upon signing in, rejoice! If not, well, have patience! P.S. - Looking for more? Our BFFs at Joystiq have compiled a series of exhaustive videos chronicling the Fall Update. Check it out! %Gallery-103613%
Peter Molyneux brings Milo, Kinect, and snails to the TED stage
Poor Milo. Our virtual friend has been in our heart for about as long as Kinect (née Project Natal) has been in the public eye, always doodling, always playing with snail, rarely able to escape the confines of dark developer studio. When we talked to Milo's "father" Peter Molyneux at the last Engadget Show, he kept referencing this TED Talk demo he recently gave, and sure enough, video of that speech is now available online. The 11-minute presentation delves into a number of the setups / "magician's tricks" used to make Milo an interactive and at times empathetic character, and how natural voice recognition was implemented (thanks in part to Microsoft's TellMe database) so that the player isn't limited to simple yes and no responses. Curious about the moral ramifications of an artificial adolescent aggressive to mollusk? Definitely worth a look, as is our last Engadget Show episode if you missed it; video after the break.
Microsoft pulls apart a Kinect camera, tickles your non-gaming fetish
Tease as much as you want, Sony, but things get real serious when you flip to the other side and look at the magic behind Microsoft's Kinect camera. Recently, T3 was able to get behind the scenes for a quick lesson on how this Xbox 360 peripheral works, and as part of the tour, it also saw the innocent sensor sitting bare naked in the lab. As pictured above, this little device actually has a lot to pack in -- namely a RGB camera for facial recognition plus video capturing, a depth sensor (an infrared projector paired with a monochrome CMOS camera) for movement tracking, four downward-facing mics for voice recognition, a quiet motor in the bulky base for rotation, and all the circuitry components to link them up. Head over to the source link for a detailed briefing -- but we all know you're just gonna go straight to the gallery of Redmond's naughty pics.
250GB Xbox 360 Kinect bundle tipped on 4GB packaging
Well, well -- what have we here? We already knew that Microsoft was planning to ship a 4GB Xbox 360 bundle that included Kinect, and now it seems as if the Big M will also package its forthcoming motion sensor with the 250GB 'box. Based on the packaging of a 4GB bundle over in Australia, it definitely looks as if consumers will have a more capacious option if buying an Xbox 360 for the first time with Kinect, but we're all waiting with bated breath to hear the official confirmation (or denial, but mostly just confirmation) from Ballmer's crew. Anytime now, folks....
Microsoft's Kinect patent application goes public, reveals gobs of fine print
Not like it matters much now -- after all, Project Natal has had time to incubate and come out as Kinect -- but those wondering about the inner workings of the motion sensing system now have more one outlet to investigate. A patent application filed on February 23, 2009 was just made public today, describing a "gesture keyboarding" scenario where users can make gestures that are caught by a "depth camera" and then converted into in-game controls. Of course, those paying close attention could've read between the lines when we toyed with a camouflaged PrimeSense demo at GDC, but here's the fully skinny in black and white. And a bit of blue, if you count the buttons. Give that source link a tap once you're settled in. %Gallery-98933%