Project Natal

From Xbox Wiki

Project Natal (pronounced "nuh-tall") is the code name for a "controller-free gaming and entertainment experience" by Microsoft for the Xbox 360 video game platform. Based on an add-on peripheral for the Xbox 360 console, Project Natal enables users to control and interact with the Xbox 360 without the need to touch a game controller, through gestures, spoken commands,^[1] or presented objects and images. The project is aimed at broadening the Xbox 360's audience beyond its typically hardcore base.^[2] Project Natal was first announced on June 1 at the 2009 Electronic Entertainment Expo. Microsoft said that over 1000 development kits began shipping to game developers that same day.^[2] Microsoft has not revealed any price or release date projections for Project Natal,^[3][2] though several observers expect the control system to be released in late 2010.^[4][5][6]

Contents 1 Sensor device 2 Technology demos 3 Code name 4 Videos 4.1 E3 2009 Videos 4.2 TGS 2009 Videos 5 See also 6 Notes 7 References 8 External links

Sensor device

An approximately nine-inch (23 cm) wide horizontal bar^[7] connected to a small circular base with a ball joint pivot, the Project Natal sensor is designed to be positioned lengthwise above or below the video display. The device features an "RGB camera, depth sensor, multi-array microphone, and custom processor running proprietary software", which provides full-body 3D motion capture, facial recognition, and voice recognition capabilities. The Project Natal sensor's microphone array enables the Xbox 360 to conduct acoustic source localization and ambient noise suppression, allowing for things such as headset-free party chat over Xbox Live.^[1]

The depth sensor consists of an infrared projector combined with a monochrome CMOS sensor, and allows the Project Natal sensor to see in 3D under any ambient light conditions.^[8][1] The active depth-sensing range of the depth sensor is adjustable, with the Project Natal software capable of automatically calibrating the sensor based on the gameplay and environment conditions, such as the presence of couches.^[9]

Project Natal is reportedly based on software technology developed internally by Microsoft and hardware intellectual property acquired from time-of-flight camera developer 3DV Systems.^{[4][10][11][12][13]} Before agreeing to sell all its assets in March 2009,^[14] 3DV had been preparing its own depth-sensing webcam controller, known as the ZCam.^[15]a[›]

Described by Microsoft personnel as the primary innovation of Project Natal,^[12][13][16] the software technology enables advanced gesture recognition, facial recognition, and voice recognition.^[11] The skeletal mapping technology shown at E3 2009 was capable of simultaneously tracking multiple users for motion analysis,^[11][13][8] with a real-time feature extraction of 48 interest points on a human body.^[9] Depending on the person's distance from the sensor, Project Natal is capable of tracking models that can identify individual fingers.^[8][11]

Technology demos

Three technical demos were shown to showcase Project Natal when it was revealed at Microsoft's E3 2009 Media Briefing:^[17]

• Ricochet - a Breakout-like game in which the entire body is used to bounce balls at blocks.
• Paint Party - where the player can make throwing motions to splash paint onto a wall. He/she can choose colours using speech recognition, and can pose to make stencils.
• Milo and Kate - a game in development by Lionhead Studios,^[18] in which the player interacts with a young child (Milo or Milly, selected by the user at the start) and his/her dog Kate, using items and passing him virtual items from real life actions. In an interview after the demonstration, Lionhead founder Peter Molyneux confirmed that the demo was in fact the long running Project Dimitri. In the demonstration available at E3 2009, only Milo was available to interact with.^[19]
• Burnout Natal - not showcased as a live demonstration, a demo based on Burnout Paradise in which the player uses an invisible steering wheel to control the vehicle.

Code name

The name "Project Natal" follows in Microsoft's tradition of using cities as code names.^[1] Microsoft director Alex Kipman, who incubated the project, chose to name it after the Brazilian city Natal as a tribute to his country of origin, and because the word natal relates to birth, which Kipman felt reflected the new audiences the project would deliver for the Xbox 360.^[20]

Videos

E3 2009 Videos

TGS 2009 Videos

See also

• Xbox Live Vision

Notes

• ^ a: Though most pre-announcement speculation surrounding the device focused on the depth sensor, information on the general architecture of Project Natal was leaked a few weeks before E3 2009 with the publishing of a patent application by the United States Patent and Trademark Office.^[21][22]
  

References

External links

• Project Natal
• Project Natal at YouTube