Project Sidekick

Sidekick is a project developed by NASA and Microsoft to provide virtual aid for astronauts using the Microsoft HoloLens augmented-reality headset.[1] As of December 2015, Sidekick is deployed at the International Space Station.[2]

Functionality

Sidekick has two modes of operation. Remote Expert Mode uses the functionality of the Holographic Skype application—voice and video chat, real-time virtual annotation—to allow a ground operator and space crew member to collaborate directly over what the astronaut sees, with the ground operator able to see the crew member's view in 3D, provide interactive guidance, and draw annotations into the crew member's environment. In Procedure Mode, animated virtual illustrations display on top of objects as a crew member interacts with them. This mode can be used for guidance and instructional purposes in standalone scenarios.[1] Applications include inventory management, in which the system recognizes an inventory item, and can display a path to where the item should be stored.[3] Previously, crew members would rely primarily on printed instructions and voice-based communication when performing complex tasks. The capabilities provided by Sidekick have been promoted as potential enabling features allowing for reduced crew training requirements and increased efficiency in deep space missions in which communication delays can complicate difficult operations.[1]

History

After having performed simulated reduced-gravity testing in its Weightless Wonder C9 aircraft,[1] NASA attempted to launch a pair of HoloLens units aboard the SpaceX CRS-7 launch to the International Space Station on June 28, 2015,[4] but the Falcon 9 rocket carrying the payload exploded at 2 minutes and 19 seconds into the flight.[5] Sidekick was tested at the Aquarius laboratory from late July to early August 2015 as part of the two-week long NASA Extreme Environment Missions Operations 20 expedition, demonstrating its operation in tasks such as equipment checks and setup.[3][1] HoloLens hardware was successfully delivered to the ISS in the Cygnus CRS OA-4 commercial resupply mission on December 9, 2015.[2]

References
  1. Ramsey, Sarah, ed. (25 June 2015). "NASA, Microsoft Collaborate to Bring Science Fiction to Science Fact". Jet Propulsion Laboratory. Retrieved 28 June 2015.
  2. Franzen, Carl (9 December 2015). "Here's How Astronauts Will Use Microsoft's HoloLens Aboard The Space Station". Popular Science. Retrieved 14 December 2015.
  3. Metz, Rachel (8 September 2015). "Why NASA Wants Microsoft's HoloLens in Space". MIT Technology Review. Retrieved 12 September 2015.
  4. Buhr, Sarah (28 June 2015). "SpaceX's Failed CRS-7 Mission Had Something To Do With An "Overpressure Event"". TechCrunch. Retrieved 17 February 2016.
  5. Chang, Kenneth (June 28, 2015). "SpaceX Rocket Explodes After Launching". New York Times. Retrieved 28 June 2015.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.