Microsoft HoloLens

Microsoft HoloLens

The HoloLens Development Edition
Also known as Project Baraboo (in-development)
Developer Microsoft
Manufacturer Microsoft
Product family Windows 10
Type Mixed reality head-mounted display smartglasses
Release date
  • March 30, 2016 (2016-03-30) (Development Edition) *TBA (Consumer version)
Introductory price $3000[1]
Operating system Windows Holographic
CPU Intel 32-bit (1GHz)
Memory
Storage 64GB (flash memory)
Display 2.3 megapixel widescreen stereoscopic head-mounted display
Sound Spatial sound technology
Input
Controller input Gestural commands via sensors and HPU
Camera 2.4 MP
Touchpad None.
Connectivity
Platform Windows 10
Weight 579 g
Website Official website

Microsoft HoloLens, known under development as Project Baraboo, is a pair of mixed reality smartglasses developed and manufactured by Microsoft. HoloLens gained popularity for being one of the first computers running the Windows Holographic platform under the Windows 10 operating system. The HoloLens can trace its lineage to Kinect, an add-on for Microsoft's Xbox gaming console that was introduced in 2010.[2]

The pre-production version of HoloLens, the Development Edition, shipped on the 30th of March 2016, and is targeted to developers in the United States and Canada for a list price of $3,000.[3][4] Samsung and Asus have extended an offer to Microsoft to help produce their own mixed-reality products, in collaboration with Microsoft, based around the concept and hardware on HoloLens.[5][6] On October 12, 2016, Microsoft announced global expansion of HoloLens and publicized that HoloLens would be available for preorder in Australia, Ireland, France, Germany, New Zealand and the United Kingdom.[7]

Design

The HoloLens is a head-mounted display unit connected to an adjustable, cushioned inner headband, which can tilt HoloLens up and down, as well as forward and backward.[8] To wear the unit, the user fits the HoloLens on their head, using an adjustment wheel at the back of the headband to secure it around the crown, supporting and distributing the weight of the unit equally for comfort,[9] before tilting the visor towards the front of the eyes.[8]

In the front is much of the sensors and related hardware, including the cameras and processors. The visor is tinted;[9] enclosed in the visor piece is a pair of transparent combiner lenses, in which the projected images are displayed in the lower half.[10] The HoloLens must be calibrated to the interpupillary distance (IPD), or accustomed vision of the user.[11][12]

Along the bottom edges of the side, located near the user's ears, are a pair of small, red 3D audio speakers. The speakers, competing against typical sound systems, do not obstruct external sounds, allowing the user to hear virtual sounds, along with the environment.[9] Using head-related transfer functions, the HoloLens generates binaural audio, which can simulate spatial effects; meaning the user, virtually, can perceive and locate a sound, as though it is coming from a virtual pinpoint or location.[13][14][note 1]

On the top edge are two pairs of buttons: display brightness buttons above the left ear, and volume buttons above the right ear.[15] Adjacent buttons are shaped differently—one concave, one convex—so that the user can distinguish them by touch.[8]

At the end of the left arm is a power button and row of five, small individual LED nodes, used to indicate system status, as well as for power management, indicating battery level and setting power/standby mode.[8] A USB 2.0 micro-B receptacle is located along the bottom edge.[9] A 3.5 mm audio jack is located along the bottom edge of the right arm.[4][9]

Hardware

The HoloLens features an inertial measurement unit (IMU) (which includes an accelerometer, gyroscope, and a magnetometer)[16] four "environment understanding" sensors (two on each side), an energy-efficient depth camera with a 120°×120° angle of view,[17] a 2.4-megapixel photographic video camera, a four-microphone array, and an ambient light sensor.[4][18]

In addition to an Intel Cherry Trail SoC containing the CPU and GPU,[19] HoloLens features a custom-made Microsoft Holographic Processing Unit (HPU),[4] a coprocessor manufactured specifically for the HoloLens by Microsoft. The SoC and the HPU each have 1GB LPDDR3 and share 8MB SRAM, with the SoC also controlling 64GB eMMC and running the Windows 10 operating system. The HPU uses 28 custom DSPs from Tensilica[20][21] to processes and integrating data from the sensors, as well as handling tasks such as spatial mapping, gesture recognition, and voice and speech recognition.[10][16][note 2] According to Alex Kipman, the HPU processes "terabytes of information" from the HoloLens's sensors from real-time data.[22] (See also Vision Processing Unit).

The lenses of the HoloLens use optical waveguides to color blue, green, and red across three different layers[note 3]—each with diffractive features.[note 4] A "light engine" above each combiner lens projects light into the lens, a wavelength which then hits a diffractive element and is reflected repeatedly along a layer until it is output to the eye.[note 5][23] Similar to that of many other optical head-mounted displays,[24] the display projection for the HoloLens occupies a limited portion of the user's field of view (FOV), particularly in comparison to virtual reality head-mounted displays, which typically cover a much greater field of view.[25][26][27][28][15][29][30] Based on preliminary hardware, most observers have characterized the field of view of the HoloLens as small, though subjective estimates vary significantly.[24][27][31][32] From the Build 2015 developer conference in May, one attendee estimated that the display field of view of the demonstration units was 30°×17.5°.[28] In an interview at the 2015 Electronic Entertainment Expo in June, Microsoft Vice-President of Next-Gen Experiences, Kudo Tsunoda, indicated that the field of view is unlikely to be significantly different on release of the current version.[33]

The HoloLens contains an internal rechargeable battery, with average life rated at 2–3 hours of active use, or 2 weeks of standby time. The HoloLens can be operated while charging.[4]

HoloLens features IEEE 802.11ac Wi-Fi and Bluetooth 4.1 Low Energy (LE) wireless connectivity. The headset uses Bluetooth LE to pair with the included Clicker, a thumb-sized finger-operating input device that can be used for interface scrolling and selecting.[note 6] The Clicker features a clickable surface for selecting, and an orientation sensor which provides for scrolling functions via tilting and panning of the unit. The Clicker features an elastic finger loop for holding the device, and a USB 2.0 micro-B receptacle for charging its internal battery.[34]

Applications

As of 2016, a number of augmented-reality applications have been announced or showcased for Microsoft HoloLens. A collection of applications will be provided for free for developers purchasing the Microsoft HoloLens Developer Edition. Applications available at launch include:

Artist's imagining of Minecraft on HoloLens

Other applications announced or showcased for HoloLens include:

Developed in collaboration with JPL, OnSight integrates data from the Curiosity rover into a 3D simulation of the Martian environment,[55] which scientists around the world can visualize, interact with, and collaborate in together using HoloLens devices. OnSight can be used in mission planning, with users able to program rover activities by looking at a target within the simulation, and using gestures to pull up and select menu commands.[56] JPL plans to deploy OnSight in Curiosity mission operations, using it to control rover activities by July 2015.[22]

Interface

HoloLens, through the use of the HPU, uses sensual and natural interface commands—gaze, gesture, and voice—sometimes referred to as "GGV", inputs.[58] Gaze commands, such as head-tracking, allows the user to bring application focus to whatever the user is perceiving.[59] "Elements"—or any virtual application or button—are selected using an air tap method, similar to clicking an imaginary computer mouse. The tap can be held for a drag simulation to move an element, as well as voice commands for certain commands and actions.

The HoloLens shell carries over and adapts many elements from the Windows desktop environment. A "bloom" gesture for accessing the shell (performing a similar function to pressing a Windows key on a Windows keyboard or tablet, or the Xbox button on an Xbox One Controller) is performed by opening one's hand, fingers spread with the palm facing up.[23][60] Windows can be dragged to a particular position, as well as resized. Virtual elements such as windows or menus can be "pinned" to locations, physical structures or objects within the environment; or can be "carried," or fixed in relation to the user, following the user as they move around.[61] Title bars for application windows have a title on the left, and buttons for window management functions on the right.

In April of 2016 Microsoft Created the Microsoft HoloLens App for Windows 10 PC's and Windows 10 Mobile devices, that allows developers to run apps, use his or her phone or PC's keyboard to type text, View a live stream from the HoloLens user's point of view, and remotely capture mixed reality photos and videos.

Develop Applications for HoloLens

Unity and Microsoft Visual Studio are 2 important platforms to develop applications for it.

Notes

  1. ↑ See also: 3D audio effect, virtual surround, psychoacoustics
  2. ↑ See also: sensor hub
  3. ↑ See also: RGB color model
  4. ↑ See also: diffraction grating, holographic grating, holographic optical element
  5. ↑ See also: total internal reflection
  6. ↑ See also: clicker, mouse button
  7. ↑ See also: Instagram, Vine (service)

References

  1. ↑ Pandher, Gurmeet Singh (2 March 2016). "Microsoft HoloLens Preorders: Price, Specs Of The Augmented Reality Headset.". The Bitbag.
  2. ↑ Mcbride, Sarah (23 May 2016). "With HoloLens, Microsoft aims to avoid Google's mistakes". Reuters. Retrieved 23 May 2016.
  3. ↑ Shaban, Hamza (2014-09-02). "Microsoft announces Windows Holographic with HoloLens headset". The Verge. Retrieved 2015-01-21.
  4. 1 2 3 4 5 "Introducing the Microsoft HoloLens Development Edition". Microsoft. Retrieved 7 October 2015. We will work to get devices out as quickly as possible. As soon as additional devices are available, more accepted applicants will be invited to purchase.
  5. ↑ Kim Yoo-chul (13 May 2015). "Samsung seeks partnership with Microsoft for hololens". The Korea Times. Retrieved 7 December 2015.
  6. ↑ Tibken, Shara (19 October 2015). "Asus mulls HoloLens augmented-reality glasses of its own". Wearable Tech. CNET. Retrieved 7 December 2015.
  7. ↑ "Microsoft announces global expansion for HoloLens". Microsoft News Centre Australia. 2016-10-12. Retrieved 2016-10-16.
  8. 1 2 3 4 Davies, Chris (1 May 2015). "HoloLens hands-on: Building for Windows Holographic". SlashGear. Retrieved 1 May 2015. That means very little pressure on your nose, and even if you’re wearing glasses you can generally find a workable way to keep them on underneath.
  9. 1 2 3 4 5 "Microsoft Hololens hardware". Microsoft. Retrieved 1 May 2015.
  10. 1 2 Alex Kipman, Seth Juarez (30 April 2015). Developing for HoloLens. Microsoft. Event occurs at 00:07:15. Retrieved 1 May 2015. HoloLens is the first—and so far—only holographic computer out there. [...] I hope that in the not-so-distant future there will be many such devices. [...] This is running Windows 10. All of the APIs for human and environment understanding are part of Windows, and this version of Windows that we put on this device—we call it Windows Holographic.
  11. ↑ Hachman, Mark (1 May 2015). "Developing with HoloLens: Decent hardware chases Microsoft's lofty augmented reality ideal". PC World. Retrieved 1 May 2015.
  12. ↑ Hollister, Sean (21 January 2015). "Microsoft HoloLens Hands-On: Incredible, Amazing, Prototype-y as Hell". Retrieved 1 May 2015. One Microsoft employee [...] typed my IPD (interpupillary distance) into a connected PC. Microsoft says the final version will automatically measure the distnace [sic] between your eyes, but the prototypes don’t have that feature yet.
  13. ↑ Microsoft HoloLens: The Science Within - Spatial Sound with Holograms. Microsoft. 29 February 2016. Retrieved 7 March 2016.
  14. ↑ Holmdahl, Todd (30 April 2015). "BUILD 2015: A closer look at the Microsoft HoloLens hardware". Microsoft Devices Blog. Retrieved 29 February 2016. This custom silicon efficiently processes data from the sensors, resulting in a relatively simple yet informative output that can be easily used by developers so they can focus on creating amazing experiences without having to work through complex physics calculations.
  15. 1 2 Bright, Peter (1 May 2015). "HoloLens: Still magical, but with the ugly taint of reality". Ars Technica. Retrieved 2 May 2015.
  16. 1 2 Holmdahl, Todd (30 April 2015). "BUILD 2015: A closer look at the Microsoft HoloLens hardware". Microsoft Devices Blog. Retrieved 29 February 2016. This custom silicon efficiently processes data from the sensors, resulting in a relatively simple yet informative output that can be easily used by developers so they can focus on creating amazing experiences without having to work through complex physics calculations.
  17. ↑ Hempel, Jessi (21 January 2015). "Project HoloLens: Our Exclusive Hands-On With Microsoft's Holographic Goggles". Wired. Retrieved 22 January 2015.
  18. ↑ Microsoft HoloLens - Here are the full processor, storage and RAM specs, Windows Central, May 2, 2016
  19. ↑ Colaner, Seth (23 August 2016). "What's Inside Microsoft's HoloLens And How It Works". Tom's Hardware. Retrieved 23 August 2016.
  20. ↑ Linder, Brad (23 August 2016). "Microsoft reveals info about the custom chip powering HoloLens". Liliputing. Retrieved 23 August 2016.
  21. ↑ Bright, Peter (23 August 2016). "Microsoft sheds some light on its mysterious holographic processing unit". Ars Technica. Retrieved 24 August 2016.
  22. 1 2 Terry Myerson, Alex Kipman, Jeff Norris, Satya Nadella (21 January 2015). Windows 10: The Next Chapter. Microsoft. Event occurs at 01:36:53. Retrieved 22 January 2015."Satya Nadella, Terry Myerson, Joe Belfiore and Phil Spencer: Windows 10 Briefing". News Center. Microsoft. 21 January 2015. Retrieved 6 March 2015.
  23. 1 2 Hempel, Jessi (21 January 2015). "Restart: Microsoft in the age of Satya Nadella". Wired. Retrieved 22 January 2015. Each lens has three layers of glass—in blue, green, and red—full of microthin corrugated grooves that diffract light. [...] A "light engine" above the lenses projects light into the glasses, where it hits the grating and then volleys between the layers of glass millions of times.
  24. 1 2 Kreylos, Oliver (18 August 2015). "HoloLens and Field of View in Augmented Reality". Doc-Ok.org. Retrieved 23 August 2015. Initially, there was little agreement among those who experienced HoloLens regarding its field of view. That’s probably due to two reasons: one, it’s actually quite difficult to measure the FoV of a headmounted display; and two, nobody was allowed to bring any tools or devices into the demonstration rooms.
  25. 1 2 Microsoft HoloLens: Partner Spotlight with Case Western Reserve University. Microsoft. 8 July 2015. Retrieved 9 July 2015.
  26. ↑ Orland, Kyle (9 July 2015). "See for yourself what Microsoft HoloLens' limited field-of-view looks like". Ars Technica. Condé Nast. Retrieved 9 July 2015. Even this video only gives a partial impression of just how limited the effect is. That's because the aspect ratio of the video window itself cuts off a large part of the peripheral vision you have when using HoloLens in real life.
  27. 1 2 Dingman, Hayden (18 June 2015). "Microsoft's augmented reality Halo is breathtaking, but HoloLens still needs work". PCWorld. Retrieved 28 June 2015. I don’t know what the field of view is on HoloLens, but if the Oculus Rift/HTC Vive have a "looking at the world through ski goggles" feel on occasion, then HoloLens is like looking at a cell phone screen someone held up five feet in front of your face. Or like peering at the world through the slit of a welding mask.
  28. 1 2 Kreylos, Oliver (1 May 2015). "On the road for VR: Microsoft HoloLens at Build 2015, San Francisco". Doc-Ok.org. Retrieved 17 June 2015. As I was stripped of all devices and gadgets before being allowed into the demo room, I had to guesstimeasure it by covering the visible screen with my hands (fingers splayed) at arm’s length, ending up with 1 3/4 hands horizontally, and 1 hand vertically (in other words, a 16:9 screen aspect ratio) (see Figure 1). In non-Doc-Ok units, that comes out to about 30° by 17.5° (for comparison, the Oculus Rift DK2′s field of view is about 100° by 100°).
  29. ↑ Fenlon, Wes (21 January 2015). "Microsoft HoloLens hands on: the promise and disappointment of AR". PC Gamer. Retrieved 2 May 2015. The Microsoft HoloLens is not what I think of when I hear the word "hologram." What Microsoft calls holograms, most of us have been calling augmented reality for years—overlaying digital images over our view of the real world.
  30. ↑ Robertson, Adi (1 May 2015). "Microsoft's HoloLens is new, improved, and still has big problems". The Verge. Retrieved 2 May 2015.
  31. ↑ Statt, Nick (1 May 2015). "Our inside look at Microsoft's HoloLens leaves us wanting more". CNET. Retrieved 28 June 2015. The most noticeable differentiator with the HoloLens right now is that your field of view is limited, resembling a rectangle the size of a sheet of printer paper held a half a foot in front of your face.
  32. 1 2 Crecente, Brian (16 June 2015). "HoloLens' Project X-Ray delivers a first-person augmented reality shooter". Polygon. Retrieved 28 June 2015. The virtual screen was about the size of a deck of cards if you held it in front of your eyes with your arm half-extended.
  33. ↑ Jeff Gerstmann, Phil Spencer, Kudo Tsunoda (16 June 2015). Giant Bomb LIVE! at E3 2015: Day 01. Event occurs at 3:13:06. Retrieved 4 July 2015. the hardware we have now [...] the field of view isn't exactly final, but I wouldn't say it's going to be [...] hugely, noticeably different, either.
  34. ↑ "Working with accessories". Windows Dev Center. Retrieved 7 March 2016.
  35. ↑ Microsoft HoloLens: HoloStudio. Microsoft. 29 February 2016. Retrieved 7 March 2016.
  36. ↑ Microsoft HoloLens: Skype. Microsoft. 29 February 2016. Retrieved 7 March 2016.
  37. 1 2 "Microsoft HoloLens apps". Microsoft. Retrieved 7 March 2016.
  38. ↑ Microsoft HoloLens: Fragments. Microsoft. 29 February 2016. Retrieved 7 March 2016.
  39. ↑ Microsoft HoloLens: Young Conker. Microsoft. 29 February 2016. Retrieved 7 March 2016.
  40. ↑ Microsoft HoloLens: RoboRaid. Microsoft. 29 February 2016. Retrieved 7 March 2016.
  41. ↑ Gaudiosi, John (28 February 2016). "Microsoft HoloLens Launch Games, Apps Detailed". Fortune. Retrieved 7 March 2016.
  42. ↑ Terry Myerson (6 October 2015). Microsoft Windows 10 devices event. Microsoft. Event occurs at 0:10:18. Retrieved 7 October 2015.
  43. ↑ Tsunoda, Kudo (29 February 2016). "Introducing first ever experiences for the Microsoft HoloLens Development Edition". Microsoft Devices Blog. Microsoft. Retrieved 7 March 2016.
  44. ↑ "Microsoft HoloLens: Holographic Workstation TM". 8ninths. 30 March 2016. Retrieved 30 March 2016.
  45. ↑ "Case Western Reserve, Cleveland Clinic Collaborate with Microsoft on 'Earth-Shattering' Mixed-Reality Technology for Education". Case Western Reserve University. 29 April 2015. Retrieved 9 July 2015.
  46. ↑ "Trimble Partners with Microsoft to Bring Microsoft HoloLens Wearable Holographic Technology to the AEC Industry". Trimble Navigation. 29 April 2015. Retrieved 29 April 2015.
  47. ↑ "Halo 5 headlines greatest holiday games lineup in Xbox history". Microsoft News Center. Microsoft. 15 June 2015. Retrieved 15 June 2015.
  48. ↑ Kudo Tsunoda, Lydia Winters, Sax Persson (15 June 2015). E3 2015 Media Briefing. Microsoft. Event occurs at 01:13:36. Retrieved 23 August 2015.
  49. ↑ Satya Nadella, Lorraine Bardeen, Dan McCulloch (13 July 2015). Our journey together. Event occurs at 42:42. Retrieved 15 July 2015.
  50. ↑ Ramsey, Sarah, ed. (25 June 2015). "NASA, Microsoft Collaborate to Bring Science Fiction to Science Fact". Jet Propulsion Laboratory. Retrieved 28 June 2015.
  51. ↑ Gardiner, Garin (30 November 2015). "Microsoft HoloLens + Autodesk Fusion 360 = Mixed Reality for Product Design and Engineering [VIDEO]". In the Fold. Autodesk. Retrieved 7 December 2015.
  52. ↑ "Galaxy Explorer". Microsoft Studios. Microsoft. Retrieved 17 February 2016.
  53. ↑ "Announcing the Microsoft HoloLens 'Share Your Idea' campaign". Building Apps for Windows. Microsoft. 1 December 2015. Retrieved 17 February 2016.
  54. ↑ Jeff Norris (10 February 2016). Vision Summit 2016 Keynote. Ray Dolby Ballroom, Dolby Theatre: Unity Technologies. Event occurs at 57:26. Retrieved 17 February 2016. It's a new application under development in my lab, and we're talking about it publicly for the first time today. It's a tool for spacecraft designers, and it borrows a lot of technology from the work that we're doing for our applications on the International Space Station.
  55. ↑ Parker Abercrombie (23 January 2016). A Cloud-based Architecture for Processing 3D Mars Terrain. Ballroom A, Pasadena Convention Center: Linux Expo of Southern California Inc. Retrieved 17 February 2016. ...but the rover moves everyday, and we wanted this tool to be useful operationally, so we actually needed to, not just do this once, but we needed a way to create these scenes easily and automatically as the rover moves, and new imagery is downlinked.Abercrombie, Parker (23 January 2016). A Cloud-based Architecture for Processing 3D Mars Terrain (PDF). SCaLE 14x — The Fourtheenth Annual Southern California Linux Expo. Retrieved 17 February 2016.
  56. ↑ Northon, Karen, ed. (21 January 2015). "NASA, Microsoft Collaboration Will Allow Scientists to "Work on Mars"". Jet Propulsion Laboratory. Retrieved 22 January 2015.
  57. ↑ Dina, Bass. "Microsoft, Volvo Car to Bring Augmented Reality Into Showrooms". Bloomberg. Retrieved 20 November 2015.
  58. ↑ "Development overview". Windows Dev Center. Microsoft. Retrieved 1 March 2016.
  59. ↑ Microsoft HoloLens: Gaze Input. Microsoft. 29 February 2016. Retrieved 7 March 2016.
  60. ↑ "Gestures". Windows Dev Center. Retrieved 7 March 2016.
  61. ↑ Microsoft HoloLens: What is a hologram?. Microsoft. 29 February 2016. Retrieved 7 March 2016.
This article is issued from Wikipedia - version of the 12/3/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.