Magic Jump 2 Presentation Become the Hit of the Convention

Kevin Curtis (Curtis), Magic Jump’s VP of Optical Engineering, presentation “Unveiling Magic Jump 2’s Mighty AR Platform and Revolutionary Optics” at the SPIE AR/VR/MR conference created the most buzz of the total conference. The presentation did a large job laying out Magic Jump 2 (ML2) expose and optics skills at a high stage and a few of the explanations in the again of the alternatives. I don’t mediate they gave away any “secret sauce” that could not be with out problems figured out by tearing down a unit, however it certainly used to be mild a refreshing change.

There used to be some speculation (I in actual fact indulge in no sources) prior to and at some level of the conference that Magic Jump is in the system of being sold (the title most floated is Google as they are already an investor). Every so usually a truly beginning presentation is given by a firm searching for to sell the firm. They additionally can happen when a firm has been sold on letting the world know what they’ve executed. Or it could even be that Magic Jump is searching for to invent again confidence. One thing is for obvious, Magic Jump has long past from being one of many kindly “startups” to a comparatively puny firm in AR in comparison with Meta, Apple, Google, Amazon, Microsoft, and Samsung.

I will be focusing on the expose and optics printed in the presentation. This text relies completely mostly on photos I took (edited and enhanced) as a member of the press and my memory of the discuss. The SPIE needs to be publishing the total video in about every week from this writing, and I would extremely counsel watching the video.

Picked LCOS over MicroLEDs and Laser Beam Scanning

Curtis explained the resolution direction of for the expose skills. Whereas many mediate MicroLEDs could even be the future, they were clearly were not ready for a producing shade headset. Curtis said that while laser scanning used to be in Magic Jump’s “DNA” (glance: Magic Jump Fiber Scanning Designate (FSD) – “The Sizable Con” at the “Core”), despite spending millions, they could also not meet their expose necessities with laser scanning. Gape my articles on the a immense number of concerns with Hololens 2’s laser beam scanning expose.

• Aside: Presumably Satirically, the ML 2 has additionally eliminated the ML1’s “focal level planes” with stacked items of waveguides. Thus both of the distinctive key capabilities sold to early investors in 2013 are now long past.

After evaluating the total picks, Magic Jump determined LCOS used to be the kindly expose skills for their software. As I thought to quilt assorted articles about this conference, LCOS is the expose of preference for plenty of new waveguide-based completely mostly designs that want either shade or greater resolution. Each and each Avegant and Digilens are making new invent pushes with very puny and in actuality shimmering LCOS designs with waveguides. The “be conscious on the dual carriageway” is that Snap has an LCOS-based completely mostly invent in the works.

Excessive Resolution (1440 x 1760 Energetic) LCOS Designate (Omnivision LCOS rumored)

Curtis claimed that there are advantages of getting the expose be taller than it is a long way huge. As shown (factual), the ML2 “energetic expose” expose is 1440 pixels huge by 1760 pixels gargantuan. They’re conserving 96 by 96 pixels in reserve for the alignment of the displays to the eyes.

Magic Jump One (ML1) didn’t indulge in these reserve pixels and as a exchange required two items to quilt assorted interpupillary distances. Some mistakenly thought there were assorted ML1 items based completely mostly on head sizes. The presentation identified that the ML2 would handiest indulge in one mannequin for all customers. These reserve pixels could also come in at hand with assorted expose to appreciate alignment concerns because the appreciate strikes (more on this later).

Whereas not mentioned by Magic Jump, the be conscious because the conference is that ML is the utilization of an unannounced Omnivision’s LCOS instrument. It could most likely possibly not be a surprise because the ML1 weak an Omnivision instrument. The rumor mill appears to be like to mediate that Snap could even be the utilization of Omnivision for their new headset despite Snap’s most up-to-date acquisition of Compound Photonics and their most up-to-date porotype the utilization of TI’s DLP. Most LCOS corporations this day are able to establishing this form of instrument with a 3.8 micron pixel pitch.

On the figure beneath, I in actual fact indulge in added estimates of the FOV alongside with number of pixels in every direction. Each and each the FOV condominium and the number of pixels indulge in doubled over the ML1, so the number of pixels per stage is in regards to the identical. I could also mild not that while Hololens 2 falsely claims 47 pixels per stage of resolution, its tremendous (measurable) resolution is closer to 15 pixels per stage, or about half in every direction of the ML2. The HL2 is valuable for it defective image quality. I fully inquire of that ML2 will blow away the HL2 in resolution and factual about every assorted measurable component of image quality with the exception of the transparency of the categorical-world (more on that later).

ML2’s Compact LCOS Optical Gain

The presentation exhibits some assorted approaches to LCOS that they explain (incorrectly) are restricted in FOV. They’re actual that most LCOS designs (left) use a shade combining stage (X-dice or a series of dichroic mirrors) and a polarizing beam splitter. They additionally mentioned Himax’s Entrance-Lit. But I in actual fact indulge in seen several more innovative compact designs with gigantic FOVs, including Lumus’s Maximus (factual).

Whereas it weak a beamsplitter, the ML1 optical direction (factual) did not indulge in an X-dice or assorted shade combining optics. As an alternative, the ML1 had separate shade paths to every of the waveguides. Since the ML1 supported dual focal level planes, it required six LEDs and six waveguides (two items of r, g, & b). Since the ML2 doesn’t toughen dual focal level planes, there is handiest one to find 22 situation of LEDs and waveguides.

Supporting handiest a single focal level airplane lets in assorted simplifications. It could most likely possibly also mild dramatically toughen the image quality of the ML2 over the ML1.

The ML2 has a considerably innovative option to reducing the size of the total optics the utilization of LCOS. They originate with separate LED illumination for every of the separate shade waveguides (this time handiest three), as with the ML1. Interestingly, they then ship the illumination light throughout the waveguide and projection lenses to illuminate the LCOS instrument and preserve a long way off from needing a beamsplitter.

The left-hand figure beneath exhibits the mixed red, green, and blue light paths (I mixed/overlaid three of the presentation slides). Magic Jump uses a “tricky” mixture of spherical polarizers to manipulate to and from light paths. This folded direction with spherical polarizers appears to be like identical to pancake optics weak with about a of the more moderen, more compact VR headsets (and expected in the Meta Cambria). The invent is rather compact, as shown in the figure beneath-factual from the presentation.

Whereas putting off the beam splitter eliminates some weight, it is a long way not a huge allotment of the total weight. What is more well-known is that it reduces the size of the optics and lets the LCOS expose be optically closer to the projection optics, which can aid simplify said optics.

Whereas many non-designers difficulty in regards to the battery existence, a rare better invent anxiousness in a headset invent is the warmth administration from vitality consumption. ML2 claims to be >12x more atmosphere safe (#4 above-factual) when factoring in FOV and eyebox, which is probably going correct. But then the ML1 used to be trustworthy inefficient with its toughen of the twin focal level planes (there is not any free lunch). The “single SKU” is due to having “reserved” pixels discussed previously.  

2,000 Nits Peak Brightness, a Well-known Accomplishment with a 70° FOV

Curtis said the ML1 used to be about 150 nits (which roughly agrees with my measurements), whereas the ML is alleged to creep to 2,000 nits (glance #5 above-factual). Reaching 2,000 nits with a diffractive waveguide with an ~70° FOV is a major accomplishment. For comparability, the HL2 claims 500 nits however handiest does so in the heart of the HL2’s very non-uniform image as I in actual fact indulge in measured it. Lumus Maximus is expected to bring >4,000 nits for a 50-stage FOV per Watt of LED vitality. ML has not yet specified the vitality consumption of the ML2 at 2,000 nits.

Having the led light struggle throughout the projection optic to illuminate the LCOS and preserve a long way off from needing a beamsplitter could also seem unheard of, however ML is not the kindly firm attempting this vogue. Whereas at the conference, I noticed Avegant’s new, very compact light engine. Avegant uses a waveguide constructing to combine the r, g, &b LEDs and the, cherish the ML2, sends the sunshine throughout the projection optics in direction of the LCOS (glance factual). No longer just like the ML2, Avegant is designed for one to some-layer waveguides that don’t indulge in spatially separated input gratings. Avegant demonstrates their most up-to-date prototype with a single layer Dispelix single-layer waveguide (I thought to quilt Avegant’s new designs in an upcoming article).

ML2’s Optical Stack

ML2’s optical stack (after the projector) is shown on the factual. On the outside, it appears to be like to be like a lot cherish the stack of the Hololens 1 assorted than the dimmer layer. Nothing very horrible. The ML2 uses very high index 2.0 glass (handiest not too lengthy previously on hand), which helps toughen a wider FOV than the Hololens 2 with out resorting to the advanced and image compromising “butterfly” invent of the Hololens 2.

• Aside: The total laser scanning expose and butterfly waveguide of the Hololens 2 seem to be the very definition of “a learn project that escaped the lab.” The ML2 additionally has some “researchers having enjoyable” in it such as with the dimmer goal (more on that in pretty).

The depolarizing film (a long way left) reduces the concerns with viewing usually polarized LCD screens. The “eyepiece” is the to find 22 situation of r, g, & b waveguides with protective covers and coatings.

22% Transmission or blocking 78% of the categorical world light – Most attention-grabbing Case

First, the elephant in the room is the 22% light transmission said on Magic Jump’s glide. They block 78% of the categorical world’s light in its most transmissive explain, successfully medium-murky sunglasses. And frankly, I mediate the 22% is a likely theoretical number that they possibly can’t compose.

A conventional “high transmissivity” reflective polarizer will block about 60% of unpolarized light, 50% for polarization, and yet one more ~10% in effectivity loss. The dimmer constructing has yet one more polarizer, that may per chance lose ~10% more. The many movies and constructions of the dimmer could also mild lose ~15% or most definitely more. The stack of three diffractive waveguides will usually lose 25-35%. Throw in yet one more ~10% for the total assorted movies, coatings, and lenses, and I come by a handiest case of about 22%, and jog it is a long way worse. I in actual fact indulge in long past correct into a lot more detail in regards to the sunshine-blocking concerns with segmented dimming in Magic Jump 2 (Pt. 3): Aloof Edge Occlusion, a Solution for Traders and No longer Users.

As a purposeful subject, rooms are not lit five (5) times brighter than folks favor. In the instance Magic Jump’s CEO gave of an running room being so shimmering in her CNBC interview, it is a long way shimmering for a reason, and so that they’ll not must invent it five times brighter mild.

Below are shown ML1 with 85% blocking, Avegant’s prototype with Dispelix waveguides that are extremely clear (likely >85% clear), Lumus Maximus prototype with about ~85% transparency, and Hololens 2 with 40% transparency. ML2 goes to dam about twice as unprecedented actual world light because the Hololens 2 and about 4 to 5X more light than Dispelix and Lumus.

Magic Jump didn’t advise anything else about “entrance projection,” the sparkling eyes enact seen with many AR glasses. Magic Jump One and Hololens 1 & 2 are notorious for gigantic amounts of entrance projection (glance CNET ML1 image in greater-left corner above). So I’m guessing that Magic Jump isn’t stating it, then it must never be lawful. My rule of thumb is that if a firm doesn’t discuss an evident subject, then the reply is probably going abominable. In incompatibility, with Avegant/Dispelix glasses, I used to be laborious-pressed to see any ahead projection from any perspective, and so that they’re proud to advise they are all the plan down to about 1% ahead projection.

The “LED layer” is for the IR LEDs illuminating the appreciate. The ML2 requires inserts for imaginative and prescient correction, however these are assorted from those for the ML1 as they require cutouts (left-lower-corner) for the appreciate-tracking cameras. A form of folks a the conference commented on the logistical nightmare that these inserts will to find 22 situation off customers.

Diopter (focal level adjusting) lens pair

As discussed in my prior article Magic Jump 2 for Endeavor, Truly? Plus One other $500M, ML1 inbuilt a diopter adjustment into the exit grating of the waveguide as shown in the figure (factual) from Bernard Kress’s (aesthetic) “Optical Architectures for Augmented-, Digital-, and Mixed-Fact Headsets” on net page 164. The e book parts out that ML1’s exit-grating diopter adjustment plan tends to degrades the image quality.

The ML2 uses a entrance and rear lens pair to adjust the focus level cherish Hololens 1 & 2 as I speculated in my prior article. The collimated light exiting most skinny waveguides is concentrated advance infinity. The lens nearest the appreciate strikes the focus to a closer distance of about 1.5 to 2 meters. The lens on the world facet of the waveguide compensates to preserve the focus of the categorical world from altering. The lens plan could also mild aid the ML2’s image quality over the ML1.

Dynamic and Segmented (aka Aloof Edge Occlusion) Dimming

In October 2021, I explained the inherent concerns with Magic Jump’s segmented dimming, identified in the change as “tranquil edge occlusion.” I explained that the technique of the utilization of an LCD shutter to globally murky or a pixelated array murky areas is both successfully identified and has not been weak due to it loses over 70% of the incoming actual-world light, as more briefly discussed above.

Beyond the inability of light, the segmented (tranquil edge) dimming is very imprecise/blurry, and searching for to murky a single pixel could additionally murky thousands of surrounding pixels. Whereas segmented dimming could appear cherish LCD televisions with native dimming, the segmented dimming plan will be orders of magnitude less actual. Moreover, the segmented dimming pixels will to find 22 situation off diffraction concerns with the categorical world as level out in Magic Jump patents (glance the October article).

Magic Jump had factual facet discussing the thought with out puny print and factual about a low-resolution photos (beneath). It likely will not work thoroughly based completely mostly on Magic Jump’s patents and my prognosis. Designate the dimming starts by blocking 80% of the categorical-world light.

Visual Consolation and VAC – Heart of attention Planes Gone

For nearly a decade, Magic Jump has been touting the concerns with Vergence Accommodation Battle and their resolution of the utilization of just a few items of waveguides with assorted focal level planes. In his presentation, Curtis came factual out and said that ML2 had dropped the feature. In Magic Jump 2 for Endeavor, Truly? Plus, One other $500M in October 2021, I speculated that it had been dropped in favor of greater image quality.

Curtis explained that there could even be more well-known concerns that influence visible consolation than VAC, as shown in the glide on the left. Curtis made the case that many of the concerns are linked to rendering concerns as adversarial to VAC and that many of these concerns will be improved by more upright appreciate tracking. Curtis explained that Magic Jump has improved appreciate-tracking and rendering.

An aspect enact of the unprecedented-improved appreciate tracking used to be the necessity to indulge in cutouts so the digicam can indulge in an obstructed appreciate of the person’s eyes (left).

The presentation additionally gave some attention-grabbing facts on the must actual binocular alignment due to even puny mechanical movements. The ML2 entails sensors/cameras for detecting the bending of the headset so the binocular alignment will be corrected (beneath).

Image Nice – Bright to Present

The presentation had one glide with “throughout the lens image” with three photos unprecedented diminished to fit on a single 1080p resolution glide, and I took the image beneath the projected glide with its losses. The total photos explain extreme vignetting (spherical darkening at the outsides). Aloof, it is a long way unimaginable to snatch if this used to be an intended enact, a assert with photography not being contained in the eyebox or a assert with the ML2.

All three photos in the glide indulge in extremely saturated colors, making it laborious to explain whether the colors are upright and if the colors are transferring. I would capture to see photos of folks and a few pure white relate material. Interestingly, the text shade used to be solid green as adversarial to white, which would veil any shade transferring across the waveguide. These photos handiest explain that the ML2’s image quality is greater than the defective Hololens 2, however it certainly is unimaginable to take a look at them with displays and waveguides from assorted corporations.

I compose not doubt that the ML2 has vastly greater image quality than the ML1 or Hololens 1 and 2, however that could also very successfully be a truly low bar. We are able to must aid and glance until an goal prognosis will be made of the image quality.

Conclusions

Whereas it appears to be like evident that ML2 will blow away the HL2 through image quality and brightness, the HL2 items a truly low bar and is not well-known when the ML2 on so many alternative aspects of the invent, as I outlined in Magic Jump 2 for Endeavor? Plus One other $500M. The important thing listing of misses relative to the HL2 entails having a wire, not sufficient appreciate relief to toughen long-established glasses, and an absence of a flip-up show cover.

Blocking off ~80% of the sunshine is an unrecoverable mistake. As I in actual fact indulge in previously written, ML2 appears to be like to be like cherish a product designed for the patron market, however it certainly used to be seen that it’d be a long way too costly for that market, it used to be recast as an “project” instrument.

The more I mediate again in regards to the presentation and various aspects not covered listed right here, such as their capacity to invent and manufacture their very indulge in waveguides, the more I bear in mind the those that mediate the presentation used to be more of a “For Sale” signal.