Multinarity Ltd

Sightful Computers Ltd

Tomer Kahan

Tamir Berliner

Orit Dolev

Doron Assayas Terre

Oded Noam

Eli Elhadad

Tomer Dvir

Dori Peleg

Amit Knaani

Barel Tayouri

Aviv Burshtein

Fade Rudman

Amir Eshel

Elad Levi

Systems, methods, and computer program products are provided for performing operations for presenting content in three dimensional (3D) environments. Performing operations for presenting content in 3D environments includes: requesting content for virtual presentation in an environment of an extended reality appliance; receiving the content for the virtual presentation in the environment; receiving with the content, a plurality of tags, each being associated with a portion of the content, wherein a particular portion of the content associated with a particular tag includes an inanimate virtual object; for each tag, selecting, based on the respective tag, a 3D placement requirement for the portion of the content associated with the respective tag; and for each portion of the content, determining, based on a layout of the environment and the selected 3D placement requirement, a location in the environment for virtual placement of the respective portion of the content.

Presenting extended reality content in different physical environments

Systems, methods, and non-transitory computer readable media including instructions for enabling user interface display mode toggling. Enabling user interface display mode toggling includes presenting information in a first display region having predefined boundaries, the information being manipulatable via a user interface in the first display region; presenting, via a wearable extended reality appliance, a second display region beyond the predefined boundaries of the first display region; providing a control for altering a location of the user interface, wherein in a first mode, the user interface is presented in the first display region while the information is presented in the first display region and in a second mode, the user interface is presented in the second display region outside the predefined boundaries of the first display region while the information is presented in the first display region; and enabling toggling between the first mode and the second mode via the control.

Dual mode presentation of user interface elements

Systems, methods, and non-transitory computer readable media for coordinating virtual content display with mobility status are disclosed. A non-transitory computer readable medium contains instructions that cause a processor to: access rules associating user mobility statuses with display modes; receive first sensor data reflecting a mobility status of a user during a first time period; based on the first sensor data, determine that during the first time period the user is associated with a first mobility status; implement a first accessed rule to generate a first display of virtual content; receive second sensor data reflecting the mobility status of the user during a second time period; based on the second sensor data, determine that during the second time period the user is associated with a second mobility status; and implement a second accessed rule to generate a second display of the virtual content different from the first display.

Altering display of virtual content based on mobility status change

A system and method for operating a keyboard and wearable extended reality appliance combination to control a virtual display are disclosed. The system may include a processor configured to receive, from a first hand-position sensor associated with the wearable extended reality appliance, first signals representing first hand-movements; receive, from a second hand-position sensor associated with the keyboard, second signals representing second hand-movements, wherein the second hand-movements include actions other than interactions with a feedback component; and control the virtual display based on the first signals and the second signals.

Docking virtual objects to surfaces

Systems, methods, and non-transitory computer readable media including instructions for extracting content from a virtual display are disclosed. Extracting content from a virtual display includes generating a virtual display via a wearable extended reality appliance, wherein the virtual display presents a group of virtual objects and is located at a first virtual distance from the wearable extended reality appliance; generating an extended reality environment via the wearable extended reality appliance including at least one additional virtual object at a second virtual distance from the wearable extended reality appliance; receiving input for causing a specific virtual object to move from the virtual display to the extended reality environment; and in response, generating a presentation of a version of the specific virtual object in the extended reality environment at a third virtual distance different from the first virtual distance and the second virtual distance.

Moving windows between a virtual display and an extended reality environment

Methods, systems, apparatuses, and computer-readable media are provided for enabling collaboration between writers. In one implementation, the computer-readable medium includes instructions to cause a processor to receive, from an image sensor associated with a wearable extended reality appliance, image data representing a physical surface, the physical surface being a compilation of pages; receive, from a computing device associated with a virtual writer, annotation data representing first virtual markings associated with a first page of the compilation and second virtual markings associated with a second page of the compilation; analyze the image data to determine that the compilation is opened to the first page; and cause the wearable extended reality appliance to overlay the first virtual markings on the first page of the compilation and exclude overlaying the second virtual markings on the first page of the compilation.

Enhancing physical notebooks in extended reality

A method for augmenting a physical display with an extended reality display. A processor receives first signals representative of a first object fully presented on a physical display, second signals representative of a second object having a first portion presented on the physical display and a second portion extending beyond a border of the physical display, and third signals representative of a third object initially presented on the physical display and subsequently wholly moved beyond the border of the physical display. In response to receiving the second signals, the second portion is presented via a wearable extended reality appliance in a virtual space while the first portion is presented on the physical display. In response to receiving the third signals, the third object is wholly presented via the wearable extended reality appliance in the virtual space following the third object having been wholly presented on the physical display.

Extending working display beyond screen edges

Systems, methods, and non-transitory computer readable media including instructions for presenting information in a first display region having predefined boundaries, the information manipulatable via a user interface presentable in the first display region; presenting, via a wearable extended reality appliance, a second display region beyond the predefined boundaries of the first display region, wherein the second display region is visible via the wearable extended reality appliance; providing a control for altering a location of the user interface, wherein in a first mode, the user interface is presented in the first display region while the information is presented in the first display region and in a second mode, the user interface is presented in the second display region outside the predefined boundaries of the first display region while the information is presented in the first display region; and enabling toggling between the first mode and the second mode via the control.

Recording the complete physical and extended reality environments of a user

Systems, methods, and computer program products are provided for facilitating presentation of content in a three dimensional (3D) environment. Facilitating presentation of content in a 3D environment includes: receiving an indication of device settings of an extended reality appliance; receiving an indication of content requested for presentation via the extended reality appliance; based on the device settings, selecting 3D placement requirements for the requested content, the 3D placement requirements including at least one of: a 3D physical background, a visual span, virtual object positioning protocols, 3D anchoring requirements, 3D content size requirements, or ambient illumination requirements; transmitting the selected 3D placement requirements and the requested content, the transmitted content including at least one tag for associating portions of the content with at least some of the 3D placement requirements to thereby enable the extended reality appliance to display the content in a 3D environment.

Protocol for facilitating presentation of extended reality content in different physical environments

Systems, methods, and non-transitory computer readable media including instructions for presenting location-based content are described. Presenting location-based content includes obtaining an indication of a current physical location of an extended reality appliance; providing the indication to a first server that maps physical locations to a plurality of content addresses; receiving from the first server, at least one specific content address associated with the current physical location; using the at least one specific content address to access a second server; receiving content, associated with the current physical location, from the second server; and presenting the content via the extended reality appliance, while the extended reality appliance is in the current physical location.

Location-based virtual resource locator

Systems, methods, and non-transitory computer readable media including instructions for customizing location-based content presentation are described. Customizing location-based content presentation includes accessing a group of content display mode rules specifying a format impacting 3D presentation; accessing stored selections unique to a wearer of a wearable extended reality appliance associating content display mode rules with physical locations; receiving a first indication that the wearable extended reality appliance is at the first physical location; based on the received first indication and the accessed stored selections, displaying first location-based content at the first physical location according to the first content display mode rule; receiving a second indication that the wearable extended reality appliance is at the second physical location; and based on the received second indication and the accessed stored selections, displaying second location-based content at the second physical location according to the second content display mode rule.

User-customized location based content presentation

A system and a method for content localization in moving vehicles may include receiving from within a moving vehicle first acceleration data captured using a first sensor included in an extended reality appliance mountable on a head of a wearer. The first acceleration data includes a first component associated with movement of the head of the wearer with respect to the vehicle and a second component associated with movement of the vehicle. The system also includes receiving from within the moving vehicle second acceleration data captured using a second sensor included in a personal input device. The personal input device may be a non-vehicle component configured to be paired with the extended reality appliance. The system may segregate the second component from the first component using the first acceleration data and the second acceleration data to thereby isolate the head acceleration with respect to the vehicle from the vehicle acceleration.

Displaying virtual content on moving vehicles

Methods, systems, apparatuses, and computer-readable media are provided for moving a virtual cursor along two traversing virtual planes. In one implementation, the computer-readable medium includes instructions to cause a processor to generate, via a wearable extended reality appliance, a display including a virtual cursor and virtual objects located on a first virtual plane that traverses a second virtual plane overlying a physical surface; receive a first two-dimensional input reflective of an intent to select a first virtual object located on the first virtual plane; cause a first cursor movement, toward the first virtual object, along the first virtual plane; receive a second two-dimensional input reflective of an intent to select a second virtual object appearing on the physical surface; and cause a second cursor movement, toward the second virtual object, including a partial movement along the first virtual plane and a partial movement along the second virtual plane.

Coordinating cursor movement between a physical surface and a virtual surface

Consistent with disclosed embodiments, systems, methods, and computer readable media including instructions for wearable extended reality appliances to share virtual content. Embodiments may include a processor to generate a visual code reflecting a first physical position of a mobile device. The visual code may be presented on a display of the mobile device in order for the plurality of wearable extended reality appliances to detect the visual code. The plurality of wearable extended reality appliances may share content in a common coordinate system upon detection of the visual code. The processor may detect movement of the mobile device to a second physical position different from the first physical position. The processor may alter the presentation of the visual code upon the detected movement of the mobile device making the visual code unavailable for use in content sharing.

Shared extended reality coordinate system generated on-the-fly

Systems, methods, and non-transitory computer-readable media for providing situational awareness to users of wearable extended reality appliances are disclosed. In one implementation, a non-transitory computer-readable medium contains instructions that when executed by at least one processor cause the at least one processor to: cause virtual content to be displayed through a first wearable extended reality appliance; detect a second wearable extended reality appliance in proximity to the first wearable extended reality appliance; establish a link between the first wearable extended reality appliance and the second wearable extended reality appliance; and transmit data representing at least a portion of the virtual content in an obscured form to the second wearable extended reality appliance, wherein the obscured form provides an indication of a position of the at least a portion of the virtual content in a three-dimensional space without revealing substance of the virtual content in obscured form.

Growing community of inventors

Ramat Hasharon, Israel

Tomer Kahan