Multinarity Ltd

Sightful Computers Ltd

Orit Dolev

Tamir Berliner

Tomer Kahan

Doron Assayas Terre

Oded Noam

Tomer Dvir

Eli Elhadad

Amit Knaani

Dori Peleg

Aviv Burshtein

Barel Tayouri

Fade Rudman

Amir Eshel

Systems, methods, and non-transitory computer readable media for coordinating virtual content display with mobility status are disclosed. A non-transitory computer readable medium contains instructions that cause a processor to: access rules associating user mobility statuses with display modes; receive first sensor data reflecting a mobility status of a user during a first time period; based on the first sensor data, determine that during the first time period the user is associated with a first mobility status; implement a first accessed rule to generate a first display of virtual content; receive second sensor data reflecting the mobility status of the user during a second time period; based on the second sensor data, determine that during the second time period the user is associated with a second mobility status; and implement a second accessed rule to generate a second display of the virtual content different from the first display.

Altering display of virtual content based on mobility status change

A system and method for operating a keyboard and wearable extended reality appliance combination to control a virtual display are disclosed. The system may include a processor configured to receive, from a first hand-position sensor associated with the wearable extended reality appliance, first signals representing first hand-movements; receive, from a second hand-position sensor associated with the keyboard, second signals representing second hand-movements, wherein the second hand-movements include actions other than interactions with a feedback component; and control the virtual display based on the first signals and the second signals.

Docking virtual objects to surfaces

Systems, methods, and non-transitory computer readable media including instructions for extracting content from a virtual display are disclosed. Extracting content from a virtual display includes generating a virtual display via a wearable extended reality appliance, wherein the virtual display presents a group of virtual objects and is located at a first virtual distance from the wearable extended reality appliance; generating an extended reality environment via the wearable extended reality appliance including at least one additional virtual object at a second virtual distance from the wearable extended reality appliance; receiving input for causing a specific virtual object to move from the virtual display to the extended reality environment; and in response, generating a presentation of a version of the specific virtual object in the extended reality environment at a third virtual distance different from the first virtual distance and the second virtual distance.

Moving windows between a virtual display and an extended reality environment

Methods, systems, apparatuses, and computer-readable media are provided for enabling collaboration between writers. In one implementation, the computer-readable medium includes instructions to cause a processor to receive, from an image sensor associated with a wearable extended reality appliance, image data representing a physical surface, the physical surface being a compilation of pages; receive, from a computing device associated with a virtual writer, annotation data representing first virtual markings associated with a first page of the compilation and second virtual markings associated with a second page of the compilation; analyze the image data to determine that the compilation is opened to the first page; and cause the wearable extended reality appliance to overlay the first virtual markings on the first page of the compilation and exclude overlaying the second virtual markings on the first page of the compilation.

Enhancing physical notebooks in extended reality

A method for augmenting a physical display with an extended reality display. A processor receives first signals representative of a first object fully presented on a physical display, second signals representative of a second object having a first portion presented on the physical display and a second portion extending beyond a border of the physical display, and third signals representative of a third object initially presented on the physical display and subsequently wholly moved beyond the border of the physical display. In response to receiving the second signals, the second portion is presented via a wearable extended reality appliance in a virtual space while the first portion is presented on the physical display. In response to receiving the third signals, the third object is wholly presented via the wearable extended reality appliance in the virtual space following the third object having been wholly presented on the physical display.

Extending working display beyond screen edges

Systems, methods, and non-transitory computer readable media including instructions for presenting information in a first display region having predefined boundaries, the information manipulatable via a user interface presentable in the first display region; presenting, via a wearable extended reality appliance, a second display region beyond the predefined boundaries of the first display region, wherein the second display region is visible via the wearable extended reality appliance; providing a control for altering a location of the user interface, wherein in a first mode, the user interface is presented in the first display region while the information is presented in the first display region and in a second mode, the user interface is presented in the second display region outside the predefined boundaries of the first display region while the information is presented in the first display region; and enabling toggling between the first mode and the second mode via the control.

Recording the complete physical and extended reality environments of a user

Systems, methods, and non-transitory computer readable media including instructions for presenting location-based content are described. Presenting location-based content includes obtaining an indication of a current physical location of an extended reality appliance; providing the indication to a first server that maps physical locations to a plurality of content addresses; receiving from the first server, at least one specific content address associated with the current physical location; using the at least one specific content address to access a second server; receiving content, associated with the current physical location, from the second server; and presenting the content via the extended reality appliance, while the extended reality appliance is in the current physical location.

Location-based virtual resource locator

Systems, methods, and non-transitory computer readable media including instructions for customizing location-based content presentation are described. Customizing location-based content presentation includes accessing a group of content display mode rules specifying a format impacting 3D presentation; accessing stored selections unique to a wearer of a wearable extended reality appliance associating content display mode rules with physical locations; receiving a first indication that the wearable extended reality appliance is at the first physical location; based on the received first indication and the accessed stored selections, displaying first location-based content at the first physical location according to the first content display mode rule; receiving a second indication that the wearable extended reality appliance is at the second physical location; and based on the received second indication and the accessed stored selections, displaying second location-based content at the second physical location according to the second content display mode rule.

User-customized location based content presentation

Systems, methods, and non-transitory computer-readable media for providing situational awareness to users of wearable extended reality appliances are disclosed. In one implementation, a non-transitory computer-readable medium contains instructions that when executed by at least one processor cause the at least one processor to: cause virtual content to be displayed through a first wearable extended reality appliance; detect a second wearable extended reality appliance in proximity to the first wearable extended reality appliance; establish a link between the first wearable extended reality appliance and the second wearable extended reality appliance; and transmit data representing at least a portion of the virtual content in an obscured form to the second wearable extended reality appliance, wherein the obscured form provides an indication of a position of the at least a portion of the virtual content in a three-dimensional space without revealing substance of the virtual content in obscured form.

Sharing obscured content to provide situational awareness

A method for capturing extended reality environments includes receiving image data from at least one image sensor associated with a wearable extended reality appliance, the image data representing at least a 140 degrees field of view of a physical environment. At least two extended reality objects are virtually associated with a composite perspective of the physical environment, wherein the at least two extended reality objects are spaced apart by at least 140 degrees from a point of view of the wearable extended reality appliance. Displaying, via the wearable extended reality appliance and during a particular time period, changes in one of the at least two extended reality objects while refraining from displaying changes in another of the at least two extended reality objects. Enabling non-synchronous display of concurrent changes in the at least two extended reality objects that took place during the particular time period.

Methods, systems, apparatuses, and computer-readable media are provided for managing extended reality video conferences. In one implementation, the computer-readable medium may include instructions to cause a processor to: receive a request to initiate a video conference between a plurality of participants; receive image data captured by at least one image sensor associated with a wearable extended reality appliance, the image data reflecting a layout of a physical environment in which the wearable extended reality appliance is located; analyze the image data to identify at least one interference region in the physical environment; receive visual representations of the plurality of participants; and cause the wearable extended reality appliance to display the visual representations of the plurality of participants at multiple distinct locations other than in the at least one interference region.

Positioning participants of an extended reality conference

An integrated computational interface device may include a portable housing having a key region and a non-key region; a keyboard associated with the key region of the housing; and a holder associated with the non-key region of the housing. The holder may be configured for selective engagement with and disengagement from the wearable extended reality appliance, such that when the wearable extended reality appliance is selectively engaged with the housing via the holder, the wearable extended reality appliance is transportable with the housing.

Integrated computational interface device with holder for wearable extended reality appliance

Systems, methods, and non-transitory computer readable media configured for enabling content sharing between users of wearable extended reality appliances are provided. In one implementation, the computer readable medium may be configured to contain instructions to cause at least one processor to establish a link between a first wearable extended reality appliance and a second wearable extended reality appliance. The first wearable extended reality appliance may display first virtual content. The second wearable extended reality appliance may obtain a command to display first virtual content via the second wearable extended reality appliance, and in response, this content may be transmitted and displayed via the second extended reality appliance. Additionally, the first wearable extended reality appliance may receive second virtual content from the second wearable extended reality appliance, and display said second virtual content via the first wearable extended reality appliance.

Moving content between virtual and physical displays

Disclosed are systems, methods, and non-transitory computer readable media for making virtual colored markings on objects. Instructions may include receiving an indication of an object; receiving from an image sensor an image of a hand of an individual holding a physical marking implement; detecting in the image a color associated with the marking implement; receiving from the image sensor image data indicative of movement of a tip of the marking implement and locations of the tip; determining from the image data when the locations of the tip correspond to locations on the object; and generating, in the detected color, virtual markings on the object at the corresponding locations, wherein the object is a three-dimensional virtual object, and wherein the virtual markings include markings in the detected color on two traversed surfaces of the virtual representation of the physical object.

Color-sensitive virtual markings of objects

Methods, systems, apparatuses, and non-transitory computer-readable media are provided for tying virtual whiteboards to physical spaces. In one implementation, the computer-readable medium includes instructions to cause a processor to receive wirelessly, an indication of a location of a first wearable extended reality appliance; perform a lookup to determine that the location of the first wearable extended reality appliance corresponds to a location of a particular virtual whiteboard; transmit to the first wearable extended reality appliance, data corresponding to content of the particular virtual whiteboard; receive, during a first time period, virtual content added by a first user; receive wirelessly at a second time period an indication that a second wearable extended reality appliance is in the location of the particular virtual whiteboard; and transmit to the second wearable extended reality appliance, data corresponding to the content and the added content of the particular virtual whiteboard.

Growing community of inventors

Tel Aviv, Israel

Orit Dolev