Elbit Systems Ltd.

Magic Leap, Inc.

Lior Barak

Rani Ben-Yishai

Guy Rosenthal

Adi Perry

Ron Kornblit

Ron Kornbilt

A system for registering a coordinate system associated with a model of an object with a reference-coordinate-system, the object includes at least one marker, the system includes a portable-unit, a tracking-system and a processor. The portable unit includes and display and an optical-detection-assembly for acquiring at least one representation of the marker. The tracking-system tracks the position-and-orientation of the portable-unit in the reference-coordinate-system. The processor is configured to determine position-related-information respective of the marker in the reference-coordinate-system, to register the model with the reference-coordinate-system at least based on the position-related-information respective of the marker, and on a location of the marker in a coordinate system associated with the model, and to display registration-related-information on the display, at least one of the registration-related-information and the display location of the registration-related-information is related to the position-and-orientation of the portable-unit in the reference-coordinate-system.

Model registration system and method

Systems and methods for predicting head pose for a rendering engine of an augmented or virtual reality device can include a recurrent neural network (RNN) that accepts a time series of head pose data and outputs a predicted head pose. The recurrent neural network can include one or more long short term memory (LSTM) units or gated recurrent units (GRUs). A fully connected (FC) layer can accept input from the RNN and output a 3 degree-of-freedom (DOF) head pose (e.g., angular orientation or spatial position) or a 6 DOF head pose (e.g., both angular orientation and spatial position). The rendering engine can use the predicted head pose to generate and display virtual content to the user at the time the user looks toward the position of the virtual content, which reduces system latency and improves user experience.

Deep predictor recurrent neural network for head pose prediction

System for registering a coordinate system associated with a pre-acquired model of an object with a reference coordinate system. The system includes a portable unit which includes a display, a tracking system for tracking the portable unit and a processor. The processor is coupled with the portable unit and with the tracking system. The processor determines the position and orientation of the portable unit. The processor further determines the position of at least one marker located on the object according to at least one of, a tracked pointer and respective position related information. The processor further displays registration related information on the display. At least one of the registration related information and the display location of the registration related information are related to the position and orientation of the portable unit. The position of the at least one marker, in the coordinate system associated with the pre-acquired model, is predetermined.

An optical tracker is provided herein. The tracker may include at least two optical tracker sensors, facing at least partially each other. Each optical tracker sensor may include: a pixel array sensor configured to generate a pixel-by-pixel stream of values representing a scene; at least one visual indicator physically coupled to said pixel array sensor; and an integrated circuit (IC) physically coupled to said at least one pixel array sensor, and configured to: receive said pixel-by-pixel stream of values; and apply a binary large object (BLOB) analysis to said stream, to yield BLOB parameters indicative of the at least one visual indicator present in the scene in a single pass of the pixels representing the scene; and a computer processor configured to receive said BLOB parameters and calculate a relative position and/or orientation, or a partial data thereof, of the at least two optical tracker sensors.

Growing community of inventors

Binyamina, Israel

Lior Barak