Apple Inc.

Other

Vuelosophy Inc.

Nie, Xiaochun

Xiaochun Nie

Hsi-Jung Wu

Thomas Pun

Roger Kumar

Maynard J Handley

Christopher L Flick

Atul Puri

Barin Geoffry Haskell

Adriana Dumitras

James O Normile

Xin Tong

J Peter Hoddie

Disclosed herein are various methods of calibrating relative orientation between imaging sensor and spatial orientation sensor, and relative orientation between imaging sensors.

Systems and methods for calibrating an eye tracking system

Disclosed herein are various methods of calibrating relative orientation between spatial orientation sensors, relative orientation between imaging sensor and spatial orientation sensor, and relative orientation between imaging sensors. The relative orientation of the spatial orientation sensors, imaging sensors is calculated with respect to a reference frame.

Systems and methods for calibrating imaging and spatial orientation sensors

Apparatus, systems and methods configured for eye tracking with slippage detection and correction are disclosed. In one example, a method comprises: obtaining a first image and a second image of a person's eye, with an imaging sensor; determining a position relationship between an eyeball center of the eye and the imaging sensor based on the first image and the second image.

Wearable eye tracking system with slippage detection and correction

Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made. If the quantizer value is at the high end then larger adjustments may be made to the quantizer. Finally, in one embodiment, the quantizer is implemented along with an inverse quantizer for efficient operation.

Method for implementing a quantizer in a multimedia compression and encoding system

Apparatus, systems and methods configured for tracking head and eye movement are disclosed. In one example, an apparatus comprises an imaging sensor, a spatial orientation sensor and a computing device comprising a processor and a memory communicatively coupled with the processor. The imaging sensor is configured for capturing and recording images of an eye of a user when the user stares at a gaze point and rotates a head of the user about a first axis and about a second axis that is orthogonal to the first axis. The spatial orientation sensor is coupled to the imaging sensor such that the imaging sensor has a fixed position and a fixed orientation relative to the spatial orientation sensor and is configured for generating outputs during the rotations of the head of the user, wherein each of the outputs corresponds to one of the images of the eye.

Systems and methods for tracking motion and gesture of heads and eyes

A method for encoding video with a two-dimensional (2D) transform separable to two one-dimensional (1D) transforms. The method receives an array of values for a sub-section of an image, performs a first 1D-transform of the array, transposes the resulting array, and performs a second 1D-transform of the array resulting from the transpose. The method, without performing another transpose, generates a data stream using a transposed scan order based on the values of the array resulting from the second transform. A method for decoding video encoded by a 2D transform, which separable to two 1D transforms. The method receives a data stream containing encoded values for an image, parses out the values into an array using a transposed scan order, performs a first 1D-inverse transform on the array, transposes the resulting array, and performs a second 1D-inverse transform of the array resulting from the transpose to produce a decoded output.

Efficient video encoding by preforming transform operations

The rate controller in a digital video encoding system is responsible for allocating a bit budget for video frames to be encoded. The rate controller considers many different factors when determining the frame bit budget. One of the factors considered is the complexity of the frames being compressed. Occasionally there will be a very complex frame that is not representative of the overall video frame sequence. Such a rare complex frame may cause a disproportionate affect on the bit budget allocation. The system of the present invention limits the amount that a very complex frame can change the bit budget allocation. The rate controller of the present invention also includes a relaxation factor. The relaxation factor allows a user to determine if the rate controller should strictly allocate its bit budget or relax its standards such that the rate controller may not be so conservative when allocating bits to frames.

Method of implementing improved rate control for a multimedia compression and encoding system

In some embodiments, a method of determining encoding type and predictive mode(s) selections for a macroblock of a video frame is provided. In some embodiments, a general method 1) selects the encoding type (16&#xd7;16 or 4&#xd7;4) that is initially considered for a macroblock using an encoding type selection algorithm (based on an attribute of the macroblock that is easy to compute), 2) if the 16&#xd7;16 encoding type is selected in step 1, consider the four 16&#xd7;16 prediction modes that may be used on the macroblock using conventional methods or an improved 16&#xd7;16 predictive mode search algorithm based on distortion thresholds, and 3) if the 4&#xd7;4 encoding type is selected in step 1, select the 4&#xd7;4 prediction mode to be used for each of the sixteen 4&#xd7;4 blocks of the macroblock using conventional methods or an improved 4&#xd7;4 predictive mode search algorithm based on the positional relationships between predictive modes.

Growing community of inventors

Cupertino, CA, United States of America

Xiaochun Nie