Apple Inc.

David A Schmuck

Jeremy C Franklin

Brian S Lau

Marinus Meursing

Jason C Sauers

Jae Hwang Lee

David A Kalinowski

Edward S Huo

Grant H Mulliken

Kevin A Gross

Eric N Vergo

Brandon R Neale

A system can include head-mounted devices that collaborate to process views from cameras of the respective head-mounted devices and identify objects from different perspectives and/or objects that are within the view of only one of the head-mounted devices. Sharing sensory input between multiple head-mounted devices can complement and enhance individual units by interpreting and reconstructing objects, surfaces, and/or an external environment with perceptive data from multiple angles and positions, which also reduces occlusions and inaccuracies. As more detailed information is available at a specific moment in time, the speed and accuracy of object recognition, hand and body tracking, surface mapping, and/or digital reconstruction can be improved. Such collaboration can provide more effective and efficient mapping of space, surfaces, objects, gestures and users.

Shared data and collaboration for head-mounted devices

A head-mounted device includes a device housing, a support structure that is connected to the device housing to support the device housing with respect to a user, a display device that is connected to the device housing to display content, an optical system that is associated with the display device, and sensors that generate sensor output signals. The head-mounted device also includes a tension controller that determines a tensioning command based on the sensor output signals, and a tension adjuster that applies tension to the user according to the tensioning command in order to restrain motion of the device housing with respect to the user.

Head-mounted device with tension adjustment

A head-mounted device includes a device housing, a support structure that is connected to the device housing to support the device housing with respect to a user, a display device that is connected to the device housing to display content, an optical system that is associated with the display device, and sensors that generate sensor output signals. The head-mounted device also includes a tension controller that determines a tensioning command based on the sensor output signals, and a tension adjuster that applies tension to the user according to the tension command in order to restrain motion of the device housing with respect to the user.

A head-mounted device can be operated with another device and/or object for which information is gathered to facilitate visual display of a representation thereof. An object can be provided with indicators that allow a head-mounted device to determine both an identity and a characteristic (e.g., position, orientation, distance, etc.) of the object. Additionally or alternatively, the head-mounted device can determine both an identity and a characteristic (e.g., position, orientation, distance, etc.) of an electronic device attached to an object for producing a virtual representation of the object. Additionally or alternatively, the head-mounted device can receive data from an electronic device attached to an object for producing a virtual representation of the object. The virtual representation of the object can resemble the physical object, even where the object itself is not independently analyzed.

Object tracking for head-mounted devices

A pass-through camera in a head-mounted device may capture image data for displaying on a display in the head-mounted device. However, only low-resolution image data may be needed to display low-resolution images in the periphery of the user's field of view on the display. Therefore, the pass-through camera may only capture high-resolution images that correspond to the portion of the user's field-of-view that is being directly viewed and may capture lower resolution image data that corresponds to the real-world objects in the user's peripheral vision. To enable the camera module to selectively capture high-resolution images, the pass-through camera may include an image sensor with two or more pixel densities, a distortion lens, and/or one or more planar or curved mirrors. Any of the components in the camera module may be adjusted to change which portion of a scene is captured with high-resolution image data.

Growing community of inventors

Mountain View, CA, United States of America

David A Schmuck