Nextvr Inc.

Nevermind Capital LLC

Apple Inc.

Ryan Michael Sheridan

David Michael Cole

Alan McKay Moss

Hector M Medina

David Ibbitson

Matthew Yaeger

In one implementation, a camera includes an image sensor including a plurality of sensor elements at a respective plurality of first image sensor locations. The camera includes a controller to receive, from the image sensor, a plurality of sensor values indicative of a characteristic of light impinging on the plurality of sensor elements and generate, based on the plurality of sensor values, an image file including a plurality of pixels having a respective plurality of pixel values, wherein the plurality of pixels are associated with a respective plurality of pixel locations that represent a respective plurality of second image sensor locations. The plurality of second image sensor locations are within a circle and the image file does not include a pixel having a pixel location representing an image sensor location outside the circle and within a square in which the circle is inscribed.

Circular image file

An unobstructed image portion of a captured image from a first camera of a camera pair, e.g., a stereoscopic camera pair including fisheye lenses, is combined with a scaled extracted image portion generated from a captured image from a second camera in the camera pair. An unobstructed image portion of a captured image from the second camera of the camera pair is combined with a scaled extracted image portion generated from a captured image from the first camera in the camera pair. As part of the combining obstructed image portions which were obstructed by part of the adjacent camera are replaced in some embodiments. In some embodiments, the obstructions are due to adjacent fisheye lens. In various embodiments fish eye lenses which have been cut to be flat on one side are used for the left and right cameras with the spacing between the optical axis approximating the spacing between the optical axis of a human person's eyes.

Methods and apparatus for capturing, processing and/or communicating images

A camera apparatus, e.g., a stereoscopic camera apparatus, includes a dual element mounting plate, a pair of individual lens mounts, and a pair of sensor holders, each sensor holder holding an image sensor. The lens mounts and sensor holders are secured to the dual element mounting plate. Multiple dual element mounting plates corresponding to camera pairs may be secured to a base plate. Various features facilitate achieving and maintaining alignment between a lens and a corresponding image sensor, as well as between camera pairs and between sets of camera pairs.

Camera apparatus and methods

Methods and apparatus for aligning components of camera assemblies of one or more camera pairs, e.g., a stereoscopic camera pairs, are described. A camera calibration tool referred to as a camera bra is used. Each dome of the camera bra includes a test pattern, e.g., grid of points, with the domes being aligned and spaced apart by a predetermined amount. The bra is placed over the cameras of a camera pair, the grids are detected and displayed. The camera component positions are adjusted until the displayed images show the grids as being properly aligned. Because the grids on the calibration tool are properly aligned as a result of the manufacturing of the calibration tool, when the images are brought into alignment the cameras will be properly spaced and aligned at which point the calibration tool can be removed and the stereoscopic camera pair used to capture images of a scene.

Camera alignment and/or calibration methods and apparatus

Methods and apparatus for packing images into a frame and/or including additional content and/or graphics are described. A composite image is generated including at least one image in addition to another image and/or additional image content, e.g., a logo, texture, sign, or advertisement. In some embodiments, first and second pairs of stereoscopic images are combined, e.g., with additional image content to generate a composite image which is then encoded, e.g., using a UHD (Ultra High Definition) encoder. In some other embodiments, the rather than two pairs of stereo images a pair of stereo images are combined with images captured by two mono cameras. In various embodiments, the set of cameras which are sources of captured images for the composite image are dynamically selected, e.g., with different sets of cameras in a camera rig being selected at different times.

Methods and apparatus for packing images into a frame and/or including additional content or graphics

Methods and apparatus for packing images into a frame and/or including additional content and/or graphics are described. A composite image is generated including at least one image in addition to another image and/or additional image content. A playback device received an encoded frame including a captured image of a portion of and environment and the additional image content. The additional image content is combined with or used to replace a portion of the image of the environment during rendering. Alpha value mask information is communicated to the playback device to provide alpha values for use in image combining. Alpha values are communicated as pixel values in the encoded frame or as additional information. One or more mesh models and/or information on how to map image content to the one or more mesh models is communicated to the playback device for use in rendering image content recovered from a frame.

Methods and apparatus for communicating and/or using frames including a captured image and/or including additional image content

Methods and apparatus for checking the alignment and/or spacing of cameras of a camera pair, e.g., stereoscopic camera pair, are described. Images of a calibration target are captured by first and second cameras of a camera pair being calibrated The captured first and second images, which may correspond to all or a portion of the calibration target, are combined in accordance with the invention to generate a calibration image which is then displayed to an operator of the calibration apparatus including the calibration target. Given the position of at least some different color grid elements in the calibration target, when proper camera spacing and optical axis alignment of the cameras is achieved, the overlaid image will include an overlay of two different color image grid elements resulting in the generated calibration image including grid elements of a different color than that of the overlaid grid elements.

Methods and apparatus for calibrating and/or adjusting the arrangement of cameras in a camera pair

A camera apparatus, e.g., a stereoscopic camera apparatus, includes a slideable filter plate inserted into a slot in a dual element mounting plate. The slideable filter plate includes a plurality of selectable pairs of filter mounting positions and changes between pairs of filter mounting positions may be performed without altering camera alignments. Each pair of filter mounting positions includes a right eye filter mounting position and a left eye filter mounting position. Each pair of filter mounting positions in the slideable filter plate includes a pair of filters or no filters.

Growing community of inventors

Rancho Cucamonga, CA, United States of America

Ryan Michael Sheridan