Essential Products, Inc.

Joseph Anthony Tate

Andrew E Rubin

David John Evans, V

Jason Sean Gagne-Keats

Xiaoyu Miao

Matthew J Hershenson

Xinrui Jiang

Rebecca Schultz Zavin

Michael Kolb

William Francis Leggett

James Jong-sik Kim

David John Evans V

Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display includes several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. The camera can include a plurality of noncontiguous pixel regions disposed beneath the display layer and be configured to capture a plurality of images corresponding to the plurality of noncontiguous pixel regions. In some embodiments, the plurality of images can form a composite image with depth.

System comprising a display and a camera that captures a plurality of images corresponding to a plurality of noncontiguous pixel regions

Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display includes several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. In one embodiment, the layers include a substantially transparent region disposed above the camera. The substantially transparent region allows light from outside to reach the camera, enabling the camera to record an image. In another embodiment, the color filter layer does not include a substantially transparent region, and the camera records the light from the outside colored by the color filter layer. According to another embodiment, while none of the layers include a substantially transparent region, the layers are all substantially transparent, and the camera disposed beneath the layers records light reaching the camera from outside.

Display device comprising a touch sensor formed along a perimeter of a transparent region that extends through a display layer and exposes a light sensor

Some embodiments include a mobile device with a light sensor overlaid under a display (e.g., a touchscreen). The mobile device can identify a command to capture an image. The mobile device can adjust at least a target portion of an opaqueness adjustable region of the display directly over the light sensor. The opaqueness adjustable region is capable of transforming from substantially opaque to substantially transparent. The mobile device can capture the image utilizing at least the light sensor while the target portion of the opaqueness adjustable region is substantially transparent.

Mobile device with display overlaid with at least a light sensor

In one embodiment, a light sensor, such as a camera, records an image through the surface with the residue to produce a stained image. A processor associated with the camera identifies object outlines within the image using a machine learning model, and smooth the colors within the object outlines. In another embodiment, the light sensor is placed beneath a dual-mode region of a display containing the residue. The dual-mode region can be opaque and function as part of the display, or can be transparent and allow environment light to reach the light sensor. Initially, the processor determines the position of the residue by causing the dual-mode region to display a predetermined pattern, while the light sensor records the predetermined pattern. Using the determined position of the residue, the processor corrects the pixels within the residue in the recorded image, by interpolating the values of the pixels outside of the residue.

Sensing light through a surface with a residue

Various embodiments concern techniques for intelligently switching between multiple sources of USB signals. More specifically, user devices are described that include a physical USB port for receiving a USB connector and one or more wireless transceivers that communicate with an accessory. The wireless transceiver(s) may communicate with the accessory using a USB-based protocol (e.g., Wireless USB). The user devices described herein can intelligently switch between these different sources of USB signals so that USB signals can be simultaneously or sequentially received from a peripheral (via the USB port) and an accessory (via the wireless transceiver(s)). In some embodiments, a switching routine is executed (e.g., by a processor or signal switch) that determines which peripheral and/or accessory is connected to a user device at a given point in time.

Systems and techniques for intelligently switching between multiple sources of universal serial bus signals

Presented here are manufacturing techniques to create an irregularly shaped electronic display, including a hollow within which a sensor, such as a camera, can be placed. The manufacturing techniques enable the creation of the hollow anytime during the manufacturing process. The resulting electronic display occupies the full side of the mobile device, with the sensors placed within and surrounded by the display.

Hollowed electronic display

Various embodiments include a device that implements a high bandwidth wireless data interface for communication between the device and a device accessory. The device can include an external shell and a display (e.g., a touchscreen). In some embodiments, the external shell and the display together hermetically seal various other components of the device. In various embodiments, the device includes an attachment mechanism, an alignment mechanism (e.g., for magnetic alignment between a device and a device accessory), a wireless data transceiver, and a wired or wireless energy source (e.g., for sharing power between the device and the device accessory). The wireless data transceiver can transmit data at extremely high electromagnetic frequencies between the device in the device accessory.

Communication between devices and device accessories

Certain aspects of the technology disclosed herein include generating a virtual sound field based on data from an ambisonic recording device. The ambisonic device records sound of a surrounding environment using at least four microphones having a tetrahedral orientation. An omnidirectional microphone having an audio-isolated portion can be used to isolate sound from a particular direction. Sound received from the plurality of microphones can be used to generate a virtual sound field. The virtual sound field include a dataset indicating a pressure signal and a plurality of velocity vectors. The ambisonic recording device can include a wide angle camera and generate wide angle video corresponding to the virtual sound field.

Microphone array for generating virtual sound field

Presented here are devices and methods to correct ambient light measurements made in the presence of optical elements, such as the curved edge of the cover glass associated with the mobile device. In one embodiment, a film with optical properties is placed within the ambient light sensor to diffuse the high-intensity light beam coming from the optical element. In another embodiment, an aperture associated with the ambient light sensor is disposed to prevent the high-intensity light beam from entering the ambient light sensor. In another embodiment, a processor coupled to the ambient light sensor smooths the peak associated with the high intensity light beam produced by the optical element.

Ambient light sensor

The technology disclosed here integrates a light sensor with a dual-mode display, thus increasing the size of the dual-mode display. The light sensor can be a camera, an ambient sensor, a proximity sensor, etc. The light sensor is placed beneath the dual-mode display and can detect incoming light while the dual-mode display is displaying a display image. The dual-mode display and the light sensor can operate at the same time. For example, a camera placed beneath the dual-mode display can record an image of the environment, while at the same time the dual-mode display is showing the display image. Further, multiple light sensors can be placed at various locations beneath the dual-mode display.

Light sensor beneath a dual-mode display

Techniques are described for mounting a display and/or display cover to a housing of a display device, such as a mobile phone. In an embodiment, the housing and display cover include chamfered edges at complementary angles to allow for an 'edge-to-edge' display. The display cover and housing are affixed to each other at the chamfered edges using curable liquid adhesive.

Display cover mounting

Introduced here are methods and systems to create a relief on an electronic display. In one embodiment, the relief is created by micro-electromechanical systems (MEMS) placed above a cover layer of the electronic display. Each MEMS when activated can protrude or depress, thus creating the relief on the electronic display. In another embodiment, the relief is created by a plurality of resistors placed beneath the cover layer. The cover layer is made out of an elastically deformable material that, when heated, expands, thus creating a protrusion on the electronic display. Each resistor when activated heats a section of the cover layer, causing the cover layer to protrude.

Electronic display with a relief

Disclosed here are methods and systems to vary geometry of an optical lens, so that a single lens can assume various geometries, and change from a portrait lens, to a standard lens, to a wide-angle lens, to a fisheye lens, etc. The lens is made out of piecewise linear elements of polygonal shape, that can move in relation to forcing members laid out on a plane. The forcing members can exert a force on the corresponding piecewise linear elements to cause them to move in relation to the forcing members. The force can be electrical, magnetic, mechanical, etc. As a result, the optical lens can assume various shapes such as concave, convex, and planar.

Growing community of inventors

San Jose, CA, United States of America

Joseph Anthony Tate