Sphero, Inc.

Fabrizio Polo

Adam Wilson

Jonathan Carroll

Skylar Castator-Smith

Ian H Bernstein

Brian Keith Smith

Brandon Dorris

Patrick Martin

Hunter James Lang

David E Hygh

Ross Ingram

A computing device operating as a controller can obtain image data from a camera component. The computing device can determine a location of the self-propelled device relative to the camera based on the image data. A virtual content may be generated on the computing device based at least in part on the location of the self-propelled device.

Remotely controlling a self-propelled device in a virtualized environment

A method is disclosed for operating a computing device. One or more images of a scene captured by an image capturing device of the computing device is processed. The scene includes an object of interest that is in motion and that has a rounded shape. The one or more images are processed by detecting a rounded object that corresponds to the object of interest. Position information is determined based on a relative position of the rounded object in the one or more images. One or more processes are implemented that utilize the position information determined from the relative position of the rounded object.

Operating a computing device by detecting rounded objects in an image

A modular sensing device can include an inertial measurement unit to generate sensor data corresponding to user gestures performed by a user, a mode selector enabling the user to select a mode of the modular sensing device out of a plurality of modes, and one or more output devices to generate output based on the user gestures and the selected mode. The modular sensing device can further include a controller to implement a plurality of state machines. Each state machine can be associated with a corresponding user gesture by a sensor data signature. The state machine can execute a state transition when the sensor data matches the sensor data signature. The executed state transition can cause the controller to generate a corresponding output via the one or more output devices specific to the selected mode and based on the corresponding user gesture.

Modular sensing device implementing state machine gesture interpretation

A self-propelled device can establish a communication link with a controller device that is operable by a user to remotely control the self-propelled device. The self-propelled device can further receive, over the communication link, a computer code package from the controller device, and execute the computer code package to perform one or more processing operations performed by the controller device.

Outsourcing processing to a self-propelled device

A method is disclosed for operating a mobile computing device. The method may include a communication link between the mobile computing device and a second computing device. The second computing device may provide a virtual environment for the mobile computing device. Furthermore, the mobile computing device may allow a user to control a self-propelled device, which may be rendered as a virtual entity upon the virtual environment.

Interactive augmented reality using a self-propelled device

Systems and methods are disclosed herein for determining relative orientation between a self-propelled device and a mobile computing device by utilizing the asymmetric radiation pattern of communication link emissions by the self-propelled device. Upon establishing the communication link, the self-propelled device may perform a spin, thereby enabling the self-propelled device and/or the mobile computing device to detect radiated pulses due to the asymmetry in the link. A direction may be determined based on such pulses, which may be utilized for calibration purposes.

Utilizing asymmetrical radiation pattern to determine relative orientation

A computing device can augment video content by receiving video content from an image capturing device and detecting and tracking a self-propelled device in the video content. The computing device can display a plurality of augmented reality elements selectable to augment the self-propelled device and receive a user selection of one of the plurality of augmented reality elements to augment the self-propelled device. The computing device may then augment the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

Augmentation of elements in a data content

Systems and methods are disclosed herein for outsourcing processing operations between a mobile computing device and a self-propelled device. The self-propelled device may be in operative control by the mobile computing device via a communication connection. Due to latency in the communication connection, the mobile computing device may compile a computer code package for transmission to the self-propelled device. Execution of the computer code package by the self-propelled device may offset operations otherwise performed by the mobile computing device.

A system and method are disclosed for processing data content. Received data content comprises a scene and includes one or more recognized objects. The recognized object(s) include various characteristics, and can be detected and tracked during content capture. The data content can then be stored, and incorporated with metadata associated with the recognized object and/or one or more other elements in the data content. User inputs can be enabled in real-time, or post-capture, to augment one or more of the elements in the stored data content, including one or more characteristics of the recognized object. The data content can then be augmented to introduce one or more augmented elements, corresponding to respective elements of the data content, into the data content based on the user inputs.

Growing community of inventors

Boulder, CO, United States of America

Fabrizio Polo