Sony Group Corporation

Leigh Anderson

Tonni Sandager Larsen

Ted Yamazaki

Tatsushi Nashida

Naomasa Takahashi

A system and method for object classification and related applications based on frame and event camera processing is provided. The system acquires an output of image sensor circuitry and determines a first object classification result based on feature points associated with first objects in a first frame of the acquired output. The system executes an event-camera signal processing operation on at least two frames of the acquired output to generate an event frame. The generated event frame includes pixel-level movement information associated with second objects. The system determines a second object classification result based on the pixel-level movement information and determines one or more object classification tags based on the determined first and the determined second object classification result. The determined one or more object classification tags correspond to one or more objects, included in at least the first objects and the second objects.

Object classification and related applications based on frame and event camera processing

A system and method of vehicle control for user safety and experience is provided. The system receives sensed information associated with a first vehicle, detects a state of the first vehicle, and determines activities of a person or a second vehicle in proximity of the first vehicle. Such activities are determined based on the sensed information. The system triggers actions based on whether or not the determined activities are unsafe for the first vehicle or for users of the first vehicle in the detected state. The system controls devices associated with the first vehicle based on the triggered actions. The devices include a light-based projector device that is controlled to project a visual alert, included in the triggered actions, directly onto a physical surface. The physical surface is a window portion of the first vehicle or a physical structure which is external to and separate from the first vehicle.

Vehicle control for user safety and experience

A system includes a first multilayer surface that includes a plurality of layers. The system further includes a plurality of sensors and circuitry. The circuitry receives a plurality of signals from the plurality of sensors and projection data associated with a media content projectable by a projection device. The projection data includes contrast control information associated with the media content. The circuitry determines ambient condition of an enclosed space based on the received plurality of signals. The circuitry selects one or more portions of the plurality of layers of the first multilayer surface based on the determined ambient condition or the projection data. The circuitry controls an opacity level of the selected one or more portions of the first multilayer surface to provide dynamic shade control in the enclosed space or improve contrast of the projected media content based on the determined ambient condition or the projection data.

Control of multilayer surface for enclosed space

A system in a first vehicle includes a plurality of sensors, a plurality of audio output devices and circuitry. The circuitry receives a plurality of signals from the plurality of sensors. The circuitry determines a relative position between a first device and the first vehicle based on the received plurality of signals or a geo-location of the first vehicle. The circuitry receives first information from the first device based on the determined relative position between the first device and the first vehicle, and at least one selection criterion. The circuitry generates a first three-dimensional (3D) audio object corresponding to the received first information. The circuitry controls, based on the determined relative position, a first set of audio output devices of the plurality of audio output devices to output the generated first 3D audio object, in a 3D space of the first vehicle at a first time instant.

Three-dimensional (3D) audio interaction for vehicles

A system including circuitry communicably coupled to a plurality of sensors and a plurality of audio output devices are provided. The circuitry receives a plurality of signals from the plurality of sensors. The circuitry further detects a type of a first object and a position of the first object with respect to a first vehicle based on the received plurality of signals. The circuitry further generates metadata associated with the first object based on the detected type of the first object and the position of the first object. The metadata comprises a first three-dimensional (3D) audio object. The circuitry further controls a first set of audio output devices of the plurality of audio output devices to output the first 3D audio object in a 3D space of the first vehicle at a first time instant.

Growing community of inventors

Novi, MI, United States of America

Leigh Anderson