Florida Institute for Human and Machine Cognition, Inc.

Nissan North America, Inc.

Jeffrey M Bradshaw

Matthew Johnson

Lawrence K Bunch

Liam Pedersen

Maarten Sierhuis

Mauro Della Penna

Hans Utz

Michael Vignati

Micael Vignati

Larry Bunch

Matt Johnson

Marco Mattos Carvalho

Thomas Eskridge

Paul J Feltovich

A graphical user interface allowing one or more users to rapidly perceive and respond to varying operational states. Glyphs depicting differing levels of detail are provided for a top-level manager versus a lower-level operator. As applied to the vehicle paradigm, each individual glyph presents information as to the vehicle's current assigned task, mode, state, status, and its progress in completing that task. Each display shows multiple glyphs representing multiple vehicles. A vehicle in need of attention rises in the depiction whereas a vehicle not needing attention remains in a low position.

Object management display

Methods and systems for remote support of autonomous operation of vehicles have been disclosed. State indicators are generated by a first state display based on state data from a portion of vehicles assigned to a respective first level control station. A second state display is generated for a second control station and displays state indicators for the state data of the vehicles. A remote support interface including the first state display and image data received from a first vehicle of the vehicles is generated. Instruction data to the first vehicle is transmitted using the remote support interface and based on an indication that the first vehicle needs remote support, the instruction data modifying the autonomous operation of the first vehicle. A workload between the first level control stations is allocated by assigning the vehicles using the state indicators of the second state display.

Autonomous vehicle remote support mapping interface

Methods, apparatuses, systems, and non-transitory computer readable storage media for monitoring vehicles including autonomous vehicles are described. The disclosed technology includes a vehicle monitoring system that receives vehicle data and external data associated with a vehicle and a corresponding predetermined area. The vehicle data includes a vehicle state of the vehicle and the external data includes external states of external objects. An issue type of the vehicle is determined based on the vehicle state and at least one of the external states. An indication of the issue type is generated for display on an interface.

Autonomous vehicle monitoring using generated interfaces

A graphical user interface allowing one or more users to rapidly perceive and respond to varying operational states. Glyphs depicting differing levels of detail are provided for a top-level manager versus a lower-level operator. As applied to the vehicle paradigm, each individual glyph presents information as to the vehicle's current assigned task, mode, state, status, and its progress in completing that task. Each display shows multiple glyphs representing multiple vehicles. A vehicle m need of attention rises in the depiction whereas a vehicle not needing attention remains in a low position.

A method for visually depicting complex events. Software agents are preferably employed to assist the human operator by collecting, enriching, selecting, aggregating, and analyzing data so that patterns of interest can be visually flagged or otherwise emphasized in the visual display. Events are depicted as an 'event flow' from a source surface to a destination surface. Intervening surfaces may also be defined. The point of origin on the source surface reveals some information about the event flow, as does the point of impact on the destination surface. The event flow may be mapped to one or more intervening surfaces in order to visually depict other characteristics of the event. The entire depiction is rendered in a simulated three-dimensional view. The user is preferably given the ability to pan, zoom, and reorient the vantage point from which the user 'views' the depiction on the computer display.

Event data visualization tool

Growing community of inventors

Pensacola, FL, United States of America

Jeffrey M Bradshaw