The Penn State Research Foundation

Google Inc.

Waymo LLC

Poonam Suryanarayan

James Z Wang

Jia Li

Xin Lu

Reginald B Adams

Michelle Newman

Nathaniel Fairfield

Jay Yagnik

Vivek Kwatra

Michael Epstein

Alexander Toshev

Ioan-Alexandru Sucan

Fang Da

Omer Baror

Lei Yao

Jian Leong

Yutaka Leon Suematsu

Mu Qiao

The disclosure relates to training models for identification of events likely to cause discomfort to passengers of autonomous vehicles and for assessment of overall ride quality of autonomous vehicle rides. For instance, ride data may be associated with a ride quality value indicative of a level of discomfort and/or a first overall ride quality value indicating an overall ride quality provided by the passenger for the first ride. This ride data may be used to train a model such that the model is configured to, in response to receiving ride data for a second ride as input, output a list of events likely to cause discomfort to a passenger during the second ride and/or such that the model is configured to, in response to receiving second ride data for a second ride as input, output a second overall ride quality value for the second ride.

Assessing ride quality for autonomous vehicles

Shape features in natural images influence emotions aroused in human beings. An in-depth statistical analysis helps to understand the relationship between shapes and emotions. Through experimental results on the International Affective Picture System (IAPS) dataset, evidence is presented as to the significance of roundness-angularity and simplicity-complexity on predicting emotional content in images. Shape features are combined with other state-of-the-art features to show a gain in prediction and classification accuracy. Emotions are modeled from a dimensional perspective in order to predict valence and arousal ratings, which have advantages over modeling the traditional discrete emotional categories. Images are distinguished vis-a-vis strong emotional content from emotionally neutral images with high accuracy. All of the methods and steps disclosed herein are implemented on a programmed digital computer, which may be a stand-alone machine or integrated into another piece of equipment such as a digital still or video camera including, in all embodiments, portable devices such as smart phones.

Automatically computing emotions aroused from images through shape modeling

A comprehensive system to enhance the aesthetic quality of the photographs captured by mobile consumers provides on-site composition and aesthetics feedback through retrieved examples. Composition feedback is qualitative in nature and responds by retrieving highly aesthetic exemplar images from the corpus which are similar in content and composition to the snapshot. Color combination feedback provides confidence on the snapshot to contain good color combinations. Overall aesthetics feedback predicts the aesthetic ratings for both color and monochromatic images. An algorithm is used to provide ratings for color images, while new features and a new model are developed to treat monochromatic images. This system was designed keeping the next generation photography needs in mind and is the first of its kind. The feedback rendered is guiding and intuitive in nature. It is computed in situ while requiring minimal input from the user.

On-site composition and aesthetics feedback through exemplars for photographers

A computing device segments an image into a plurality of segments, wherein each segment of the plurality of segments comprises a set of pixels that share visual characteristics. The computing device then determines expected contexts for the segments, wherein an expected context for a segment comprises at least one of additional segments or features expected to occur in the image together with the segment. The computing device then identifies a probable object based on the expected contexts.

System and method for exploiting segment co-occurrence relationships to identify object location in images

Growing community of inventors

San Francisco, CA, United States of America

Poonam Suryanarayan