Toyota Research Institute, Inc.

Toyota Jidosha Kabushiki Kaisha

Shabnam Hakimi

Nikos Arechiga

Charlene C Wu

Matthew L Lee

Yue Weng

Emily Sarah Sumner

Yin-Ying Chen

Matthew Kyung-Soo Hong

Scott Carter

David Ayman Shamma

Guy Rosman

Simon A I Stent

Tiffany L Chen

Daniel J Brooks

Jonathan Decastro

Yanxia Zhang

Deepak Edakkattil Gopinath

Jonathan A DeCastro

Totte Harri Harinen

Kenton Michael Lyons

Monica PhuongThao Van

Candice Hogan

Alex Filipowicz

A method for automated moodboard augmentation via cross-modal generative association making is described. The method includes specifying, by a user, a region to augment in their digital workspace, including at least one selected image. The method also includes inferring a representative text, label, or description for the at least one selected image. The method further includes creating a basis for concept blending based on the representative text, label, or description inferred for the at least one selected image. The method also includes generating images in response to an adjustable slider, as adjusted by the user, to adjust how much the generated images should resemble directly adjacent images, including the at least one selected image.

Automated moodboard augmentation via cross-modal generative association making

A method for legitimate remote co-worker encounters is described. The method includes scheduling a virtual walkabout of a user in a remote environment. The method also includes identifying a remote co-worker in the remote environment to facilitate an interaction with during the virtual walkabout of the user. The method further includes outputting a notification in response to identifying the remote co-worker in the remote environment. The method also includes interfacing the user with the remote co-worker to facilitate the interaction with the remote co-worker during the virtual walkabout of the user.

System and method for legitimate co-worker remote encounter interactions

A method for statistical data clarification is described. The method includes determining a relevance of statistical data according to a textual context of a statistical data detected within a document viewed by a user. The method also includes establishing a frame of reference for the statistical data according to the textual context and a determined relevance of the statistical data detected within the document viewed by the user. The method further includes generating, according to the frame of reference, at least one analogy that corresponds to the statistical data. The method also includes displaying the at least one analogy to the user to assist the user in understanding and using the statistical data.

System and method for improving understanding and decision making regarding statistical data

A system includes a processor configured to build a model of human behavior that can be assigned to a simulated human, where the model is trained on a dataset of interactions between humans, and parameters of the model can be adjusted. The processor is further configured to build a model of a task to be engaged in by a plurality of simulated humans, simulate interactions between the plurality of simulated humans, and display behavior of the simulated humans and information about the interactions between the simulated humans during simulated interactions.

Systems and methods for investigating interactions between simulated humans

In accordance with one embodiment, a system includes a processor, a memory module communicatively coupled to the processor, an NLP module communicatively coupled to the processor, and a set of machine-readable instructions stored in the memory module. The machine-readable instructions, when executed by the processor, direct the processor to perform operations including receiving a text data, and receiving a training text data for training one or more models of the NLP module. The operations also include generating, with a novice model of the NLP module, a novice suggestion based on the text data and the training text data to present an idea related to the text data, generating, with an expert model of the NLP module, an expert suggestion based on the text data and the training text data to present an idea elaborating on the text data, and outputting the novice suggestion and/or the expert suggestion.

Methods and systems for expert-novice guidance

Systems and methods for learning and managing robot user interfaces are disclosed herein. One embodiment generates, based on input data including information about past interactions of a particular user with a robot and with existing HMIs of the robot, a latent space using one or more encoder neural networks, wherein the latent space is a reduced-dimensionality representation of learned behavior and characteristics of the particular user, and uses the latent space as input to train a decoder neural network associated with (1) a new HMI distinct from the existing HMIs or (2) a particular HMI among the existing HMIs to alter operation of the particular HMI. The trained first decoder neural network is deployed in the robot to control, at least in part, operation of the new HMI or the particular HMI in accordance with the learned behavior and characteristics of the particular user.

Systems and methods for learning and managing robot user interfaces

A method to generate a digital avatar simulating a human for behavioral empathy and understanding is described. The method includes training a neural network to generate the digital avatar to simulate the human according to a vector of human attributes and generate responses in response to interactions with a user based on the vector of human attributes. The method also includes interacting, by the user, with the digital avatar, in which the digital avatar initially having a similar background and attributes as the user. The method further includes modifying, over time, the attributes of the digital avatar to represent a target background and a target set of attributes different from the user.

System and method of a digital persona for empathy and understanding

A method for inferring intent and discrepancies in a label coding scheme is described. The method includes compiling data indicating how one or more individuals labeled unstructured content according to the label coding scheme comprising a plurality of labels. The method also includes analyzing a context associated with a content labeled in a particular manner by the one or more individuals. The method further includes detecting discrepancies of meaning for a particular label used by the one or more individuals. The method also includes inferring a strategic thinking of the one or more individuals associated with the discrepancies of meaning detected for the particular label. The method further includes displaying recorded metadata associated with the strategic thinking and the discrepancies of meaning detected for the particular label between the one or more individuals regarding a coded dataset.

System and method to infer thoughts and a process through which a human generated labels for a coding scheme

A method for search construct validation is described. The method includes determining a construct of a search query recognized on a search engine of a third party webpage and related constructs represented in a plurality of search results generated based on the search query. The method includes mapping the determined construct to the related constructs represented in the plurality of search results generated based on the search query. The method includes generating a knowledge graph illustrating the mapping between the determined construct and the related constructs and a hierarchy and a strength of a conceptual relationship between the determined construct and the related constructs. The method includes displaying, via an interactive user interface, an interactive graph illustrating the mapping between the determined construct and the plurality of related constructs and the hierarchy and the strength of the conceptual relationship between the determined construct and the plurality of related constructs.

System and method for contextualizing and improving understanding of web search results

Methods, systems, and non-transitory machine-readable mediums for ranking on an absolute scale include displaying, on an electronic display, a first handle, a second handle, and an interactor, determining a value of the first handle and a value of the second handle based on their respective positions on the interactor, in response to a user dragging the first and second handles on the interactor, and determining a rank of the first and second handles based on the values of the first and second handles, in response to the user dragging the first and second handles on the interactor.

Ranked choice on an absolute scale

A method for an augmented reality goal assistant is described. The method includes detecting an object associated with a behavioral goal of a user. The method also includes altering an appearance of the object based on the behavioral goal of the user. The method further includes displaying the altered appearance of a detected object on an augmented reality headset, such that the altered appearance of the detected object is modified based on the behavioral goal of the user.

Growing community of inventors

San Francisco, CA, United States of America

Shabnam Hakimi