Salesforce Com, Inc.

Salesforce, Inc.

Saleforce.com, Inc.

Caiming Xiong

Richard Socher

Yingbo Zhou

Kazuma Hashimoto

Wenhao Liu

Bryan McCann

Ran Xu

Nitish Shirish Keskar

Chu Hong Hoi

James Bradbury

Tian Xie

Victor Zhong

Jia Li

Chien-Sheng Wu

Xinyi Yang

Huan Wang

Shashank Harinath

Govardana Sachithanandam Ramachandran

Jin Qu

Mingfei Gao

Tong Niu

Le Xue

Jiasen Lu

Zachary Alexander

Juan Carlos Niebles Duque

Ehsan Hosseini-Asl

Chen Xing

Feihong Wu

Stephen Merity

Shu Zhang

Sitaram Asur

Wojciech Kryscinski

Semih Yavuz

Alexis Roos

Ankit Chadha

Prafulla Kumar Choubey

Chetan Ramaiah

Lichao Sun

Silvio Savarese

Xugang Ye

Linqing Liu

Raffaella Buschiazzo

Teresa Anna Marshall

Junnan Li

Na Cheng

Shiva Kumar Pentyala

Weiran Wang

Ning Yu

Romain Paulus

Ka Chun Au

Xi Victoria Lin

Alexander Richard Trott

Alexander R Fabbri

Zeyuan Chen

Bo Pang

Wenzhuo Yang

Wenpeng Yin

Erik Lennart Nijkamp

Markus Anderle

Chenxi Li

Yongjun Chen

Lily Hu

Harshavardhan Utharavalli

Congying Xia

Chih-Yao Ma

Stephen Joseph Merity

Kai Sheng Tai

Luowei Zhou

Lav Raj Varshney

Akari Asai

Evan Albright

Hung Le

Nazneen Rajani

Jean-Marc Soumet

Roojuta Lalani

Thomas Archie Cook, Jr

Yixin Mao

Manju Vijayakumar

Jesse Vig

Stephan Zheng

Ye Liu

Michael Machado

Johnson Liu

Ankit Kumar

Victor Winslow Yee

Soujanya Lanka

Roberto Martín-Martín

Victor Yee

Juan Rodriguez

Jacob Nathaniel Huffman

Philippe Laban

Hao Liu

Huishuai Zhang

Michael Shum

Simo Arajarvi

Xilai Li

Tong Che

Peng Tang

Embodiments described herein provide a method for building an artificial intelligence (AI) agent to respond to a user query. The method includes: receiving a user query; retrieving a set of documents that are ranked based on respective relevance scores of a first type to the user query; generating a core question that filters out irrelevant texts from the user query; generating a first summary of a first document from the set of documents and a first reasoning output explaining how the first summary addresses the core question; generating a relevance score of a second type and a corresponding reranking for the first document based at least in part on a combination of the core question and the first reasoning output; generating a response to the user query using one or more top-ranked documents according to generated rerankings of the set of documents.

Systems and methods for a reasoning-intensive reranking based artificial intelligence conversation agent

Embodiments described herein provide a training framework for generative NLP models. Specifically, the training input, e.g., in the form of a sequence of tokens representing a user-agent dialogue, may be randomly masked for a few spans, which can be one or more tokens, one or more words, one or more sentences, or one or more paragraphs. These masked spans are replaced with their embeddings generated from pre-trained large language models are then used for training the NLP model.

Systems and methods for training a neural network model using knowledge from pre-trained large language models

Embodiments are directed to pre-training a transformer model using more parameters for sophisticated patterns (PSP++). The transformer model is divided into a held-out model and a main model. A forward pass and a backward pass are performed on the held-out model, where the forward pass determines self-attention hidden states of the held-out model and the backward pass determines loss of the held-out model. A forward pass on the main model is performed to determine a self-attention hidden states of the main model. The self-attention hidden states of the main model are concatenated with the self-attention hidden states of the held-out model. A backward pass is performed on the main model to determine a loss of the main model. The parameters of the held-out model are updated to reflect the loss of the held-out model and parameters of the main model are updated to reflect the loss of the main model.

Parameter utilization for language pre-training

Embodiments described herein provide a training framework for generative NLP models that operate on previously learnt knowledge from pretrained large language models. Specifically, to train an NLP model to generate a response to a user utterance (e.g., 'resolve login issue'), document embeddings of support IT documents encoded by a pretrained LLM are fed to an NLP decoder together with a training dialogue (e.g., a dialogue between the chat agent on how to “resolve login issue”). The NLP decoder can thus be trained by a causal language modeling loss computed based on the predicted next token and the ground-truth token from the training dialogue.

Embodiments described herein provides an intent prototypical contrastive learning framework that leverages intent similarities between users with different behavior sequences. Specifically, user behavior sequences are encoded into a plurality of user interest representations. The user interest representations are clustered into a plurality of clusters based on mutual distances among the user interest representations in a representation space. Intention prototypes are determined based on centroids of the clusters. A set of augmented views for user behavior sequences are created and encoded into a set of view representations. A contrastive loss is determined based on the set of augmented views and the plurality of intention prototypes. Model parameters are updated based at least in part on the contrastive loss.

Systems and methods for sequential recommendation

A method of training a neural network based three-dimensional (3D) encoder is provided. A first plurality of samples of a training dataset are generated using a first 3D model. An image generator with multi-view rendering is used to generate a plurality of two-dimensional (2D) images having different viewpoints of the first 3D model. A first language model is used to generate a plurality of texts corresponding to the plurality of 2D images respectively. A first text for a first image is generated by using one or more text descriptions generated by the first language model. A point cloud is generated by randomly sampling points in the 3D model. The first plurality of samples are generated using the plurality of 2D images, the corresponding plurality of texts, and the point cloud. The neural network based 3D encoder is trained using the training dataset including the first plurality of samples.

Systems and methods for multimodal pretraining for three-dimensional understanding models

Systems and methods for training a neural network based three-dimensional (3D) encoder for 3D classification are provided. A training dataset including a plurality of samples is received, wherein a first sample includes an image, a text, and a point cloud. An image encoder of a pretrained vision and language model is used to generate image representations for the image of the first sample. A text encoder of the pretrained vision and language model is used to generate text representations for the text of the first sample. The neural network based 3D encoder is used to generate 3D representations for the point cloud of the first sample. A loss objective is computed based on the image representations, text representations, and 3D representations. Parameters of the neural network based 3D encoder are updated based on the computed loss objective via backpropagation.

Systems and methods for learning unified representations of language, image, and point cloud for three-dimensional recognition

A method of training a neural network based three-dimensional (3D) encoder is provided. A training dataset is generated using a plurality of 3D models of a 3D model dataset. To generate a first sample of the training dataset, an image generator with multi-view rendering is used to generate a plurality of image candidates of a first 3D model. A word is chosen from metadata associated with the first 3D model. A language model is used to generate one or more text descriptions using the selected word and a plurality of prompts. A point cloud is generated by randomly sampling points in the 3D model. The first sample is generated to include a first image randomly selected from the plurality of image candidates, one or more text descriptions, and the point cloud is generated. The 3D encoder is trained using the training dataset including the first sample.

Embodiments described herein provide a video generation framework built on a decoupled multimodal cross-attention module to simultaneously condition the generation on both an input image and a text input. The video generation may thus be conditioned on the visual appearance of a target object reflected in the input image. In this way, zero-shot video generation may be achieved with little fine-tuning efforts.

Systems and methods for controllable video generation

A computing device may perform training of a set of machine learning models on a first data set associated with a first domain. In some examples, the training may include, for each machine learning model of the set of machine learning models, inputting, as values for a set of parameters of the respective sets of parameters and for an iteration of a set of iterations, a moving average of the set of parameters calculated over a threshold number of previous iterations. The computing device may select a set of model states that are generated during the training of the plurality of machine learning models based on a validation performance of the set of model states performed during the training. The computing device may then generate an ensembled machine learning model by aggregating the set of machine learning models corresponding to the set of selected model states.

Techniques for machine learning model selection for domain generalization

Embodiments described herein provide a two-stage model-agnostic approach for generating counterfactual explanation via counterfactual feature selection and counterfactual feature optimization. Given a query instance, counterfactual feature selection picks a subset of feature columns and values that can potentially change the prediction and then counterfactual feature optimization determines the best feature value for the selected feature as a counterfactual example.

Systems and methods for counterfactual explanation in machine learning models

Embodiments described herein provide a prompt-based transfer learning method that employs shared latent space prompt tuning). Specifically, a shared latent space is assumed, among all source and target tasks, where each vector in the space captures a basis skill to do a particular task. Given an instance (from either a source task or a target task), it is first encoded into an instance representation vector and then queries the latent space, which yields a skill vector for this instance. This vector modulates a frozen model, via soft prompts which are a simple prompt transformation (the prompt generator in FIG.) of the basis skill vector, to generate an answer for the instance. The latent space and prompt transformation are learned end-to-end in upstream pre-training on source tasks.

Systems and methods for shared latent space prompt tuning

Embodiments described herein provide a structured conversation summarization framework. A user interface may be provided which allows an agent to perform a conversation with a customer, for example regarding resolving a customer support issue. Utterances by both the agent and customer may be stored, and at the end of the conversation, the utterances may be used to generate a structured summary. The structured summary may include components such as a general summary, an issue summary, and a resolution summary. Using neural network models and heuristics, each component of the summary may be automatically generated.

Systems and methods for structured conversation summarization

Embodiments described herein provide a system for three-dimensional (3D) object detection. The system includes an input interface configured to obtain 3D point data describing spatial information of a plurality of points, and a memory storing a neural network based 3D object detection model having an encoder and a decoder. The system also includes processors to perform operations including: encoding, by the encoder, a first set of coordinates into a first set of point features and a set of object features; sampling a second set of point features from the first set of point features; generating, by attention layers at the decoder, a set of attention weights by applying cross-attention over at least the set of object features and the second set of point feature, and generate, by the decoder, a predicted bounding box among the plurality of points based on at least in part on the set of attention weights.

Systems and methods for attention mechanism in three-dimensional object detection

Some embodiments of the current disclosure disclose methods and systems for training for training a natural language processing intent classification model to perform few-shot classification tasks. In some embodiments, a pair of an utterance and a first semantic label labeling the utterance may be generated and a neural network that is configured to perform natural language inference tasks may be utilized to determine the existence of an entailment relationship between the utterance and the semantic label. The semantic label may be predicted as the intent class of the utterance based on the entailment relationship and the pair may be used to train the natural language processing intent classification model to perform few-shot classification tasks.

Systems and methods for few-shot intent classifier models

Growing community of inventors

Palo Alto, CA, United States of America

Caiming Xiong