Amazon Technologies, Inc.

Zhiguo Wang

Bing Xiang

Ramesh M Nallapati

Sudipta Sengupta

Patrick Ng

Stephen Michael Ash

Sharanabasappa Parashuram Revadigar

Timothy Jones

Jun Wang

Hanbo Li

Gregory David Adams

Yung Haw Wang

Rishav Chakravarti

Jiarong Jiang

Peng Xu

Mukul Vijay Karnik

Cicero Nogueira Dos Santos

Douglas Scott Cerny

Henghui Zhu

Nanyan Li

Stephanie Weeks

Xiaofei Ma

Zhiheng Huang

Anuj Chauhan

Donald Harold Rivers Weidner

Deepak Shantha Murthy

Andrew Oliver Arnold

Dimitrios Soulios

Saurabh Kumar Singh

Yong Yuan

Yifan Gao

Dejiao Zhang

Ankit Sultania

Krishnakumar Rajagopalan

Dong Wang

Feng Nan

Wuwei Lan

Sheng Zhang

Jean-Pierre Dodel

Milan Saini

Techniques for handling natural language query processing are described. In some examples, entities are recognized during an entity recognition phase and then relations between those entities are determined. Those relations are fed to an entity linker to help the linker link candidate to columns and/or a intent representation generator to help parse multiple values and column pairs of a natural language query.

Natural language query processing

A schema and cell value aware Named Entity Recognition (NER) model is used to perform natural language queries. Natural language queries may be received via an interface of a natural language query processing system. A fuzzy search may be performed that allows non-exact matches for column names or cell values of data sets potentially used to answer the natural language query. An NER model that adds a type embedding for an exact match of a column name or cell found in the fuzzy search that corresponds to a span of one or more words may be applied as part of generating the entity prediction for the natural language query. One or more queries to at least one of the data sets may be performed to return a result to the natural language query using the entity prediction generated by the NER machine learning model.

Schema and cell value aware named entity recognition model for executing natural language queries

Techniques for handling natural language query processing are described. In some examples, a sequence-to-sequence model is used to handle a natural language query. Post-processing of a result of the sequence-to-sequence model utilizes fine-grained information from an entity linker. In some examples, the sequence-to-sequence model and aspects of a natural language query pipeline are used to handle a natural language query.

Techniques for predicting an answer to a question using a machine learning model are described. In some examples, the model predicts one or more answers to the question by: predicting at least two answers to the question using a first component of the question-answer model from a set of passages, generating, using a second component of the question-answer model, at least one question for each of the predicted at least two answers, and performing roundtrip predictions until each generated question only has one answer.

Questions disambiguation using generative evidence fusion and round-trip prediction

Interactive assistances for executing natural language queries to data sets may be performed. A natural language query may be received. Candidate entity linkages may be determined between an entity recognized in the natural language query and columns in data sets. The candidate linkages may be ranked according to confidence scores which may be evaluated to detect ambiguity for an entity linkage. Candidate entity linkages may be provided to a user via an interface to select an entity linkage to use as part of completing the natural language query.

Interactive assistance for executing natural language queries to data sets

Multiple stage filtering may be implemented for natural language query processing pipelines. Natural language queries may be received at a natural language query processing system and processed through a query language processing pipeline. The query language processing pipeline may filter candidate linkages for a natural language query before performing further filtering of the candidate linkages in the natural language query processing pipeline as part of generating an intermediate representation used to execute the natural language query.

Multiple stage filtering for natural language query processing pipelines

Query restatements may be provided for explaining natural language query results. A natural language query is received at a natural language query processing system. An intermediate representation of the natural language query is generated for executing the natural language query. The intermediate representation is translated into a natural language restatement of the natural language query. The natural language restatement is provided with a result of the natural language query via an interface of the natural language query processing system.

Providing query restatements for explaining natural language query results

Techniques for displaying a search are described. An exemplary method includes receiving a search query, performing the search query on a plurality of documents, the documents including text passages, to generate a search query result, determining an aspect of the search query result that has a confidence value that exceeds a first confidence threshold with respect to its relevance to the search query; and, displaying the search result including an emphasis on the aspect of the result exceeds the first confidence threshold.

Systems, apparatuses, and methods for providing emphasis in query results

Techniques for generation of synthetic queries from customer data for training of document querying machine learning (ML) models as a service are described. A service may receive one or more documents from a user, generate a set of question and answer pairs from the one or more documents from the user using a machine learning model trained to predict a question from an answer, and store the set of question and answer pairs generated from the one or more documents from the user. The question and answer pairs may be used to train another machine learning model, for example, a document ranking model, a passage ranking model, a question/answer model, or a frequently asked question (FAQ) model.

Systems, apparatuses, and methods to generate synthetic queries from customer data for training of document querying machine learning models

Techniques for searching documents are described. An exemplary method includes receiving a document search query; querying at least one index based upon the document search query to identify matching data; fetching the identified matched data; determining one or more of a top ranked passage and top ranked documents from the set of documents based upon one or more invocations of one or more machine learning models based at least on the fetched identified matched data and the document search query; and returning one or more of the top ranked passage and the proper subset of documents.

Systems, apparatuses, and methods for document querying

Growing community of inventors

Great Neck, NY, United States of America

Zhiguo Wang