Microsoft Technology Licensing, LLC

Adobe, Inc.

Arpit Ajay Narechania

Ryan A Rossi

Eunyee Koh

Bongshin Lee

Gonzalo Alberto Ramos

Fan Du

Atanu Ranjan Sinha

Sonali Surange

Adam Fourney

Shunan Guo

Vasanthi Holtcamp

Jane Elizabeth Hoffswell

Saurabh Mahapatra

John Anderson

Embodiments provide systems, methods, and computer storage media for management, assessment, navigation, and/or discovery of data based on data quality, consumption, and/or utility metrics. Data may be assessed using attribute-level and/or record-level metrics that quantify data: 'quality'—the condition of data (e.g., presence of incorrect or incomplete values), its “consumption”—the tracked usage of data in downstream applications (e.g., utilization of attributes in dashboard widgets or customer segmentation rules), and/or its “utility”—a quantifiable impact resulting from the consumption of data (e.g., revenue or number of visits resulting from marketing campaigns that use particular datasets, storage costs of data). This data assessment may be performed at different stages of a data intake, preparation, and/or modeling lifecycle. For example, an interactive tree view may visually represent a nested attribute schema and attribute quality or consumption metrics to facilitate discovery of bad data before ingesting into a data lake.

Interactive tree representing attribute quality or consumption metrics for data ingestion and other applications

In example, a natural language input is processed to generate a formal query that is executed to retrieve data from a data store. An indication as to which subparts of the natural language input were used to generate the formal query may be presented to a user. The user may debug the query, such that associations between natural language input subparts and formal query subparts may be changed, added, or removed by the user. Further, a set of steps may be generated that provide an indication to the user as to how the formal query is executed, for example using sample data from the data store. The user may manipulate the sample data, thereby causing the presented steps to be updated accordingly. Once the user has made adjustments and has finished debugging the query, the revised formal query may be executed to retrieve updated data from the data store.

Natural language query processing and debugging

Growing community of inventors

Atlanta, GA, United States of America

Arpit Ajay Narechania