Microsoft Technology Licensing, LLC

Carlos Augusto Otero

John S Campbell

Christian Canton

Benjamin Edward Rampson

Samuel C Radakovitz

Uhl Albert

Matthew Hart Fichtner

Allison Jane Rutherford

Charles David Ellis

Daniel Yancy Parish

Dominique Fortier

Aaron Lamar Wilson

Simon Peyton Jones

Steve Tullis

Liyin Xue

John David Sully

Pablo Rochat

Andrew James Becker

Christopher John Gross

Catherine William Neylan

Jakob Peter Nielsen

Ehab Sobhy Deraz

Sam C Radakovitz

Ashvini Sharma

Annie Colonna

Johnny S Campbell

Eric W Patterson

Safiya Bhojawala

Micah James Myerscough

Catherine Anne Harley

Caoimhe Grace Dowling

Steven Paul Kraynak

Daniya Alisa Petal Ulgen

Samrin Iqbal

Aftabalam Nooruddin Azmi

Jake Elliot Armstrong

Andrey A Zaikin

Howard Su

Sameer Surendra Jagdale

Olivia Jean Thomas

Tien Bui

Fei Wu

Samuel Chow Radakovitz

Matthew Fichtner

Technology is disclosed herein for the integration of spreadsheet environments with LLM services. In an implementation, an application receives a natural language input from a user associated with a spreadsheet hosted by the application. The application generates a prompt that includes metadata about the spreadsheet and identifies a required format for descriptions of pivot tables. The application sends a prompt to a large language model (LLM) service to elicit a reply that includes a description of the pivot table having the required format. The application receives a reply to the prompt from the LLM service that includes the description of the pivot table in the required format. The application generates pivot table according to the reply from the LLM service.

Large language model integrations for pivot tables in spreadsheet environments

Natural gestures for interacting with spreadsheet documents are provided. A user may interact with a spreadsheet document using a variety of touch-based gestures. Gestures applied to a spreadsheet document may be used for making structural and display changes to the document. For example, gestures may be used on the spreadsheet document for inserting new columns and rows; for revealing hidden columns and rows; for deleting columns and rows; for extending functionalities across columns and rows; for moving objects displayed in a spreadsheet document; and for navigating various parts of a spreadsheet document.

Natural quick function gestures

The present disclosure describes a value referred to as a compound object that stores multiple values in a single cell, wherein those multiple values are organized according to a defined structure. The compound object may store multiple values according to a known defined data structure such as, for example, a record, vector, matrix, table, or array. In other embodiments, the compound object may store multiple values as any nested combination of any one of the known or user-defined data structures. Each of the values stored in the compound object are individually referenceable and can fully participate with spreadsheet functionality including calculations, referencing, and formatting.

Compound data objects

Described herein is a system and method for associating images with one or more cells in a spreadsheet application. As described, one or more images may be associated with a single cell in a spreadsheet application or it may be associated with a range of cells in the spreadsheet application. Information about the image, such as metadata, pixel information or other parameters, may be retrieved from the image. Once retrieved, a calculation engine may perform one or more calculations on the information in order to change an appearance of the image.

Calculations on images within cells in spreadsheets

Systems for performing operations on dynamic data associated with cells of a spreadsheet are provided. Both dynamic data and static data may be associated with a single cell of the spreadsheet. Upon association, parameters (including stream attributes, video attributes, image attributes and audio attributes) may be manipulated by a user, providing dynamic data processing functionality within a spreadsheet. Controls may be provided for playing the dynamic data and/or playing the dynamic data in response to spreadsheet data satisfying a condition. Operations for inserting text transcriptions (e.g., speech-to-text) of an audio track associated with dynamic data as subtitles may further be provided. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on parameters of associated dynamic data.

Operations on dynamic data associated with cells in spreadsheets

The present disclosure is directed to systems and methods for implementing rich data types in a spreadsheet application. Generally, a value being of a rich data type is as a type of value that has context and established relationships with other types of data. In particular, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data.

Rich data types

Systems, methods, and software for mobile data visualization frameworks are provided herein. An exemplary method includes, determining data insight candidates for presentation on the mobile computing device that describe analysis of a target dataset, determined based at least on data analysis preferences associated with processing one or more past datasets, and where each of the data insight candidates includes at least one insight object directed to the target dataset and is described by object metadata that indicates at least a processing lineage used to produce the at least one insight object. The method includes selecting a presentation detail level for displaying the data insight candidates on the mobile computing device based at least on properties of the mobile computing device, and generating one or more insight views for presentation on the mobile computing device.

Mobile data insight platforms for data analysis

The present disclosure relates to enriching a compound object with data provided by a third party service, database, or local database. In some embodiments, this is performed by receiving an entry of a value in a cell of a spreadsheet; determining whether the value is related to information provided by a service; based on a determination that the value is related to information provided by the service, selecting the service; displaying a field selection user interface; receiving a selection of one or more fields from the field selection user interface; receiving one or more values associated with the selected one or more fields; and enriching a compound object based on the selected one or more fields and associated one or more values.

Enriched compound data objects

Systems for associating audio files with cells of a spreadsheet are provided. Both audio files and data may be associated with a single cell of the spreadsheet. An audio file may be recorded, retrieved from storage, or converted from a document (e.g., using text-to-speech technology) for association with a spreadsheet. Upon association, audio parameters may be viewed and/or manipulated by a user, providing audio processing functionality within a spreadsheet. Controls may be provided for listening to the audio file and/or playing the audio file in response to spreadsheet data satisfying a condition. Text transcriptions (e.g., speech-to-text) of audio files may be inserted into the spreadsheet. For low vision users, audio transcriptions (e.g., text-to-speech) of data may be generated and 'played' for the user. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on audio parameters of associated audio files.

Operations on sound files associated with cells in spreadsheets

Systems, methods, and software for developing application usage information are provided herein. An exemplary method includes identifying data sources that relate to application usage activity of one or more users, determining activity signals related to at least data analysis by the one or more users from among the application usage activity, and applying the activity signals to a knowledge graphing service that infers data analysis preferences from among the activity signals. The method also includes providing ones of the data analysis preferences for use by data insight services that establish data insight objects visualizing target datasets based at least on the ones of the data analysis preferences.

Application usage signal inference and repository

A smart fill feature is provided, which may be utilized to provide suggestions to a user and to prepopulate fill results in a spreadsheet. Characteristics associated with a set of data may be recognized and used to help determine fill results Suggestions may be determined from internal and or/external data sources, and may use contextual information in a data set to determine what a user may be trying to accomplish. External data sources may include one or more Internet data sources or internal corporate databases, providing a large amount of data from which to search for potential fill results. A split column command may be used to split a column into two or more columns. Data may be split between columns or combined by various methods, which may include, by example, by direct manipulation via tokens, or via a slider UI.

Method and system for providing autofill of data

In non-limiting examples of the present disclosure, systems, methods and devices for assisting with providing a dependency-based presence indication are presented. An indication that a first application instance of a co-authored file is active may be received. An indication that a second application instance associated with the co-authored file is concurrently active with the first application instance may be received. A data-modification indication that data affecting at least one object displayed on a user interface of a computing device executing the first application is being accessed by a second computing device executing the second application may be received. The at least one object may be caused to be highlighted on the user interface of the computing device executing the first application instance based on the received data-modification indication.

Dependency-based presence for co-authored documents

The techniques described herein facilitate supporting remote micro-services from cloud-based analytics platforms as native functions in spreadsheet applications, e.g., Microsoft Excel&#xae;. In an implementation, a method of supporting remote micro-services as native functions in a spreadsheet application is disclosed. The method includes accessing a listing identifying at least one micro-service that is available for use by a user of a spreadsheet application. The at least one micro-service is remotely located in a cloud service platform. The method further includes obtaining a schema associated with the at least one remote micro-service, generating a translation model based on the schema, and registering the skeleton spreadsheet function as a native function in the spreadsheet application. The translation model maps between the at least one remote micro-service and a skeleton spreadsheet function.

Techniques for supporting remote micro-services as native functions in spreadsheet applications

The techniques described herein facilitate proactively discovery of remote micro-services by spreadsheet applications, e.g., Microsoft Excel&#xae;. In an implementation, a method of operating a spreadsheet application to proactively discover remote micro-services based on credential information is disclosed. The method includes identifying the credential information associated with a user of the spreadsheet application responsive to detecting a micro-service updating event and proactively discovering one or more micro-services that are available to the user of the spreadsheet application through a cloud service platform based on the credential information. The method further includes persisting a list including the one or more micro-services that are available to the user of the spreadsheet application based on the credentials.

Credential-based proactive discovery of remote micro-services by spreadsheet applications

Growing community of inventors

Seattle, WA, United States of America

Carlos Augusto Otero