Microsoft Technology Licensing, LLC

Christian Canton

John S Campbell

Benjamin Edward Rampson

Samuel C Radakovitz

Carlos Augusto Otero

Matthew Hart Fichtner

Johnny S Campbell

Allison Jane Rutherford

Joseph John McDaid

Simon Peyton Jones

Jim Sun

John David Sully

Andrew James Becker

Advait Sarkar

Christopher John Gross

Marc Manuel Johannes Brockschmidt

Sjoerd Roelof De Jong

Robert David Ohn Tinn

Andrew William Stegmaier

Juliana Patricia Vicente Franco

Sneha Khullar

Vikas Yadav

Andrew Donald Gordon

Neil Toronto

Catherine Anne Harley

Steven Paul Kraynak

Christopher Evan Oslund

Carlos A Ortero

Anusha Iyer

George Chalhoub

Various embodiments of the present technology generally relate to enhancements to spreadsheet tables. More specifically, embodiments of the present technology include systems and methods for incorporating various table column operations into table columns headers, thereby simplifying the act of propagating a desired effect across a range that exactly matches the table column. In an embodiment, a spreadsheet application detects a cell event in a spreadsheet, wherein the cell event affects one or more cells of the spreadsheet, determines that a cell of the one or more cells is inside a range that makes up a table in the spreadsheet, identifies a table column of the table to which the cell belongs, identifies metadata for the table column, wherein the metadata for the table column comprises column configuration instructions, and applies the column configuration instructions to the cell.

Table column operations for spreadsheets

The present disclosure describes a value referred to as a compound object that stores multiple values in a single cell, wherein those multiple values are organized according to a defined structure. The compound object may store multiple values according to a known defined data structure such as, for example, a record, vector, matrix, table, or array. In other embodiments, the compound object may store multiple values as any nested combination of any one of the known or user-defined data structures. Each of the values stored in the compound object are individually referenceable and can fully participate with spreadsheet functionality including calculations, referencing, and formatting.

Compound data objects

Systems and methods for charting images and/or attributes of images associated with a spreadsheet are provided. For instance, when an image is associated with a spreadsheet, the image may be treated as a new type of data within the spreadsheet. In some aspects, a plurality of images may be associated with a spreadsheet, e.g., within a single cell or within a range of cells. In some aspects, the images themselves, as well as image data (e.g., pixelated data, etc.), image attributes (e.g., opacity, color palette, resolution, aspect ratio, image dimensions, author, creation date and/or time, file name, tags, file size, GPS location information, etc.), and/or spreadsheet data (e.g., values in cells, user comments, etc.) may be incorporated into a report (e.g., a chart) using a spreadsheet charting function, either automatically or by user selection.

Images on charts

Systems, methods, and software are disclosed herein for enhancing functions and formulas in spreadsheets. A computing apparatus detects a beginning of a formula in a cell of a spreadsheet. In response to detecting the beginning of the formula, the computing apparatus identifies one or more vector representations of a context of the cell and supplies the one or more vector representations as input to one or more machine learning models. The one or more machine learning models produce output comprising one or more suggested functions for the formula and one or more suggested operands, which the computing apparatus presents in a user interface to the spreadsheet.

Suggested functions for formulas in spreadsheets

Described herein is a system and method for associating images with one or more cells in a spreadsheet application. As described, one or more images may be associated with a single cell in a spreadsheet application or it may be associated with a range of cells in the spreadsheet application. Information about the image, such as metadata, pixel information or other parameters, may be retrieved from the image. Once retrieved, a calculation engine may perform one or more calculations on the information in order to change an appearance of the image.

Calculations on images within cells in spreadsheets

Systems for performing operations on dynamic data associated with cells of a spreadsheet are provided. Both dynamic data and static data may be associated with a single cell of the spreadsheet. Upon association, parameters (including stream attributes, video attributes, image attributes and audio attributes) may be manipulated by a user, providing dynamic data processing functionality within a spreadsheet. Controls may be provided for playing the dynamic data and/or playing the dynamic data in response to spreadsheet data satisfying a condition. Operations for inserting text transcriptions (e.g., speech-to-text) of an audio track associated with dynamic data as subtitles may further be provided. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on parameters of associated dynamic data.

Operations on dynamic data associated with cells in spreadsheets

Systems and methods for charting audio files and/or attributes of audio files associated with a spreadsheet are provided. For instance, when an audio file is associated with a spreadsheet, the audio file may be treated as a new type of data within the spreadsheet. In some aspects, a plurality of audio files may be associated with a spreadsheet, e.g., within a single cell or within a range of cells. In some aspects, the audio files themselves, as well as audio data (e.g., modulated data representing soundwaves, etc.), audio attributes (e.g., frequency, amplitude, sampling rate, codec, bitrate, volume, pitch, speed, channel, audio effects, author/artist, creation date and/or time, file name, file size, duration, etc.), and/or spreadsheet data (e.g., values in cells, user comments, etc.) may be incorporated into a report (e.g., a chart) using a spreadsheet charting function, either automatically or by user selection.

Sound on charts

The present disclosure is directed to systems and methods for implementing rich data types in a spreadsheet application. Generally, a value being of a rich data type is as a type of value that has context and established relationships with other types of data. In particular, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data.

Rich data types

Described herein is a system and method for associating audio files with one or more cells in a spreadsheet application. As described, one or more audio files may be associated with a single cell in a spreadsheet application or it may be associated with a range of cells in the spreadsheet application. Information about the audio file, such playback properties and other parameters, may be retrieved from the audio file. Once retrieved, a calculation engine of the spreadsheet application may perform one or more calculations on the information in order to change the content of audio file, the playback of the audio files and so on.

Calculations on sound associated with cells in spreadsheets

Systems, methods, and software are disclosed herein for enhancing functions and formulas in spreadsheets. A computing apparatus detects a beginning of a formula in a cell of a spreadsheet. In response to detecting the beginning of the formula, the computing apparatus identifies a vector representation of a context of the cell and supplies the vector representation as input to one or more machine learning models. The one or more machine learning models produce output comprising one or more suggested functions for the formula and one or more suggested operands, which the computing apparatus presents in a user interface to the spreadsheet.

Form-based formula editing in spreadsheets

The present disclosure relates to enriching a compound object with data provided by a third party service, database, or local database. In some embodiments, this is performed by receiving an entry of a value in a cell of a spreadsheet; determining whether the value is related to information provided by a service; based on a determination that the value is related to information provided by the service, selecting the service; displaying a field selection user interface; receiving a selection of one or more fields from the field selection user interface; receiving one or more values associated with the selected one or more fields; and enriching a compound object based on the selected one or more fields and associated one or more values.

Enriched compound data objects

Systems for associating audio files with cells of a spreadsheet are provided. Both audio files and data may be associated with a single cell of the spreadsheet. An audio file may be recorded, retrieved from storage, or converted from a document (e.g., using text-to-speech technology) for association with a spreadsheet. Upon association, audio parameters may be viewed and/or manipulated by a user, providing audio processing functionality within a spreadsheet. Controls may be provided for listening to the audio file and/or playing the audio file in response to spreadsheet data satisfying a condition. Text transcriptions (e.g., speech-to-text) of audio files may be inserted into the spreadsheet. For low vision users, audio transcriptions (e.g., text-to-speech) of data may be generated and 'played' for the user. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on audio parameters of associated audio files.

Operations on sound files associated with cells in spreadsheets

Aspects of the present disclosure further provide the ability to define, among other features, the layout of the cell view of the cell in which the compound object is stored as well as the card view of the compound object. Aspects of the present disclosure further provide the ability to modify properties associated with the values stored in a compound object, including, but not limited to properties of calculated values, value formatting, and permissions.

Extensibility of compound data objects

Technology is disclosed herein for handing approximate (or uncertain) values in spreadsheet applications. More specifically, the technology describes spreadsheet applications that support arrays or sets of approximate (or uncertain) values as native entities. An approximate (or uncertain) value may be the value of a cell of the spreadsheet that is resolvable by formula, charts and other functionalities. In some implementations, approximate values may include a range of data and a probability distribution that can be automatically created by the spreadsheet application, generated based on context, input by the user, etc. Because the approximate (or uncertain) value is natively available, it can be incorporated in a spreadsheet like other values. Additionally, the approximate (or uncertain) values can automatically propagate through a spreadsheet calculation to obtain a final approximate result. The techniques also describe various ways to represent uncertain values in cells and to visualize the probability distribution.

Natively handling approximate values in spreadsheet applications

In non-limiting examples of the present disclosure, systems, methods and devices for interacting with data in a productivity application are presented. A plurality of values associated with the productivity application may be analyzed to determine whether they include a value that can be added to a set comprising a plurality of values with a set data type upon which the productivity application can execute a plurality of set operations. An indication to add at least one of the analyzed values as a member of the set may be received. At least one of the analyzed values may be added as a member of the set. An indication to perform a set operation associated with the set may be received and performed, and the result of the performed set operation may be displayed on a productivity application user interface.

Growing community of inventors

Bellevue, WA, United States of America

Christian Canton