Veritone Alpha, Inc.

Clearsight Systems Inc.

Hynomics Corporation

Microsoft Technology Licensing, LLC

Veritone, Inc.

Vcritonc Alpha, Inc.

Wolf Kohn

Yanfang Shen

Michael Luis Sandoval

Jonathan Cross

Jordan Makansi

Vishnu Vettrivel

David Talby

Jason Knox

Mike Lazarus

Anil Nerode

Vladimir Brayman

David Kettler

Xiaofeng Zhang

Chad Steelberg

Michael Victor Ehrenberg

Zelda B Zabinsky

Rekha Nanda

Brandon Weiss

Girish Thirukkurungudi Sekar

John James

Leslie Gene Engelbrecht

Andrew Elvin Badgett

Pengbo Zhang

Brian Schaper

Neel Master

Techniques are described for implementing an automated control system to control operations of a target physical system, such as production of electrical power in an electrical grid. The techniques may include determining how much electrical power for each of multiple producers to supply for each of a series of time periods, such as to satisfy projected demand for that time period while maximizing one or more indicated goals, and initiating corresponding control actions. The techniques may further include repeatedly performing automated modifications to the control system's ongoing operations to improve the target system's functionality, by using reinforcement learning to iteratively optimize particles generated for a time period that represent different state information within the target system, to learn one or more possible solutions for satisfying projected electrical power load during that time period while best meeting the one or more defined goals.

Controlling operation of an electrical grid using reinforcement learning and multi-particle modeling

Techniques are described for implementing automated control systems to control operations of target physical systems and/or their components (e.g., a fuel cell, wind turbine, HVAC unit, etc.), such as based at least in part on models of their dynamic non-linear behaviors that are generated by gathering and analyzing information about their operations under varying conditions. The techniques may include, for each of multiple levels of inputs to the system/component and/or other factors, injecting a corresponding signal input into the system/component, and using active sensors to collect time changes of the responses to these pulses. Information about the inputs and the responses is used to generate an incremental parametric model representing the internal state and behavioral dynamics of the system/component, which is further used to control additional ongoing operations of the system/component (e.g., to control whether and how much output is produced in a current or future time period).

Using active non-destructive state excitation of a physical system to model and control operations of the physical system

Techniques are described for implementing automated control systems that manipulate operations of specified target systems, such as by modifying or otherwise manipulating inputs or other control elements of the target system that affect its operation (e.g., affect output of the target system). An automated control system may in some situations have a distributed architecture with multiple decision modules that each controls a portion of a target system and operate in a partially decoupled manner with respect to each other, such as by each decision module operating to synchronize its local solutions and proposed control actions with those of one or more other decision modules, in order to determine a consensus with those other decision modules. Such inter-module synchronizations may occur repeatedly to determine one or more control actions for each decision module at a particular time, as well as to be repeated over multiple times for ongoing control.

Determining control actions of decision modules

Techniques are described for implementing automated control systems that each control or otherwise manipulate, for a target system having one or more battery cells each having internal components that include one or more internal supercapacitor components in parallel with at least one battery component, usage operations for one of the internal components of one of the battery cells, with the usage operations for the internal components of a particular battery cell being synchronized or otherwise coordinated to protect the battery component(s) of the battery cell while satisfying other criteria (e.g., to increase battery cell life and/or reduce power dissipation). In at least some situations, the target system is an electric vehicle, and the automated control systems control the electric vehicle's battery cells to provide electrical power to the motor during acceleration and constant speed driving, and to store electrical power in the battery cells during braking or other deceleration.

Controlling ongoing usage of a battery cell having one or more internal supercapacitors and an internal battery

Techniques are described for implementing automated control systems to control operations of target physical systems including batteries, such as based at least in part on models of the batteries' dynamic behaviors that are generated by gathering and analyzing information about the batteries' operations under varying conditions. The techniques may include, for each of multiple charge levels of a battery and for each of multiple resistive loads, injecting multi-frequency microvolt pulses into the battery, and using sensors to collect time changes of the responses to these pulses. Information about the inputs and the responses is then analyzed and used to generate an incremental parametric state model representing the internal dynamics of the battery, which is further used to control additional ongoing battery operations (e.g., to control whether and how much power is supplied to and/or extracted from the battery in a current or future time period).

Using battery state excitation to model and control battery operations

An automated control system to control at least some operations of one or more target physical systems that each includes one or more batteries. The described techniques may include determining whether and how much power to supply for each of a series of time periods, and implementing the determined power amount for a time period by determining and setting one of multiple impedance level control values of an associated actuator component. Repeated automated operations of this type may include using parametric linear approximation to determine one of multiple enumerated control values that best satisfies one or more defined goals at a given time in light of current state information (e.g., current output from the battery, voltage from the battery, battery temperature, etc.), such as by repeatedly determining an improved distribution function over the control values, and propagating it over multiple future time periods.

Controlling ongoing battery system usage via parametric linear approximation

Techniques are described for implementing automated control systems that manipulate operations of specified target systems, such as by modifying or otherwise manipulating inputs or other control elements of the target system that affect its operation (e.g., affect output of the target system). An automated control system may in some situations have a distributed architecture with multiple decision modules that each controls a portion of a target system, and may further have one or more components that interacts with one or more users to obtain a description of the target system, including restrictions related to the various elements of the target system, and one or more goals to be achieved during control of the target system. The component(s) then perform various automated actions to generate, test and deploy one or more executable decision modules to use in performing the control of the target system based on the user-specified information.

Cooperative distributed control of target systems

Techniques are described for implementing automated control systems that repeatedly perform automated modifications to control system actuator components' ongoing operations to improve functionality for target battery systems, such as to reduce power dissipation while performing other battery power use activities to maximize battery life. Controlling a battery's usage may include using a DC-to-DC amplifier, and the repeated automated modifications may include modifying the state of the DC-to-DC amplifier actuator to adjust a level of resistance and/or an amount of time during which power is supplied. The repeated automated modifications may be performed to repeatedly reduce the distance between the current battery performance and an idealized version of the battery performance (e.g., a version with no power dissipation).

Controlling ongoing battery system usage while repeatedly reducing power dissipation

Techniques are described for implementing automated control systems that repeatedly perform automated modifications to control system actuator components' ongoing operations to improve functionality for electrical devices in target systems, such as to reduce power dissipation while using the electrical devices. The described techniques further include synchronizing a particular control system's state improvements with corresponding control system state improvements being performed for one or more other control systems that are each controlling one or more distinct electrical devices in the target system(s), so as to improve the collective control system functionality according to one or more criteria (e.g., to reduce power dissipation)&#x2014;such synchronizing may include, for example, generating a mean field representation of the overall control system state for the target system(s) and using the mean field representation to improve the overall control system state.

Managing coordinated improvement of control operations for multiple electrical devices to reduce power dissipation

Techniques are described for implementing automated control systems for target battery systems based at least in part on battery state information gathered from active excitation of the batteries, such as to maximize battery life while performing other battery power use activities. The excitation of a target battery system may occur while it is in use, by repeatedly introducing small defined variations as input to the battery system while the battery system is otherwise used to supply or receive electricity. Corresponding small variations in output of the battery system from the excitation activities are then measured by hardware sensors, aggregated and analyzed to generate a current model of the internal state of the one or more batteries, and then used to assist in controlling further operations of the battery system, including in some cases to update a previously existing model of the battery system.

Using battery state excitation to control battery operations

Techniques are described for implementing automated control systems to control operations of specified physical target systems, such as with one or more batteries used to store and provide electrical power. Characteristics of each battery's state may be used to perform automated control of DC power from the battery, such as in a real-time manner and to optimize long-term operation of the battery. In some situations, multiple batteries are controlled by using multiple control systems each associated with one of the batteries, and with overall control being coordinated in a distributed manner using interactions between the multiple control systems. A system that includes one or more batteries to be controlled may further include additional components in some situations, such as one or more electrical sources and/or one or more electrical loads, with one non-exclusive example of a type of such system being one or more home electrical power systems.

Using battery DC characteristics to control power output

Techniques are described for implementing automated control systems to control operations of specified physical target systems. In some situations, the described techniques include forecasting future values of parameters that affect operation of a target system, and using the forecasted future values as part of determining current automated control actions to take for the target system&#x2014;in this manner, the current automated control actions may be improved relative to other possible actions that do not reflect such forecasted future values. Various automated operations may also be performed to improve the forecasting in at least some situations, such as by combining the use of multiple different types of forecasting models and multiple different groups of past data to use for training the models, and/or by improving the estimated internal non-observable state information reflected in at least some of the models.

Using forecasting to control target systems

Techniques are described for implementing automated control systems to control operations of specified physical target systems. In some situations, the described techniques include obtaining and analyzing sensor data about operations of a target system in order to generate an improved model of a current state of the target system, and using the modeled state information as part of determining further current and/or future automated control actions to take for the target system, such as to generate a function and/or other structure that models internal operations of the target system, rather than merely attempting to estimate target system output from input without understanding the internal structure and operations of the target system.

Using sensor data to assist in controlling a target system by modeling the functionality of the target system

A set of SKUs is divided into a plurality of different Mean Field clusters, and a tracker (or sensor) is identified for each cluster. Product decisions for each Mean Field cluster are generated based on the tracker (or sensor) and each Mean Field cluster is then deconstructed to obtain product decisions for individual SKUs in the Mean Field cluster.

Growing community of inventors

Seattle, WA, United States of America

Wolf Kohn