Microsoft Technology Licensing, LLC

Intuit, Inc.

Babak Seyed Aghazadeh

Eric P Traut

Ashish Kapoor

Debasish Das

Marcos De Moura Campos

Systems and methods for controlling traffic flow for software experimentation are disclosed. An example method includes receiving a first traffic from a first plurality of users to receive an existing feature or a new feature, determining, from the first traffic, a first portion of the first plurality of users to receive the existing feature (with the first portion bounded by a first lower threshold and/or a first upper threshold) and a second portion of the first plurality of users to receive a new feature (with the second portion bounded by a second lower threshold and/or a second upper threshold). The method also includes providing the existing feature to the first portion, providing the new feature to the second portion, receiving feedback from the first plurality of users, and adjusting the first portion and/or the second portion based on the feedback and based on the bounds.

Machine learning based traffic flow control for adaptive experimentations

A method of training a machine learning system. The method comprises collecting a first simulation dataset derived from a computer simulating a hypothetical scenario with a first simulation configuration having a first degree of fidelity. The method further comprises collecting a second simulation dataset derived from a computer simulating the hypothetical scenario with a second simulation configuration having a second degree of fidelity different than the first degree of fidelity. The method further comprises building a multi-fidelity training dataset including training data from both the first simulation dataset and the second simulation dataset according to an interleaving protocol.

Growing community of inventors

Fremont, CA, United States of America

Babak Seyed Aghazadeh