The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Dec. 11, 2018

Filed:

Mar. 18, 2015
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Serguei B. Stepaniants, Redmond, WA (US);

Kyle Leon Battisti, Seattle, WA (US);

Rui Chen, Seattle, WA (US);

Michael Luis Collado, Seattle, WA (US);

Kevin Donald Kelly, Bainbridge Island, WA (US);

Sebastian Kohlmeier, Mountlake Terrace, WA (US);

Kevin McAlister, Seattle, WA (US);

Daniel Parshall, Woodinville, WA (US);

Assignee:

AMAZON TECHNOLOGIES, INC., Seattle, WA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 17/18 (2006.01); G06F 17/10 (2006.01); G06F 17/30 (2006.01);
U.S. Cl.
CPC ...
G06F 17/18 (2013.01);
Abstract

Described are techniques for determining long-term effects of an experimental change to a user experience after the end of the experiment. A control state and a treatment state of a statistical hypothesis experiment may be assigned to first and second client devices, respectively, during an experiment time period. Subsequent to the end of the experiment, presentation of the control state may be discontinued. Result data corresponding to the treatment state may be determined during the experiment time period and for a length of time subsequent to the experiment time period. Result data corresponding to the control state may be determined during the experiment time period, and for a length of time prior to assignment of the control state to the first client device.


Find Patent Forward Citations

Loading…