Adobe, Inc.

Xinyue Liu

Zhenyu Yan

Jun He

Wuyang Dai

Abhishek Pani

Chang Liu

Suofei Wu

Shengyun Peng

Introduced here are approaches for identifying the optimal send time for messages by accounting for hidden confounders, such as the content of those messages, delivery channel, etc. These approaches use a causal inference framework to discover and then remove the impact of hidden confounders. These approaches may be employed by a marketing and analytics platform (or simply 'marketing platform') that may be used to design, implement, or review digital marketing campaigns. The marketing platform can consider the send time as a treatment and then employ machine learning (ML) models that consider the send time, features of the recipient, and hidden confounders to produce a ranked series of send times with the effect of the hidden confounders marginalized. Approaches to performing offline evaluations that mimic A/B tests using data related to existing field experiments are also introduced here.

Optimization of send time of messages

The present disclosure relates to systems, methods, and non-transitory computer readable media for determining send times for distributing digital content to client devices utilizing a recommendation system approach. For example, the disclosed systems can utilize a recommendation system model such as a matrix factorization model, a factorization machine model, and/or a neural network to implement collaborative filtering to generate predicted response rates for particular candidate send times. Based on the predicted response rates indicating likelihoods of receiving responses for particular send times, the disclosed system can generate a distribution schedule to provide electronic communications at one or more of the send times.

Utilizing a recommendation system approach to determine electronic communication send times

Growing community of inventors

San Jose, CA, United States of America

Xinyue Liu