Netflix Inc.

Chunyun Zhao

Wei Liu

Aravindan Ramkumar

Kasturi Chatterjee

Vinod Viswanathan

Prashanth Ramdas

Poorna Chandra Tejashvi Reddy

Konstantinos Christidis

Justin Cunningham

One embodiment of the present invention sets forth a technique for performing schema-driven data processing. The technique includes detecting a first change to a first producer schema for a first dataset produced by a first data processor. The technique also includes performing a compatibility check between the first change and a first consumer schema associated with processing of the first dataset by a second data processor, wherein the first consumer schema includes a set of fields required by the second data processor. The technique further includes modifying an operation of the second data processor based on a result of the compatibility check.

Schema-driven distributed data processing

In various embodiments, a flexible queue application allocates messages stored in priority queues to clients. In operation, the flexible queue application receives, from a client, a request to allocate a message from a priority queue. At least a first message and a second message are stored in the priority queue, and the priority of the first message is higher than the priority of the second message. The flexible queue application determines that the first message is pending but does not satisfy an allocation constraint. The flexible queue allocation then determines that the second message is pending and satisfies the allocation constraint. The flexible queue application allocates the second message to the client. Advantageously, because the flexible queue application can adapt the priority-based ordering of priority queues based on allocation constraints, the flexible queue application can efficiently enforce resource-related constraints when allocating messages from priority queues.

Techniques for improving resource utilization in a microservices architecture via priority queues

Growing community of inventors

Cupertino, CA, United States of America

Chunyun Zhao