Facebook, Inc.

Ramkumar Venkat Vadali

Chun-Yang Chen

Dmytro Molkov

Joydeep Sen Sarma

A system and method of managing a cluster of distributed machines is described. A cluster manager receives status updates regarding tasks running on each machine in the cluster from a task tracker running on the machine. The cluster manager receives resource requests from a job tracker created by a client wishing to run a job in the cluster. The cluster manager is responsible for implementing push-based fair scheduling of resources to the job trackers. The job tracker is responsible for running tasks for one job in the resource identified by the cluster manager. In one embodiment, the job tracker can run in the client for small jobs and in the cluster for larger jobs. The cluster manager can also be restarted, for example, for software updates without restraining the cluster.

Growing community of inventors

Mountain View, CA, United States of America

Ramkumar Venkat Vadali