Microsoft Technology Licensing, LLC

Shandan Zhou

Karthikeyan Subramanian

Thomas Moscibroda

Si Qin

Saurabh Agarwal

Yong Xu

Qingwei Lin

Gowtham Natarajan

Ajay Mani

Gurpreet Virdi

Yunus Mohammed

Hang Dong

Bo Qiao

Nisarg Tarakkumar Sheth

Sorin Iftimie

Marko Lalic

Wanghai Gu

Sandeep Ramji

Paul Naveen Selvaraj

Yuwen Yang

Asad Yaqoob

John Lawrence Miller

Gaurav Jagtiani

Murtaza Muidul Huda Chowdhury

Eli Cortez

Ambrose Thomas Treacy

Zainab Hakim

Abhay Sudhir Ketkar

Sanjay Ramanujan

Shanti Kemburu

Luke Rafael Rodriguez

Vipin Kumar

Christopher Cowdery

Sam Prakash Bheri

Yancheng Chen

Hemant Malik

Shweta Balkrishna Patil

Dalianna Victoria Vaysman

Valentina Li

Michal Jama

Maitreyee Ramprasad Joshi

Vinayak Ramnath Karnataki

Neha Keshari

Yash Purohit

Koon Hui Geoffrey Goh

The present disclosure relates to systems, methods, and computer readable media for predicting surplus capacity on a set of server nodes and determining a quantity of deferrable virtual machines (VMs) that may be scheduled over an upcoming period of time. This determination of VM quantity may be determined while minimizing risks associated with allocation failures on the set of server nodes. This disclosure described systems that facilitate features and functionality related to improving utilization of surplus resource capacity on a plurality of server nodes by implementing VMs having some flexibility in timing of deployment while also avoiding significant risk caused as a result of over-allocated storage and computing resources. In one or more embodiments, the quantity of deferrable VMs is determined and scheduled in accordance with rules of a scheduling policy.

Allocating computing resources for deferrable virtual machines

The present disclosure relates to systems, methods, and computer readable media for predicting expansion failures and implementing defragmentation instructions based on the predicted expansion failures and other signals. For example, systems disclosed herein may apply a failure prediction model to determine an expansion failure prediction associated with an estimated likelihood that deployment failures will occur on a node cluster. The systems disclosed herein may further generate defragmentation instructions indicating a severity level that a defragmentation engine may execute on a cluster level to prevent expansion failures while minimizing negative customer impacts. By uniquely generating defragmentation instructions for each node cluster, a cloud computing system can minimize expansion failures, increase resource capacity, reduce costs, and provide access to reliable services to customers.

Predicting expansion failures and defragmenting cluster resources

A computer implemented method includes receiving telemetry data corresponding to capacity health of nodes in a cloud based computing system. The received telemetry data is processed via a prediction engine to provide predictions of capacity health at multiple dimensions of the cloud based computing system. Node recoverability information is received and node recovery execution is initiated as a function of the representations of capacity health and node recoverability information.

Capacity aware cloud environment node recovery system

The present disclosure relates to systems, methods, and computer readable media for predicting deployment growth on one or more node clusters and selectively permitting deployment requests on a per cluster basis. For example, systems disclosed herein may apply tenant growth prediction system trained to output a deployment growth classification indicative of a predicted growth of deployments on a node cluster. The system disclosed herein may further utilize the deployment growth classification to determine whether a deployment request may be permitted while maintaining a sufficiently sized capacity buffer to avoid deployment failures for existing deployments previously implemented on the node cluster. By selectively permitting or denying deployments based on a variety of factors, the systems described herein can more efficiently utilize cluster resources on a per-cluster basis without causing a significant increase in deployment failures for existing customers.

Allocating cloud resources in accordance with predicted deployment growth

A method for minimizing allocation failures in a cloud computing system without overprovisioning may include determining a predicted supply for a virtual machine series in a system unit of the cloud computing system during an upcoming time period. The predicted supply may be based on a shared available current capacity and a shared available future added capacity for the virtual machine series in the system unit. The method may also include predicting an available capacity for the virtual machine series in the system unit during the upcoming time period. The predicted available capacity may be based at least in part on a predicted demand for the virtual machine series in the system unit during the upcoming time period and the predicted supply. The method may also include taking at least one mitigation action in response to determining that the predicted demand exceeds the predicted supply during the upcoming time period.

Capacity management in a cloud computing system using virtual machine series modeling

Embodiments relate to determining whether to take a resource distribution unit (RDU) of a datacenter offline when the RDU becomes faulty. RDUs in a cloud or datacenter supply a resource such as power, network connectivity, and the like to respective sets of hosts that provide computing resources to tenant units such as virtual machines (VMs). When an RDU becomes faulty some of the hosts that it supplies may continue to function and others may become unavailable for various reasons. This can make a decision of whether to take the RDU offline for repair difficult, since in some situations countervailing requirements of the datacenter may be at odds. To decide whether to take an RDU offline, the potential impact on availability of tenant VMs, unused capacity of the datacenter, a number or ratio of unavailable hosts on the RDU, and other factors may be considered to make a balanced decision.

Opportunistic offlining for faulty devices in datacenters

Aspects extend to methods, systems, and computer program products for clustering streamed or batch data. Aspects of the invention include dynamic clustering and labeling of streamed data and/or batch data, including failures and error logs (user, platform, etc.), latency logs, warning logs, information logs, Virtual Machine (VM) creation data logs, template logs, etc., for use in analysis (e.g., error log analysis). A clustering system can learn from previously identified patterns and use that information to group newer information dynamically as it gets generated. The clustering system can leverage streamed data and/or batch data domain knowledge for preprocessing. In one aspect, a clustering system uses a similarity measure. Based on (e.g., users' configuration of) a similarity threshold, the cluster system (e.g., automatically) assigns/clusters streamed data and/or batch data into groups.

Clustering and labeling streamed data

Techniques for automated capacity managed in distributed computing systems are disclosed herein. In one embodiment, a method includes receiving predicting one or more future usage levels of a computing resource in the distributed computing system based on received data representing historical usage levels of the computing resource and determining whether a currently available capacity of the computing resource in the distributed computing system is depleted beyond a threshold time period based on the one or more future usage levels. In response to determining that the currently available capacity of the computing resource in the distributed computing system is depleted before the threshold time period, the method includes immediately rebooting, reimaging, or performing other recovery actions on one or more out-for-repair hosts that provide the computing resource.

Automated capacity management in distributed computing systems

Growing community of inventors

Kenmore, WA, United States of America

Shandan Zhou