Vmware, Inc.

Citrix Systems, Inc.

Robert Kidd

Jeremy Tidemann

Raja Kommula

Georgios Oikonomou

Ojas Gupta

Edward Choh

Constantine Polychronopoulos

Marc-Andre Bordeleau

Marc Andre Bordeleau

Andrew Penner

Thayumanavan Sridhar

Mingjie Zhao

Miguel Melnyk

Nicholas James Stavrakos

Fabian Breg

Frederick Alan Koopmans

Ioannis Beredimas

Kapil Dakhane

Abhishek Chauhan

Tushar Kanekar

Kannan Parthasarathy

Kartik Ayyar

Harpreet Singh

Nathanael A Thompson

Joseph Sestrich

Ritesh Patani

Sergey Golubev

Some embodiments of the invention provide novel methods for performing services on data messages passing through a network connecting one or more datacenters, such as software defined datacenters (SDDCs). The method of some embodiments uses service containers executing on host computers to perform different chains (e.g., ordered sequences) of services on different data message flows. For a data message of a particular data message flow that is received or generated at a host computer, the method in some embodiments uses a service classifier executing on the host computer to identify a service chain that specifies several services to perform on the data message. For each service in the identified service chain, the service classifier identifies a service container for performing the service. The service classifier then forwards the data message to a service forwarding element to forward the data message through the service containers identified for the identified service chain. The service classifier and service forwarding element are implemented in some embodiments as processes that are defined as hooks in the virtual interface endpoints (e.g., virtual Ethernet ports) of the host computer's operating system (e.g., Linux operating system) over which the service containers execute.

Distributed service chain across multiple clouds

A system can reduce congestion in slice-based networks, such as a virtual service network ('VSN'). The system can include a monitoring module that communicates with agents on switches, such as routers or servers. The switches report telematics data to the monitoring module, which determines slice-specific performance attributes such as slice latency and slice throughput. These slice-specific performance attributes are compared against software license agreement (“SLA”) requirements. When the SLA is not met, the monitoring module can implement a new slice path for the slice to reduce the congestion.

Congestion avoidance in a slice-based network

A switch in a slice-based network can be used to enforce quality of service ('QoS'). Agents can run in the switches, such as in the core of each switch. The switches can sort ingress packets into slice-specific ingress queues in a slice-based pool. The slices can have different QoS prioritizations. A switch-wide policing algorithm can move the slice-specific packets to egress interfaces. Then, one or more user-defined egress policing algorithms can prioritize which packets are sent out into the network first based on slice classifications.

Quality of service in virtual service networks

In a slice-based network, switches can be programmed to perform routing functions based on a slice identifier. The switch can receive a packet and determine a slice identifier for the packet based on packet header information. The switch can use the slice identifier to determine a next hop. Using the slice identifier with a multi-path table, the switch can select an egress interface for sending the packet to the next hop. The multi-path table can ensure that traffic for a slice stays on the same interface link to the next hop, even when a link aggregation group ('LAG') is used for creation of a virtual channel across multiple interfaces or ports.

Slice-based routing

Some embodiments provide a novel method for adjusting a path for a packet flow from a source machine to a destination machine in a network. The method of some embodiments identifies a condition at a first forwarding element along a first path traversed by the packet flow through the network. The first path traverses through a hardware, second forwarding element before the first forwarding element. In some embodiments, the second forwarding element includes a programmable data plane circuit. The method, in some embodiments, uses an application programming interface (API) of the programmable data plane circuit to provide a set of parameters to the data plane circuit that cause the data plane circuit to forego selecting the first path to forward the packets of the packet flow to the destination machine and instead to select a second path, not traversing the first forwarding element, to the destination machine.

Dynamic multipathing using programmable data plane circuits in hardware forwarding elements

Some embodiments of the invention provide a novel method of performing network slice-based operations on a data message at a hardware forwarding element (HFE) in a network. For a received data message flow, the method has the HFE identify a network slice associated with the received data message flow. This network slice in some embodiments is associated with a set of operations to be performed on the data message by several network elements, including one or more machines executing on one or more computers in the network. Once the network slice is identified, the method has the HFE process the data message flow based on a rule that applies to data messages associated with the identified slice.

Forwarding element with physical and virtual data planes

Some embodiments provide a method for establishing multiple virtual service networks over multiple datacenters. The method configures, for each virtual service network of the plurality of virtual service networks, a set of machines distributed across the datacenters to implement an ordered set of network services for the virtual service network. The method configures multiple service network selectors executing within the datacenters to receive a data message, select one of the virtual service networks for the data message based on analysis of contents of the data message, determine a location within the datacenters for a machine implementing a first network service of the ordered set of network services for the selected virtual service network, and transmit the data message to the machine implementing the first network service.

Virtual service networks

In a slice-based network, slice multiplexers can be used to anchor inter-cloud tunnels across different clouds in a slice path. The slice multiplexers can dynamically change a total allocated bandwidth of an outer tunnel and reconfigure relative slice bandwidths of inner tunnels. This can result in an optimized bandwidth allocation that enforces slice priorities, maintains required SLA performance levels, and minimizes total allocated bandwidth on the network connection. The dynamic changes can be based on slice priority levels, total number of slices, and historical slice throughput.

Dynamic slice bandwidth multiplexing based on slice priority

Examples can include an optimizer that dynamically determines where to place virtual network functions for a slice in a distributed Telco cloud network. The optimizer can determine a slice path that complies with a service level agreement and balances network load. The virtual network functions of the slice can be provisioned at clouds identified by the optimal slice path. In one example, performance metrics are normalized, and tenant-selected weights can be applied. This can allow the optimizer to prioritize particular SLA attributes in choosing an optimal slice path.

Dynamic inter-cloud placement of virtual network functions for a slice

Distributed fault tolerant service chain

Some embodiments provide a method for a network slice selector. From an electronic device, the method receives a connection initiation message for a connection between the electronic device and a network domain. The method exchanges a set of connection initiation messages with the electronic device to set up the connection. The method receives a data message belonging to the connection from the electronic device. The method selects one of multiple network slices to which the electronic device has access as the network slice for the connection based on analysis of the received data message. The method forwards the data message and subsequent data messages belonging to the connection onto the selected network slice to be delivered to the network domain.

Stateful network slice selection using slice selector as connection termination proxy

Forwarding element slice identifying control plane

Performing slice based operations in a data plane circuit

Growing community of inventors

Champaign, IL, United States of America

Robert Kidd