Scale Hyper-V Neutron Agent

Registered by Vinod Kumar on 2015-08-18

A typical medium sized hybrid cloud deployment consists of more than
50 Hyper-V compute nodes along with computes like KVM or ESX.
The rate at which VMs are spawned/updated under such a deployment is
around 25 operations/minute. And these operations consists of spawning,
updation and deletion of the VM and its properties (like security group rules).
At this rate the possibility of concurrent spawn or update operations on a
given compute is High. What is typically observed is a spawn rate of ~2 VM(s)/minute.
Since WMI is not that performant, a VM port binding in Hyper-V neutron agent takes
10x amount of time when compared to KVM IPtable.
The situation worsens when the number of SG Rules to apply increases for a given port
(with the number of SG members), and there are many ports in queue to treat.
Under such a scenario neutron agent running on Hyper-v compute fails to complete binding
security rules to the VM port in given time,and VM remains in-accessible on the allocated
IP address.
This blueprint addresses the neutron port binding failure on the agent by
introducing port binding concurrency.

Blueprint information

Status:
Complete
Approver:
Alessandro Pilotti
Priority:
High
Drafter:
Sonu
Direction:
Approved
Assignee:
Claudiu Belu
Definition:
Approved
Series goal:
None
Implementation:
Implemented
Milestone target:
None
Started by
Vinod Kumar on 2015-09-14
Completed by
Claudiu Belu on 2016-03-04

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/spec,n,z

Addressed by: https://review.openstack.org/214958
    Scaling hyperv neutron agent

Gerrit topic: https://review.openstack.org/#q,topic:bp/scale-hyperv-neutron-agent,n,z

Addressed by: https://review.openstack.org/223021
    Port bind worker script

Addressed by: https://review.openstack.org/223442
    Implement concurrent port bind.

Addressed by: https://review.openstack.org/235793
    Hyper-V Code Decomposed & Worker Script

Addressed by: https://review.openstack.org/235859
    Hyper-V Code Decomposed & Async process support

Addressed by: https://review.openstack.org/264282
    Replaces vNIC periodic query with event listeners

Addressed by: https://review.openstack.org/264235
    Adds native thread pool

Addressed by: https://review.openstack.org/275194
    Ensure security groups are properly rebound

Addressed by: https://review.openstack.org/288452
    Adds trace to the port processing logic

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.