Catalog of tempest test cases for heat

Registered by Steven Dake

This is the master blueprint for integrating Heat into the Tempest test framework.

We need to test the following features functionally:
* OpenStack Rest API with following operations:
stack-create
stack-delete
stack-show
stack-list
stack-show
stack-update
event-list
event-show
resource-list
resource-metadata
resource-show
action-suspend
action-resume

* Processes YAML based templates

* Processes JSON based templates

* Heat processes most of the AWS CloudFormation syntax

* Template declaration
http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/template-anatomy.html
AWSTemplateFormatVersion - just a version date
Description - valid JSON string
Parameters - supported properties: Type, Default, NoEcho, AllowedValues, AllowedPattern, MaxLength, MinLength, MaxValue, MinValue, Description, ContraintDescription
Mappings - name-value pairs that are accessed via Fn::FindInMap
Resources - composed of type (specified below) and optionally properties made up of string, list, dict, or result of function or reference - resources also output attributes which define the resource after it has been orchestrated
Outputs - output is composed of a double-quoted key name, a single colon, and one or more properties made up of value and an optional description

* Heat processes HOT DSL syntax

* Support for following resource types, grouped by feature:

** Autoscaling:
AWS::AutoScaling::LaunchConfiguration': LaunchConfiguration
AWS::AutoScaling::AutoScalingGroup': AutoScalingGroup
AWS::AutoScaling::ScalingPolicy': ScalingPolicy
OS::Heat::CWLiteAlarm
OS::Ceilometer::Alarm

** Floating IPs:
AWS::EC2::EIP
AWS::EC2::EIPAssociation
High Availability:
OS::Heat::HARestarter

** Security:
OS::Nova::Keypair
AWS::IAM::User
AWS::IAM::AccessKey
OS::Heat::AccessPolicy

** Networking:
AWS VPC:
AWS::EC2::RouteTable
AWS::EC2::SubNetRouteTableAssociation
AWS::EC2::VPC
AWS::EC2::SecurityGroup
AWS::EC2::InternetGateway
AWS::EC2::VPCGatewayAttachment
AWS::EC2::Subnet

*** Neutron SDN:
OS::Neutron::FloatingIP
OS::Neutron::FloatingIPAssociation
OS::Neutron::Port
OS::Neutron::Router
OS::Neutron::RouterInterface
OS::Neutron::RouterGateway
OS::Neutron::Subnet

*** Neutron VPN:
OS::Neutron::VPNService
OS::Neutron::IPsecSiteConnection
OS::Neutron::IKEPolicy
OS::Neutron::IPsecPolicy

*** Neutron Firewall:
OS::Neutron::Firewall
OS::Neutron::FirewallPolciy
OS::Neutron::FirewallRule

*** Neutron Load balancer:
OS::Neutron::HealthMonitor
OS::Neutron::Pool
OS::Neutron::LoadBalancer

** Virtual Machines
AWS::EC2::Instance

** OS::Nova::Server
AWS::CloudFormation::Stack

** Volumes
AWS::EC2::Volume
AWS::EC2::VolumeAttachment
OS::Cinder::Volume
OS::Cinder::VolumeAttachment

** Object storage
OS::Swift::Container
AWS::S3::Bucket

** AWS WaitConditions
AWS::CloudFormation::WaitCondition
AWS::CloudFormation::WaitConditionHandle

* Environments

* Stack Updates and rollbacks

* Keystone trusts tests

* HOT template tests

* Client tests (python-heatclient)
action-resume
action-suspend
event-list
event-show
resource-list
resource-metadata
resource-show
resource-template
stack-create
stack-delete
stack-list
stack-show
stack-update
template-show
template-validate

* heat-cfntools
Currently heat-cfntools is the recomended solution for in-instance agents, we need to test the following agents work correctly

cfn-get-metadata
cfn-hup
cfn-init
cfn-push-stats
cfn-signal

Blueprint information

Status:
Complete
Approver:
Giulio Fidente
Priority:
Not
Drafter:
Steven Dake
Direction:
Approved
Assignee:
Steven Dake
Definition:
Obsolete
Series goal:
Accepted for icehouse
Implementation:
Unknown
Milestone target:
None
Completed by
Matthew Treinish

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/tempest-heat-integration,n,z

Addressed by: https://review.openstack.org/64707
    Add basic read-only tests for heat cli

Addressed by: https://review.openstack.org/69725
    Return body output after given status reached

Addressed by: https://review.openstack.org/69726
    Enhance templates test

Addressed by: https://review.openstack.org/93540
    Revert "Add basic read-only tests for heat cli"

Addressed by: https://review.openstack.org/94590
    Add tests for neutron firewall resource

Addressed by: https://review.openstack.org/103467
    Add API Tests for AWS::EC2::Instance Resource

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.