Catalog of tempest test cases for heat

Registered by Steven Dake on 2013-12-17

This is the master blueprint for integrating Heat into the Tempest test framework.

We need to test the following features functionally:
* OpenStack Rest API with following operations:
stack-create
stack-delete
stack-show
stack-list
stack-show
stack-update
event-list
event-show
resource-list
resource-metadata
resource-show
action-suspend
action-resume

* Processes YAML based templates

* Processes JSON based templates

* Heat processes most of the AWS CloudFormation syntax

* Template declaration
http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/template-anatomy.html
AWSTemplateFormatVersion - just a version date
Description - valid JSON string
Parameters - supported properties: Type, Default, NoEcho, AllowedValues, AllowedPattern, MaxLength, MinLength, MaxValue, MinValue, Description, ContraintDescription
Mappings - name-value pairs that are accessed via Fn::FindInMap
Resources - composed of type (specified below) and optionally properties made up of string, list, dict, or result of function or reference - resources also output attributes which define the resource after it has been orchestrated
Outputs - output is composed of a double-quoted key name, a single colon, and one or more properties made up of value and an optional description

* Heat processes HOT DSL syntax

* Support for following resource types, grouped by feature:

** Autoscaling:
AWS::AutoScaling::LaunchConfiguration': LaunchConfiguration
AWS::AutoScaling::AutoScalingGroup': AutoScalingGroup
AWS::AutoScaling::ScalingPolicy': ScalingPolicy
OS::Heat::CWLiteAlarm
OS::Ceilometer::Alarm

** Floating IPs:
AWS::EC2::EIP
AWS::EC2::EIPAssociation
High Availability:
OS::Heat::HARestarter

** Security:
OS::Nova::Keypair
AWS::IAM::User
AWS::IAM::AccessKey
OS::Heat::AccessPolicy

** Networking:
AWS VPC:
AWS::EC2::RouteTable
AWS::EC2::SubNetRouteTableAssociation
AWS::EC2::VPC
AWS::EC2::SecurityGroup
AWS::EC2::InternetGateway
AWS::EC2::VPCGatewayAttachment
AWS::EC2::Subnet

*** Neutron SDN:
OS::Neutron::FloatingIP
OS::Neutron::FloatingIPAssociation
OS::Neutron::Port
OS::Neutron::Router
OS::Neutron::RouterInterface
OS::Neutron::RouterGateway
OS::Neutron::Subnet

*** Neutron VPN:
OS::Neutron::VPNService
OS::Neutron::IPsecSiteConnection
OS::Neutron::IKEPolicy
OS::Neutron::IPsecPolicy

*** Neutron Firewall:
OS::Neutron::Firewall
OS::Neutron::FirewallPolciy
OS::Neutron::FirewallRule

*** Neutron Load balancer:
OS::Neutron::HealthMonitor
OS::Neutron::Pool
OS::Neutron::LoadBalancer

** Virtual Machines
AWS::EC2::Instance

** OS::Nova::Server
AWS::CloudFormation::Stack

** Volumes
AWS::EC2::Volume
AWS::EC2::VolumeAttachment
OS::Cinder::Volume
OS::Cinder::VolumeAttachment

** Object storage
OS::Swift::Container
AWS::S3::Bucket

** AWS WaitConditions
AWS::CloudFormation::WaitCondition
AWS::CloudFormation::WaitConditionHandle

* Environments

* Stack Updates and rollbacks

* Keystone trusts tests

* HOT template tests

* Client tests (python-heatclient)
action-resume
action-suspend
event-list
event-show
resource-list
resource-metadata
resource-show
resource-template
stack-create
stack-delete
stack-list
stack-show
stack-update
template-show
template-validate

* heat-cfntools
Currently heat-cfntools is the recomended solution for in-instance agents, we need to test the following agents work correctly

cfn-get-metadata
cfn-hup
cfn-init
cfn-push-stats
cfn-signal

Blueprint information

Status:
Complete
Approver:
Giulio Fidente
Priority:
Not
Drafter:
Steven Dake
Direction:
Approved
Assignee:
Steven Dake
Definition:
Obsolete
Series goal:
Accepted for icehouse
Implementation:
Unknown
Milestone target:
None
Completed by
Matthew Treinish on 2014-09-11

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/tempest-heat-integration,n,z

Addressed by: https://review.openstack.org/64707
    Add basic read-only tests for heat cli

Addressed by: https://review.openstack.org/69725
    Return body output after given status reached

Addressed by: https://review.openstack.org/69726
    Enhance templates test

Addressed by: https://review.openstack.org/93540
    Revert "Add basic read-only tests for heat cli"

Addressed by: https://review.openstack.org/94590
    Add tests for neutron firewall resource

Addressed by: https://review.openstack.org/103467
    Add API Tests for AWS::EC2::Instance Resource

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.