Flatten services YAML files

Registered by Emilien Macchi on 2018-02-13

Some services have been defined in multiple YAML files, for example in docker/services but also in puppet/services.
Since Queens is the release where we only support containerized overclouds, we expect all deployments running with Docker.

The way it works now causes performance problems, e.g. heat creates around 300 stacks instead of ~50.

We should convert the services into one file so:
- it's easier to create new services
- it's easier to maintain existing services
- it increases performances results

Blueprint information

Status:
Complete
Approver:
Alex Schultz
Priority:
High
Drafter:
Emilien Macchi
Direction:
Approved
Assignee:
None
Definition:
Approved
Series goal:
Accepted for train
Implementation:
Implemented
Milestone target:
milestone icon train-1
Started by
Alex Schultz on 2019-01-22
Completed by
Alex Schultz on 2019-06-07

Related branches

Sprints

Whiteboard

[2018-04-09] No update for Rocky. Moving to future.

Gerrit topic: https://review.openstack.org/#q,topic:bp/services-yaml-flattening,n,z

Addressed by: https://review.openstack.org/611188
    WIP: Flatten Aodh service configuration

Addressed by: https://review.openstack.org/615552
    Flatten Keystone service configuration

Addressed by: https://review.openstack.org/624175
    Move podman into deployment directory

Addressed by: https://review.openstack.org/624177
    Move docker into deployment directory

Addressed by: https://review.openstack.org/624182
    Flatten Keepalived service configuration

Addressed by: https://review.openstack.org/624712
    WIP - flatten memcached service configuration

Addressed by: https://review.openstack.org/624719
    Flatten Glance service configuration

Addressed by: https://review.openstack.org/624803
    WIP - flatten keystone service configuration

Addressed by: https://review.openstack.org/624952
    Flatten Zaqar service configuration

Addressed by: https://review.openstack.org/625019
    Fix service naming conventions

Addressed by: https://review.openstack.org/625022
    Add deployments/README.rst

Addressed by: https://review.openstack.org/625025
    Flatten Ironic services configuration

Addressed by: https://review.openstack.org/625270
    flatten sahara service configuration

Addressed by: https://review.openstack.org/625322
    flatten snmp service configuration

Addressed by: https://review.openstack.org/625323
    flatten tuned service configuration

Addressed by: https://review.openstack.org/625324
    flatten tripleo-firewall service configuration

Addressed by: https://review.openstack.org/625326
    flatten tripleo-packages service configuration

Addressed by: https://review.openstack.org/625940
    flatten time service configuration

Addressed by: https://review.openstack.org/625979
    flatten sshd service configuration

Addressed by: https://review.openstack.org/626012
    flatten the heat service configurations

Addressed by: https://review.openstack.org/626375
    WIP: flatten nova service configuration

Addressed by: https://review.openstack.org/626384
    Update memcache config in docker-uc-light env

Addressed by: https://review.openstack.org/626573
    WIP - DO NOT MERGE Flatten RabbitMQ service configuration

Addressed by: https://review.openstack.org/626631
    flatten haproxy service configuration

Addressed by: https://review.openstack.org/626760
    WIP - flatten database services MySQL, Redis, MongoDB configuration

Addressed by: https://review.openstack.org/626937
    flatten cinder service configuration

Addressed by: https://review.openstack.org/627642
    flatten the mistral service configurations

Addressed by: https://review.openstack.org/628171
    Prevent service bootstrap node facts from colliding with each other

Addressed by: https://review.openstack.org/629664
    WIP: flatten the neutron service configurations

Addressed by: https://review.openstack.org/630513
    step2: flatten the neutron service configurations

Gerrit topic: https://review.openstack.org/#q,topic:haproxy/lol,n,z

Addressed by: https://review.openstack.org/632522
    step1: flatten nova service configuration

Addressed by: https://review.openstack.org/632536
    Move selinux to deployment folder

Addressed by: https://review.openstack.org/632545
    flatten the swift service configurations

Addressed by: https://review.openstack.org/632552
    Move kernel config to deployment directory

Addressed by: https://review.openstack.org/632553
    Move securetty to deployment dir

Addressed by: https://review.openstack.org/632554
    Move login-defs to deployment directory

Addressed by: https://review.openstack.org/632556
    Flatten etcd configuration

Addressed by: https://review.openstack.org/633273
    flatten the manila service configurations

Addressed by: https://review.openstack.org/633278
    step2: flatten nova service configuration

Addressed by: https://review.openstack.org/633546
    flatten the tacker service

Addressed by: https://review.openstack.org/633568
    flatten the panko service

Addressed by: https://review.openstack.org/633597
    step3: flatten nova service configuration

Addressed by: https://review.openstack.org/633716
    flatten the congress service

Addressed by: https://review.openstack.org/633723
    flatten the iscsid service

Addressed by: https://review.openstack.org/633727
    Move the multipathd services into deployment

Addressed by: https://review.openstack.org/633617
    flatten ceilometer service configuration

Addressed by: https://review.openstack.org/633980
    WIP - flatten database service MySQL Server

Addressed by: https://review.openstack.org/634703
    flatten the gnocchi service configurations

Addressed by: https://review.openstack.org/634752
    flatten the horizon service configurations

Addressed by: https://review.openstack.org/634783
    flatten the barbican service configurations

Addressed by: https://review.openstack.org/634804
    flatten the fluentd service configurations

Addressed by: https://review.openstack.org/634845
    step1: flatten the designate service configurations

Addressed by: https://review.openstack.org/634930
    step2: flatten the designate service configurations

Addressed by: https://review.openstack.org/634950
    step3: flatten the neutron service configurations

Addressed by: https://review.openstack.org/635318
    Move container-image-prepare.j2.yaml to deployment dir

Addressed by: https://review.openstack.org/635930
    flatten database service Redis

Addressed by: https://review.openstack.org/636203
    flatten tripleo-ui service configuration

Addressed by: https://review.openstack.org/636206
    flatten sensu service configuration

Addressed by: https://review.openstack.org/636232
    flatten collectd service configuration

Addressed by: https://review.openstack.org/636507
    flatten qdrouterd service configs

Addressed by: https://review.openstack.org/637046
    Move openstack clients service

Addressed by: https://review.openstack.org/637230
    step4: flatten nova service configuration

Addressed by: https://review.openstack.org/638464
    flatten gnocchi services config

Addressed by: https://review.openstack.org/638762
    flatten the octavia service configurations

Addressed by: https://review.openstack.org/639090
    flatten the ec2 service configurations

Addressed by: https://review.openstack.org/639119
    flatten the ovn service configurations

Addressed by: https://review.openstack.org/640048
    step4: flatten the neutron service configurations

Addressed by: https://review.openstack.org/640059
    step5: flatten the neutron service configurations

Addressed by: https://review.openstack.org/640384
    flatten opendaylight-api service

Addressed by: https://review.openstack.org/641290
    Flatten and move logrotate-crond service container

Addressed by: https://review.openstack.org/638701
    Deprecate opendaylight service

Addressed by: https://review.openstack.org/644449
    Move neutron-plugin-ml2.yaml to deployment

Addressed by: https://review.openstack.org/644450
    flatten the neutron-plugin-mlnx-sdn service

Addressed by: https://review.openstack.org/644621
    flatten the cavium liquidio service

Addressed by: https://review.openstack.org/644623
    move tempest to deployment

Addressed by: https://review.openstack.org/644624
    move undercloud-upgrade.yaml into deployment

Addressed by: https://review.openstack.org/644630
    move clustercheck.yaml into deployment

Addressed by: https://review.openstack.org/644632
    move logging into deployment

Addressed by: https://review.openstack.org/644635
    move ceph-ansible into deployment

Addressed by: https://review.openstack.org/647416
    puppet/services -> deployments updates

Addressed by: https://review.openstack.org/647611
    Move apache service under deployment directory

Addressed by: https://review.openstack.org/648385
    Move Aide to deployments

Addressed by: https://review.openstack.org/648469
    Move pacemaker, pacemaker-remote into deployments

Addressed by: https://review.openstack.org/650371
    Move containers-common.yaml into deployment

Gerrit topic: https://review.openstack.org/#/q/topic:containers-common

Gerrit topic: https://review.openstack.org/#/q/topic:bp/services-yaml-flattening

Addressed by: https://review.openstack.org/652663
    Move Manila backends into deployment

Gerrit topic: https://review.opendev.org/#/q/topic:bp/services-yaml-flattening

Addressed by: https://review.opendev.org/648469
    Move pacemaker, pacemaker-remote into deployments

Addressed by: https://review.opendev.org/652663
    Move Manila backends into deployment

Addressed by: https://review.opendev.org/654661
    Move neutron base, plugins to deployment

Addressed by: https://review.opendev.org/655138
    Move Manila backends into deployment

Addressed by: https://review.opendev.org/655223
    Move openvswitch into deployments

Addressed by: https://review.opendev.org/655508
    Move auditd, ca-cert, certmonger to deployment

Addressed by: https://review.opendev.org/655512
    Move masq-nets, swift-external, and validations to deployment

Addressed by: https://review.opendev.org/655513
    Move vpp, and veritas-hyperscale into deployment

Addressed by: https://review.opendev.org/655514
    Drop puppet/services/metrics/collectd.yaml

Addressed by: https://review.opendev.org/655684
    Move compute-instanceha, neutron-ovn-dvr-ha to deployments

Addressed by: https://review.opendev.org/655989
    Move puppet/services/README and releasenotes

Addressed by: https://review.opendev.org/656039
    Drop puppet/services/metrics/collectd.yaml

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.