Add installation for vspheredb module

changelogs/fragments/feature_add_vspheredb_module_installation.yml

@@ -0,0 +1,3 @@
+---
+major_changes:
+ - Added Installation of vSphereDB Module

changelogs/fragments/feature_add_x509_module_installation.yml

@@ -0,0 +1,3 @@
+---
+major_changes:
+ - Added Installation of x509 certificate monitoring model

doc/getting-started.md

@@ -1,11 +1,19 @@
 ### Getting Started
 
-The collection includes two roles in the current version.
+The collection includes six roles in the current version.
 
 * icinga.repos: Role to manage repositories
  * [Documentation: doc/role-repos](role-repos/role-repos.md)
 * icinga.icinga2: Role to install and manage Icinga 2 instances.
  * [Documentation: doc/role-icinga2](role-icinga2/role-icinga2.md)
+* icinga.icingadb: Role to install and manage IcingaDB, Icinga2's new data backend.
+ * [Documentation: doc/role-icingadb](role-icingadb/role-icingadb.md)
+* icinga.icingadb_redis: Role to install and manage Redis, IcingaDB's cache backend.
+ * [Documentation: doc/role-icingadb_redis](role-icingadb_redis/role-icingadb_redis.md)
+* icinga.icingaweb2: Role to install and manage Icinga Web 2.
+ * [Documentation: doc/role-icingaweb2](role-icingaweb2/role-icingaweb2.md)
+* icinga.monitoring_plugins: Role to install and manage Icinga2 compatible monitoring plugins.
+ * [Documentation: doc/role-monitoring_plugins](role-monitoring_plugins/role-monitoring_plugins.md)
 
 
 ---
@@ -39,6 +47,36 @@ ansible-galaxy collection build ansible-collection-icinga
 ansible-galaxy collection install icinga-icinga-0.3.0.tar.gz
 ```
 
+## Databases
+
+Icinga2 relies on relational databases for many parts of its functionality. **None** of those databases get installed by the roles. You need to install and configure them yourself. For doing so, there are many ways available, e.g. the Ansible role [geerlingguy.mysql](https://galaxy.ansible.com/geerlingguy/mysql) for MySQL flavours (both MySQL and MariaDB) or [geerlingguy.postgresql](https://galaxy.ansible.com/geerlingguy/postgresql) for PostGresQL:
+
+```yaml
+- name: Configure databases for Icinga2
+ hosts: database
+ vars:
+ mysql_databases:
+ - name: icingadb
+ - name: icingaweb
+ - name: vspheredb
+ encoding: utf8mb4
+ collation: utf8mb4_unicode_ci
+ - name: director
+ mysql_users:
+ - name: icingadb-user
+ host: localhost
+ password: icingadb-password
+ priv: "icingadb.*:ALL"
+ [...]
+ roles:
+ - role: geerlingguy.mysql
+```
+
+> [!NOTE]
+> Schema migrations needed for the respective Icinga components to work will be handled either by the respective roles or by the Icinga components themselves.
+
+
+
 ## Example Playbooks
 
 This is an example on how to install an Icinga 2 server/master instance.

doc/role-icingadb/role-icingadb.md

@@ -5,7 +5,12 @@ This role installs and configures the IcingaDB daemon. In addition it can also i
 It serves as the official, more performant successor to Icinga IDO. More information about its purpose and design can be found [in the official documentation](https://icinga.com/docs/icinga-db/latest/doc/01-About/).
 
 
-> :information_source: In many scenarios you want to install the [icingadb_redis role](../role-icingadb_redis/) together with this role. It is part of this collection, too.
+> [!TIP]
+> In many scenarios you want to install the [icingadb_redis role](../role-icingadb_redis/) together with this role. It is part of this collection, too.
+
+## Database
+
+IcingaDB relies on a relational database to persist received data. This database **won't** be created by this role - you need to deploy and configure one in advance. For more information, see the [Databases](../getting-started.md#databases) section in the getting started guide.
 
 ## Variables
 

doc/role-icingaweb2/module-vspheredb.md

@@ -0,0 +1,58 @@
+## Module vSphereDB
+
+> [!WARNING]
+> This module can only be installed from source as it has not been packaged yet.
+> Therefore, `git` is a needed dependency to be present on the target system.
+> The role will then install `vspheredb` and its dependency `incubator`.
+
+## Configuration
+
+The general module parameter like `enabled` can be applied here.
+
+For every config file, create a dictionary with sections as keys and the parameters as values. For all parameters please check the [module documentation](https://icinga.com/docs/icinga-vsphere-integration/latest/doc/01-Installation/)
+
+as Icinga Web 2 resource, please use the `icingaweb2_resources` variable to define
+the resource.
+
+Example:
+
+```
+icingaweb2_resources:
+ vspheredb:
+ type: db
+ db: mysql
+ host: localhost
+ dbname: vspheredb
+ username: vspheredb
+ password: vspheredb
+ charset: utf8mb4
+
+icingaweb2_modules:
+ vspheredb:
+ enabled: true
+ source: package
+ config:
+ db:
+ resource: vspheredb
+```
+
+## Database 
+
+The database can be created using the Geerlingguy mysql role. 
+
+For more parameters please check the [role documentation](https://github.com/geerlingguy/ansible-role-mysql)
+
+Example: 
+
+```
+mysql_databases:
+ - name: vspheredb
+ encoding: utf8mb4
+ collation: utf8mb4_general_ci
+
+pre_tasks:
+ - ansible.builtin.include_role:
+ name: geerlingguy.mysql
+
+
+```

doc/role-icingaweb2/module-x509.md

@@ -0,0 +1,95 @@
+## Module x509
+
+### Variables and Configuration
+
+The general module parameter like `enabled` and `source` can be applied here.
+
+| Variable | Value |
+|----------|------------|
+| enabled | true/false |
+| source | package |
+
+#### Section configuration
+
+The backend database for the module needs to be available and configured at the `icingaweb2_resources` variable.
+
+```
+icingaweb2_modules:
+ x509:
+ source: package
+ enabled: true
+ config:
+ backend:
+ resource: x509
+```
+
+#### Configure SNI Names.
+
+To configure SNIs for a IP address, use the dictionary `sni`.
+
+Example:
+
+```
+icingaweb2_modules:
+ x509:
+ source: package
+ enabled: true
+ config:
+ backend:
+ resource: x509
+ sni:
+ 192.168.56.213:
+ hostnames:
+ - icinga.com
+ - test2.icinga.com
+```
+
+#### Import Certificates
+
+To import certificates use the **list** `certificate_files` all files need to be
+available locally beforehand.
+
+```
+icingaweb2_modules:
+ x509:
+ source: package
+ enabled: true
+ config:
+ backend:
+ resource: x509
+ certificate_files:
+ - /etc/ssl/certs/ca-certificates.crt
+```
+
+#### Database Schema Setup
+
+To import the database schema use `database` dictionary with the following variables.
+
+| Variable | Type | Description | Default |
+|----------|------|-------------|---------|
+| `import_schema` | `Boolean` | Defines wether the schema will be imported or not. | false |
+| `host` | `String` | Defines database address to connect to. | `localhost` |
+| `port` | `int` | Defines the database port to connect to. | `3306` or `5432` |
+| `user` | `string` | Defines database user | `x509` |
+| `name` | `String` | Defines the database to connect to. | `x509` |
+| `password` | `String` | Defines the database password to connect with. | OMITTED |
+| `ssl_mode` | `String` | Clients attempt to connect using encryption, falling back to an unencrypted connection if an encrypted connection cannot be established |**n/a** |
+|`ssl_ca`| `String`| Defines the path to the ca certificate for client authentication. | **n/a** |
+|`ssl_cert`|`String`| Defines the path to the certificate for client authentication. | **n/a** |
+|`ssl_key`| `String` | Defines the path to the certificate key for client key authentication. | **n/a** |
+|`ssl_cipher`|`String`| Ciphers for the client authentication. | **n/a** |
+|`ssl_extra_options`|`String`| Extra options for the client authentication. | **n/a** |
+
+
+```
+icingaweb2_modules:
+ x509:
+ source: package
+ enabled: true
+ database:
+ import_schema: true
+ host: localhost
+ port: 3306
+ user: x509
+ password: secret
+```

doc/role-icingaweb2/role-icingaweb2.md

@@ -7,6 +7,10 @@ The role icingaweb2 installs and configures Icinga Web 2 and its modules.
 * [IcingaDB](./module-icingadb.md)
 * [Monitoring](./module-monitoring.md)
 
+## Databases
+
+Icingaweb2 and some of its modules rely on a relational database to persist data. These databases **won't** be created by this role - you need to deploy and configure them in advance. For more information, see the [Databases](../getting-started.md#databases) section in the getting started guide.
+
 ## Variables
 
 ### Icinga Web 2 DB Configuration

roles/icingaweb2/defaults/main.yml

@@ -2,6 +2,7 @@ icingaweb2_config_dir: /etc/icingaweb2
 icingaweb2_group: icingaweb2
 icingaweb2_modules_config_dir: "{{ icingaweb2_config_dir }}/modules"
 icingaweb2_director_service: icinga-director.service
+icingaweb2_vspheredb_service: icinga-vspheredb.service
 
 icingaweb2_groups:
  icingaweb2:

roles/icingaweb2/files/icinga-vspheredb.conf

@@ -0,0 +1 @@
+d /run/icinga-vspheredb 0755 icingavspheredb icingaweb2 -

roles/icingaweb2/tasks/main.yml

@@ -43,3 +43,11 @@
  force: yes
  when: icingaweb2_modules is defined
  loop: "{{ icingaweb2_modules | dict2items }}"
+
+# Many daemons fail before e.g. the resource is set up or the schema hasn't been migrated. This is a workaround.
+- name: Manage enabled module daemons
+ ansible.builtin.service:
+ name: "icinga-{{ item.key }}"
+ state: restarted
+ when: icingaweb2_modules is defined and item.value.enabled|bool == true and item.key in ['vspheredb', 'x509']
+ loop: "{{ icingaweb2_modules | dict2items }}"

roles/icingaweb2/tasks/manage_mysql_imports.yml

@@ -0,0 +1,38 @@
+---
+- name: Check Database Credentials
+ ansible.builtin.assert:
+ that:
+ - _db['user'] is defined
+ - _db['password'] is defined
+ fail_msg: "No database credentials defined."
+
+- name: Build mysql command
+ ansible.builtin.set_fact:
+ _tmp_mysqlcmd: >-
+ mysql {% if _db['host'] | default('localhost') != 'localhost' %} -h "{{ _db['host'] }}" {%- endif %}
+ {% if _db['port'] is defined %} -P "{{ _db['port'] }}" {%- endif %}
+ {% if _db['ssl_mode'] is defined %} --ssl-mode "{{ _db['ssl_mode'] }}" {%- endif %}
+ {% if _db['ssl_ca'] is defined %} --ssl-ca "{{ _db['ssl_ca'] }}" {%- endif %}
+ {% if _db['ssl_cert'] is defined %} --ssl-cert "{{ _db['ssl_cert'] }}" {%- endif %}
+ {% if _db['ssl_key'] is defined %} --ssl-key "{{ _db['ssl_key'] }}" {%- endif %}
+ {% if _db['ssl_cipher'] is defined %} --ssl-cipher "{{ _db['ssl_cipher'] }}" {%- endif %}
+ {% if _db['ssl_extra_options'] is defined %} {{ _db['ssl_extra_options'] }} {%- endif %}
+ -u "{{ _db['user'] }}"
+ -p"{{ _db['password'] }}"
+ "{{ _db['name'] }}"
+
+- name: MySQL check for db schema
+ ansible.builtin.shell: >
+ {{ _tmp_mysqlcmd }}
+ -Ns -e "{{ _db['select_query'] }}"
+ failed_when: false
+ changed_when: false
+ check_mode: false
+ register: _db_schema
+
+- name: MySQL import db schema
+ ansible.builtin.shell: >
+ {{ _tmp_mysqlcmd }}
+ < {{ _db['schema_path'] }}
+ when: _db_schema.rc != 0
+ run_once: yes

roles/icingaweb2/tasks/modules/vspheredb.yml

@@ -0,0 +1,63 @@
+---
+- name: Module vSphereDB | Ensure config directory
+ ansible.builtin.file:
+ state: directory
+ dest: "{{ icingaweb2_modules_config_dir }}/vspheredb"
+ owner: "{{ icingaweb2_httpd_user }}"
+ group: "{{ icingaweb2_group }}"
+ mode: "2770"
+
+- name: Module vSphereDB | Manage config files
+ ansible.builtin.include_tasks: manage_module_config.yml
+ loop: "{{ _files }}"
+ loop_control:
+ loop_var: _file
+ when: vars['icingaweb2_modules'][_module][_file] is defined
+ vars:
+ _module: "{{ item.key }}"
+ _files:
+ - config
+
+- name: Module vSphereDB | Check for pending migrations
+ ansible.builtin.shell:
+ cmd: icingacli vspheredb migration pending
+ register: _pending
+ changed_when: _pending.rc|int == 0
+ failed_when: _pending.stdout|length > 0
+ when: vars['icingaweb2_modules']['vspheredb']['import_schema'] is defined and vars['icingaweb2_modules']['vspheredb']['import_schema'] and vars['icingaweb2_modules']['vspheredb']['config'] is defined
+
+- name: Module vSphereDB | Ensure installation from source is complete
+ when: icingaweb2_modules['vspheredb']['source'] == 'git'
+ block:
+ - name: Module vSphereDB | Ensure service user exists
+ ansible.builtin.user:
+ name: icingavspheredb
+ group: icingaweb2
+ system: true
+ home: /var/lib/icingavspheredb
+ shell: /bin/false
+
+ - name: Module vSphereDB | Ensure service user home exists
+ ansible.builtin.file:
+ state: directory
+ dest: /var/lib/icingavspheredb
+ owner: icingavspheredb
+ group: icingaweb2
+ mode: "0750"
+
+ - name: Module vSphereDB | Ensure service file is installed
+ ansible.builtin.copy:
+ src: "{{ icingaweb2_config.global.module_path }}/vspheredb/contrib/systemd/icinga-vspheredb.service"
+ dest: "/etc/systemd/system/icinga-vspheredb.service"
+ remote_src: true
+ mode: "0644"
+
+ - name: Module vSphereDB | Ensure socket file is copied
+ ansible.builtin.copy:
+ src: icinga-vspheredb.conf
+ dest: /etc/tmpfiles.d/icinga-vspheredb.conf
+ mode: 0644
+
+ - name: Module vSphereDB | Ensure socket file is installed
+ ansible.builtin.command: systemd-tmpfiles --create /etc/tmpfiles.d/icinga-vspheredb.conf
+