Jump to content

Portal:Cloud VPS/Admin/Runbooks/GaleraDown

From Wikitech
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.


The GaleraDown alert fires when mysqld exporter can't connect to the MariaDB instance on a cloudcontrol node.

The procedures in this runbook require admin permissions to complete.

Error / Incident

The datastore used by all OpenStack services is unreachable.

Debugging

Log in to the host in question, then:

  1. Check if you can log in to the MariaDB host manually:
    user@cloudcontrolXXXX ~ $ sudo -i mariadb -u root
  2. Check the mysqld-exporter logs:
    user@cloudcontrolXXXX ~ $ sudo systemctl status prometheus-mysqld-exporter.service

Common issues

Add here any new common issues you find.

Support contacts

Old incidents

Add here any new tasks for incidents you might encounter.

Retrieved from "https://wikitech.wikimedia.org/w/index.php?title=Portal:Cloud_VPS/Admin/Runbooks/GaleraDown&oldid=2107757"