Refactor integration testing suites

[Crazybus]

Right now there is a lot of testing duplication in the test suites. We also have some suites which are only testing a couple of things which are already being tested.

New setup and roles

oss

Standard elasticsearch-oss role with idempotency test

oss-upgrade

Upgrade from previous minor version oss to current minor version oss

oss-to-xpack-upgrade Upgrade from previous minor version oss to current minor version xpack

xpack

Standard elasticsearch (with xpack) role with idempotency test

xpack-upgrade

Upgrade from previous minor version xpack to current minor version xpack
multi: Tests multiple instances of elasticsearch on a single machine

The plan is to make sure that all of the features being tested by the current test suites end up in the new test suites (plus extra options and tests)

Notes about what the current test suites actually do:

config:

• oss
• changes the transport port from 9301 to 9501
• changes the http port from 9201 to 9301
• changes bootatrp.memory_lock from false to true
• sets es_max_threads to 3000
• installs ingest-geoip, then switches to ingest-attachment and ingest-user-agent
• add custom es_config_log4j2 file

issue-test:

• xpack
• es_users file and native
• es_role native

multi:

• oss
• deploy a master
• deploy a data node on a different port

package:

• oss
• installs an extra plugin

standard:

• oss
• install plugin ingest-geoip
• tests idempotence

xpack-standard:

• xpack
• increase heap size to 2g
• enable xpack features: monitoring, graph, ml

xpack:

• xpack
• first run:
  • upgrade from previous version to current version (6.2.4 to 6.3.0)
  • test installing xpack license
  • es_templates: true
  • enable features: security, alerting
  • basic auth
  • es_message_auth_file
  • es_role_mapping
  • es_users: native, file
  • es_roles: native, file
• second run:
  • install a different plugin
  • change basic auth password
  • remove elastic user from es_users.native
  • don't set a password for logstash_system user
  • remove es_roles variable

[itsmed]

🍠