Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve compatibility matrix testing #2134

Open
1 of 2 tasks
jsoriano opened this issue Nov 5, 2021 · 3 comments
Open
1 of 2 tasks

Improve compatibility matrix testing #2134

jsoriano opened this issue Nov 5, 2021 · 3 comments
Labels
Team:Ecosystem Label for the Packages Ecosystem team [elastic/ecosystem]

Comments

@jsoriano
Copy link
Member

jsoriano commented Nov 5, 2021

Currently, packages in this repository have limited testing coverage with different versions of the stack:

  • On PRs, they are tested with the last supported version according to the kibana.version constraint. This is done to ensure that backwards compatibility is warranted as defined in the package.
  • CI jon can be parameterized with a stackVersion. There is a daily job testing with the last 7.x and 8.x snapshots, to know if some package breaks with new versions.

This has some problems:

  • Upper bounds of the kibana.version constraints are not checked at any moment.
  • Intermediary versions are not checked at any moment.
  • Daily jobs attempt to run tests for all packages for the given version, even if the package doesn't support this version.

Some things to do:

@botelastic
Copy link

botelastic bot commented Dec 13, 2022

Hi! We just realized that we haven't looked into this issue in a while. We're sorry! We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!

@botelastic
Copy link

botelastic bot commented May 2, 2024

Hi! We just realized that we haven't looked into this issue in a while. We're sorry! We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!

@botelastic botelastic bot added the Stalled label May 2, 2024
@mrodm
Copy link
Contributor

mrodm commented May 9, 2024

👍

@botelastic botelastic bot removed the Stalled label May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Ecosystem Label for the Packages Ecosystem team [elastic/ecosystem]
Projects
None yet
Development

No branches or pull requests

2 participants