[7.17](backport #39211) Update xpack/filebeat & xpack/metricbeat pipelines to match Jenkins steps

[mergify]

Proposed commit message

Updated x-pack/filebeat and x-pack/metricbeat pipelines to match same steps & commands as in Jenkins.

Jenkins vs. Buildkite comparison

• x-pack/filebeat: https://gist.github.com/oakrizan/0ef4a4df595547489538cbbc0ad1a4e5
• x-pack/metricbeat: https://gist.github.com/oakrizan/97eabb0635ad7727ae2b37e3f8469ff8

For both pipelines updated cloud test environment setup script and test commands to match Jenkins.

x-pack/filebeat: Cloud (MODULE) Tests failure is not related to current PR changes.

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Author's Checklist

• .buildkite/x-pack/pipeline.xpack.filebeat.yml
• .buildkite/x-pack/pipeline.xpack.metricbeat.yml

How to test this PR locally

Related issues

• Relates: https://github.com/elastic/ingest-dev/issues/3254

Use cases

Screenshots

Logs

BK builds:
x-pack/filebeat: https://buildkite.com/elastic/beats-xpack-filebeat/builds?branch=elastic%3Amergify%2Fbp%2F7.17%2Fpr-39211
x-pack/metricbeat: https://buildkite.com/elastic/beats-xpack-metricbeat/builds?branch=elastic%3Amergify%2Fbp%2F7.17%2Fpr-39211

---

This is an automatic backport of pull request #39211 done by [Mergify](https://mergify.com).

[mergify]

Cherry-pick of bf13818 has failed:

On branch mergify/bp/7.17/pr-39211
Your branch is up to date with 'origin/7.17'.

You are currently cherry-picking commit bf138189db.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	renamed:    .buildkite/scripts/cloud_tests.sh -> .buildkite/scripts/setup_cloud_env.sh

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   .buildkite/x-pack/pipeline.xpack.filebeat.yml
	both modified:   .buildkite/x-pack/pipeline.xpack.metricbeat.yml

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

[mergify]

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b mergify/bp/7.17/pr-39211 upstream/mergify/bp/7.17/pr-39211
git merge upstream/7.17
git push upstream mergify/bp/7.17/pr-39211

[oakrizan]

/test

[oakrizan]

/test

[dliappis]

LGTM

[dliappis]

LGTM with the latest changes too