#491: adding compression to metrics API

[nagydaoudt]

What does this PR do?

It's addressing #491, Adding deflate compression to metrics API

Motivation

Testing Guidelines

By adding a test, I don't have an AWS account, So maybe you can help me run the integration tests

Types of Changes

• Bug fix
• New feature
• Breaking change
• Misc (docs, refactoring, dependency upgrade, etc.)

Check all that apply

• This PR's description is comprehensive
• This PR contains breaking changes that are documented in the description
• This PR introduces new APIs or parameters that are documented and unlikely to change in the foreseeable future
• This PR impacts documentation, and it has been updated (or a ticket has been logged)
• This PR's changes are covered by the automated tests
• This PR collects user input/sensitive content into Datadog
• This PR passes the integration tests (ask a Datadog member to run the tests)

[astuyve]

Overall looks great, thanks for the PR. One thing we should chante

Some users are using the datadog lambda extension where this proposed DD_COMPRESS_METRIC_PAYLOAD env var would not be honored.

Let's remove it and use compression all the time, which is what datadog-lambda-python does. That should simplify the implementation as well. I can run it through our test bed and see if it creates extra latency, but given that I expect most payloads to be small, it should be fine. That is unless users are pushing massive numbers of metrics and thus would want compression.

Thanks!

[nagydaoudt]

@astuyve
Should I also remove this configuration: https://github.com/DataDog/datadog-lambda-js/pull/492/files#diff-a2a171449d862fe29692ce031981047d7ab755ae7f84c707aef80701b3ea0c80R92

[astuyve]

Yup! Should make the implementation easier, just rip out the config boolean everywhere.

[astuyve]

LGTM, thanks for the contribution! (just need to run prettier)

[astuyve]

Our CI won't run on a fork, I'll merge this and let the integration tests run. I'll update the github issue when this is released.

Thanks again!

[astuyve]

This is released in 8.107.0 and layer v107!