Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Breaking change in tracing setup, no more jaeger agent possible #2453

Closed
wkloucek opened this issue Aug 31, 2021 · 6 comments · Fixed by #2457
Closed

Breaking change in tracing setup, no more jaeger agent possible #2453

wkloucek opened this issue Aug 31, 2021 · 6 comments · Fixed by #2457
Labels
Category:Defect Existing functionality is not working as expected OCIS-Fastlane Planned outside of the sprint Type:Bug Type:Regression

Comments

@wkloucek
Copy link
Contributor

Describe the bug

After #2372 it's not possible anymore to use jaeger agent. oCIS services now want to send traces directly to the jaeger collector.

This is the respective code path:

exp, err := jaeger.New(
jaeger.WithCollectorEndpoint(
jaeger.WithEndpoint(collectorEndpoint),
),
)

This is a conflict to our recommendation on https://owncloud.dev/ocis/deployment/monitoring-tracing/ and the monitoring / tracing examples (https://github.com/owncloud-devops/monitoring-tracing-client, https://github.com/owncloud-devops/monitoring-tracing-server).

Especially for our fleet of continuously deployed oCIS examples, we are dependent on jaeger agent, since this supports adding tags:

https://github.com/owncloud-devops/monitoring-tracing-client/blob/176b5d268cd9d125a53dcd93dfd631226463e72a/docker-compose.yml#L53

These tags allow us to filter oCIS instances in our single jaeger instance (https://jaeger.infra.owncloud.works/search) where all oCIS demo instances are reporting to.

Steps to reproduce

Steps to reproduce the behavior:

  1. start one of our oCIS deployment examples with the monitoring / tracing additions
    ocis:
    environment:
    OCIS_TRACING_ENABLED: "true"
    OCIS_TRACING_ENDPOINT: jaeger-agent:6831
  2. start the monitoring / tracing client besides it (https://github.com/owncloud-devops/monitoring-tracing-client/blob/master/docker-compose.yml)

Expected behavior

oCIS sends traces to the jaeger agent, which forwards them to the jaeger collector and you can see them in the jaeger UI.

Actual behavior

oCIS says 2021/08/31 00:21:50 Post "": unsupported protocol scheme ""

@wkloucek wkloucek added Type:Regression Category:Defect Existing functionality is not working as expected labels Aug 31, 2021
@wkloucek
Copy link
Contributor Author

@micbar @refs is this something for the fastlane or next sprint?

@micbar micbar added the OCIS-Fastlane Planned outside of the sprint label Sep 1, 2021
@refs
Copy link
Member

refs commented Sep 1, 2021

mea culpa. Fastlane, I'll get to it now, as I believe it should be a quick one. Sorry for the regression, I assumed too much :)

@wkloucek
Copy link
Contributor Author

wkloucek commented Sep 1, 2021

mea culpa. Fastlane, I'll get to it now, as I believe it should be a quick one. Sorry for the regression, I assumed too much :)

No worries. Single oCIS deployments may also use the Collector directly, but since we have 10+ extensions / service creating traces, it also may make sense to always use an Agent!?

@refs
Copy link
Member

refs commented Sep 1, 2021

it also may make sense to always use an Agent!?

I think you're right, as we should probably deploy an agent for example as a sidecar process with our services, whereas we would deploy only a collector, as its own service.

I would still keep creating an exporter from a collector endpoint if the config so requires it, but take precedence an agent. Opening a PR soon and we can move the discussion over there. Will link it here when I have it.

@exalate-issue-sync
Copy link

Alex Unger commented: PR in Reva: cs3org/reva#2029

PR in oCIS incoming.

@exalate-issue-sync
Copy link

Alex Unger commented: oCIS PR: #2457

@refs refs closed this as completed in #2457 Sep 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Category:Defect Existing functionality is not working as expected OCIS-Fastlane Planned outside of the sprint Type:Bug Type:Regression
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants