Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failed to lookup SRV records #5366

Open
Dauber01 opened this issue May 16, 2022 · 5 comments
Open

failed to lookup SRV records #5366

Dauber01 opened this issue May 16, 2022 · 5 comments

Comments

@Dauber01
Copy link

image

when i add the head of "dnssrv+_grpc._tcp." i got a error like the picture show caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-receive-ingestor-default.namespace.svc err="no such host" and when i don't add the head , it work as well,so what should i do if i want to use the head "dnssrv+_grpc._tcp." at the verson of 24 in kubenets v1.20.10
@stale
Copy link

stale bot commented Jul 31, 2022

Hello 👋 Looks like there was no activity on this issue for the last two months.
Do you mind updating us on the status? Is this still reproducible or needed? If yes, just comment on this PR or push a commit. Thanks! 🤗
If there will be no activity in the next two weeks, this issue will be closed (we can always reopen an issue if we need!). Alternatively, use remind command if you wish to be reminded at some point in future.

@stale stale bot added the stale label Jul 31, 2022
@subbuedcast
Copy link

level=warn ts=2022-09-20T08:30:14.347379507Z caller=proxy.go:279 component=proxy request="min_time:1663662000000 max_time:1663662600000 matchers:<name:"cluster" > matchers:<type:RE name:"node" > matchers:<type:NEQ name:"container" > matchers:<name:"name" value:"node_namespace_pod_container:container_memory_working_set_bytes" > max_resolution_window:6000 aggregates:COUNT aggregates:SUM " err="No StoreAPIs matched for this query" stores="store Addr: 10.2.2.192:10901 LabelSets: {prometheus="platform/prometheus-operator-prometheus", prometheus_replica="prometheus-prometheus-operator-prometheus-0"} Mint: 1630390089788 Maxt: 1663653600000 filtered out: does not have data within this time period: [1663662000000,1663662600000]. Store time ranges: [1630390089788,1663653600000]"
level=error ts=2022-09-20T08:30:39.290908121Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"
level=error ts=2022-09-20T08:31:09.243997623Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"
level=error ts=2022-09-20T08:31:39.297070824Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"
level=error ts=2022-09-20T08:32:09.264274188Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"
level=error ts=2022-09-20T08:32:39.275291006Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"
level=error ts=2022-09-20T08:33:09.306956837Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"

level=error ts=2022-09-20T08:33:39.27053823Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"
level=error ts=2022-09-20T08:34:09.288647186Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"
level=error ts=2022-09-20T08:34:39.294578868Z caller=resolver.go:99 msg="failed to lookup SRV records" host=_grpc._tcp.thanos-sidecar-grpc.platform.svc.cluster.loca err="no such host"

@subbuedcast
Copy link

The error is fixed because labeling was not done properly

@stale stale bot removed the stale label Sep 22, 2022
@osipovdaniil
Copy link

osipovdaniil commented Nov 21, 2022

i have same problem when i try to connect to memcached
i have service memcached-thanos-system
In thanos-store:

- |-
          --index-cache.config="config":
            "addresses":
            - "dnssrv+_client._tcp.memcached-thanos-system.{{ .Release.Namespace }}.svc.cluster.local"
          "type": "memcached"
        - |-
          --store.caching-bucket.config="blocks_iter_ttl": "5m"
          "chunk_object_attrs_ttl": "24h"
          "chunk_subrange_size": 16000
          "chunk_subrange_ttl": "24h"
          "config":
            "addresses":
            - "dnssrv+_client._tcp.memcached-thanos-system.{{ .Release.Namespace }}.svc.cluster.local"
          "type": "memcached"

I got msg="failed to lookup SRV records" host=_grpc._tcp.memcached-thanos-system.prometheus-system-layer err="no such host"

But from other pod, i run nslookup memcached-thanos-system.prometheus-system-layer and this work, dns resolve ip

Help please, Any ideas?
@Dauber01 Did you solve the problem?

UPD:

I use

"addresses":
            - "memcached-thanos-system.{{ .Release.Namespace }}.svc.cluster.local:11211"

Instead

"addresses":
            - "dnssrv+_client._tcp.memcached-thanos-system.{{ .Release.Namespace }}.svc.cluster.local"

And this work for me

@ricardov1
Copy link

The error is fixed because labeling was not done properly

@subbuedcast could you elaborate on this? which labels on which pod/s were incorrect and how did you fix them?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants