Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

es.index-prefix should not include : #1238

Closed
gitclonedcush opened this issue Dec 4, 2018 · 10 comments · Fixed by #1284
Closed

es.index-prefix should not include : #1238

gitclonedcush opened this issue Dec 4, 2018 · 10 comments · Fixed by #1284
Assignees

Comments

@gitclonedcush
Copy link

es.index-prefix should not include :

It would be better if the index-prefix did not include :, is there an explicit reason this is included? It actually prevents uniformity with our other elasticsearch indices. We have elasticsearch curator code that pattern matches, and the colon makes this more tedious.

Proposal - what do you suggest to solve the problem or improve the existing situation?

Either exclude the : in the es.index-prefix or make it optional.

@pavolloffay
Copy link
Member

We have chosen : to clearly distinguish the prefix from the name. The name uses - between words e.g. tenant:jaeger-span-index.

@yurishkuro
Copy link
Member

IIIRC newer ES versions are not going to support colon in the index name. There was a similar discussion in zipkin.

@pavolloffay
Copy link
Member

It's traced in elastic/elasticsearch#23892. It will be probably removed in version ES7.

I guess we can simply remove it and do direct concatenation with the name.

@pavolloffay
Copy link
Member

Now the question is how to fix this in jaeger. The simplest is to change : to - but it will break people.

The other option is to remove adding any separator to the prefix. It still breaks existing deployments using the prefix. They will have to change index prefix configuration and add : in there.

When do we want to do this? As soon as possible or let say wait for jaeger 2.0, but when will it happen?

@objectiser
Copy link
Contributor

The simplest is to change : to - but it will break people.

The benefit of just changing the separator is that it does not impact the user (in terms of prefix configuration) as long as reading from indexes with either char is supported for some period of time.

@gitclonedcush
Copy link
Author

gitclonedcush commented Dec 7, 2018

In our case its best to leave it out entirely, and we can still clearly delineate the prefix if we choose. I wouldn't be opposed to keeping some type of separator, but in that case would at least like it to be optional.

@gitclonedcush
Copy link
Author

I actually removed the : altogether and rebuilt the image. If that's the solution you want I can submit a PR.

@pavolloffay
Copy link
Member

as long as reading from indexes with either char is supported for some period of time.

I like the idea, but I don't like to complicate readers. Not sure if it would cripple query time as we would double number of indices (even half of them would not exists).

I would like to hear more from other people who are using ES storage cc @jaegertracing/elasticsearch

@masteinhauser
Copy link
Member

I think Elasticsearch could handle specifying multiple indices to search, matching the two known patterns during a period where Jaeger has deprecated the old : colon-based separation. Especially if only a single index exists in either the new or old format, it should be transparent to Jaeger's queries.

@pavolloffay
Copy link
Member

I am looking into this. I will change the processing to include both separators - and : during the deprecation period.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants