Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Elasticsearch setup job does not create index datahub_usage_event #6924

Closed
bossenti opened this issue Jan 2, 2023 · 0 comments
Closed

Elasticsearch setup job does not create index datahub_usage_event #6924

bossenti opened this issue Jan 2, 2023 · 0 comments
Assignees
Labels
bug Bug report

Comments

@bossenti
Copy link
Contributor

bossenti commented Jan 2, 2023

Describe the bug
The setup job for elasticsearch does not create the index datahub_usage_event.
With that missing, the analytics page only displays a wide screen.
When creating the index manually with curl -XPUT 'http://localhost:9200/_data_stream/datahub_usage_event',
the analytics page renders successfully.

Expected behavior
The index datahub_usage_event is created by the elasticsearch setup job.

Versions
datahub-chart: 0.2.116
datahub-prerequisites: 0.0.11
elasticsearch-setup-job: 0.9.3

Additional context
see also https://datahubspace.slack.com/archives/CV2UVAPPG/p1672673087716239

logs of the setup job:

2023/01/02 09:55:13 Waiting for: http://elasticsearch-master:9200/
2023/01/02 09:55:13 Received 200 from http://elasticsearch-master:9200/
going to use protocol: http
going to use default elastic headers
not using any prefix

 datahub_analytics_enabled: true

>>> GET _ilm/policy/datahub_usage_event_policy response code is 404
>>> creating _ilm/policy/datahub_usage_event_policy because it doesn't exist ...
{
  "policy": {
    "phases": {
      "hot": {
        "actions": {
          "rollover": {
            "max_age": "7d"
          }
        }
      },
      "delete": {
        "min_age": "60d",
        "actions": {
          "delete": {}
        }
      }
    }
  }
}{"acknowledged":true}
>>> GET _index_template/datahub_usage_event_index_template response code is 404
>>> creating _index_template/datahub_usage_event_index_template because it doesn't exist ...
{
  "index_patterns": ["*datahub_usage_event*"],
  "data_stream": { },
  "priority": 500,
  "template": {
    "mappings": {
      "properties": {
        "@timestamp": {
          "type": "date"
        },
        "type": {
          "type": "keyword"
        },
        "timestamp": {
          "type": "date"
        },
        "userAgent": {
          "type": "keyword"
        },
        "browserId": {
          "type": "keyword"
        }
      }
    },
    "settings": {
      "index.lifecycle.name": "datahub_usage_event_policy"
    }
  }
}{"acknowledged":true}
2023/01/02 09:55:13 Command finished successfully.
@bossenti bossenti added the bug Bug report label Jan 2, 2023
@szalai1 szalai1 self-assigned this Jan 2, 2023
@szalai1 szalai1 closed this as completed Jan 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug report
Projects
None yet
Development

No branches or pull requests

2 participants