Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Maps] Features not being imported from valid GeoJson files #107335

Closed
kelastic opened this issue Jul 30, 2021 · 3 comments · Fixed by #107907
Closed

[Maps] Features not being imported from valid GeoJson files #107335

kelastic opened this issue Jul 30, 2021 · 3 comments · Fixed by #107907
Labels
bug Fixes for quality problems that affect the customer experience [Deprecated-Use Team:Presentation]Team:Geo Former Team Label for Geo Team. Now use Team:Presentation impact:high Addressing this issue will have a high level of impact on the quality/strength of our product.

Comments

@kelastic
Copy link

Kibana version:
7.13.4

Elasticsearch version:
7.13.4

Server OS version:
macOS 10.15.7 (with and Intel CPU)
karl@Karls-MacBook-Pro-2 geojson % uname -a
Darwin Karls-MacBook-Pro-2.local 19.6.0 Darwin Kernel Version 19.6.0: Tue Jun 22 19:49:55 PDT 2021; root:xnu-6153.141.35~1/RELEASE_X86_64 x86_64

Browser version:
Google Chrome is up to date
Version 92.0.4515.107 (Official Build) (x86_64)

Browser OS version:
macOS 10.15.7 (with and Intel CPU)
karl@Karls-MacBook-Pro-2 geojson % uname -a
Darwin Karls-MacBook-Pro-2.local 19.6.0 Darwin Kernel Version 19.6.0: Tue Jun 22 19:49:55 PDT 2021; root:xnu-6153.141.35~1/RELEASE_X86_64 x86_64

Original install method (e.g. download page, yum, from source, etc.):
Downloaded these 2 files and ran tar xzf
elasticsearch-7.13.4-darwin-x86_64.tar.gz
kibana-7.13.4-darwin-x86_64.tar.gz
I then ran /bin/elasticsearch and /bin/kibana and enabled the trial license.
There was no other load on the cluster or Kibana.

Describe the bug:
Please note: This information is copied from the Slack conversation:
https://elastic.slack.com/archives/C2ZUZ5T7B/p1627673794014800

I’m trying to import 3 GeoJson files with 7.13.4. I’ve checked that they are all valid using: https://www.itb.ec.europa.eu/json/geojson/upload
One of them imports successfully, but the other 2 cause messages such as this to be displayed after import:
“Indexed 13 features. Unable to index 5 features” AND 1 feature is missing from the map.
After I select the GeoJson file, but before I import it, all features are displayed on the map.
After I add the layer to the map, it appears that 5 features are missing from the map.
The import response JSON contains this: “reason”: “failed to parse”,
There are 8 records (i.e. 13-5) in the index that is created.

I've also checked the GeoJson file renders correctly here: http://geojson.io/

Also, I thought that it could be related to the Arabic letters, so I used http://geojson.io to remove most of the columns, but I still only got 8 out of 13 features imported by Elastic.

Steps to reproduce:

  1. Install a single node cluster on a Mac laptop, do not load in any data
  2. Create a new map and load in saudi-arabia-regions.geojson
  3. Please note, this file also has a similar issue: saudi-arabia-districts.geojson

Expected behavior:

  1. For all features to be imported successfully.
  2. For saudi-arabia-regions.geojson, I would except a new index to be createed with 13 and not just 8 documents.
  3. For saudi-arabia-regions.geojson, I would expect for the map of Saudi Arabia to be completely covered with regions
  4. I would expect the same result from Elastic as from http://geojson.io

Screenshots (if relevant):
Please see attached.

Errors in browser console (if relevant):
None

Provide logs and/or server output (if relevant):
No relevant log entries were produced.

Any additional context:
If you would to have a Zoom call for more details, I would be happy to help. FYI, I'm based in the UK and my email address is: [email protected]
Thanks, Karl

saudi-arabia-regions.geojson.zip
saudi-arabia-districts.geojson.zip

Screenshot 2021-07-30 at 21 04 50
Screenshot 2021-07-30 at 21 17 15
step 0 - before import
step 2 - after add layer
step 1 - after import

@kelastic kelastic added the bug Fixes for quality problems that affect the customer experience label Jul 30, 2021
@botelastic botelastic bot added the needs-team Issues missing a team label label Jul 30, 2021
@kindsun kindsun added the [Deprecated-Use Team:Presentation]Team:Geo Former Team Label for Geo Team. Now use Team:Presentation label Jul 30, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-gis (Team:Geo)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Jul 30, 2021
@kindsun kindsun changed the title Features not being imported from valid GeoJson files [Maps] Features not being imported from valid GeoJson files Jul 30, 2021
@kelastic
Copy link
Author

kelastic commented Aug 2, 2021

I tested my 2 GeoJSON files (already attached previously) with http://mapshaper.org/ and the districts imported successfully, but the regions gave this error message:

Error importing regions.geojson
Unable to import mixed-geometry GeoJSON features

@nreese nreese added the impact:high Addressing this issue will have a high level of impact on the quality/strength of our product. label Aug 4, 2021
@nreese
Copy link
Contributor

nreese commented Aug 9, 2021

saudi-arabia-regions.geojson.zip contains invalid polygons for elasticsearch tessellation. #107907 adds the caused_by details to the output to provide better feedback for users

Screen Shot 2021-08-09 at 8 56 37 AM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience [Deprecated-Use Team:Presentation]Team:Geo Former Team Label for Geo Team. Now use Team:Presentation impact:high Addressing this issue will have a high level of impact on the quality/strength of our product.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants