Failing to import few saved objects via the kbn archiver. Missing reference error

[rashmivkulkarni]

Trying to migrate es_archiver to kbn_archiver for Maps tests

Part of #102552

Steps:
1 ) load esArchiver of Maps tests for .kibana data : x-pack/test/functional/es_archives/maps/kibana

NODE_TLS_REJECT_UNAUTHORIZED=0 node --no-warnings scripts/es_archiver load x-pack/test/functional/es_archives/maps/kibana  --config test/functional/config.js  --es-url=http://elastic:changeme@localhost:9220 --kibana-url=http://elastic:changeme@localhost:5620

2. Find all the different types of saved objects in .kibana loaded in the first step by running

2. cat  x-pack/test/functional/es_archives/maps/kibana/data.json | awk '{$1=$1};1' | fgrep '"type":' | fgrep -v '"type": "doc"' | sort | uniq

resulted in:

"filters": [{"meta":{"index":"b15b1d40-a8bb-11e9-98cf-2bb06ef63e0b","alias":null,"negate":false,"type":"phrase","key":"extension.raw","value":"jpg","params":{"query":"jpg"},"disabled":false},"query":{"match":{"extension.raw":{"query":"jpg","type":"phrase"}}},"$state":{"store":"appState"}}]
"type": "dashboard",
"type": "envelope"
"type": "index-pattern"
"type": "map"
"type": "map",
"type": "polygon"
"type": "query",
"type": "space"
"type":"index-pattern"

3. Now save .kibana json into KBN archiver by running (please feed the types from step 2 here - dashboard,index-pattern,map)

node scripts/kbn_archiver.js --config x-pack/test/functional/config.js save x-pack/test/functional/fixtures/kbn_archiver/maps/data.json  --type dashboard,index-pattern,map 

Resulted in :

 succ Exported 33 saved objects to /Users/rashmikulkarni/Documents/kibana/x-pack/test/functional/fixtures/kbn_archiver/maps.json

rest of the type (s) - gave errors

ERROR 400 resp: '{"statusCode":400,"error":"Bad Request","message":"Trying to export non-exportable type(s): envelope, polygon, space"}'

4. Make the changes in the index file of Maps test - Replace esArchiver loading .kibana and unloading:

     await kibanaServer.importExport.load(
        'x-pack/test/functional/fixtures/kbn_archiver/maps.json'
      );

5. Run the tests. node scripts/functional_test_runner.js

1)    maps app
 │       "before all" hook in "maps app":
 │
 │      Error: failed to import all saved objects: {
 │   errors: [
 │     {
 │       error: {
 │         references: [
 │           {
 │             id: 'idThatDoesNotExitForESGeoGridSource',
 │             type: 'index-pattern'
 │           },
 │           {
 │             id: 'idThatDoesNotExitForESSearchSource',
 │             type: 'index-pattern'
 │           },
 │           {
 │             id: 'idThatDoesNotExitForESJoinSource',
 │             type: 'index-pattern'
 │           }
 │         ],
 │         type: 'missing_references'
 │       },
 │       id: '745c98b0-23e1-11e9-a048-6fef5a3e0d1e',
 │       meta: {
 │         icon: 'gisApp',
 │         title: 'layer with errors'
 │       },
 │       title: 'layer with errors',
 │       type: 'map'
 │     }
 │   ],
 │   success: false,
 │   successCount: 32,

tried to find the referenced id in the original es_archiver and newly saved kbn_archiver, they do have the references.

[elasticmachine]

Pinging @elastic/kibana-operations (Team:Operations)

[elasticmachine]

Pinging @elastic/kibana-gis (Team:Geo)

[tylersmalley]

This isn't a bug, and something we discussed already. One of the tests is validating a case where there is a missing index pattern, so the esArchive has just that - a missing index pattern. You can't do that with the import API since it validates that all the references exist. You will need to populate the reference and can delete it after it's been successfully imported.

[rashmivkulkarni]

identifying the missing references and adding them to the kbnArchiver- data.json resolves this issue. Also added the logic in the maps index.js file to delete them using the API after successful import .

Ref PR: #103028