ingest: Default index pipeline not being applied to docs during bulk indexing

[rfraposa]

Elasticsearch version (bin/elasticsearch --version): 6.5.1

Description of the problem including expected versus actual behavior: I am indexing a Google spreadsheet (using the add-on: https://github.com/elastic/google-sheets-add-on) into a 6.5.1 cluster. The index has a default pipeline defined, which works as expected if I use _bulk from within Console. But the pipeline is not being applied to docs indexed using a _bulk insert from the JavaScript code.

[elasticmachine]

Pinging @elastic/es-core-features

[jakelandis]

@rfraposa - could this be a due to #35817 ? (Console doesn't do anything special with the request)

If so, can we close as a duplicate ?

[rfraposa]

I don't know if it is the same issue, but it might be. The JavaScript code is not using any aliases - the _bulk command uses the actual index name.

[jakelandis]

Is it possible to grab the http requests that are being sent from JavaScript ?

Or can you provide a reproduction scenario ?

[rfraposa]

I don't seem to be able to see the requests - not sure why. I'll PM you a link to a google doc with everyone configured and ready for testing.

[rfraposa]

Sorry @jakelandis - I don't know how the Add-On works, but it appears to use a callback mechanism. The data is not posted from my browser, so I can't see the _bulk command.

At any rate, my guess is that this is a duplicate of #35817 - it's the only thing that makes sense.

[jakelandis]

closing and will take a closer look outside of this issue.

[jakelandis]

I believe the root cause of this issue is #36219 (which was uncovered by investigating this issue) thanks for report @rfraposa !