Fields gone missing - Reload field list not seeing fields

[hvisage]

Hi there,

I have a situation that we've created visualizations and dashboards before the weekend, and today, those visualizations/dashboards complains about "Could not locate that index-pattern-field (id: toastername.raw)". Looking at the discovery, shows the warning triangle about "No cached mapping for this field" for the entries. Tried the Settings -> index -> reload field list, but it still doesn't see the fields. restarted both elasticsearch and kibana 4.0.2 build 6004, same results, the two "important" fields are missing :(

Where do I start to debug this?

[rashidkpc]

What does your index pattern look like? Kibana looks at a maximum of 5 indices matching the pattern, is this a field that comes and goes?

[hvisage]

Hmmm... it is fields that is not in the last(newest) indexes, but "hidden" in older indexes (typically only loaded a month or so after the latest indexes have been loaded which do not contain these fields)

SO, how do I get Kibana to scan all of the indexes?

[hvisage]

Okay, perhaps the way I'll have to solve this is to break out those two setups of logs, though similar but from different versions of the source software, into two separate sets of indexes.
PS: Is Kibana able to coalesce two sets of indexes, ie. [indexA-]YYYY.MM.DD and [indexB-]YYYY.MM.DD into the same visualization & dashboards?

[rashidkpc]

I'm going to go ahead and file this as a bug. We really need to come up with a way to scan all indices.

[rashidkpc]

Duplicate of #2928

[yidingalan]

@rashidkpc so what's the solution to tackle this problem. I had the same issues and the index will always be gone after refreshing the page