Field format error

[sulemanof]

Kibana version:
master

Describe the bug:
While operating with hour_of_day numeric field from kibana_sample_data_logs index,
there is an error appears in console when choosing the field in the visualization editor:

Steps to reproduce:

1. install kibana_sample_data_logs sample index
2. create a new visualization (e.x. Data table)
3. add a Split row bucket -> Terms agg -> choose hour_of_day
4. see the vis is crashed, errors in console

Any additional context:

This #78352 PR can possibly be a reason of the regression

[elasticmachine]

Pinging @elastic/kibana-app-arch (Team:AppArch)

[sulemanof]

Also the related issue #81206
since [Logs] Heatmap vis uses a terms agg by the same field:

[mattkime]

@sulemanof I'm attempting to address this problem but failed to reproduce the problem on master. Can you try to reproduce it? Perhaps I'm overlooking something.

[sulemanof]

@mattkime I believe this PR #82876 fixed mentioned regressions!