Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removing idex sort fiild from testUpdateSnapshotStatus #10080

Closed
wants to merge 0 commits into from

Conversation

gashutos
Copy link
Contributor

@gashutos gashutos commented Sep 15, 2023

This addition is breaking in 2.x
#10075.

The reason is, index is getting created in mixed cluster on newer versions, and shards are routed back to old versions, and then from old version it is trying to restore snapshot to newer version.
Our fix introduced here #10045 wont work in this case as Index version is already newer version, this wont be the scenario in real world. So removing as of now to unblock critical upgrade fix.

Between this line was added in PR #10045 only

@gashutos
Copy link
Contributor Author

gashutos commented Sep 15, 2023

@reta @andrross
This case didnt fail in main. So it is matter of chance if index is getting created on new vs old nodes.

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

github-actions bot commented Sep 15, 2023

Compatibility status:

Checks if related components are compatible with change 5fdd418

Incompatible components

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git]

@@ -387,7 +387,7 @@ public void testUpdateSnapshotStatus() throws Exception {
Settings.Builder settings = Settings.builder()
.put(IndexMetadata.INDEX_NUMBER_OF_SHARDS_SETTING.getKey(), between(5, 10))
.put(IndexMetadata.INDEX_NUMBER_OF_REPLICAS_SETTING.getKey(), 1)
.putList("index.sort.field", "sortfield")
//.putList("index.sort.field", "sortfield") /* disabling as of now as it breaks non production scenario */
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gashutos just trying to understand if we are phasing out a valid scenario:

  • assume the index is created in 1.3 with index sort
  • the snapshot of this index is taken
  • the snapshot is restored in 2.11

That should work, right? Or the test does something different? If we comment out index.sort.field, the original flow that triggers the issue won't be exercised, right?

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@codecov
Copy link

codecov bot commented Sep 15, 2023

Codecov Report

Merging #10080 (85dc9ce) into main (e6dec29) will decrease coverage by 0.01%.
Report is 7 commits behind head on main.
The diff coverage is 77.90%.

@@             Coverage Diff              @@
##               main   #10080      +/-   ##
============================================
- Coverage     71.03%   71.03%   -0.01%     
- Complexity    58071    58090      +19     
============================================
  Files          4824     4825       +1     
  Lines        273918   273976      +58     
  Branches      39918    39922       +4     
============================================
+ Hits         194591   194622      +31     
- Misses        63017    63036      +19     
- Partials      16310    16318       +8     
Files Changed Coverage Δ
...org/opensearch/index/fielddata/IndexFieldData.java 74.07% <0.00%> (-1.40%) ⬇️
.../org/opensearch/index/translog/TranslogHeader.java 81.48% <ø> (ø)
...opensearch/transport/TransportResponseHandler.java 0.00% <0.00%> (ø)
...ain/java/org/opensearch/index/IndexSortConfig.java 73.49% <50.00%> (-1.51%) ⬇️
...in/java/org/opensearch/index/shard/IndexShard.java 69.45% <78.57%> (-0.02%) ⬇️
...nsearch/index/fielddata/IndexNumericFieldData.java 85.07% <80.00%> (-1.14%) ⬇️
...ava/org/opensearch/transport/TransportService.java 78.38% <80.00%> (-1.62%) ⬇️
...ing/handler/TraceableTransportResponseHandler.java 83.33% <83.33%> (ø)
.../main/java/org/opensearch/index/IndexSettings.java 86.41% <100.00%> (+0.06%) ⬆️

... and 468 files with indirect coverage changes

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants