Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Limit in flight requests when indexing model download parts #113710

Merged
merged 1 commit into from
Sep 27, 2024

Conversation

davidkyle
Copy link
Member

Manual backport of #112992

…stic#112992)

Restores the changes from elastic#111684 which uses multiple streams to improve the
time to download and install the built in ml models. The first iteration has a problem
where the number of in-flight requests was not properly limited which is fixed here.
Additionally there are now circuit breaker checks on allocating the buffer used to
store the model definition.
# Conflicts:
#	x-pack/plugin/ml-package-loader/src/main/java/org/elasticsearch/xpack/ml/packageloader/action/TransportLoadTrainedModelPackage.java
#	x-pack/plugin/ml-package-loader/src/test/java/org/elasticsearch/xpack/ml/packageloader/action/TransportLoadTrainedModelPackageTests.java
@davidkyle davidkyle added >non-issue :ml Machine learning backport auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) labels Sep 27, 2024
@elasticsearchmachine elasticsearchmachine merged commit de607d4 into elastic:8.15 Sep 27, 2024
15 checks passed
@davidkyle davidkyle deleted the bp-112992 branch September 27, 2024 17:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport :ml Machine learning >non-issue v8.15.3
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants