forked from apache/horaedb
-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[pull] main from apache:main #50
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
## Rationale Add sst level configuration for the benchmark test. ## Detailed Changes Add sst level configuration for the benchmark test. ## Test Plan Manual test --------- Co-authored-by: jiacai2050 <[email protected]>
## Rationale CI fails due to no space... ``` Error: No space left on device : '/home/runner/runners/2.313.0/_diag/pages/e678fbe3-017c-41da-8bca-a6d70099419c_0ce2596c-30e4-5db6-a7ae-10ecfd0107a7_1.log' ``` - https://github.com/apache/incubator-horaedb/actions/runs/7974416510/job/21770259595 ## Detailed Changes Refer https://github.com/orgs/community/discussions/25678 ## Test Plan CI
## Rationale Close #1461 ## Detailed Changes Bump datafusion to https://github.com/CeresDB/arrow-datafusion/commits/e21b03154, which is version 33. Some important breaking changes: - apache/datafusion#7920 - apache/datafusion#9109 ## Test Plan CI --------- Co-authored-by: jiacai2050 <[email protected]>
## Rationale Add exponential backoff retry. ## Detailed Changes follow [this](https://github.com/apache/arrow-rs/blob/dfb642809e93c2c1b8343692f4e4b3080000f988/object_store/src/client/backoff.rs#L26) backoff implementation. ## Test Plan New UT. --------- Co-authored-by: zealchen <[email protected]>
## Rationale The first step to support compaction offload #1480 ## Detailed Changes - Extract the common compaction logic to `CompactionExecutor`. - Define the `CompactionRunner` trait to support remote compaction after. - Define the `Compactor` to integration the new compaction logics, and insert them into main process. ## Test Plan Test manually.
## Rationale Refer to #1485, we will implement horaectl using rust. ## Detailed Changes * Remove go implementation of horaectl. ## Test Plan No need.
## Rationale Update version to 2.0.0, prepare for releasing v2.0.0. ## Detailed Changes ## Test Plan
## Rationale Upgrade rustc version ## Detailed Changes - upgrade rustc version - upgrade rand version - upgrade obkv-client version - upgrade clap version - Adapt to new APIs ## Test Plan CI
TRIVIAL AS IS Signed-off-by: tison <[email protected]>
## Rationale When time column is not in `select`, `extract_time_range` will not find time range of one query ## Detailed Changes - CeresDB/influxql#16 ## Test Plan CI
## Rationale Prepare for releasing v2.0.0 . ## Detailed Changes * Add NOTICE file. * Add ASF license header. ## Test Plan CI.
Bumps [mio](https://github.com/tokio-rs/mio) from 0.8.6 to 0.8.11. <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/tokio-rs/mio/blob/master/CHANGELOG.md">mio's changelog</a>.</em></p> <blockquote> <h1>0.8.11</h1> <ul> <li>Fix receiving IOCP events after deregistering a Windows named pipe (<a href="https://redirect.github.com/tokio-rs/mio/pull/1760">tokio-rs/mio#1760</a>, backport pr: <a href="https://redirect.github.com/tokio-rs/mio/pull/1761">tokio-rs/mio#1761</a>).</li> </ul> <h1>0.8.10</h1> <h2>Added</h2> <ul> <li>Solaris support (<a href="https://redirect.github.com/tokio-rs/mio/pull/1724">tokio-rs/mio#1724</a>).</li> </ul> <h1>0.8.9</h1> <h2>Added</h2> <ul> <li>ESP-IDF framework support (<a href="https://redirect.github.com/tokio-rs/mio/pull/1692">tokio-rs/mio#1692</a>).</li> <li>AIX operating system support (<a href="https://redirect.github.com/tokio-rs/mio/pull/1704">tokio-rs/mio#1704</a>).</li> <li>Vita support (<a href="https://redirect.github.com/tokio-rs/mio/pull/1721">tokio-rs/mio#1721</a>).</li> <li><code>{UnixListener,UnixStream}:bind_addr</code> (<a href="https://redirect.github.com/tokio-rs/mio/pull/1630">tokio-rs/mio#1630</a>).</li> <li><code>mio_unsupported_force_poll_poll</code> and <code>mio_unsupported_force_waker_pipe</code> <strong>unsupported</strong> configuration flags to force a specific poll or waker implementation (<a href="https://redirect.github.com/tokio-rs/mio/pull/1684">tokio-rs/mio#1684</a>, <a href="https://redirect.github.com/tokio-rs/mio/pull/1685">tokio-rs/mio#1685</a>, <a href="https://redirect.github.com/tokio-rs/mio/pull/1692">tokio-rs/mio#1692</a>).</li> </ul> <h2>Fixed</h2> <ul> <li>The <code>pipe(2)</code> based waker (swapped file descriptors) (<a href="https://redirect.github.com/tokio-rs/mio/pull/1722">tokio-rs/mio#1722</a>).</li> <li>The duplicate waker check to work correctly with cloned <code>Registry</code>s. (<a href="https://redirect.github.com/tokio-rs/mio/pull/1706">tokio-rs/mio#1706</a>).</li> </ul> <h1>0.8.8</h1> <h2>Fixed</h2> <ul> <li>Fix compilation on WASI (<a href="https://redirect.github.com/tokio-rs/mio/pull/1676">tokio-rs/mio#1676</a>).</li> </ul> <h1>0.8.7</h1> <h2>Added</h2> <ul> <li>Add/fix support for tvOS and watchOS, Mio should now build for tvOS and</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/tokio-rs/mio/commit/0328bdef900b6396b8d00d33c825cd8af748553d"><code>0328bde</code></a> Release v0.8.11</li> <li><a href="https://github.com/tokio-rs/mio/commit/708449851283b57eb6f514c8f289b66e982720b3"><code>7084498</code></a> Fix warnings</li> <li><a href="https://github.com/tokio-rs/mio/commit/90d4fe00df870acd3d38f3dc4face9aacab8fbb9"><code>90d4fe0</code></a> named-pipes: fix receiving IOCP events after deregister</li> <li><a href="https://github.com/tokio-rs/mio/commit/c710a307f8627c4d63ac1003252aa45175e08399"><code>c710a30</code></a> Add v0.8.x to the CI</li> <li><a href="https://github.com/tokio-rs/mio/commit/c29e21c244b2b835e8b3e015b92c708c33c7d70a"><code>c29e21c</code></a> Release v0.8.10</li> <li><a href="https://github.com/tokio-rs/mio/commit/f6a20da1c81c2d56a78bc6f6832b9904b9215914"><code>f6a20da</code></a> Add Solaris operating system support (<a href="https://redirect.github.com/tokio-rs/mio/issues/1724">#1724</a>)</li> <li><a href="https://github.com/tokio-rs/mio/commit/e80c3b21b59b92238f4c8c331fcfc4a71508d1c5"><code>e80c3b2</code></a> Release v0.8.9</li> <li><a href="https://github.com/tokio-rs/mio/commit/862786bbbf719886be55631c0d150d4813a9a1b6"><code>862786b</code></a> Fix importing of IoSourceState</li> <li><a href="https://github.com/tokio-rs/mio/commit/40348728e4f06f5e150783d8f1559ee974e5e834"><code>4034872</code></a> Add support for vita target</li> <li><a href="https://github.com/tokio-rs/mio/commit/8eb4010a92bede550850e177d3dd7c4c76eb90ba"><code>8eb4010</code></a> Fix receiver and sender fd in pipe based waker</li> <li>Additional commits viewable in <a href="https://github.com/tokio-rs/mio/compare/v0.8.6...v0.8.11">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=mio&package-manager=cargo&previous-version=0.8.6&new-version=0.8.11)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/incubator-horaedb/network/alerts). </details> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
## Rationale Related with #1466 ## Detailed Changes Replay logs of different tables in parallel ## Test Plan CI --------- Co-authored-by: jiacai2050 <[email protected]>
…golang.org/grpc/otelgrpc from 0.20.0 to 0.46.0 in /horaemeta (#1463) Bumps [go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc](https://github.com/open-telemetry/opentelemetry-go-contrib) from 0.20.0 to 0.46.0. --------- Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: jiacai2050 <[email protected]>
## Rationale All source file should have ASF headers. ## Detailed Changes ## Test Plan CI
## Rationale Related with #1466 ## Detailed Changes 1. Make execution_props an arguments to logical2physical. 2. Make scan_batch_size NonZeroUsize ## Test Plan Manual test
## Rationale Add some dependency project descriptions in `NOTICE`. ## Detailed Changes 1. Add some dependency project descriptions in `NOTICE`. 2. Add `DEPENDENCIES` file. ## Test Plan No need.
… /integration_tests/sdk/go (#1500) Bumps google.golang.org/protobuf from 1.30.0 to 1.33.0. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=google.golang.org/protobuf&package-manager=go_modules&previous-version=1.30.0&new-version=1.33.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/incubator-horaedb/network/alerts). </details> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
## Rationale Implement horaectl using rust ## Detailed Changes - Support `cluster list`, `cluster diagnose`, `cluster schedule` ``` $ target/debug/horaectl -h HoraeCTL is a command line tool for HoraeDB Usage: horaectl [OPTIONS] [COMMAND] Commands: cluster Operations on cluster help Print this message or the help of the given subcommand(s) Options: -m, --meta <META_ADDR> Meta addr [env: HORAECTL_META_ADDR=] [default: 127.0.0.1:8080] -c, --cluster <CLUSTER_NAME> Cluster name [env: HORAECTL_CLUSTER=] [default: defaultCluster] -i, --interactive Enter interactive mode -h, --help Print help $ target/debug/horaectl cluster -h Operations on cluster Usage: horaectl cluster [OPTIONS] <COMMAND> Commands: list List cluster diagnose Diagnose cluster schedule Schedule cluster help Print this message or the help of the given subcommand(s) Options: -m, --meta <META_ADDR> Meta addr [env: HORAECTL_META_ADDR=] [default: 127.0.0.1:8080] -c, --cluster <CLUSTER_NAME> Cluster name [env: HORAECTL_CLUSTER=] [default: defaultCluster] -h, --help Print help ``` ## Test Plan - Manual tests --------- Co-authored-by: jiacai2050 <[email protected]>
## Rationale In some extreme scenarios, etcd events may be lost or update failures may occur, which may cause the mapping between nodes and shards to fail to be updated correctly. We need to add a cover-up mechanism to ensure that the mapping relationship is always correct. ## Detailed Changes * Add `NodeInspector`, it will start when the cluster start, running in he background and detect the status of nodes. ## Test Plan Pass CI. --------- Co-authored-by: xikai.wxk <[email protected]>
## Rationale Our repo should not contain any binaries. ## Detailed Changes - Download tini instead of hard copy ## Test Plan CI Also I use command below to ensure no other binaries exists. ``` fd -t file --exclude target --exec file {} \; | grep -v ASCII | grep -v UTF-8 ```
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )