Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] main from apache:main #50

Merged
merged 21 commits into from
Mar 21, 2024
Merged

[pull] main from apache:main #50

merged 21 commits into from
Mar 21, 2024

Conversation

pull[bot]
Copy link

@pull pull bot commented Feb 20, 2024

See Commits and Changes for more details.


Created by pull[bot]

Can you help keep this open source service alive? 💖 Please sponsor : )

## Rationale

Add sst level configuration for the benchmark test.

## Detailed Changes

Add sst level configuration for the benchmark test.

## Test Plan
Manual test

---------

Co-authored-by: jiacai2050 <[email protected]>
@pull pull bot added the ⤵️ pull label Feb 20, 2024
jiacai2050 and others added 20 commits February 21, 2024 14:19
## Rationale

CI fails due to no space...
```
Error: No space left on device : '/home/runner/runners/2.313.0/_diag/pages/e678fbe3-017c-41da-8bca-a6d70099419c_0ce2596c-30e4-5db6-a7ae-10ecfd0107a7_1.log'
```
-
https://github.com/apache/incubator-horaedb/actions/runs/7974416510/job/21770259595

## Detailed Changes
Refer https://github.com/orgs/community/discussions/25678


## Test Plan
CI
## Rationale
Close #1461 

## Detailed Changes
Bump datafusion to
https://github.com/CeresDB/arrow-datafusion/commits/e21b03154, which is
version 33.

Some important breaking changes:
- apache/datafusion#7920
- apache/datafusion#9109

## Test Plan
CI

---------

Co-authored-by: jiacai2050 <[email protected]>
## Rationale

Add exponential backoff retry.

## Detailed Changes

follow
[this](https://github.com/apache/arrow-rs/blob/dfb642809e93c2c1b8343692f4e4b3080000f988/object_store/src/client/backoff.rs#L26)
backoff implementation.

## Test Plan

New UT.

---------

Co-authored-by: zealchen <[email protected]>
## Rationale
The first step to support compaction offload #1480 

## Detailed Changes
- Extract the common compaction logic to `CompactionExecutor`.
- Define the `CompactionRunner` trait to support remote compaction
after.
- Define the `Compactor` to integration the new compaction logics, and
insert them into main process.

## Test Plan
Test manually.
## Rationale
Refer to #1485,
we will implement horaectl using rust.

## Detailed Changes
* Remove go implementation of horaectl.

## Test Plan
No need.
## Rationale
Update version to 2.0.0, prepare for releasing v2.0.0.

## Detailed Changes


## Test Plan
## Rationale
Upgrade rustc version
## Detailed Changes
- upgrade rustc version
- upgrade rand version
- upgrade obkv-client version
- upgrade clap version
- Adapt to new APIs

## Test Plan
CI
## Rationale
When time column is not in `select`, `extract_time_range` will not find
time range of one query

## Detailed Changes
- CeresDB/influxql#16

## Test Plan
CI
## Rationale
Prepare for releasing v2.0.0 .

## Detailed Changes
* Add NOTICE file.
* Add ASF license header.

## Test Plan
CI.
Bumps [mio](https://github.com/tokio-rs/mio) from 0.8.6 to 0.8.11.
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/tokio-rs/mio/blob/master/CHANGELOG.md">mio's
changelog</a>.</em></p>
<blockquote>
<h1>0.8.11</h1>
<ul>
<li>Fix receiving IOCP events after deregistering a Windows named pipe
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1760">tokio-rs/mio#1760</a>,
backport pr:
<a
href="https://redirect.github.com/tokio-rs/mio/pull/1761">tokio-rs/mio#1761</a>).</li>
</ul>
<h1>0.8.10</h1>
<h2>Added</h2>
<ul>
<li>Solaris support
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1724">tokio-rs/mio#1724</a>).</li>
</ul>
<h1>0.8.9</h1>
<h2>Added</h2>
<ul>
<li>ESP-IDF framework support
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1692">tokio-rs/mio#1692</a>).</li>
<li>AIX operating system support
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1704">tokio-rs/mio#1704</a>).</li>
<li>Vita support
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1721">tokio-rs/mio#1721</a>).</li>
<li><code>{UnixListener,UnixStream}:bind_addr</code>
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1630">tokio-rs/mio#1630</a>).</li>
<li><code>mio_unsupported_force_poll_poll</code> and
<code>mio_unsupported_force_waker_pipe</code>
<strong>unsupported</strong> configuration flags to force a specific
poll or waker
implementation
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1684">tokio-rs/mio#1684</a>,
<a
href="https://redirect.github.com/tokio-rs/mio/pull/1685">tokio-rs/mio#1685</a>,
<a
href="https://redirect.github.com/tokio-rs/mio/pull/1692">tokio-rs/mio#1692</a>).</li>
</ul>
<h2>Fixed</h2>
<ul>
<li>The <code>pipe(2)</code> based waker (swapped file descriptors)
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1722">tokio-rs/mio#1722</a>).</li>
<li>The duplicate waker check to work correctly with cloned
<code>Registry</code>s.
(<a
href="https://redirect.github.com/tokio-rs/mio/pull/1706">tokio-rs/mio#1706</a>).</li>
</ul>
<h1>0.8.8</h1>
<h2>Fixed</h2>
<ul>
<li>Fix compilation on WASI (<a
href="https://redirect.github.com/tokio-rs/mio/pull/1676">tokio-rs/mio#1676</a>).</li>
</ul>
<h1>0.8.7</h1>
<h2>Added</h2>
<ul>
<li>Add/fix support for tvOS and watchOS, Mio should now build for tvOS
and</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/tokio-rs/mio/commit/0328bdef900b6396b8d00d33c825cd8af748553d"><code>0328bde</code></a>
Release v0.8.11</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/708449851283b57eb6f514c8f289b66e982720b3"><code>7084498</code></a>
Fix warnings</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/90d4fe00df870acd3d38f3dc4face9aacab8fbb9"><code>90d4fe0</code></a>
named-pipes: fix receiving IOCP events after deregister</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/c710a307f8627c4d63ac1003252aa45175e08399"><code>c710a30</code></a>
Add v0.8.x to the CI</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/c29e21c244b2b835e8b3e015b92c708c33c7d70a"><code>c29e21c</code></a>
Release v0.8.10</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/f6a20da1c81c2d56a78bc6f6832b9904b9215914"><code>f6a20da</code></a>
Add Solaris operating system support (<a
href="https://redirect.github.com/tokio-rs/mio/issues/1724">#1724</a>)</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/e80c3b21b59b92238f4c8c331fcfc4a71508d1c5"><code>e80c3b2</code></a>
Release v0.8.9</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/862786bbbf719886be55631c0d150d4813a9a1b6"><code>862786b</code></a>
Fix importing of IoSourceState</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/40348728e4f06f5e150783d8f1559ee974e5e834"><code>4034872</code></a>
Add support for vita target</li>
<li><a
href="https://github.com/tokio-rs/mio/commit/8eb4010a92bede550850e177d3dd7c4c76eb90ba"><code>8eb4010</code></a>
Fix receiver and sender fd in pipe based waker</li>
<li>Additional commits viewable in <a
href="https://github.com/tokio-rs/mio/compare/v0.8.6...v0.8.11">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=mio&package-manager=cargo&previous-version=0.8.6&new-version=0.8.11)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
You can disable automated security fix PRs for this repo from the
[Security Alerts
page](https://github.com/apache/incubator-horaedb/network/alerts).

</details>

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
## Rationale

Related with #1466

## Detailed Changes
Replay logs of different tables in parallel

## Test Plan
CI

---------

Co-authored-by: jiacai2050 <[email protected]>
…golang.org/grpc/otelgrpc from 0.20.0 to 0.46.0 in /horaemeta (#1463)

Bumps
[go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc](https://github.com/open-telemetry/opentelemetry-go-contrib)
from 0.20.0 to 0.46.0.

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: jiacai2050 <[email protected]>
## Rationale
All source file should have ASF headers.

## Detailed Changes


## Test Plan
CI
## Rationale
Related with #1466

## Detailed Changes
1. Make execution_props an arguments to logical2physical.
2. Make scan_batch_size NonZeroUsize

## Test Plan
Manual test
## Rationale
Add some dependency project descriptions in `NOTICE`.

## Detailed Changes
1. Add some dependency project descriptions in `NOTICE`.
2. Add `DEPENDENCIES` file.

## Test Plan
No need.
… /integration_tests/sdk/go (#1500)

Bumps google.golang.org/protobuf from 1.30.0 to 1.33.0.


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=google.golang.org/protobuf&package-manager=go_modules&previous-version=1.30.0&new-version=1.33.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
You can disable automated security fix PRs for this repo from the
[Security Alerts
page](https://github.com/apache/incubator-horaedb/network/alerts).

</details>

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
## Rationale
Implement horaectl using rust

## Detailed Changes
- Support `cluster list`, `cluster diagnose`, `cluster schedule`

```
$ target/debug/horaectl -h
HoraeCTL is a command line tool for HoraeDB

Usage: horaectl [OPTIONS] [COMMAND]

Commands:
  cluster  Operations on cluster
  help     Print this message or the help of the given subcommand(s)

Options:
  -m, --meta <META_ADDR>        Meta addr [env: HORAECTL_META_ADDR=] [default: 127.0.0.1:8080]
  -c, --cluster <CLUSTER_NAME>  Cluster name [env: HORAECTL_CLUSTER=] [default: defaultCluster]
  -i, --interactive             Enter interactive mode
  -h, --help                    Print help

$ target/debug/horaectl cluster -h
Operations on cluster

Usage: horaectl cluster [OPTIONS] <COMMAND>

Commands:
  list      List cluster
  diagnose  Diagnose cluster
  schedule  Schedule cluster
  help      Print this message or the help of the given subcommand(s)

Options:
  -m, --meta <META_ADDR>        Meta addr [env: HORAECTL_META_ADDR=] [default: 127.0.0.1:8080]
  -c, --cluster <CLUSTER_NAME>  Cluster name [env: HORAECTL_CLUSTER=] [default: defaultCluster]
  -h, --help                    Print help


```

## Test Plan
- Manual tests

---------

Co-authored-by: jiacai2050 <[email protected]>
## Rationale
In some extreme scenarios, etcd events may be lost or update failures
may occur, which may cause the mapping between nodes and shards to fail
to be updated correctly. We need to add a cover-up mechanism to ensure
that the mapping relationship is always correct.

## Detailed Changes
* Add `NodeInspector`, it will start when the cluster start, running in
he background and detect the status of nodes.

## Test Plan
Pass CI.

---------

Co-authored-by: xikai.wxk <[email protected]>
## Rationale
Our repo should not contain any binaries.

## Detailed Changes
- Download tini instead of hard copy

## Test Plan
CI

Also I use command below to ensure no other binaries exists.
```
fd -t file --exclude target --exec file {} \; | grep -v ASCII | grep -v UTF-8
```
@pull pull bot merged commit 54a5db7 into ShiKaiWi:main Mar 21, 2024
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants