diff --git a/content/_index.html b/content/_index.html index d2f4ffe2..5b7d7ffe 100644 --- a/content/_index.html +++ b/content/_index.html @@ -8,7 +8,7 @@ diff --git a/content/posts/releases/v0.19.4-beta.md b/content/posts/releases/v0.19.4-beta.md new file mode 100644 index 00000000..a0260050 --- /dev/null +++ b/content/posts/releases/v0.19.4-beta.md @@ -0,0 +1,106 @@ +--- +date: 2024-10-30 +title: 'Spice v0.19.4-beta (Oct 30, 2024)' +type: blog +author: Spice AI ([@spice_ai](https://twitter.com/spice_ai)) +categories: [release] +tags: [data accelerator, resiliency, localpod] +--- + +Announcing the release of Spice v0.19.4-beta ☘️ + +Spice v0.19.4-beta introduces a new `localpod` Data Connector, improvements to accelerator resiliency and control, and a new configuration to control when accelerated datasets are considered ready. + +## Highlights in v0.19.4 + +**`localpod` Connector**: Implement a "tiered" acceleration strategy with a new `localpod` Data Connector that can be used to accelerate datasets from other datasets registered in Spice. + +```yaml +datasets: + - from: s3://my_bucket/my_dataset + name: my_dataset + acceleration: + enabled: true + engine: duckdb + mode: file + refresh_check_interval: 60s + - from: localpod:my_dataset + name: my_localpod_dataset + acceleration: + enabled: true +``` + +Refreshes on the `localpod`'s parent dataset will automatically be synchronized with the `localpod` dataset. + +**Improved Accelerator Resiliency**: When Spice is restarted, if the federated source for a dataset configured with a file-based accelerator is not available, the dataset will still load from the existing file data and will attempt to connect to the federated source in the background for future refreshes. + +**Accelerator Ready State**: Control when an accelerated dataset is considered "ready" by the runtime with the new `ready_state` parameter. + +```yaml +datasets: + - from: s3://my_bucket/my_dataset + name: my_dataset + acceleration: + enabled: true + ready_state: on_load # or on_registration +``` + +- `ready_state: on_load`: Default. The dataset is considered ready after the initial load of the accelerated data. For file-based accelerated datasets that have existing data, this means the dataset is ready immediately. +- `ready_state: on_registration`: The dataset is considered ready when the dataset is registered in Spice. Queries against this dataset before the data is loaded will fallback to the federated source. + +## Breaking changes + +Accelerated datasets configured with `ready_state: on_load` (the default behavior) that are not ready will return an error instead of returning zero results. + +## Contributors + +- @Sevenannn +- @peasee +- @phillipleblanc +- @sgrebnov +- @barracudarin +- @Jeadie +- @ewgenius + +## What's Changed + +- Update helm for v0.19.3-beta by @ewgenius in +- docs: Mark GitHub as Beta in README.md by @peasee in +- Fix docker publish by @phillipleblanc in +- Add SQLite TPC-DS Limitations: `ROLLUP` and `GROUPING` by @sgrebnov in +- Update version to 1.0.0-rc.1 by @sgrebnov in +- Synchronize localpod acceleration with parent acceleration refreshes by @phillipleblanc in +- feat: Update Datafusion, promote DuckDB and MySQL by @peasee in +- Add SQLite TPC-DS Limitations: `stddev` by @sgrebnov in +- fix indentation issue with service annotations by @barracudarin in +- fix: Expose GitHub ratelimit errors by @peasee in +- Revert Datafusion parquet changes by @Sevenannn in +- Promote arrow accelerator to beta by @Sevenannn in +- Add SQLite TPC-DS Limitations: casting to DECIMAL by @sgrebnov in +- Accelerated datasets can fallback to federated source while loading by @phillipleblanc in +- Enable overlap_size correctly by @Jeadie in +- Avoid duplicated filter conditions in rewritten SQL by @Sevenannn in +- Fix SQLite records conversion with NULL in first row by @sgrebnov in +- fix: Update datafusion by @peasee in +- Display shorter name for benchmark workflow matrix by @Sevenannn in +- Update `spice_sys_dataset_checkpoint` to store federated table schema by @phillipleblanc in +- Update postgres connector/accelerator snapshot by @Sevenannn in +- Accelerated tables with existing file data can load without a connection to the federated source by @phillipleblanc in +- Ensure synchronized tables complete their insertion at the same time by @phillipleblanc in + +**Full Changelog**: + +## Resources + +- [Getting started with Spice.ai](https://docs.spiceai.org/getting-started/) +- [Documentation](https://docs.spiceai.org/) + +## Community + +Spice.ai started with the vision to make AI easy for developers. We are building Spice.ai in the open and with the community. Reach out on Discord or by email to get involved. + +- Twitter: [@spice_ai](https://twitter.com/spice_ai) +- Discord: [https://discord.gg/kZnTfneP5u](https://discord.gg/kZnTfneP5u) +- Telegram: [Spice AI Discussion](https://t.me/spiceaichat) +- Reddit: [https://www.reddit.com/r/spiceai](https://www.reddit.com/r/spiceai) +- Email: [hey@spice.ai](mailto:hey@spice.ai)