Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SRE update 2025-01-17 #530

Merged
merged 2 commits into from
Feb 5, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
59 changes: 59 additions & 0 deletions blog/2025-01-17-sre.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
---
title: SRE Team Update
slug: 2025-01-17-sre
authors: johnalotoski
tags: [sre]
hide_table_of_contents: false
---

## High level summary

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

* Sanchonet was respun after a community scheduled test hardfork to PV11

* Buildkite agent modules were added to cardano-playground

* Adds a latest tag GHA action to cardano-node upon new release publication

## Repository Work

### Cardano-parts
* Cardano-node has been updated to `10.1.4`, cardano-cli and the -ng variant to
`10.1.1.0` and `10.2.0.0` respectively, and mithril to `v2450`. Colmena has
been updated to utilize a new pure flake evaluation approach. New nix jobs were
added for a new "next-gen" network spin up method, which supports network
creation with a fork directly to Conway and then retirement of the genesis
bootstrap pool in favor of on-chain registered backbone pools. CI tests to
support these new jobs were added. The recipe to query governance actions was
updated with the latest voting calculations and the output was improved with
color and additional reporting totals. A psql prepared statement for voting
activity over time was added to the postgres module. Other small miscellaneous
improvements and clean up were made with details available in the release
notes:
[cardano-parts-release-v2025-01-17](https://github.com/input-output-hk/cardano-parts/releases/tag/v2025-01-17)

### Cardano-playground
* Cardano-node has been updated to `10.1.4`, mithril to `v2450` and all envs
deployed. Buildkite modules were added to support fast buildkite agent scaling
in any AWS region. Sanchonet was respun after a planned community hard fork test.
The recipe to query governance actions was updated with the latest voting
calculations. A new `start-demo-ng` recipe was added to utilize a new
"next-gen" spin up method. More detail is available in the PR description:
[cardano-playground-pull-39](https://github.com/input-output-hk/cardano-playground/pull/39)

### Cardano-mainnet
* Cardano-node has been updated to `10.1.4` and mithril to `v2450` and all machines
deployed. The mainnet canary dashboard was updated with a governance voting
analysis panel. The recipe to query governance actions was updated with the
latest voting calculations. More detail is available in the PR description:
[cardano-mainnet-pull-29](https://github.com/input-output-hk/cardano-mainnet/pull/29)

### Cardano-node
* Adds GHA steps to push a latest tag for node and api containers on release
events where the tag is the latest release. Updates the docker-compose to
default to the latest tag and bumps iohk-nix for an updated target number of
established peers. Fixes related configs to pass CI checks.
[cardano-node-pull-6057](https://github.com/IntersectMBO/cardano-node/pull/6057)
47 changes: 47 additions & 0 deletions quarterly/2024-Q4-sre.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
---
title: SRE Q4 2024 Update
slug: 2024-Q4-sre
authors: johnalotoski
tags: [sre]
hide_table_of_contents: false
---

## 2024-10 - 2024-12

### Main achievements

In addition to ongoing general maintenance and support of cardano environments,
some highlights of SRE achievements for this quarter include:

* Cardano-parts started offering regular
[releases](https://github.com/input-output-hk/cardano-parts/releases) to ease
the process of upgrading rather than only PR merges with migration notes.

* All IOE cardano-parts supported node environments, including preview,
preprod, sanchonet, mainnet were upgraded through various cardano-node releases
including `10.0.0-pre`, `10.1.0-pre`, `10.1.1`, `10.1.2`, and finally into
`10.1.3` by the end of December.

* All environments were migrated from deprecated grafana agent to grafana alloy.

* Sanchonet environment was re-spun twice; once for cardano-node
`10.0.0-pre` and once for a community scheduled PV11 hardfork test.

* Preview and preprod networks were successfully forked into Conway era, Plomin
protocol version `10.0`.

* Private and shelley-qa chains were retired after fulfilling their intended
goal.

* Remaining cardano-world legacy resources were retired, replaced by
cardano-playground.

Details of this and other SRE work can be found in the biweekly SRE reports.

### Next steps

* Switch to the new cardano-node tracing system as default and retire use of
the legacy tracing system, including dashboards, alerts, cardano-tracer and
cardano-node nixos service updates as well as container image required changes.

* Continue cardano-parts and operations improvements.
Loading