Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Outsource Redis management #293

Open
AndreasHuber opened this issue Nov 14, 2023 · 0 comments
Open

Outsource Redis management #293

AndreasHuber opened this issue Nov 14, 2023 · 0 comments

Comments

@AndreasHuber
Copy link

AndreasHuber commented Nov 14, 2023

Redis outages in the last months have been the main cause of serlo.org not working, so we need to improve this.
Reasons why Redis was not working were:

  • not enough storage
    • the version of Redis we use doesn't remove automatically the stale keys
    • in order to upgrade the Redis image we would have to refactor module (it would need to upgrade the helm chart)
  • not enough memory -> could maybe be solved with auto-scaling
  • sometimes Redis restarts itself and we don't know yet the real reason (not a big problem though, since it is just for some minutes, but it is annoying and hard to debug)

We could fix all these things in the cluster but it sounds easier to outsource it and not have to manage the Redis availability.

Note that our API gateway is dependent on the Redis cache, so that it is down if the connection to Redis fails.

RICE Score

  • Reach and impact: 8 -- Will not directly make work on features easier but saves developer time that currently is needed when Redis does not work.
  • Confidence: 7 -- Should be possible but needs a small investigation about options and concrete implementation.
  • Effort: 6 -- Sounds not to complicated at first but probably there are lots of details to be considered to get it right.
@AndreasHuber AndreasHuber converted this from a draft issue Nov 14, 2023
@AndreasHuber AndreasHuber changed the title Outsource redis management Outsource Redis management Nov 14, 2023
@hugotiburtino hugotiburtino moved this from Idea to Clarification in Simplify backend development May 23, 2024
@hugotiburtino hugotiburtino moved this from Clarification to Idea in Simplify backend development May 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: Idea
Development

No branches or pull requests

2 participants