Skip to content
This repository has been archived by the owner on Jan 28, 2025. It is now read-only.

ARXIVNG-3742: Initial Compiler Service development instance in GC #31

Draft
wants to merge 28 commits into
base: develop
Choose a base branch
from

Conversation

DavidLFielding
Copy link
Contributor

@DavidLFielding DavidLFielding commented Apr 27, 2021

This PR contains scripts and configuration files to deploy a development Compiler Service in Google Cloud Kubernetes. It should be straight forward to deploy this to Phoenix and then add a compile.phoenix.arxiv.org host but I'm waiting to see if the upcoming Submission UI work impacts the Compiler Service before doing so.

There are scripts to create a Kubernetes cluster and a Redis cluster (outside of Kubernetes). The remaining scripts assume that the Kubernetes and Redis cluster exist.

The development compiler service uses localstack (temporary) so you currently need to set the endpoint in the compiler-configmap.yaml. I plan to automate this shortly and will delete this line when complete.

There are scripts to update specific pieces of the compiler service. The script that brings up everything is compiler-deploy_all.sh. This script loads the configmap, requests persistent storage claims, and deploys compiler api, compiler worker, storage service (development/temporary) , and an nfs service (experimental).

There are additional scripts to delete the entire cluster or specific deployments.

I've added a helper script to request compilation (to save you from crafting curl requests) that is currently 'compile_announced.pl'.

perl ./compile_announced.pl 2012.02375

Compilation request was ACCEPTED

URL to check status:

     http://34.75.4.221/2012.02375/Ik1vbiwgMDcgRGVjIDIwMjAgMDE6MDk6MTUgR01UIg%3D%3D/pdf

There are still things that need to be improved so the compiler service will continue to change during the next sprint where the Submission Ui will be the main focus.

@DavidLFielding DavidLFielding self-assigned this Apr 27, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant