Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update the dev container #134

Merged
merged 3 commits into from
Aug 27, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,6 @@ ARG base
FROM $base

USER root
RUN pip install --no-cache-dir pyarrow pyiceberg[pandas,snappy,daft,s3fs] avro
RUN pip install --no-cache-dir pyarrow pyiceberg[pandas,snappy,daft,s3fs] avro fastavro
USER dev
RUN sbt clean compile
2 changes: 1 addition & 1 deletion build_container.sh
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ else
git archive -o myapp.tar --format=tar HEAD
echo "$hash" > oldhash
fi
VERSION=${VERSION:-0.4}
VERSION=${VERSION:-0.5}
IMAGE=${IMAGE:-holdenk/hps:$VERSION}
MINI_IMAGE=${MINI_IMAGE:-holdenk/hps-mini:$VERSION}
docker buildx build --platform=linux/amd64,linux/arm64 -t "${MINI_IMAGE}" -f Dockerfile-mini . --push
Expand Down
2 changes: 1 addition & 1 deletion misc/container_launch.sh
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/bin/bash
if [ ! -f /high-performance-spark-examples/iceberg-workshop/Workshop.ipynb ]; then
cp /high-performance-spark-examples/iceberg-workshop/Workshop-Template.ipynb /high-performance-spark-examples/iceberg-workshop/Workshop.ipynb
cp /high-performance-spark-examples/iceberg-workshop-solutions/Workshop-Template.ipynb /high-performance-spark-examples/iceberg-workshop/Workshop.ipynb
fi
jupyter-lab --ip 0.0.0.0 --port 8877
2 changes: 1 addition & 1 deletion run_container.sh
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/bin/bash
set -ex
VERSION=${VERSION:-0.4}
VERSION=${VERSION:-0.5}
IMAGE=${IMAGE:-holdenk/hps:$VERSION}
export VERSION
export IMAGE
Expand Down
Loading