Running Pluto from docker #1043

thedacheng · 2021-04-01T03:58:18Z

thedacheng
Apr 1, 2021

I am trying to run Pluto from Julia docker image and access the web page from outside the container. However I am not able to do so, here are the steps and error I see:

docker run -p 8080:1234 julia /bin/bash
julia # launch julia inside container
] add Pluto
using Pluto
Pluto.run()

in the same container session I can access the Pluto web interface

docker exec -it interesting_nobel /bin/bash
root@b2a4eb678ce6:/# curl localhost:1234
<!DOCTYPE html>
<html lang="en">

<head>
    <meta name="viewport" content="width=device-width" />
    <title>⚡ Pluto.jl ⚡</title>
    <meta charset="utf-8" />
    <script>
        console.log("Pluto.jl, by Fons van der Plas (https://github.com/fonsp) and Mikołaj Bochenski (https://github.com/malyvsen) 🌈");
    </script>
    <meta name="author" content="Fons van der Plas; Mikołaj Bochenski" />
    <link rel="license" href="https://github.com/fonsp/Pluto.jl/blob/master/LICENSE" />
    <meta name="theme-color" content="#ffffff" />
    <link rel="icon" type="image/png" sizes="16x16" href="img/favicon-16x16.png">
    <link rel="icon" type="image/png" sizes="32x32" href="img/favicon-32x32.png">
    <link rel="icon" type="image/png" sizes="96x96" href="img/favicon-96x96.png">
    <meta name="description" content="Pluto.jl notebooks" />

    <link rel="stylesheet" href="./index.css">
    <link rel="stylesheet" href="../index.css">
</head>

<body class="error">
    <div id="title">
        <h2 style="font-style: normal;">Not yet authenticated</h2>
        <main>
            <p><b>Open the link that was printed in the terminal where you launched Pluto.</b> It includes a <em>secret</em>, which is needed to access this server.<br><br>If you are running the server yourself and want to change this configuration, have a look at the keyword arguments to <em>Pluto.run</em>. <br><br>Please <a href='https://github.com/fonsp/Pluto.jl/issues'>report this error</a> if you did not expect it!</p>
            <br />
            <p><a href="./">Go back</a></p>
            <br />
            <p></p>
            <pre></pre>
        </main>
    </div>
</body>

However outside the container I can't

curl localhost:8080
curl: (56) Recv failure: Connection reset by peer

Here's configuration for the docker container.

docker inspect interesting_nobel
[
    {
        "Id": "b2a4eb678ce6a7719cc7e6d61ebf0b7d61bc7ef290338ca9fbe90b4549cc53ab",
        "Created": "2021-04-01T03:40:19.280062121Z",
        "Path": "/bin/bash",
        "Args": [],
        "State": {
            "Status": "running",
            "Running": true,
            "Paused": false,
            "Restarting": false,
            "OOMKilled": false,
            "Dead": false,
            "Pid": 8789,
            "ExitCode": 0,
            "Error": "",
            "StartedAt": "2021-04-01T03:40:21.255272183Z",
            "FinishedAt": "0001-01-01T00:00:00Z"
        },
        "Image": "sha256:e38165fefff7e0e0f3dc3456a85e84333635819c0a2fee386463c06de919171c",
        "ResolvConfPath": "/var/lib/docker/containers/b2a4eb678ce6a7719cc7e6d61ebf0b7d61bc7ef290338ca9fbe90b4549cc53ab/resolv.conf",
        "HostnamePath": "/var/lib/docker/containers/b2a4eb678ce6a7719cc7e6d61ebf0b7d61bc7ef290338ca9fbe90b4549cc53ab/hostname",
        "HostsPath": "/var/lib/docker/containers/b2a4eb678ce6a7719cc7e6d61ebf0b7d61bc7ef290338ca9fbe90b4549cc53ab/hosts",
        "LogPath": "/var/lib/docker/containers/b2a4eb678ce6a7719cc7e6d61ebf0b7d61bc7ef290338ca9fbe90b4549cc53ab/b2a4eb678ce6a7719cc7e6d61ebf0b7d61bc7ef290338ca9fbe90b4549cc53ab-json.log",
        "Name": "/interesting_nobel",
        "RestartCount": 0,
        "Driver": "overlay2",
        "Platform": "linux",
        "MountLabel": "",
        "ProcessLabel": "",
        "AppArmorProfile": "docker-default",
        "ExecIDs": null,
        "HostConfig": {
            "Binds": null,
            "ContainerIDFile": "",
            "LogConfig": {
                "Type": "json-file",
                "Config": {}
            },
            "NetworkMode": "default",
            "PortBindings": {
                "1234/tcp": [
                    {
                        "HostIp": "",
                        "HostPort": "8080"
                    }
                ]
            },
            "RestartPolicy": {
                "Name": "no",
                "MaximumRetryCount": 0
            },
            "AutoRemove": false,
            "VolumeDriver": "",
            "VolumesFrom": null,
            "CapAdd": null,
            "CapDrop": null,
            "CgroupnsMode": "host",
            "Dns": [],
            "DnsOptions": [],
            "DnsSearch": [],
            "ExtraHosts": null,
            "GroupAdd": null,
            "IpcMode": "private",
            "Cgroup": "",
            "Links": null,
            "OomScoreAdj": 0,
            "PidMode": "",
            "Privileged": false,
            "PublishAllPorts": false,
            "ReadonlyRootfs": false,
            "SecurityOpt": null,
            "UTSMode": "",
            "UsernsMode": "",
            "ShmSize": 67108864,
            "Runtime": "runc",
            "ConsoleSize": [
                0,
                0
            ],
            "Isolation": "",
            "CpuShares": 0,
            "Memory": 0,
            "NanoCpus": 0,
            "CgroupParent": "",
            "BlkioWeight": 0,
            "BlkioWeightDevice": [],
            "BlkioDeviceReadBps": null,
            "BlkioDeviceWriteBps": null,
            "BlkioDeviceReadIOps": null,
            "BlkioDeviceWriteIOps": null,
            "CpuPeriod": 0,
            "CpuQuota": 0,
            "CpuRealtimePeriod": 0,
            "CpuRealtimeRuntime": 0,
            "CpusetCpus": "",
            "CpusetMems": "",
            "Devices": [],
            "DeviceCgroupRules": null,
            "DeviceRequests": null,
            "KernelMemory": 0,
            "KernelMemoryTCP": 0,
            "MemoryReservation": 0,
            "MemorySwap": 0,
            "MemorySwappiness": null,
            "OomKillDisable": false,
            "PidsLimit": null,
            "Ulimits": null,
            "CpuCount": 0,
            "CpuPercent": 0,
            "IOMaximumIOps": 0,
            "IOMaximumBandwidth": 0,
            "MaskedPaths": [
                "/proc/asound",
                "/proc/acpi",
                "/proc/kcore",
                "/proc/keys",
                "/proc/latency_stats",
                "/proc/timer_list",
                "/proc/timer_stats",
                "/proc/sched_debug",
                "/proc/scsi",
                "/sys/firmware"
            ],
            "ReadonlyPaths": [
                "/proc/bus",
                "/proc/fs",
                "/proc/irq",
                "/proc/sys",
                "/proc/sysrq-trigger"
            ]
        },
        "GraphDriver": {
            "Data": {
                "LowerDir": "/var/lib/docker/overlay2/910cfe09048aa7dd57963cbe177a5de90417517bc199067c5637e800cb4444c0-init/diff:/var/lib/docker/overlay2/7b019523f5873cf481515f2076ffe51c2c2c5720d00c4a282a6ee0f63ffb8e51/diff:/var/lib/docker/overlay2/338cee0f8775b771dfd1893aacf61c5288dd6bea38072f302f402201ec43c2cf/diff:/var/lib/docker/overlay2/ba202697fe18ef78a541d5283259e9cb861b16390be1a078af81fe1e62d0ba19/diff",
                "MergedDir": "/var/lib/docker/overlay2/910cfe09048aa7dd57963cbe177a5de90417517bc199067c5637e800cb4444c0/merged",
                "UpperDir": "/var/lib/docker/overlay2/910cfe09048aa7dd57963cbe177a5de90417517bc199067c5637e800cb4444c0/diff",
                "WorkDir": "/var/lib/docker/overlay2/910cfe09048aa7dd57963cbe177a5de90417517bc199067c5637e800cb4444c0/work"
            },
            "Name": "overlay2"
        },
        "Mounts": [],
        "Config": {
            "Hostname": "b2a4eb678ce6",
            "Domainname": "",
            "User": "",
            "AttachStdin": true,
            "AttachStdout": true,
            "AttachStderr": true,
            "ExposedPorts": {
                "1234/tcp": {}
            },
            "Tty": true,
            "OpenStdin": true,
            "StdinOnce": true,
            "Env": [
                "PATH=/usr/local/julia/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                "JULIA_PATH=/usr/local/julia",
                "JULIA_GPG=3673DF529D9049477F76B37566E3C7DC03D6E495",
                "JULIA_VERSION=1.6.0"
            ],
            "Cmd": [
                "/bin/bash"
            ],
            "Image": "julia",
            "Volumes": null,
            "WorkingDir": "",
            "Entrypoint": null,
            "OnBuild": null,
            "Labels": {}
        },
        "NetworkSettings": {
            "Bridge": "",
            "SandboxID": "2fce1dbe2bcb35941e1067c5b20e5827d36906cd91741680364f807528fb0800",
            "HairpinMode": false,
            "LinkLocalIPv6Address": "",
            "LinkLocalIPv6PrefixLen": 0,
            "Ports": {
                "1234/tcp": [
                    {
                        "HostIp": "0.0.0.0",
                        "HostPort": "8080"
                    }
                ]
            },
            "SandboxKey": "/var/run/docker/netns/2fce1dbe2bcb",
            "SecondaryIPAddresses": null,
            "SecondaryIPv6Addresses": null,
            "EndpointID": "85d237b4648260ea5dffd375ad967d67826c1b7306a53fb3ca6a6ac7ca55d59b",
            "Gateway": "172.17.0.1",
            "GlobalIPv6Address": "",
            "GlobalIPv6PrefixLen": 0,
            "IPAddress": "172.17.0.3",
            "IPPrefixLen": 16,
            "IPv6Gateway": "",
            "MacAddress": "02:42:ac:11:00:03",
            "Networks": {
                "bridge": {
                    "IPAMConfig": null,
                    "Links": null,
                    "Aliases": null,
                    "NetworkID": "8a2500eeeaf58059919a16b90651ab06375099e3428e14a43bb7e48c3ccd0732",
                    "EndpointID": "85d237b4648260ea5dffd375ad967d67826c1b7306a53fb3ca6a6ac7ca55d59b",
                    "Gateway": "172.17.0.1",
                    "IPAddress": "172.17.0.3",
                    "IPPrefixLen": 16,
                    "IPv6Gateway": "",
                    "GlobalIPv6Address": "",
                    "GlobalIPv6PrefixLen": 0,
                    "MacAddress": "02:42:ac:11:00:03",
                    "DriverOpts": null
                }
            }
        }
    }
]

Is there anything I am missing?

Thanks,

Answered by StatisticalMice

Apr 7, 2021

It is likely the authentication that Pluto requires, and which is done automatically if you start it 'the normal way'.

There's an example on how to bypass that here https://github.com/StatisticalMice/julia-jupyter-docker/blob/main/1.6-buster/jupyter_notebook_config.py, but the syntax there is for Jupyter.

Just turning off authentication is not ideal, but it's ok at least if it's going through Jupyter.

View full answer

StatisticalMice · 2021-04-07T12:41:59Z

StatisticalMice
Apr 7, 2021

It is likely the authentication that Pluto requires, and which is done automatically if you start it 'the normal way'.

There's an example on how to bypass that here https://github.com/StatisticalMice/julia-jupyter-docker/blob/main/1.6-buster/jupyter_notebook_config.py, but the syntax there is for Jupyter.

Just turning off authentication is not ideal, but it's ok at least if it's going through Jupyter.

3 replies

thedacheng Apr 7, 2021
Author

This does not solve my problem.
I tried to launch Pluto using
Pluto.run(launch_browser=false, require_secret_for_open_links=false, require_secret_for_access=false) and I see the same issue as before.

I do not see the same problem with docker images from Jupyter. With this, I can launch a docker instance and run notebook with Julia 1.5 run time without problem.
docker run -p 8888:8888 -p 8080:1234 jupyter/datascience-notebook
I even tried to launch Pluto from within Julia Jupyter notebook and I still see the same problem.

So I think the cause may be in Pluto, not how the docker instance was configured.

StatisticalMice Apr 7, 2021

Maybe you could try the two other options that you left out, they might help.

host="0.0.0.0", port={port},

thedacheng Apr 7, 2021
Author

Thank you, @StatisticalMice . Setting host solved my problem.
Authentication using secrete works as normal.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Running Pluto from docker #1043

{{title}}

Replies: 1 comment 3 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Running Pluto from docker #1043

thedacheng Apr 1, 2021

Replies: 1 comment · 3 replies

StatisticalMice Apr 7, 2021

thedacheng Apr 7, 2021 Author

StatisticalMice Apr 7, 2021

thedacheng Apr 7, 2021 Author

thedacheng
Apr 1, 2021

Replies: 1 comment 3 replies

StatisticalMice
Apr 7, 2021

thedacheng Apr 7, 2021
Author

thedacheng Apr 7, 2021
Author