Move SolidProject to Netlify to the community Solid Server

[MarrelleBailey]

Will work on this the week of June 7

Issue: solid/solidproject.org#248

[bourgeoa]

leave this for the steps for implementation

[bourgeoa]

meeting notes from 2020-02-11
meeting place : https://meet.jit.si/solidproject-org

presents :

Jackson
Justin
Alain

meeting

• Actual status

  • source : github
  • build with jekyll
  • how is it published -->github actions
  • where is the webserver --> netlify

• how is the certificate managed, domain provider gandi ?

• objectives

  • static .html on a CSS server
  • server provider digital ocean ?
  • CSS >= version 3.0.0 ? single user pod
  • publication from github actions

• github actions :

  • see example in authorization panel when a PR Fix AccessNeedDescription pointing back to AccessNeedGroup data-interoperability-panel#239
    https://solid.github.io/data-interoperability-panel/specification/
  • _site is a static site
  • then publish _site
  • inrupt authentication : client credential flows ? do not exist now (client Id and client secret)
  • give CSS a bearer token works use the refesh token on github node version (session cache) or java version

conclusions

Work sharing :

• jackson authentication
• justin jekyll
• alain
  • install jekyll see https://github.com/solid/solidproject.org/README.md
  • run jekyll --> _site will contain the static site
  • run CSS file mode with single user and copy _site folder content in it
  • test if nginx is needed

[bourgeoa]

meeting notes from 2020-02-18
meeting place : https://meet.jit.si/solidproject-org

presents :

Jackson
Justin
Alain

meeting

Alain report actions

• run jekyll 3.8 on solidproject with docker
  - use wsl2 for docker
  - cd to solidproject repo
  - https://dev.to/michael/compile-a-jekyll-project-without-installing-jekyll-or-ruby-by-using-docker-4184
  pas de sudo

docker run --rm -it --volume="$PWD:/srv/jekyll" --volume="$PWD/vendor/bundle:/usr/local/bundle" --env JEKYLL_ENV=production jekyll/jekyll:3.8 jekyll build

• solidos WSL2 Pb

  • npm run setup with sh: 1: make: not found
  • sudo apt-get update
  • sudo apt-get install build-essential

• test on NSS https:// localhost:8443 multi-user

  • It must be root because all links are relative to _site

  • assets is needed twice : keep assets at root and copy assets --> pages/solid/solidproject.org/assets

  • in container to not display all contained resources

  • newsletter/archive.html should be renamed newsletter/index.html

  • in general developers/vocabularies/ is not structured correctly
    - missing index.html in well-known, create, use, publish and may be code
    - well-known.html --> index.html

  • some links are wrong specification (link on right (example team : pages/solid/solidproject.org/team should be /team)

  • rm -r node_modules

  • permalink

    • all pages use permalink exemple : permalink : /about <-- note there no .html (see navigation.yml, toc-about.html, page-about.html)
      the consequence is that
    • .html extension must be converted to $.html except index.html this is to be compatible with a nice url build with permalink
    • renaming all except index.html :

find . -type f -name "*.html" -exec sh -c 'mv -f $0 ${0%.html}$.html' {} \;
find . -type f -name "index$.html" -exec sh -c 'mv -f $0 ${0%$.html}.html' {} \;

• CSS mashlib single user (http://localhost/3000/ = same problem than NSS +
  - each folder must end with / else error

  • display draft version message

  • some problem with folder containing index.html on > level 1 :

    • developers/vocabularies/ return 404
    • developers/vocabularies/index.html is ok

  • actual site organization questions :
    to keep the pod clean it may be better with this structure

    • root/index.html
    • solidproject/ for the site

• site contents questions

  • why 2 folders : developers and for-developers

• for information build of CSS without mashlib

  • see problem with clock and login authorization
    https://gitter.im/solid/community-server?at=620a8f801fe6ba5a9725fe95
    https://snippets.khromov.se/how-to-restart-wsl2-windows-subsystem-linux-on-windows-10/
    • clone tag version v2.0.1

	# git clone https://github.com/solid/community-server.git
	# cd community-server
	# git branch -b test-v2.0.1 v2.0.1
	# npm ci
	# npm start -- -c @css:config/file.json -f ./Documents 

• CSS with mashlib : todo as single user

Jackson report

• https://github.com/o-development/clone-to-solid-pod/
• waiting for jeff issue

Justin report

• jekyll github-actions : https://github.com/justinwb/justin.bingham.id/blob/jekyll-base/.github/workflows/deploy-jekyll.yml

Actions

• jackson
  • waiting for jeff's to document issue with solid-node-client using solid-rest with jsonld to turtle (?? $rdf should be added as global like for PATCH)
  • will include justin github-action jekyll workflow
• justin
  • to review the questions raised on site structure (see alain above comments)
  • some changes may be made on a github-action pre-publish step
• alain :
  • propose PR's for changing site
  • on CSS container MUST end with /

next meeting Friday 25 February 2022 same time17:30 CET

[bourgeoa]

This week :

• jackson

  • the issue in solid-node-client has been resolved.
  • published the github action here: https://github.com/marketplace/actions/clone-to-solid-pod

• alain
  For discussion I have made some needed changes to the solidproject.org content see Css bourgeoa/solidproject.org#1

  The changes are mostly around :

  • creating a dedicated container parameter SPS for the pod (to avoid mixing of solidproject.org and pod datas
  • add .html extension when needed (on a pod content-type default is not text/html)
  • add / to folders (needed actually for containers in CSS)

  There are 2 examples of running solidproject.org on NSS (I do not have a server running CSS with mashlib).

  For an easy loading I renamed the _site produced by jekyll to SPS, ziped the SPS folder as an SPS.zip, then with solid-file-client upload and unzip with extractZipArchive().

  • https://bourgeoa.bourgeoa.ga/ with an index.htm redirect to https://bourgeoa.bourgeoa.ga/SPS/
  • https://solidproject.solidcommunity.net/SPS/ with no redirect and some files being too big for the server parameters I was not able to load them

  Experimental : solidproject.org is running on a CSS server https://solidweb.me/bourgeoa/SPS/
  CSS do not seem to accept .zip files

[bourgeoa]

@RubenVerborgh just opened an issue CommunitySolidServer/CommunitySolidServer#1235

[bourgeoa]

Removed the comment on .zip file. Seems a mashlib only issue solid/solid-ui#486

[bourgeoa]

@jaxoncreed I have difficulties using the token o-development/clone-to-solid-pod#2
I suppose i am doing something wrong because jeff and you did succeed.

[bourgeoa]

No it was time consuming each folder must end with a / and each html file must end with .html
And to create a pod container each link must begin with it.
I had problem to understand the redirect that uses site.url and site.baseurl
At the end there can be no more distinction between site.url and site.container. site.container can be replaced by site.url and keep only site.url

The problem is to load all the data. Some file are rejected for size. The number of request is high : 7000
Sometimes appears issues on like 500, lock file more than 3000 ms, err memory ?, and a difficulty with assets/img/fontawesome-free-5.11.2-web/svgs/solid/ that contains 1000 images.

[jaxoncreed]

Update on this. As far as I'm aware, this project has not been completed. Is that correct @bourgeoa ? Should we rope this into our upcoming meetings?

[bourgeoa]

@jaxoncreed yes you are correct. And I suppose the objective is still to deploy on a solid pod.

[csarven]

Original issue: solid/solidproject.org#248