Upgrade pymdown-extensions and markdown

[BryanQuigley]

Also merges where python dependencies are specified to requirements.txt.

Fixes #3041

Proposed Changes

1. Add restrict_base_path: False to mkdocs - this unblocks upgrading pymdown
2. Consolidate where packages are specified to just use requirements.txt

Readiness Checklist

Author/Contributor

• Add entry to the CHANGELOG listing the change and linking to the corresponding issue (if appropriate)
• If documentation is needed for this change, has that been included in this pull request

Reviewing Maintainer

• Label as breaking if this is a large fundamental change
• Label as either automation, bug, documentation, enhancement, infrastructure, or performance

[BryanQuigley]

I've only tested the local dev workflow, but I believe the others should work fine.

[echoix]

This however might not work, since I don't think that that file is copied inside the released docker images. The entrypoint.sh script is what is ran when running the docker images. Should we either include the dependencies file, or find a way to keep the deps needed (and not installed by default, like node's dev dependencies), or keep it manually in sync?

[BryanQuigley]

Reverted (with changed versions) and added note to keep in sync.

[echoix]

Did you have the chance to run your built image with the env var UPGRADE_LINTERS_VERSION set to true, in order to see if the following section works?

megalinter/entrypoint.sh

Lines 29 to 41 in e2d2f6e

	# Called by Auto-update CI job
	if [ "${UPGRADE_LINTERS_VERSION}" == "true" ]; then
	echo "[MegaLinter init] UPGRADING LINTER VERSION"
	pip install pytest-cov pytest-timeout
	# Run only get_linter_version test methods
	pytest -v --durations=0 -k _get_linter_version megalinter/
	# Run only get_linter_help test methods
	pytest -v --durations=0 -k _get_linter_help megalinter/
	# Reinstall mkdocs-material because of broken dependency
	pip3 install --upgrade "markdown==3.3.7" mike mkdocs-material "pymdown-extensions==9.11" "mkdocs-glightbox==0.3.2" mdx_truly_sane_lists jsonschema json-schema-for-humans giturlparse webpreview "github-dependents-info==0.10.0"
	cd /tmp/lint || exit 1
	chmod +x build.sh
	GITHUB_TOKEN="${GITHUB_TOKEN}" bash build.sh --doc --dependents --stats

It is the equivalent of

megalinter/.github/workflows/auto-update-linters.yml

Lines 93 to 100 in e2d2f6e

	#####################################
	# Collect linters versions & help #
	#####################################
	- name: Collect latest versions and help
	id: compute_versions
	shell: bash
	run: docker run -e UPGRADE_LINTERS_VERSION=true -e GITHUB_SHA=${{ github.sha }} -e GITHUB_TOKEN=${GITHUB_TOKEN} -e GITHUB_OUTPUT="${GITHUB_OUTPUT}" -e MEGALINTER_VOLUME_ROOT="${GITHUB_WORKSPACE}" -v "/var/run/docker.sock:/var/run/docker.sock:rw" -v "/home/runner/work/_temp/_runner_file_commands":"/github/file_commands" -v ${GITHUB_WORKSPACE}:/tmp/lint oxsecurity/megalinter:auto_update_${{ github.sha }}
	timeout-minutes: 60

[BryanQuigley]

Wasn't able to test that path. Should I just revert that part?

[BryanQuigley]

I don't believe the GitPod issue was related to this PR.

[echoix]

Nope, it's fixed now. There was the download server for node that was down a bit

[echoix]

Lychee failure : wbond/packagecontrol.io#164

[echoix]

Ooos, seems like Mike was removed and not added to the requirements file. I thought I doubled checked that all the equivalent dependencies were there