Improved URL checking workflow

[cordt-sei]

URL Checking Improvements

This updates the docs page URL checking system to be more thorough, efficient, and integrated.

Key areas:

1. Enhanced URL Checking Script:

   • Improved URL validation
   • Much better reporting
   • Structured JSON output for better integration with GitHub Actions

2. Configurable Settings:

   • Added MAX_WORKERS constant to control the level of concurrency
   • Use env variable CHECK_PATH to specify dir to check, defaults to './pages/'

3. Improved Workflow:

   • Sets CHECK_PATH environment variable
   • Automatic creation of issue if any errors present [once weekly automated check remains]
   • Parses JSON output from the script for more detailed and structured reporting
   • Dynamic issue titling and content based on check results
   • Added 'url-check' label to created issues

4. Custom 404 Page Handling:

   • Detects redirect to internal 404 page
   • Reports these as broken links even though they return a 200 status code

Implementation Notes

• Script now produces JSON output
• Workflow uses ${{secrets.GITHUB_TOKEN}} for issue creation
• Each check run creates a new issue with a detailed breakdown of results, if any are found
• The exit code of the script is the number of issues found