Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MegaLinter v6 #1153

Merged
merged 169 commits into from
Jul 10, 2022
Merged

MegaLinter v6 #1153

merged 169 commits into from
Jul 10, 2022

Conversation

nvuillam
Copy link
Member

@nvuillam nvuillam commented Jan 9, 2022 •
edited
Loading

  • New reporter SARIF_REPORTER that aggregates all SARIF output files into a single one

    • Correct SARIF files for known format errors

  • Manage offline run of bash build.sh for those who want to code in planes :)

  • Automate update of CHANGELOG.md after release (pilot)

  • Rename default report folder from report to megalinter-reports

  • Accelerate internal CI testing performances

  • Display GitHub stars in linters summary table in documentation

  • Linters:

    • Add DevSkim security linter by Microsoft
    • Add dustilock to check for dependency confusion attacks with node and python packages
    • Add gitleaks to lint git repository
    • Add goodcheck as regex-based linter
    • Add PMD to lint java files (disabled for now)
    • Add semgrep as regex-based linter with many community rules
    • Add syft to generate SBOM (Software Bill Of Materials)
    • Add trivy security linter
    • Remove dockerfilelint, as it is not maintained anymore and hadolint contains all its rules
    • SARIF management for:
      • bandit
      • checkov
      • checkstyle
      • cfn-lint
      • devskim
      • eslint
      • gitleaks
      • hadolint
      • ktlint
      • npm-groovy-lint
      • psalm
      • semgrep
      • secretlint
      • revive
      • terrascan
      • tflint
      • trivy

  • Descriptors:

    • New flavor Security
    • New descriptor repository: contains secretlint, git_diff, gitleaks and goodcheck
      • remove CREDENTIALS and GIT descriptors

  • mega-linter-runner

    • Propose to test ox.security service
    • --upgrade option can now upgrade repos MegaLinter config to v6

nvuillam and others added 30 commits November 17, 2021 13:50
@nvuillam
[automation] Auto-update linters version, help and documentation
810ca54
@nvuillam
Disable Github Status reporter
d7c796c
@nvuillam
Merge branch 'create-pull-request/patch' into v6_dev
8f33ebc
@nvuillam
Breaking change: GITHUB_STATUS_REPORTER disabled by default
93ea2b4
@nvuillam
Breaking change: set PRINT_ALL_FILES default to false
82e55f0
@nvuillam
Merge remote-tracking branch 'origin/main' into v6_dev
a6ff77a
@nvuillam
Deploy V6 image (#1035)
5c8f66b
@nvuillam
QuickFix CI job
14e1fb1
@nvuillam
New flavor Security (#1036)
6ea449a 
* Java PMD v0

* Java Pmd v0.01

* Working Java + pmd :)

* changelog + doc

* Genedate doc + manage offline mode

* changelog

* Bring back referring linters

* Fix build

* Automate update of changelog when new release (v0)

* Do not create commit & tag with npm version

* Move markdown formatting

* .md

* PMD install commands

* More pmd descriptor infos + build

* Fix megalinter errors

* Fix PMD install commands + build

* [MegaLinter] Apply linters fixes

* Hardcode some licenses

* [MegaLinter] Apply linters fixes

* Add gitleaks

* Build with gitleaks

* Gitleaks fixes

* changelog

* New descriptor: repository

TODO: deprecate git and credentials

* New descriptor "repository"

* Add Goodcheck


Goodcheck updates

* Fix PMD

* Fix PMD

* [MegaLinter] Apply linters fixes

* Fix pmd installation

* Typo

* wget --quiet

* Add trivy

* Build v6-alpha flavors

* Remove git & credentials descriptors + upgrade python base image

* Upgrade python

* New flavor Security v0

* Fix ansible-lint install

* Deploy v6-alpha documentation

* Fix test class

quick build

* Disable java pmd

* Downgrade python version

* SARIF v0

* Update descriptor JSON schema + retries for sgerrand url

* Add SARIF output for checkov

* Add SARIF output for eslint

* [automation] Auto-update linters version, help and documentation (#1038)

* Fix gitleaks

* Build

* Do not skip build if failed

* Do not test SARIF when SARIF is not active on a linter

* Update ansible install

* Fix goodcheck tests

* Fix markdown-table-formatter

* Fix trivy command

* Fix checkov test case + manage default sarif output file

* use MegaLinter beta for now

* Update CI for new default report folder

+ Manage {{REPORT_FOLDER}} in CLI variables

* Exit code 1 for trivy

* Fix replace_vars definition

* Do not run test mega-linter-runner when docker build failed

* Fix replace_vars

* Downgrade v8r version

* Fix arm test case

* build

* Fix again arm test case

* Fix makedirs for report folder

* Rename default report folder into megalinter-reports

* Fix gitleaks

* Try again gitleaks

* Fix last errors

* Fix internal lint errors

Co-authored-by: nvuillam <[email protected]>
@nvuillam
v6-alpha for github action
f72555c
@nvuillam
Adapt CI for v6-alpha. (#1062)
217a9fb
@nvuillam
Fix own MegaLinter errors (#1063)
93b5f44 
* Fix own MegaLinter errors

* Do not use secretlint on report folder

* Fix gitleaks own config

* Use regexes in gitleaks toml config file

* grmblmblm

* try with paths

* Regex to gather gitleaks errors

* Make gitleaks non blocking
@nvuillam
Update gitleaks descriptor
fefacca
@nvuillam
Debug gitleaks (#1068)
ad11301 
* Debug gitleaks

* Remove LinkedIn ID gitleaks check

* Ignore .gitleaks.toml files

* Update security flavor + toml gitleaks update to use regexes

* Try again...

* Fix gitleaks config (use regexes in paths)

* Update default .gitleaks.toml files

* Clean dev variables

* Build
@nvuillam @llaville
Retrofit latest v5 updates into v6 (#1070)
ac8c38a 
* [automation] Auto-update linters version, help and documentation (#1038)

* Implement new linter PHPLint (#1037)

* add new phplint linter (see #1031)

* use composer global install for overture/phplint

* update changelog

* fix feature #1043 (#1044)

* Add @babel/eslint-parser as dependency for eslint (#1045)

* [automation] Auto-update linters version, help and documentation (#1046)

* [automation] Auto-update linters version, help and documentation + @babel-core

* Add @babel-core dependency

* Use node.js LTS and not nodejs-current

* Downgrade v8r version

* Fix arm test case

* Fix again arm test case

* [automation] Auto-update linters version, help and documentation

* Build

* [automation] Auto-update linters version, help and documentation (#1050)

* [automation] Auto-update linters version, help and documentation (#1052)

* [automation] Auto-update linters version, help and documentation

* Update doc for gitlab MegaLinter config

* Bandit default config file (#1051)

* remove default parameters

* add default bandit configfile built with bandit-config-generator command

* update changelog

* update bandit doc page

Co-authored-by: Nicolas Vuillamy <[email protected]>

* Try again ktlint auto-upgrade (#976)

* [automation] Auto-update linters version, help and documentation (#1055)

* [automation] Auto-update linters version, help and documentation (#1056)

* Docs & links (#1058)

* Update stale config

* Fix getting linter version of npm plugin. (#804)

* [automation] Auto-update linters version, help and documentation (#1059)

* Fix doc

* [automation] Auto-update linters version, help and documentation (#1065)

* [automation] Auto-update linters version, help and documentation (#1067)

* build

Co-authored-by: Laurent Laville <[email protected]>
@nvuillam
SARIF for gitleaks (#1069)
edf9aa3 
* SARIF for gitleaks

* Sarif python test class v0

* Lint fix + changelog
@nvuillam
Generate security flavor
da32f53
@nvuillam @llaville
SARIF support for trivy (#1071)
f38b978 
* [automation] Auto-update linters version, help and documentation (#1038)

* Implement new linter PHPLint (#1037)

* add new phplint linter (see #1031)

* use composer global install for overture/phplint

* update changelog

* fix feature #1043 (#1044)

* Add @babel/eslint-parser as dependency for eslint (#1045)

* [automation] Auto-update linters version, help and documentation (#1046)

* [automation] Auto-update linters version, help and documentation + @babel-core

* Add @babel-core dependency

* Use node.js LTS and not nodejs-current

* Downgrade v8r version

* Fix arm test case

* Fix again arm test case

* [automation] Auto-update linters version, help and documentation

* Build

* [automation] Auto-update linters version, help and documentation (#1050)

* [automation] Auto-update linters version, help and documentation (#1052)

* [automation] Auto-update linters version, help and documentation

* Update doc for gitlab MegaLinter config

* Bandit default config file (#1051)

* remove default parameters

* add default bandit configfile built with bandit-config-generator command

* update changelog

* update bandit doc page

Co-authored-by: Nicolas Vuillamy <[email protected]>

* Try again ktlint auto-upgrade (#976)

* [automation] Auto-update linters version, help and documentation (#1055)

* [automation] Auto-update linters version, help and documentation (#1056)

* Docs & links (#1058)

* Update stale config

* Fix getting linter version of npm plugin. (#804)

* [automation] Auto-update linters version, help and documentation (#1059)

* Fix doc

* [automation] Auto-update linters version, help and documentation (#1065)

* [automation] Auto-update linters version, help and documentation (#1067)

* SARIF for gitleaks

* Sarif python test class v0

* Lint fix + changelog

* SARIF support for trivy

* Accelerate and fix internal tests

* Fix SARIF files

* Fix trivy sarif args

* [automation] Auto-update linters version, help and documentation (#1072)

* Fix SarifReporter

* Better handling of SARIF error management

* Fix SARIF default file name use

quick build

* Fix sarif reporter exception management

* Variabilize default release

* Improve runtime perfs when FLAVOR_SUGGESTIONS: false (#1073)

* Improve runtime perfs when FLAVOR_SUGGESTIONS: false

* [MegaLinter] Apply linters fixes

* Fix how to get MEGALINTER_FLAVOR

* Fix ignore flavor suggestion test class

Co-authored-by: nvuillam <[email protected]>

* Build

Co-authored-by: Laurent Laville <[email protected]>
Co-authored-by: nvuillam <[email protected]>
@nvuillam
V6/popularity - Display github stars in all linters documentation (#1075
f55ea4f 
)

* Add popularity

* Update descriptors to add linter_repo when missing

* FLAVOR_SUGGESTIONS:false to improve perfs
@nvuillam
Build
5e3e8ba
@nvuillam
Enhance documentation (#1078)
5a6e399 
* Popularity column in all tables

* More badges in linters list doc

* cspell
@nvuillam
Fix sarif test case (#1079)
1bad67a 
* Fix sarif test case

* Fix hardcoded reporter folder name in test case
@nvuillam
Remove dockerfilelint (#1080)
4375d94 
* Remove dockerfilelint

* changelog
@nvuillam
Upgrade to AWS cfn-lint (#1085)
f78969b 
* Upgrade to AWS cfn-lint

* Build
@nvuillam
Add SARIF management for cfn-lint
3e72d55
@nvuillam
Add cfn-lint example SARIF output file
1d64c4d
@nvuillam
Merge branch 'main' into v6_dev
0c18018
@nvuillam
SARIF management for Hadolint (#1089)
fce68a3 
* SARIF management for Hadolint

* Update .gitleaks.toml to ignore .mypy_cache folder

* Catch SARIF error

* Upgrade hadolint to 2.8.0-alpine
@nvuillam
SARIF for checkstyle (#1093)
859d79e
@nvuillam
SARIF for ktlint (#1095)
123277d
@nvuillam nvuillam temporarily deployed to v6-alpha July 10, 2022 07:31 Inactive
@nvuillam nvuillam temporarily deployed to v6-alpha July 10, 2022 07:35 Inactive
@nvuillam nvuillam marked this pull request as ready for review July 10, 2022 07:40
@nvuillam nvuillam temporarily deployed to v6-alpha July 10, 2022 07:51 Inactive
@nvuillam nvuillam temporarily deployed to v6-alpha July 10, 2022 09:43 Inactive
@nvuillam nvuillam changed the title MegaLinter v6 (draft) MegaLinter v6 Jul 10, 2022
@nvuillam nvuillam temporarily deployed to v6-alpha July 10, 2022 09:47 Inactive
@nvuillam nvuillam temporarily deployed to v6-alpha July 10, 2022 10:03 Inactive
@nvuillam nvuillam merged commit 33ebb65 into main Jul 10, 2022
@llaville llaville mentioned this pull request Oct 30, 2022
Closed
@melg8 melg8 mentioned this pull request Dec 6, 2023
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@nvuillam @llaville @codecov-commenter @InbarRose