Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't continue on error during E2E test #67

Closed
wants to merge 1 commit into from

Conversation

JesseParsons
Copy link
Contributor

No description provided.

@mkacmar mkacmar requested a review from a team October 2, 2024 21:46
@mkacmar
Copy link
Collaborator

mkacmar commented Oct 3, 2024

Hi Jesse, I think that continuing on error may actually be intentional here - if ESLint ends up returning a non-zero exit code (which is kind of valid and is happening right now) due to rule violations (and misconfiguration as one can see in generated SARIF) we still want to get access to SARIF reports in the next step for further analysis. This may not be the best way to test the plugin E2E going forward since it can hide real issues, but I don't think we can just flip the flag right now.

@JesseParsons
Copy link
Contributor Author

Hi Jesse, I think that continuing on error may actually be intentional here - if ESLint ends up returning a non-zero exit code (which is kind of valid and is happening right now) due to rule violations (and misconfiguration as one can see in generated SARIF) we still want to get access to SARIF reports in the next step for further analysis. This may not be the best way to test the plugin E2E going forward since it can hide real issues, but I don't think we can just flip the flag right now.

Fair enough, but I think we should consider running it without the --output-file flag or somehow being able to see the results without having to look at the SARIF. Otherwise, this step is not really a gate if ESLint and SARIF upload steps succeed.

@JesseParsons JesseParsons deleted the patch-2 branch October 4, 2024 01:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants