[Sweep GHA Fix] The GitHub Actions run failed with...

[sweep-ai]

Description

This pull request includes the following changes:

• Updated e2e_demo/scala/cleanup.sh to remove unnecessary files and directories.
• Updated e2e_demo/scala/run_demo-gradle.sh to handle errors during cleanup and project cleanup.
• Updated pysparkler/config.yaml to add a new comment and disable a specific rule.
• Updated scalafix/rules/src/main/resources/META-INF/services/scalafix.v1.Rule to add a new rule.
• Updated scalafix/rules/src/main/scala/fix/ScalaTestExtendsFix.scala to fix the extends keyword.
• Updated scalafix/rules/src/main/scala/fix/ScalaTestImportChange.scala to handle the import change with ScalaTest.

Summary

• Updated e2e_demo/scala/cleanup.sh:

  • Removed sparkdemoproject-3.
  • Removed ../../pipelinecompare/warehouse/*.
  • Removed /tmp/spark-migration-jars/*.

• Updated e2e_demo/scala/run_demo-gradle.sh:

  • Added error handling for cleanup script failure.
  • Added error handling for project cleanup failure.

• Updated pysparkler/config.yaml:

  • Added a new comment for PY24-30-001.
  • Disabled PY24-30-002.

• Updated scalafix/rules/src/main/resources/META-INF/services/scalafix.v1.Rule:

  • Added a new rule.

• Updated scalafix/rules/src/main/scala/fix/ScalaTestExtendsFix.scala:

  • Fixed the extends keyword.

• Updated scalafix/rules/src/main/scala/fix/ScalaTestImportChange.scala:

  • Handled the import change with ScalaTest.

[sweep-ai]

Apply Sweep Rules to your PR?

• Apply: All new business logic should have corresponding unit tests.
• Apply: Refactor large functions to be more modular.
• Apply: Add docstrings to all functions and file headers.

[sweep-ai]

Fixing PR: track the progress here.

I'm currently fixing this PR to address the following:

[Sweep GHA Fix] The GitHub Actions run failed with the following error logs:

✨ Created Pull Request: #124