Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Smoke testing of UTBot Java main flow #2356

Closed
33 tasks done
alisevych opened this issue Jul 3, 2023 · 1 comment
Closed
33 tasks done

Smoke testing of UTBot Java main flow #2356

alisevych opened this issue Jul 3, 2023 · 1 comment
Assignees
Labels
ctg-qa Issue is related to QA process

Comments

@alisevych
Copy link
Member

alisevych commented Jul 3, 2023

Initial set-up

Check that the IntelliJ Idea UTBot plugin can be successfully installed

Go through manual scenarios

Manual scenario #1

  • Use default plugin settings
  • Open the utbot-sample/src/main/java/org/utbot/examples/algorithms/ArraysQuickSort.java file
  • Generate tests for the class
  • Remove results
  • Generate and Run test for a method
  • Check only expected tests are red (failing on exceptions)
  • Check there are no yellow tests (failing on asserts)

Manual scenario #2

  • Use default plugin settings
  • Open the utbot-sample/src/main/java/org/utbot/examples/mock/CommonMocksExample.java file
  • Generate and Run tests with different Mocking options
  • Check only expected tests are red (failing on exceptions)
  • Check there are no yellow tests (failing on asserts)
  • Check generated tests consistency, layout, naming, correct mocking

Manual scenario #3

  • Create a new Gradle project with JDK 17
  • Add a sample java file to test
  • Generate a test in the existing test root
  • Check generated tests consistency, layout, naming

Manual scenario #4

  • Create a new Maven project with JDK 8
  • Add a sample java file to test
  • Generate a test with a new test root
  • Check generated tests consistency, layout, naming

Manual scenario #5

  • Create a new IntelliJ project with JDK 11
  • Add a sample java file to test
  • Generate tests for several classes
  • Check generated tests consistency, layout, naming
@alisevych alisevych added the ctg-qa Issue is related to QA process label Jul 3, 2023
@alisevych alisevych added this to the Spring July stabilization milestone Jul 3, 2023
@alisevych alisevych changed the title Regression testing of UTBot Java main flow Smoke testing of UTBot Java main flow Jul 4, 2023
@alisevych alisevych changed the title Smoke testing of UTBot Java main flow Regression testing of UTBot Java main flow Jul 4, 2023
@alisevych alisevych moved this from Todo to In Progress in UTBot Java Jul 6, 2023
@tyuldashev
Copy link
Collaborator

One pre-existing issue has been opened - #2376.
Also need to note that plugin size is much bigger than 100Mb now - around 180Mb

@github-project-automation github-project-automation bot moved this from In Progress to Done in UTBot Java Jul 7, 2023
@alisevych alisevych changed the title Regression testing of UTBot Java main flow Smoke testing of UTBot Java main flow Jul 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ctg-qa Issue is related to QA process
Projects
Archived in project
Development

No branches or pull requests

2 participants