Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fuzzing is not stopped on timeout when symbolic execution is excluded #570

Closed
alisevych opened this issue Jul 21, 2022 · 0 comments · Fixed by #574
Closed

Fuzzing is not stopped on timeout when symbolic execution is excluded #570

alisevych opened this issue Jul 21, 2022 · 0 comments · Fixed by #574
Assignees
Labels
comp-fuzzing Issue is related to the fuzzing ctg-bug Issue is a bug status-verified Bug fix is verified

Comments

@alisevych
Copy link
Member

alisevych commented Jul 21, 2022

Description

Need to stop test generation on timeout when only fuzzing test generation is turned on.
Fuzzing is turned on and the Simplest mode of Code analysis is used in Settings.

To Reproduce

Steps to reproduce the behavior:

  1. If you have settings.properties check that useFuzzing=true is present
  2. Run the 'UTBotJava' project in IntelliJ Idea
  3. Open File -> Settings... -> Tools -> UTBot
  4. Drag the Code analysis slider to the left most position - the Simplest
  5. Open utbot-sample/src/test/java/org/utbot/examples/algorithms/ArraysQuickSortTest.java
  6. Initiate test generation for the class with default settings (timeout 60 sec for the class)

Expected behavior

Tests are supposed to be generated after 60 sec maximum.

Actual behavior

Currently the test generation can last for 10 minutes approx.

Visual proofs (screenshots, logs, images)

Simplest Code analysis

Timeout for generation

Hanging for 10+ minutes

Environment

IntelliJ IDEA 2022.1.3

Additional context

When Code analysis slider is moved just 1 notch to the right - timeout doesn't exceed. If it is set to 10 sec - the generation ends in 10 sec approx. Only tests generated by Fuzzer are present in the Test class.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp-fuzzing Issue is related to the fuzzing ctg-bug Issue is a bug status-verified Bug fix is verified
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

2 participants