Skip to content

UtExecutionInstrumentation does not respect timeout in concrete execution #1726

Closed
#1728
Closed
UtExecutionInstrumentation does not respect timeout in concrete execution#1726
#1728
Assignees
Domonionsergeypospelov
Labels
comp-contest-estimatorIssue is related to contest estimatorcomp-instrumented-processIssue is related to Instrumented processctg-bugIssue is a bug

Description

@Domonion
Domonion
opened on Jan 20, 2023

Description

Currently UtExecutionInstrumentation measures only concrete execution, but not model construction for parameters and execution result.

Sometimes model construction might take too much time and will hang Instrumentation process indefenitely. This occurs too often in Contest Estimator, but problem relates to plugin too.

To Reproduce

Steps to reproduce the behavior:

  1. In ContestEstimator.kt set:
    • set javaHome to JDK8
    • timeLimit=120
    • projectFilter = listOf("guava-26.0")
    • set utbot-junit-contest/src/main/resources/classes/guava-26.0/list to
    com.google.common.primitives.Booleans
com.google.common.primitives.Shorts
  2. Start ContestEstimator
  3. Tests for class Shorts once in a 2-3 generations will not be generated at all

Expected behavior

Everything works

Actual behavior

Tests for Short does not generate, Instrumentation process hangs on some requrest.

Activity

  1. Domonion
    added
    ctg-bugIssue is a bug
    on Jan 20, 2023
  2. Domonion
    self-assigned this
    on Jan 20, 2023
  3. Domonion
    added this to UTBot Javaon Jan 20, 2023
  4. github-project-automation
    moved this to Todo in UTBot Javaon Jan 20, 2023
  5. Domonion
    assigned
    sergeypospelov
    on Jan 20, 2023
  6. alisevych
    added
    comp-contest-estimatorIssue is related to contest estimator
    comp-instrumented-processIssue is related to Instrumented process
    on Jan 20, 2023

  7. alisevych commented on Jan 20, 2023

    @alisevych
    alisevych
    on Jan 20, 2023
    Member

    Connected issue:

  8. Domonion commented on Jan 20, 2023

    @Domonion
    Domonion
    on Jan 20, 2023
    CollaboratorAuthor

    possible.patch.txt
    Possible patch, verification required

  9. Domonion
    added a commit that references this issue on Jan 20, 2023

    Possible fix for #1726, verification requored

    3a852f6
  10. Markoutte
    added a commit that references this issue on Jan 20, 2023

    Possible fix for #1726, verification requored

    a5c350d
  11. Domonion
    added 4 commits that reference this issue on Jan 25, 2023

    [utbot-rider]

    20870a2

    [utbot-rider]

    70d099a

    [utbot-rider]

    72d7dad

    [utbot-java]

    8be517b
  12. Domonion
    closed this as completedin #1728on Jan 27, 2023
  13. Domonion
    added a commit that references this issue on Jan 27, 2023

    Redesign for Concrete Executor timeout (#1728)

    eaf4b55
  14. github-project-automation
    moved this from Todo to Done in UTBot Javaon Jan 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

comp-contest-estimatorIssue is related to contest estimatorcomp-instrumented-processIssue is related to Instrumented processctg-bugIssue is a bug

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions