Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

EvoFuzz improvements for EvoSuite #478

Open
wants to merge 49 commits into
base: master
Choose a base branch
from
Open

EvoFuzz improvements for EvoSuite #478

wants to merge 49 commits into from

Conversation

cinemamoon
Copy link

This PR incorporates the improvements from EvoFuzz, the 1st place winner of SBFT'24 competition, specifically tailored for EvoSuite.

To summarize our PR,

  1. It incorporates improvements from EvoFuzz specifically tailored for EvoSuite.
  2. Our experiment using the JUGE framework shows the PR improves EvoSuite significantly.
    Specifically, with a 30-second time budget and 10 repetitions, we observed, for example:
    • All projects in SBFT'24 benchmark compiled into JDK8:
      • JUGE Score improved from 35.67 to 43.56
      • Line Coverage improved from 22.53% to 26.94%
    • SPOON and SEATA* in SBFT'22 benchmark compiled into JDK11:
      (* only these two projects in the benchmark can be compiled into JDK11​)
      • JUGE Score improved from 35.83 to 56.36
      • Line Coverage improved from 45.95% to 73.48%

For the additional information, refer to our paper at SBFT2024 tool competition track.
(Title: EvoFuzz at the SBFT 2024 Tool Competition)

Seokhyeon Moon and others added 30 commits April 11, 2024 17:24
Update the commons-lang3 library to include LANG-1700 bug fixes
7dcf4af 
- LANG-1700 bug is reported and fixed by me
- The bug fixes are not yet commited to the official Github of the library
Limit GenericClass type instantiation recursion level
1dfc655
Add isAssignable check before replacingParameterReference
3b7d9c6
Check type assignability for the field parameter before replacing it
f19447d
Return genericSuperClass only if possible
4fceb51
Refactor variable names in getWithParameterSuperclass()
1f7732f
Return new instance of typeVariableMap when calling getTypeVariableMap()
2d072b9
Fix a bug in getTypeVariableMap()
d8d4642 
- Generate typeVariableMap recursively
Fix the bug in clearGeneratorCache
5ba8416
Prioritize non-type parameterized generators in getRandomGenerator()
f765f16
Refactor a variable name in a method in MethodStatement.java to refle…
c2097a7 
…ct its actual meaning
Check type compatibility of variable before assigning it to the retur…
ce054a0 
…n variable of MethodStatement
Add a log message to the assertion error for debugging
0267c90
Prevent recursive generic type instantiation for the wildcard types
c2046b0
Map variable type to itself if there is no match
3623114
@cinemamoon
Increase MAX_GENERIC_DEPTH 3 to 15
36d2481
Check loops in type variable mappings before generic type variable in…
04804c3 
…stantiations
Revert "Fix a bug in getTypeVariableMap()"
288cd44 
This reverts commit d8d4642.
Fix the bug in getTypeVariableMap()
457fb62 
- Generate typeVariableMap recursively
Replace EvoLogger in VarMap with class specific Logger
f7865e7
Refactor line breaks for the code readability
50c59be
Add a debug routine to check type compatibilities functionalities
ea19ea9
Add missing import classes
4894e66
Replace replaceTypeVariable implementations with the updated Apache-c…
a5907e8 
…ommons-lang3
Fix a bug that incompletely compares type variables
e9c9aa7
Attempts a generic type variable instantiation with max_generic_depth…
022637b 
…=15 only if it is first try (Otherwise, the depth is 3)
Update the new commons-lang3 library to include new bug fixes
1523bfa
Add a mutation operator for a fieldReference parameter
8a69184
Change a directory environment variable into project root directory
2c90f1d
Update pom.xml in runtime to use local maven repository
a74589c
Seokhyeon Moon added 19 commits April 11, 2024 19:22
Update local-maven-repo to include *.jar
de2a774
Add readme.md describing the usage of local repo
ef853c5
Remove unnecessary configuration within pom.xml of runtime module
bb7d15f
Refactor to remove unnecessary changes in comparison with original Ev…
370d230 
…oSuite GitHub branch
Replace String concatenations with StringBuffer to efficiently constr…
1a7c555 
…uct a test code
Fix a possible bug in SandBoxing
4e3db6a
Remove an attempt to mutate field reference
ab2a74e
Limit the recursion depth of canBeInstantiatedTo()
5601eff
Add additional allowed RuntimePermission
2c9d47f
Modify assertion start condition
b699588
Fix the bug discovered by SPOON-65 in SBST'20 benchmark
7f5989e
Add additional type compatibilities checks
e71028b
Fix a bug discovered by GUAVA-128 in SBST'20 benchmark
d76a32d
Fix a bug discovered by GUAVA-22 in SBST'20 benchmark
af97384 
- already instantiated variable bound should be checked with ownerVariableMap, not with concreteType
Fix a bug that wrongly parses classPaths
664d29d
Fix the NPE when setting test generation strategy
25c0bb5
Generate Object type if we cannot find proper parameter type
c0cbfe5
Fix a null pointer exception
f0578bf 
- EvoFuzz generated the NPE on SBFT'24 benchmark
Reflect code review for PR#15
cff675d 
(Merge EvoFuzz improvements into EvoSuite)
@jxfzzzt
Copy link

jxfzzzt commented Aug 3, 2024

I'm very interested in it and curious about the underlying principles behind the fuzz. Could you provide a paper or a PPT to showcase your work?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@cinemamoon @jxfzzzt