Manual testing of Release 2022.12.1 Part 3 #1864

Activity

1. alisevych

   added

   ctg-qaIssue is related to QA processIssue is related to QA process

   on Feb 27, 2023
2. alisevych

   added this to the 2023.03 Release milestone on Feb 27, 2023
3. korifey

   added this to UTBot Javaon Feb 27, 2023
4. github-project-automation

   moved this to Todo in UTBot Javaon Feb 27, 2023
5. alisevych

   added

   lang-javaIssue is related to Java supportIssue is related to Java support

   on Mar 14, 2023
6. alisevych

   assigned

   tyuldashev

   and

   alisevych

   on Mar 17, 2023
7. alisevych commented on Mar 17, 2023

   

   alisevych

   on Mar 17, 2023

   Last edited by alisevych

   MemberAuthor

   More actions

   Security testing (sandboxing)

   Basic security

   • Project with JDK 8 + manual scenario from PR Add SecurityManager support to block suspicious code #622 #625 + default settings
   • Fuzzing only
   • Symbolic execution only
   • Project with JDK 11 + default settings
   • Fuzzing only
   • Symbolic execution only
   • Concrete executor is invoked from Symbolic execution
   • Project with JDK 17 + default settings

   With permissions

   • add PropertyPermission in ~.utbot\sandbox.policy - check test for property is not in sandbox, execute
   • add "permission java.io.FilePermission "<>", "read";" - check test for read not in sandbox, execute
   • add AllPermission in ~.utbot\sandbox.policy - check NO tests are in sandbox, try to execute (carefully!!!)
   • corrupt permission - check how UTBot fails - try scenario from Too many permissions file rereads - can slow down much #796
   • empty file
   • remove ~.utbot\sandbox.policy file - check generated tests are in sandbox

   Test rendering

   • JUnit4
   • JUnit5
   • TestNG
   • JUnit5 with parametrization
   • TestNG with parametrization

   Code structures

   • in private method
   • bug to check: Implicit unpermitted operations should be sandboxed #791
8. alisevych commented on Mar 21, 2023

   

   alisevych

   on Mar 21, 2023

   Last edited by alisevych

   MemberAuthor

   More actions

   Reproducing:

   • Socket.connect and Files.readAllBytes produce errors in Concrete execution #1314
   • Unused import of java.net.UnknownHostException #1999
9. alisevych

   closed this as completedon Mar 21, 2023
10. github-project-automation

    moved this from Todo to Done in UTBot Javaon Mar 21, 2023
11. alisevych

    changed the title [-]Manual testing of Release 2023.03 Part 3[/-] [+]Manual testing of Release 2022.12.1 Part 3[/+] on Mar 22, 2023