CS 267 Class Project
Competition on Software Verification (SV-COMP)
is a driving force for the invention of new verification methods, technologies, and tools.
As a class project in this course, you will first select a tool that
participated in SV-COMP in recent years (focus on the last 5 competitions, starting in
2019), then (1) evaluate the tool on the SV-COMP benchmarks by reproducing
the results, and (2) apply and evaluate the tool for verification tasks
in an application domain of your choosing.
Automated verification typically has scalability problems and application of
some verification tools may require manual effort. While choosing the tool you will focus on,
think about the application domain and the benchmark you are going to use in the application domain to evaluate the tool.
Please choose a topic that is
related to your research interests so that the project is fun for you!
You can do the project as teams of 2-3 students.
Project Deliverables
- Tool Selection: Send me one paragraph identifying the verification tool that you will be focusing on and the application domain that you are considering.
List the team members. Due: January 15, Wednesday, 5:00pm
- Tool Presentation and Evaluation Using SV-COMP Benchmarks:
Present the tool to the class, discuss its performance on SV-COMP benchmarks, and briefly discuss the application domain you plan the use the tool.
This will be a 10 minute presentation to the class with slides in the middle of the quarter. By this time you are expected the run the tool yourself on SV-COMP benchmarks and reproduce the SV-COMP competition results for the tool.
Due: February 5th, 1:00pm (in class)
- Final Project Presentation:
Present your results on applying the tool to the application domain you targeted.
This will be a 15 minute presentaiton to the class with slides at the end of the quarter.
Due: March 12th, 1:00pm (in class)
- Final Report:
You will turn in a final project report (up to 10 pages)
at the end of the quarter. The project report should describe the tool, briefly discuss its performance on SV-COMP benhmarks,
and discuss in detail the application domain you foucsed on, how you applied the tool to that domain, the benchmark and/or case studies you created, and the performance of the tool on these benchmarks and/or case studies.
Due: March 21st, Friday, 5:00pm