The RERS Challenge 2014
part of ISoLA 2014, Corfu, Greece, October 8 -11 2014
Rigorous Examination of Reactive Systems (RERS)
The results of the 2014 RERS challenge are now online
Reactive systems appear everywhere, e.g. as Web services, decision support systems, or logical controllers. Their validation techniques are as diverse as their appearance and structure. They comprise various forms of static analysis, model checking, symbolic execution and (model-based) testing, often tailored to quite extreme frame conditions. Thus it is almost impossible to compare these techniques, let alone to establish clear application profiles as a means for recommendation.
The RERS Challenges aim at overcoming this situation by providing a forum for experimental profile evaluation based on specifically designed Benchmark suites. These benchmarks are automatically synthesized to exhibit chosen properties, and then enhanced to include dedicated dimensions of difficulty, ranging from conceptual complexity of the properties (e.g. reachability, full safety, liveness), over size of the reactive systems (a few hundred lines to tens of thousands of them), to exploited language features (arrays and arithmetic at index pointer).
Characteristic for RERS is its wide scope, which addresses not only source code analyzers (White-Box problems), but also (model-based) testers and (test-based) modelers (compiled problems), and in particular free stylers (anything is allowed). Currently, RERS focuses on functional properties only, but non-functional properties like time, performance, and stochastic behavior are envisaged.
The Competition 2014
In 2014 we will address two independent categories of challenges. The problems will be generated automatically in a similar fashion as in 2013.
Categories for 2014 competition:
- White-Box (basic) in Java/C code in different shapes of hardness
- White-Box (extended) in Java/C code in easy, middle and hard
The profile of future challenges will be subject to discussion at the ISoLA 2014 challenge meeting.