Important Dates:

For Participants

Feedback

FAQ

Rewards and Achievements

RERS has a 3-dimensional reward structure:

  • 1) competition-based ranking in 4 categories,
  • 2) evaluation-based rewards for particularly interesting approaches,
  • 3) 36 kinds of achievement certificates in gold silver and bronce.

Achievements are new for RERS, but the other two rewarding categories essentially work as at RERS 2012, except for the fact that we are now considering three kinds of problem categories: White-Box, Black-Box , and Grey-Box. As 2012, Springer sponsors gift certificates for the winners of the competitions and the evaluation-based ranking.

1) Competition-based Ranking

There are four price categories: White-Box, Black-Box, Grey-Box and overall. The scores are evaluated according to the number of correctly answered questions. Each correct answer gives one point, but each wrong answer costs two (correct = +1, wrong = -2, and open = 0).

2) Evaluation-Based Rewarding

In this category rewarding is done according to the employed (combination of) methods (which must not necessarily have scored highest). The submitted descriptions of approaches and solutions will be reviewed and ranked by the Challenge Team. Due to the possible variety of methods there may be several winners in this category. As a price for the best conceptual contribution is a gift certificate for Springer books sponsored by Springer.

The teams with the best solutions in their categories will be invited for a STTT Special Section summarizing the results of the challenge, and, in particular, presenting the most advanced solutions.

3) Achievements

In order to clearly separate achievements from the previous two categories, we decided that achievements

  • are given from a verifiers perspective: given answers must be correct, but there is no need to answer every question,
  • only concern the easiest categories of each kind. The other categories, which are highlighted in red, are included in the numerical ranking and should provide input and insight for the discussion during the Challenge meeting in San Jose in November.

For all three kinds of problems we have (as last year)

  • a reachability part
  • a full LTL part

but we restrict the achievement specific part as follows in order to take the specific character of grey box and black box problems into account:

White-Box

The evaluation of the reachability problems and the LTL problems are independent and follow the same scheme:

  • Bronce requires a 70% score of one problem in the Small/Easy category, while forbidding any faulty answer.
  • Silver requires a 75% score of one problem in the medium/Easy category, while forbidding any faulty answer.
  • Gold requires a 80% score of one problem in the large/Easy category, while forbidding any faulty answer.
  • Platimum requires that all problems are solved correctly.

Grey-Box and Black-Box

Here we only consider the fraction of problems which can explicitly be demonstrated via appropriate paths. Thus, only the fraction of a problem, which can be observed through testing, contributes to the points score. Otherwise the setting is the same, i.e.

  • Bronce requires a 70% score of the considered fractions of the Small/Easy problems, while forbidding any faulty answer.
  • Silver requires a 75% score of the considered fractions of the Medium/Easy problems, while forbidding any faulty answer.
  • Gold requires a 80% score of the considered fractions of the Large/Easy problems, while forbidding any faulty answer.
  • Platimum requires that all problems of the considered fraction are solved correctly.