Important Dates:

  • Nov. 08, 2018:
       RERS at ISoLA'18
  • Oct. 01 – Oct. 14, 2018:
       Solution Submission
  • Aug. 22, 2018:
       Release Parallel LTL
  • Jul. 18, 2018:
       Release Sequential LTL and
       Sequential Reachability
  • Jul. 18, 2018:
       Training benchmarks

How to Proceed

To get a feeling for the provided problems, we provide a set of sequential and parallel training problems with solutions that are very similar to those found in the actual challenge, but tend to be smaller in size.

You may proceed as follows:

  • Step 1. Download the sequential or parallel training problems of the track that you want to participate in.
  • Step 2. Read the sequential problem description or parallel problem description. Select your favorite method or tools to find out which properties are satisfied. You may use your own tool or other people's tools or any combination thereof - the challenge is completely free-style. Some prominent tools you may consider to involve are:
    1. SPIN
    2. mCRL2
    3. LTSmin
    4. LearnLib
    If you would like your tool to be listed here or if you have any other suggestion for tools, please contact us.
  • Step 3. Test the strengths of your methods or tools using the sequential or parallel training problems.
  • Step 4. Once you are warmed up by working with the training problems, you will be ready for the actual challenge. Repeat Step 1 to Step 3 for the challenge problems. Good luck!
  • Step 5. Submit your solutions within the provided time frame for each category as listed on the left. The submission format is defined on the submission page.
  • Step 6. Receive your evaluation and hopefully also your achievements and rewards during the RERS event. At this event, we will also discuss the profile of future RERS problems.

The challenge is free-style. You are allowed to patch the code in any way you like, but the validity has, of course, to be stated according to the original problems. Nevertheless, it is advisable to first focus on the problems and properties that you can solve well. You do not have to give an answer to all properties within a problem. Of course, the more problems you can tackle, the more points you may be able to win, but please be aware that wrong answers have a high penalty.

Apart from achievements and the ranking, RERS features an evaluation-based award. In order to participate in this category, please write a brief summary of your approach, the encountered hurdles, your solutions, and your results. In these summaries, honesty, e.g. also concerning weaknesses of the employed methods, is important. Our challenge aims at profiling the various approaches and methods, which in particular means that weaknesses need to be identified. Of course, we are also very interested in new ideas and solutions that were motivated by the challenge. Details about the ranking or evaluation method can be found here.