Fix up the "All IPC" collection

Issue #9 new
Christian Muise created an issue

Before it can/should be used as a cite-able source of benchmark domains, the "All IPC" collection should be touched up. Things to do:

  • Consider renaming it
  • Use logistics-98 instead of logistics-00 (see here)
  • Remove the settlers domain (it isn't STRIPS)
  • Create an optimal equivalent

Comments (8)

  1. Jendrik Seipp

    I think the name of the collection should reflect that this suite is meant for satisficing, STRIPS planners and that it is a selection of tasks. "All IPC" sounds like it includes all tasks ever part of the IPC.

  2. Christian Muise reporter

    So two questions follow:

    1. What should the name be such that it still hints at the fact that it covers (or at least tries to) all domains across all IPCs?
    2. What would the actual difference be between the satisficing and optimal collections? Just the difficulty of the problems in the benchmarks?
  3. Florian Pommerening

    What would the actual difference be between the satisficing and optimal collections? Just the difficulty of the problems in the benchmarks?

    In your email, you mentioned:

    Benchmarks from the satisficing track are selected instead of the optimal track

    I would recommend picking optimal over satisficing tracks for the optimal collection and otherwise using the same criteria as for the other collection.

  4. Log in to comment