Automated evaluation question

Issue #135 resolved
Steven Gray created an issue

I realize it's late in the game to be asking, but what realtime factor should we see from the automated evaluation? I'm getting between 0.3x realtime at the beginning, falling to under 0.1x realtime further along in execution. In comparison, I get 0.95x to 0.5x running natively.

Is this the expected slowdown both from running without GPU support and enabling logging?

Thanks!

Comments (2)

  1. Deanna Hood

    The machine on which the trials run gets a RTF of 0.5-0.6 in the docker setup. We will send teams the logs from their smoke testing which shows the sim time and the real time, from which the RTF can be inferred.

  2. Log in to comment