No checkpoint parameters is saved in v0.5

[Alireza Khorshidi]

Right now, now check-point parameters is saved when training. This can be annoying because we may end up with a job timing out but nothing saved to the disk as output.

[andrew_peterson]

Duplicate of #76.