This means that we won't run into https://github.com/joblib/loky/issues/240
Right now, if a program crashes in the middle of saving, you lose
all your data.
Right now, if a program crashes in the middle of saving, you lose
all your data. This ensures that the old file is first moved, then
the new file is saved, and only then the old file is removed.