By default, move all intermediate results to output

Created by: yxqd

Right now intermediate results are saved in the "fast" working disk. That disk can easily be full.

Remove the "clean_on_the_fly" flag. Add a new parameter "clean_intermediate_files":

  • on_the_fly: clean as they are generated
  • archive: move to output (default)
  • None: keep them

output should be in a slow but much larger disk