By default, move all intermediate results to output
Created by: yxqd
Right now intermediate results are saved in the "fast" working disk. That disk can easily be full.
Remove the "clean_on_the_fly" flag. Add a new parameter "clean_intermediate_files":
- on_the_fly: clean as they are generated
- archive: move to output (default)
- None: keep them
output should be in a slow but much larger disk