Feature requests: append to an existing file, overwrite existing steps
Created by: kshitij-v-mehta
Feature requests coming from the GTC application:
Ability to append data to existing files: If the application crashes and has to restart, it would be good to have the ability to append data to existing files instead of creating new files.
Ability to append and overwrite data in existing files: Consider the following scenario. The snapshot data file gets data every timestep, whereas the application writes checkpoint data every few timesteps. Say, the application wrote a checkpoint after 100 timesteps, and it crashed at step 150. At this point, the snapshot file has 150 timesteps. When the application restarts, we resume from timestep 101. Steps 101-150 that exist in the snapshot file must be deleted or overwritten by new data for these timesteps coming in.