Skip to content
Snippets Groups Projects

Solve Issue #180 Modified file transports to enable write loop in size > 2Gb

Merged Solve Issue #180 Modified file transports to enable write loop in size > 2Gb
github/fork/williamfgc/writeloop into release
Merged Podhorszki, Norbert requested to merge github/fork/williamfgc/writeloop into release

Created by: williamfgc

Checking std::ios_base::failure exceptions IOChrono is off by default, each owner turns it on explicitly Modified FileDescriptor and FilePointer destructors Added Tests BPWriteRead for stdio and fstream Removed IO AddTransport with vector (shoud have been there?) to enable AddTransport in Tests

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Podhorszki, Norbert
    Podhorszki, Norbert @pnb ·
    Author Owner

    Created by: pnorbert

    Looks good to me. BTW in adios1 the limit is set to 2GB-16MB, and that works too. I don't know if it would make any difference in performance to have ~1G or ~2G chunks. adios_internals.h:#define MAX_MPIWRITE_SIZE 2130706432 /* 2GB - 16MB */

  • Podhorszki, Norbert
    Podhorszki, Norbert @pnb ·
    Author Owner

    Created by: williamfgc

    @pnorbert Thanks! Yeah, I don't know about performance wrt XGb chuck sizes, we'll have to measure.

Please register or sign in to reply