Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • A ADIOS2
  • Project information
    • Project information
    • Activity
    • Labels
    • Planning hierarchy
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 97
    • Issues 97
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
  • Merge requests 9
    • Merge requests 9
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Issue
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Podhorszki, Norbert
  • ADIOS2
  • Issues
  • #2020

Closed
Open
Created Mar 04, 2020 by Eisenhauer, Greg@eisenContributor

BP4 does not implement the BP3 "async file open"

The BP3 engine, like ADIOS1, had a feature where one could "pre-Open" a file, which helped protect applications from long delays on machines where a system-level file open might take a long time. Specifically, in BP3, the actual ADIOS2 Open() call for writers would spawn an asynchronous task for the sytem level open, and avoid use of the system file for the duration of ADIOS Open to ensure that ADIOS Open could return before system-level open() completed. BP3 writer would join the async task before the first write() that actually used that system-level resource, but between the Open and the first write, the application was free to do other things, essentially hiding the latency of system-level open. However, the addition of index files in BP4 changed the nature of Open, and it no longer refrains from touching the system-level resource. This means that in BP4, it is not possible to pre-Open a ADIOS file and hide the latency of the system-level open() call. Instead, Open blocks internally and waits for the system open to succeed so that it can write to the index files. The pre-Open functionality should be implemented in BP4 as it is in BP3. (See discussion in PR #2007.)

Assignee
Assign to
Time tracking