Allow configurable retry of preprocess and postprocess actions on Pulsar side.
Uses Kombu style retry parameters since we are already exposing those for message publish retrying. See job_managers.ini.sample for specific new options. Lots left to do - integration test of this and retry framework for client side actions.
Showing
- job_managers.ini.sample 17 additions, 0 deletionsjob_managers.ini.sample
- pulsar/managers/staging/postprocess.py 7 additions, 6 deletionspulsar/managers/staging/postprocess.py
- pulsar/managers/staging/preprocess.py 2 additions, 2 deletionspulsar/managers/staging/preprocess.py
- pulsar/managers/stateful.py 8 additions, 2 deletionspulsar/managers/stateful.py
- pulsar/managers/util/retry.py 108 additions, 0 deletionspulsar/managers/util/retry.py
- test/retry_action_test.py 44 additions, 0 deletionstest/retry_action_test.py
Loading
Please register or sign in to comment