Handle soft_kill more appropriately for pulsar runner