Add api test for stopping job early