Fix race condition around subprocess inference state tidyup

Fix race condition around subprocess inference state tidyup #321