When I went down to breakfast, I was surprised to see that my husband (didn’t leave / hadn’t left) for work yet.

didn’t leave

hadn’t left

The past perfect tense is used for an action already completed by the time of another past action.