When I went down to breakfast, I was surprised to see that my husband (didn’t leave / hadn’t left) for work yet.

didn’t leave

hadn’t left

The past perfect tense is used for an action already completed by the time of another past action.

For more help, see sections G2-f and G2-g.