I think it it possible to say "Завтра я обедаю с ним" in order to express I (will) have dinner with him tomorrow.
<Future action by using the imperfective present>
But it is not possible to say "Через два дня я бедал с ним" in order to express I was going to have dinner with him two days later <future action at the past point by using the imperfective past>, because this sentence just expresses the fact (not plan) I had dinner with him two days later.
Is my understanding OK?