The correct option is ''would not have been''.

Would is a conditional mood. “Have + been” marks the past tense. As you may know, conditional grammar expresses an idea that is not real. It didn't happen

From the above statement, we can see that ,he didn't leave earlier, so he  arrived late at his destination.