Nitrogen(N) atom is smaller in size so it's lone pair is relatively unstable. That is why repulsion between lone pairs present on nitrogen atom and bonded pairs of electrons is relatively high.

But size of Sb is more so its lone pair is relatively stable. That is why it does not want to perticipate in bond pair lone pair repulsion and decreases lp-bp repulsion.