The expression "I'd rather you..." (short for I would rather you...) is followed by a past simple verb when referring to the present or future. This is a subjunctive construction, used to express preference about another person's actions. It does not imply past time. "I'd rather you called" = I would prefer that you call (in the future), but we use the past simple called to express this preference.