When using the verb "heard" in the past tense, the action is already established in the past. The verb that follows should be in its base form (infinitive), not the past tense, because "heard" has already indicated the past.

The correct structure is to use the base form of the verb after "heard":

"We heard grandfather play the organ."