"What do you want me to do now? I'm for withdrawing and keeping quiet" 

"For" is the most appropriate preposition to use in this context. It means that the person has resigned and given up since there is nothing to be done about the situation. So the person is "for the idea of" or supports withdrawing and keeping quiet.