To Sit on the Fence
meaning: to be neutral in an argument or discussion, or to not know which side to choose.
Tom: I think we should have the party in a restaurant.
Dave: I disagree, we should have the party at my house. What do you think Bob?
Bob: I don’t know, I’m going to sit on the fence.