Mark 11:31

31 They began to argue among themselves: "If we say, 'From heaven,' He will say, 'Then why didn't you believe him?'

Mark 11:31 Meaning and Commentary

Mark 11:31

And they reasoned with themselves saying
Privately; perhaps, they withdrew at a little distance for a short time, and consulted among themselves what answer to return; and the amount of their reasonings were this;

if we shall say from heaven, he will say, why then did ye not
believe him?
that is, should they say that John had a divine commission for what he said and did, they were aware that Christ would reply, why did not ye give credit to him? and had you done so, seeing he testified of me, you would have had no occasion to have put the above question; (See Gill on Matthew 21:25).

Mark 11:31 In-Context

29 Jesus said to them, "I will ask you one question; then answer Me, and I will tell you by what authority I am doing these things.
30 Was John's baptism from heaven or from men? Answer Me."
31 They began to argue among themselves: "If we say, 'From heaven,' He will say, 'Then why didn't you believe him?'
32 But if we say, 'From men' "-they were afraid of the crowd, because everyone thought that John was a genuine prophet.
33 So they answered Jesus, "We don't know." And Jesus said to them, "Neither will I tell you by what authority I do these things."
Holman Christian Standard Bible ® Copyright © 2003, 2002, 2000, 1999 by Holman Bible Publishers.  Used by permission.  All rights reserved.