Answer:
When Jack asks the group of boys to raise their hands if they think that Ralph should not be the leader, there is silence. Jack knows that the boys do not support his attempt to usurp power from Ralph, and Jack says, "I'm not going to play any longer. Not with you"
