20 Then the whole Israelite community withdrew from Moses’ presence,

Read Exodus 35:20 Using Other Translations

And all the congregation of the children of Israel departed from the presence of Moses.
Then all the congregation of the people of Israel departed from the presence of Moses.
So the whole community of Israel left Moses and returned to their tents.