As they moved, they would go in any one of the four directions the creatures faced; the wheels did not change direction as the creatures went.
References for Ezekiel 1:17
Their rims were high and awesome, and all four rims were full of eyes all around.
References for Ezekiel 1:18
When the living creatures moved, the wheels beside them moved; and when the living creatures rose from the ground, the wheels also rose.
Wherever the spirit would go, they would go, and the wheels would rise along with them, because the spirit of the living creatures was in the wheels.
References for Ezekiel 1:20
When the creatures moved, they also moved; when the creatures stood still, they also stood still; and when the creatures rose from the ground, the wheels rose along with them, because the spirit of the living creatures was in the wheels.
References for Ezekiel 1:21
Spread out above the heads of the living creatures was what looked something like a vault, sparkling like crystal, and awesome.
References for Ezekiel 1:22
Under the vault their wings were stretched out one toward the other, and each had two wings covering its body.
When the creatures moved, I heard the sound of their wings, like the roar of rushing waters, like the voice of the Almighty, like the tumult of an army. When they stood still, they lowered their wings.
References for Ezekiel 1:24
Then there came a voice from above the vault over their heads as they stood with lowered wings.
Above the vault over their heads was what looked like a throne of lapis lazuli, and high above on the throne was a figure like that of a man.
References for Ezekiel 1:26
I saw that from what appeared to be his waist up he looked like glowing metal, as if full of fire, and that from there down he looked like fire; and brilliant light surrounded him.
References for Ezekiel 1:27