...Ye have abandoned My imperishable dominion, and have adorned yourself with the gay livery of the world...
By My beauty! All will I gather beneath the one-colored covering of the dust and efface all these diverse colors save them that choose My own....

This is written in the voice of God.  So is God really concerned about us having too many colors in the world?  I don't think so.  What this is saying is that we are too caught up in the material world and need to turn to the spiritual world, the world of God.  The one color of the world of God meaning the one path, the Way, which is to the path of spirit.