Indeed, the true meaning of the Four Symbols should be recognized universally.
However, while people worship imagined gods and deities appointed by kings, rarely does anyone worship the Four Symbols.
They are too abstract and mystical.
It is said that Tai Chi gives birth to Yin and Yang, and Yin and Yang give birth to the Four Symbols, representing the evolution of the world, from the inception to the acknowledgment of Yin and Yang contradictions, and then to the foundational worldview of the four seasons and directions... Yet no one worships Tai Chi or even the Four Symbols.
The Four Symbols are slightly better, with the existence of the four divine beasts allowing for worship, and some people do regard them as deities; Tai Chi and Yin and Yang have completely become mere concepts, amounting to nothing.
Even the Four Symbols Sect itself does not treat the worship of the Four Symbols as this foundational world concept.