The First Amendment guarantees free exercise of religion, but also forbids "establishment of religion", in the USA.
Other countries (England, Norway, etc.) have "established churches", subsidized and controlled by the government, but allow citizens to practice other religions.