Let one man worship God, another Jupiter; let one lift suppliant hands to the heavens, another to the altar of Fides; let one—if you choose to take this view of it—count in prayer the clouds, and another the ceiling panels; let one consecrate his own life to his God, and another that of a goat. For see that you do not give a further ground for the charge of irreligion, by taking away religious liberty, and forbidding free choice of deity, so that I may no longer worship according to my inclination, but am compelled to worship against it. Not even a human being would care to have unwilling homage rendered him. And so the very Egyptians have been permitted the legal use of their ridiculous superstition, liberty to make gods of birds and beasts, nay, to condemn to death any one who kills a god of their sort. … In, fact, we alone are prevented having a religion of our own. We give offence to the Romans, we are excluded from the rights and privileges of Romans, because we do not worship the gods of Rome. It is well that there is a God of all, whose we all are, whether we will or no. But with you liberty is given to worship any god but the true God, as though He were not rather the God all should worship, to whom all belong.
–Tertullian, Apology ch.24
It is a fundamental human right, a privilege of nature, that every man should worship according to his own convictions: one man’s religion neither harms nor helps another man. It is assuredly no part of religion to compel religion—to which free-will and not force should lead us—the sacrificial victims even being required of a willing mind. You will render no real service to your gods by compelling us to sacrifice. For they can have no desire of offerings from the unwilling, unless they are animated by a spirit of contention, which is a thing altogether undivine.
–Tertullian, To Scapula ch. 2