While they were fleeing religious persecution, they were not atheists. The original Pilgrims were Christians who believed the church of England to be beyond redemption. All of the founding fathers were raised in some Christian belief system, and more or less practiced their respective branches of Christianity.

They were certainly more open-minded in accepting beliefs that deviated from their own, but also certainly not atheist.