If there's such a correlation, it's more likely to be indirect, with large urban areas being less religious, and the same large urban areas being likely to be sited next to a river or coast.

As a direct example, the province of Zeeland is often considered to be part of the Dutch bible belt, and it doesn't get much more coastal than that. It does lack a major city.