Battery Church, like Battery DeRussy, is not open to the public. Its lower doors are all barred, and while one could climb up the ramped supports along both sides of the battery with relative ease, one would be very exposed in the process, and who knows what perils might await one upon the roof.