That's what the 'plug uglies' were for.
New Yorkers Have Been Illicitly Cracking Open Fire Hydrants For Centuries, by Dan Nosowitz / 30 Jul 2015, says in passing: Water mains, which were only accessible by the rich, ran in limited numbers underneath the city, made mostly of hollowed-out logs...