How New York's Digital Archives Ended Up Full of the Same Image Twice — and What the City Is Doing About It

New York City's municipal agencies are sitting on a sprawling mess of duplicated digital imagery — the same photographs, graphics, and scanned documents stored multiple times across overlapping systems — and fixing it has quietly become a line item in technology procurement conversations at City Hall. The problem did not appear overnight.

The duplication crisis traces directly to decisions made during the Bloomberg-era migration of paper records to digital storage, accelerated without sufficient standardization across agencies that each built their own content repositories. By the time the de Blasio administration launched NYC.gov redesigns in 2017 and 2018, the infrastructure underneath city web properties had accumulated redundant image files numbering in the millions, according to technology policy discussions documented in city council oversight hearings at the time.

A Patchwork Built Over Two Decades

The Department of City Planning, which maintains some of the most heavily trafficked data portals in the five boroughs, ran a separate asset management system from the Department of Housing Preservation and Development for years. Both agencies produced zoning maps, neighborhood photographs, and informational graphics that ended up duplicated when consolidated into the broader NYC Open Data platform, launched in 2012 under Executive Order 306. The Open Data portal, accessible at data.cityofnewyork.us, became a kind of landfill for redundant files as agency uploads stacked on top of each other without deduplication protocols in place.

The MTA faced a parallel problem. As the agency invested heavily in digital rider communications — particularly after the 2019 New Subway Action Plan and the subsequent capital program commitments — internal communications teams at 2 Broadway produced multiple versions of the same station photographs and signage graphics for different platforms. Marketing, operations, and accessibility teams each maintained separate folders, often without awareness of what the others were holding.

The cost implications are real. Cloud storage expenses for city government have grown substantially since agencies began migrating from on-premise servers, and duplicated files directly inflate those costs. A 2023 report from the Mayor's Office of Technology and Innovation — publicly available through the city's budget documents — identified digital asset redundancy as a contributing factor in storage expenditures that exceeded projections.

Where the Adams Administration Comes In

The Adams administration inherited this landscape and has moved, unevenly, toward addressing it. The city's Fiscal Year 2025 technology budget included allocations for what procurement documents described as digital asset management modernization across select agencies, with the Department of Records and Information Services on Chambers Street serving as a pilot site. That agency, which houses the Municipal Archives and maintains historical photograph collections stretching back over a century, has been testing automated deduplication tools since late 2024.

The practical challenge is identifying which version of a duplicated image is the authoritative one. Agencies frequently edited source files — cropping, recompressing, or watermarking them — creating derivative images that technical systems do not flag as obvious duplicates. A photograph of the Gowanus Canal taken for an environmental review in 2016, for example, might exist in a dozen variations across city servers, none of them byte-for-byte identical.

Community organizations in neighborhoods like Jackson Heights and the South Bronx that rely on city digital resources for housing and zoning information have noted the downstream effects: outdated or inconsistent imagery on city-facing documents has caused confusion during public comment periods. The Community Service Society of New York, which works extensively with low-income residents navigating city agencies, has flagged digital resource reliability as a concern in testimony before the City Council's technology committee.

The city's target, based on procurement language reviewed for this article, is to complete a first phase of deduplication across five major agencies by the end of calendar year 2026. Residents and advocates who work with city digital records would do well to note which agency portals have been updated — the Department of City Planning's ZoLa mapping tool at zola.planning.nyc.gov is among those flagged for early remediation — and to cross-reference documents against the Open Data portal when accuracy matters.