How New York's Digital Archives Ended Up Full of the Same Photo Twice, and What the City Is Doing About It

New York City's sprawling network of government databases is quietly choking on itself. Thousands of duplicate photographs, the same pothole, the same permit inspection, the same crime scene, have accumulated across municipal systems over years of siloed agency IT work, creating a records management headache that city officials and archivists have been trying to untangle since at least 2022.

The problem is not trivial. When agencies from the Department of Buildings to the Department of Transportation each maintain separate digital repositories with overlapping content and no shared deduplication protocol, the redundancy compounds fast. For a city managing tens of millions of records annually, duplicate image files inflate storage costs, slow retrieval for lawyers and journalists filing FOIC requests, and complicate compliance with the state's Freedom of Information Law.

A Problem With Deep Roots

The origins go back to the Bloomberg-era digitization push of the mid-2000s, when city agencies were encouraged to photograph everything, inspections, violations, infrastructure damage, but given little central guidance on how those images should be stored, tagged, or cross-referenced. The 311 system, launched in 2003, became a particular magnet for duplication: residents photographing the same broken sidewalk on West 125th Street in Harlem or a collapsed scaffolding on Atlantic Avenue in Brooklyn and submitting multiple reports, each generating a saved image in a different queue.

The problem worsened after Superstorm Sandy in October 2012, when emergency documentation requirements flooded agency servers with photographs taken by inspectors, contractors, and first responders, often of the same damaged block from different angles, filed under different job numbers. A 2019 audit by the city's Department of Records and Information Services, known as DORIS, found that certain agency image libraries contained duplication rates above 30 percent in specific categorical folders, though the audit covered only a subset of the city's total digital holdings.

DORIS, headquartered at 31 Chambers Street in Lower Manhattan, has been piloting a deduplication program since late 2023 using perceptual hashing software, a technology that identifies visually identical or near-identical images even when file names differ. The pilot targeted records held by the Department of Buildings and the Department of Environmental Protection first, those two agencies together accounting for a significant share of the city's inspection photography volume.

Where Things Stand Now

Progress has been methodical but slow. City contracts reviewed through the Mayor's Office of Contract Services show that a vendor agreement for expanded deduplication tooling was awarded in the first quarter of 2025, valued at just under $2.1 million over two years. The contract covers software licensing and integration work across up to fourteen city agencies, with the MTA's New York City Transit division participating under a separate memorandum of understanding given its status as a public authority rather than a city agency.

The timing matters. With FIFA World Cup matches scheduled at MetLife Stadium in East Rutherford and fan zones planned for locations including Hudson Yards and Times Square, city agencies have ramped up permitting and inspection photography since early 2026. More images mean more potential for duplication, and city IT managers have been under pressure to ensure that documentation supporting stadium access permits and public safety inspections is clean and retrievable.

For New Yorkers who file public records requests, through the city's online NYC OpenRecords portal or directly with individual agencies, the practical consequence of duplicate image backlogs is slower response times. Requests that touch inspection records or field photography can take weeks longer than the statutory 20-business-day acknowledgment window, in part because staff must manually review image packages before release.

DORIS has published updated guidance on its website encouraging agencies to adopt standardized file-naming conventions and to run deduplication checks before uploading batches of inspection photos. Whether agency compliance will keep pace with the city's ever-growing photographic output is the central question facing the program as it moves toward a broader rollout, currently scheduled for the second half of 2026.