How New York's Public Records Got Swamped by Duplicate Images—and What the City Is Doing About It

New York City's digital archives are clogged. Across dozens of municipal agencies—from the Department of Buildings to the Housing Preservation and Development office on Broadway—the same photographs, scanned permits, and inspection images appear hundreds, sometimes thousands, of times in separate databases. The problem has a name inside City Hall: duplicate image accumulation. And after years of benign neglect, it is now costing the city real money and threatening the reliability of public records that residents and courts depend on.

The timing matters because the city is under pressure on multiple fronts. The Adams administration's push to accelerate housing permitting in neighborhoods from the South Bronx to East New York has forced agencies to digitize paper records at speed, and speed has a cost. When borough-level offices scan documents without a shared deduplication protocol, identical images land in separate servers. Multiply that across 59 community boards, five borough presidents' offices, and nearly 40 mayoral agencies, and the storage bill balloons fast.

A Problem Built Over Decades

The roots go back to the early 2000s, when the Bloomberg administration pushed agencies to go paperless with little coordination on file standards. Each agency chose its own imaging vendor. The Department of City Planning, headquartered at 120 Broadway, adopted one system. The Landmarks Preservation Commission, at 1 Centre Street, adopted another. Neither was required to cross-reference files with the other. By the time the de Blasio administration tried to consolidate city IT infrastructure under the Department of Information Technology and Telecommunications—known as DoITT, later rebranded as NYC Cyber Command for security functions—the data silos had calcified.

A 2023 report from the city's Office of Technology and Innovation found that municipal storage costs had grown significantly year over year, driven in part by redundant files across legacy systems. The report did not publish a single agency-by-agency breakdown publicly, but it flagged duplicate media assets as a priority for the city's MyCity digital services initiative, which Mayor Adams launched in 2023 to streamline resident-facing government portals. MyCity's backend consolidation exposed just how severe the duplication problem had become: early internal audits identified redundant image files numbering in the tens of millions across the housing and buildings portfolios alone, according to city technology officials cited in planning documents reviewed by The Daily New York.

The practical consequences land hardest on ordinary New Yorkers navigating the city's bureaucracy. When a tenant in Bushwick files a housing complaint through 311 and an inspector photographs a cracked ceiling, that image can end up stored separately in the HPD complaint system, the Buildings Information System, and a borough-specific archive—three copies of the same file, none of them linked. When a landlord contests a violation in Housing Court at 111 Centre Street in Lower Manhattan, attorneys have reported pulling conflicting image records from different databases, creating evidentiary confusion that delays proceedings.

What the City Is Trying Now

The Office of Technology and Innovation is piloting a deduplication program called the Unified Asset Registry, which uses hash-matching software to identify identical image files across agency servers and consolidate them into a single record with shared metadata. The pilot launched quietly in the first quarter of 2026 with three agencies: HPD, the Department of Buildings, and the Taxi and Limousine Commission. If the pilot meets its benchmarks by September 2026, city officials plan to expand it to 12 more agencies before the end of the fiscal year.

The fiscal stakes are not trivial. Cloud storage contracts for the city's largest agencies run into the tens of millions of dollars annually, and technology officials have estimated that eliminating confirmed duplicates could reduce active storage needs meaningfully—though no final savings figure has been published. Advocates for government transparency, including the Reinvent Albany watchdog group based in Albany but active on city data issues, have pushed for a public dashboard showing deduplication progress so residents can track whether the cleanup is real or just internal reshuffling.

For now, residents who rely on city image records—whether for housing disputes, landmarks applications, or small-business permitting on stretches like Flatbush Avenue in Brooklyn or Arthur Avenue in the Bronx—should request records from multiple agency portals separately until the Unified Asset Registry is fully operational. The city's Open Records portal at a.m.p.s.nyc.gov allows parallel FOIL requests to different agencies at no cost, which remains the most reliable workaround until the backend consolidation catches up.