How New York's Public Records Got Flooded With Duplicate Images — and Why It's Finally a Problem Worth Fixing

The Department of Buildings has a backlog. So does the Department of City Planning. So, in different ways, does the Housing Preservation and Development office on Beaver Street. And threading through all three agencies is a quieter, less televised problem: thousands of duplicate digital images — scanned permits, property photographs, zoning maps — clogging city databases, inflating storage costs, and in some cases sending staff on paper chases for documents that exist two or three times under different file names.

It did not happen overnight. The city's digitization push dates back at least to the Bloomberg administration's early-2000s push to move paper records online, a project that accelerated in fits and starts through successive mayoral terms and never quite cohered into a unified system. Each agency built its own database architecture. Each set its own scanning protocols. When Hurricane Sandy hit in October 2012 and displaced or damaged records at multiple Lower Manhattan offices, emergency re-scanning created a second generation of files that often duplicated what already existed.

The COVID Backlog Made Everything Worse

The pandemic compounded the problem dramatically. Between March 2020 and the end of 2021, the Department of Buildings processed permit applications remotely, relying on document uploads from property owners, architects, and contractors who frequently submitted the same file multiple times to confirm receipt. Internal audits — referenced in DOB budget testimony to the City Council in fiscal year 2024 — noted that image deduplication had not been systematically addressed since at least 2019.

The downstream effects are practical and expensive. Digital storage is not free. The city's five-year technology capital plan, which the Adams administration released in early 2025, allocated roughly $340 million across agencies for IT infrastructure upgrades. A portion of that money is earmarked for what city officials call "data hygiene" initiatives, a category that includes duplicate-record remediation. Housing advocates in Crown Heights and Bushwick have long complained that permit review times at the DOB can stretch past 90 days for routine renovation filings; part of that delay, according to presentations made to the City Council's Technology Committee, traces to staff having to manually reconcile conflicting or redundant image records before a determination can be made.

The MTA's capital program offers a useful local parallel. When the authority undertook its $54 billion 2020-2024 capital plan, one early discovery was that asset-management databases for subway infrastructure contained duplicate equipment records — the same signal relay logged under multiple identifiers across different maintenance divisions. Resolving that took two years and a dedicated data-integrity team. The city's permitting problem is structurally similar, if smaller in scale.

Where Things Stand Now, and What Comes Next

The Office of Technology and Innovation, which Mayor Adams consolidated from several predecessor agencies, has been piloting an automated deduplication tool in the Department of Buildings' BIS Portal since late 2025. The pilot covers records filed after January 1, 2018 — roughly eight years of digitized submissions. A broader rollout to pre-2018 archived records, which are stored partly on servers in the MetroTech Center complex in Downtown Brooklyn, is contingent on the fiscal year 2027 budget, which the City Council has not yet finalized.

For property owners and small developers, the practical advice right now is straightforward: when submitting documents through the DOB NOW portal, use the system's built-in confirmation receipts rather than re-uploading to verify delivery. Multiple submissions of the same file remain one of the primary drivers of new duplicates entering the system. Community boards in neighborhoods like Astoria and the South Bronx, where development applications have surged under the City of Yes for Housing Opportunity zoning text amendment passed in late 2024, are especially vulnerable to processing slowdowns tied to this issue.

The fix is unglamorous and largely invisible to the public. But in a city where a delayed building permit can mean another month of unaffordable rent or a stalled affordable-housing unit, even a data-hygiene project carries real stakes on the street.