New York Leads Cities in Cracking Down on Duplicate Images in Public Records, But the Work Is Far Alone

New York City's Department of Buildings logged more than 1.2 million permit applications in fiscal year 2025, and buried inside that mountain of paperwork was a problem officials had long suspected but struggled to quantify: thousands of duplicate images — scanned documents, site photographs, and architectural drawings filed multiple times under different case numbers, clogging databases and slowing down inspections from Mott Haven to Midtown.

The issue snapped into sharper focus this spring when the city's Office of Technology and Innovation, working alongside the Department of Buildings, launched a systematic audit of its digital records infrastructure. The timing is not accidental. With the 2026 FIFA World Cup placing New York under an international spotlight — and city agencies scrambling to process construction permits for venue upgrades near MetLife Stadium's transit corridors — the administrative backlog created by duplicate filings has real, visible consequences.

What Duplicate Images Actually Cost the City

Duplicate image records are not a minor clerical nuisance. Each redundant file consumes server storage, triggers duplicate review workflows, and can generate conflicting compliance statuses on the same property. The city's Department of Records and Information Services, headquartered on Chambers Street in Lower Manhattan, manages archives dating to the 19th century, and officials there have acknowledged the digitisation push of the early 2010s introduced significant duplication when contractors batch-scanned physical folders without deduplication protocols in place.

By comparison, London's Planning Portal — which handles submissions for all 33 boroughs — implemented automated hash-based deduplication software in 2021, cutting redundant image files by roughly 34 percent within 18 months, according to figures published by the Greater London Authority. Amsterdam's Digitaal Stadsarchief adopted a similar protocol in 2019, and the city's municipal IT office reported a measurable reduction in processing time for building permit reviews. New York, with a records system far larger and more fragmented than either European counterpart, is still building the infrastructure to match those benchmarks.

The Office of Technology and Innovation declined to release a specific figure for how many duplicate images currently exist across city systems, but a March 2026 budget document reviewed by The Daily New York allocated $4.7 million to a multi-agency data deduplication initiative expected to run through June 2027. The Brooklyn Public Library's digital collections team, which has worked separately on its own archive deduplication since 2023, has called the cross-agency coordination challenge significant — a polite way of saying that no two city departments store images the same way.

How Other Cities Are Handling It

Tokyo's Bureau of Urban Development completed a full image deduplication sweep of its construction permit database in late 2024, a project that took three years and involved a dedicated team of 22 archivists and software engineers. Singapore's Urban Redevelopment Authority, widely regarded as one of the most digitally mature planning agencies in the world, runs real-time deduplication on all incoming submissions through its Integrated Plan Approval system, preventing duplicates from entering the database in the first place.

New York is not there yet. The current initiative is remedial rather than preventive — cleaning up what already exists rather than stopping new duplicates at the point of entry. The OTI has said it plans to pilot a submission-level deduplication tool at the Department of Buildings' Queens borough office, on Parsons Boulevard in Jamaica, before any citywide rollout. That pilot is scheduled to begin in the fourth quarter of 2026.

For New Yorkers navigating the permit process, the practical advice from housing attorneys and expeditors working in neighborhoods like Bushwick and Fordham is straightforward: file documents once, clearly labeled, and follow up with the relevant agency directly if a submission disappears into the system. The deduplication effort will eventually make things cleaner on the back end, but right now the front end is still messy. Contractors who have had permits stall because of conflicting duplicate records can file a formal correction request through the DOB NOW portal, a step that many applicants do not know exists. Getting that word out may matter more, in the short term, than any algorithm.