Tasmania Government Drowning in Millions of Duplicate Digital Files

Tasmania's state and local government agencies are sitting on digital archives bloated by years of duplicated image files, a problem that predates the pandemic but has grown sharply since 2020, when remote work pushed public servants to store documents across multiple platforms simultaneously. The Tasmanian Archives and Heritage Office, which operates out of Rosny Park on the Eastern Shore, has been working since late 2024 to quantify just how extensive the duplication problem is across agencies it services.

The issue matters now for a blunt reason: storage costs money, and so does the time spent by staff who cannot locate authoritative versions of planning documents, heritage records, or asset photographs buried under dozens of near-identical copies. With the state Liberal government under pressure on budget discipline, the AFL stadium project at Macquarie Point alone has attracted sustained scrutiny over cost management, waste inside digital infrastructure is no longer a line item anyone can wave away.

How the Duplication Built Up

The pattern is familiar to archivists and IT managers across Australian governments. Before cloud storage became standard, agencies like the Department of State Growth and the Hobart City Council relied on shared network drives where files were routinely saved multiple times by different staff working on the same project. A heritage photograph of, say, the Salamanca Place precinct might exist in six slightly different resolution versions spread across three folders, with no metadata linking them and no clear record of which copy had been formally approved or cleared for publication.

The shift to Microsoft SharePoint and similar platforms from roughly 2018 onward did not clean up the old drives, it added a new layer. Staff migrated some files, left others behind, and the duplication multiplied. By 2023, at least two Tasmanian councils had commissioned internal audits after discovering their digital asset libraries had grown to several terabytes without any corresponding increase in unique content. The Clarence City Council, for instance, began a structured records review that year covering planning imagery and infrastructure documentation across its Rosny and Howrah service areas.

The Tasmanian Archives and Heritage Office issued updated guidance on digital records management in March 2025 under the Archives Act 1983, flagging image duplication explicitly as a compliance risk for agencies that could not produce a single authoritative record on request. That guidance did not impose deadlines, but it signalled that routine audits would increasingly flag unmanaged duplicate files as a governance failure rather than a minor administrative inconvenience.

What Comes Next for Agencies and Councils

The practical path forward involves three steps that archivists and records managers have been recommending for several years. First, agencies need to run deduplication software across existing repositories to identify identical or near-identical files, tools that compare pixel-level data rather than just file names, since the same image saved as a JPEG and a PNG will not be caught by basic filename matching. Second, a human review process needs to establish which version of a duplicated image carries the correct metadata and provenance. Third, the surviving master file needs to be stored in a single location with access controls that prevent ad hoc re-copying.

For smaller councils without dedicated IT staff, and several of Tasmania's regional councils operate with lean technology teams, the State Government's Digital Strategy Unit, based in Hobart's CBD, has been flagging shared-service arrangements as one option. The Digital Strategy Unit's current work program runs through to June 2027 and includes a records modernisation stream that could, in principle, extend deduplication support to councils that opt in.

The cost of inaction is not abstract. Storage on government-approved cloud infrastructure in Australia runs at commercial enterprise rates, and even modest reductions in stored data volumes translate to measurable annual savings. For an agency maintaining tens of thousands of asset images, road infrastructure photographs, heritage site records, coastal monitoring imagery, eliminating duplicates can reduce storage requirements by thirty to fifty percent, according to figures cited in comparable interstate reviews.

Tasmania's digital records problem did not arrive overnight. It accumulated through a decade of platform changes, pandemic disruptions, and deferred housekeeping. The agencies that move earliest on structured deduplication will spend less, retrieve records faster, and face fewer compliance headaches when the Archives Office comes calling.