smartData Protection & Archiving

Same files, opposite jobs

Surveillance footage and broadcast masters look identical on disk and behave nothing alike.

One is written constantly and almost never watched. The other is watched, cut and re-sold for decades. Designing one archive as if it were the other is how these projects go wrong.

Aban Smart designs, supplies, integrates and supports archive software and optical WORM libraries for video retention and media archives across the GCC.

Video is the only content type where a single organisation routinely runs two archives with opposite economics. A city transport operator, an airport or a stadium writes continuous streams that nobody will ever watch, keeps them because policy says so, and destroys them on schedule. A broadcaster or production house keeps footage because it will be cut into something else in four years, and every retrieval is a revenue event. Both are large continuous files under a retention policy. Beyond that sentence they diverge, and this page treats them separately rather than pretending otherwise.

Surveillance retention drives capacityCamera count multiplied by bitrate, recording hours and retention days gives the required capacity. Holding the camera count fixed and lengthening the retention window from 30 to 180 days multiplies the footprint six times, so retention policy is the dominant driver. Recent footage stays on disk for fast review while older footage moves to an archive tier held until policy expiry.CAPACITY DRIVERSCAMERAS120streams×BITRATE4 Mbpsper stream×RECORDING24 h/daycontinuous×RETENTION90 dayspolicy-set≈ 466 TB requiredillustrative example, before overheadRETENTION WINDOW SETS THE FOOTPRINT30 days≈ 155 TB90 days≈ 466 TB180 days≈ 933 TBSame 120 cameras in every row — only the retention window changes.TIERING DECISIONReview tier — diskLast 7 days kept on line≈ 36 TB — scrub and export in seconds8% of the footprint, most of the demandArchive tier — object or tapeDays 8 to 90, retrieved on request≈ 430 TB — 92% of the footprintHeld under retention policy until expiry
Conceptual surveillance capacity model. Camera count, bitrate, recording hours and retention days multiply out to the required capacity; recent footage stays on a fast review tier while older footage moves to an archive tier held until policy expiry. Every number shown — 120 cameras, 4 Mbps, 24 hours a day, 30 to 180 day windows and the resulting terabyte figures — is an illustrative example for explaining the maths, not a verified customer measurement. Final topology depends on verified product compatibility.

Retention period dominates the capacity answer.

Where the two workloads part company

Surveillance and security video Broadcast and production media
Write pattern Continuous, all cameras, all day Bursty, tied to shoots and delivery
Read pattern Rare. Often under 1% of footage is ever viewed Frequent. Reuse is the point of keeping it
Why it is kept Policy and potential evidence Commercial value in reuse and licensing
End of life Scheduled overwrite or destruction Often indefinite, because value is unknown
Search need Time, camera and location Descriptive metadata, faces, rights, transcripts
Worst failure Footage gone when a request arrives Asset exists but nobody can find or play it

The design consequence is that surveillance archives are optimised for cost per written terabyte and for provable deletion, while media archives are optimised for findability and restore speed. A single platform can serve both, but only if the policies applied to each are genuinely separate.

Bitrate, camera count and retention maths

The figures here are constructed to demonstrate the arithmetic. They are not measurements from any site, and real bitrates vary with codec, scene motion and compression settings.

Take 400 cameras at 4 Mbps, recording 24 hours a day.

  • 4 Mbps is 0.5 MB per second, so one camera writes 0.5 × 3,600 = 1.8 GB per hour
  • Over 24 hours: 1.8 × 24 = 43.2 GB per camera per day
  • Across the estate: 43.2 GB × 400 = 17.28 TB per day

Now apply retention windows to the same estate.

Retention window Capacity required
30 days 17.28 × 30 = 518 TB
90 days 17.28 × 90 = 1,555 TB, roughly 1.6 PB
365 days 17.28 × 365 = 6,307 TB, roughly 6.3 PB

The point is the ratio. Doubling the estate to 800 cameras at 30 days gives about 1,037 TB. Leaving the estate at 400 cameras and extending retention to 90 days gives about 1,555 TB, half as much again, from a policy decision that costs nothing to make in a meeting. Going from 30 days to a year multiplies the requirement by roughly twelve while the camera count never changes.

So retention is the variable to interrogate first. Two questions usually shrink the number: does every camera need the same window, and does every camera need full frame rate for the whole window. Tiering by camera class, and stepping down to a lower-bitrate copy after the first fortnight, moves the total far more than any storage discount will.

How long footage must be kept is not something we can tell you. Periods and their interpretation are a legal and policy question for your own advisers, and they differ by sector, by site and by what the footage shows.

Surveillance: write-heavy, rarely read, provably destroyed

The recording tier is a VMS problem. The archive tier begins where the VMS stops, and it has three jobs.

  • Absorb continuous ingest without back-pressure. If the archive stalls, the VMS retention window silently shortens. Monitoring should alarm on archive write lag, not only on disk capacity.
  • Hold cheaply for the long tail. Footage older than a month is almost never read. Removable or optical media suits it, provided the catalogue stays online so a request can be located before anything is mounted.
  • Delete on schedule and prove it. Deletion is a feature here, not a risk. The archive should record what expired, when, and under which policy.

Onboard and remote estates add a wrinkle: vehicles and remote sites accumulate footage locally and offload in bursts when they reach a depot or a link. The archive has to cope with a day's worth of many cameras arriving in minutes.

QStar and DISC publish a deployment at Nottingham City Transport covering onboard vehicle video retention. That is a manufacturer's reference, not an Aban Smart customer, and we present it as an illustration of the pattern rather than as our own work.

Media production: findability is the whole value

Production archives fail differently. The file is there, the tape or disc is readable, and no one can tell what is on it. An archive without a catalogue is a landfill with an index card.

This is why the archive belongs behind the asset management system rather than beside it. QStar documents an integration with Iconik by Backlight in which assets are archived through the Iconik Storage Gateway and retrieved through QStar Archive Manager, while remaining visible and searchable in Iconik. Editors keep browsing proxies in the interface they already use, and the high-resolution master moves off expensive production storage to a lower-cost tier as a project closes.

QStar's archive software presents these tiers through standard file system and S3-compatible interfaces, so the underlying media can be disk, object storage, cloud or tape without the MAM needing to know. Three practical notes:

  • Keep proxies on fast storage permanently. They are small, and they are what people search.
  • Archive at project close, not at some age threshold. Age is a poor proxy for "finished".
  • Store the metadata with the essence. A MAM database that dies without the archive takes the archive's meaning with it.

For the media layer itself, see optical archive systems and the wider immutable and WORM storage picture.

Evidential export and chain of custody

The moment footage might be used in a proceeding, the requirement changes from storage to evidence, and evidence is about proving the file was not altered between the camera and the courtroom.

Four things carry that argument.

  1. A hash captured at ingest. Compute a cryptographic checksum when the footage lands in the archive, store it separately from the file, and re-verify on every export. An exported clip with a matching hash is a much stronger artefact than an exported clip alone.
  2. Export as a copy, never as a move. The archived original stays untouched under its retention lock. What leaves is a derived copy with its own record.
  3. A custody log. Who requested the export, under what reference, who authorised it, what was exported, and where it went. For removable media, the same log tracks the physical item.
  4. Write-once media where the stakes justify it. Retention-locked appliances resist deletion by policy. Optical WORM resists it at the recording layer, which is not rewritable, so an administrator with full rights has no data path for altering what was written. DISC documentation cites 50-plus-year Blu-ray media life with true WORM support, and QStar Archive Manager can virtualise a DISC appliance so it appears as a CIFS or NFS network share. Note that some of that DISC material dates from an earlier product generation, and capacity figures should be confirmed against current documentation rather than taken from a brochure.

No storage product makes footage admissible. Admissibility depends on procedure, authorisation and legal interpretation, and it is a question for your own advisers. What the storage layer can do is remove the argument that the file changed.

Where to go next

The retention-and-evidence pattern here overlaps with government estates, and the sheer-count problem overlaps with telecommunications. Browse the full set of industries, or request an assessment with your camera count, bitrate and current retention window, which is enough to start.

Public transport vehicle fitted with onboard video recording
Onboard video retention at Nottingham City Transport — a QStar and DISC deployment documented by the manufacturers. Not an Aban Smart customer reference.

Related resources

Manufacturer documentation relevant to this page. Availability, specifications, and configurations are subject to verification.

Frequently asked questions

They can share hardware and software, but not one policy. The retention rules, the tiering thresholds and the deletion behaviour need to be configured separately, because surveillance wants provable expiry and production wants indefinite retention with fast recall. Where budgets force a single platform, define two policy domains inside it and keep their catalogues distinct.

Turn your requirement into a defensible architecture

Share the workload, capacity, retention, access, and resilience requirements. Aban Smart will identify the next discovery inputs and the appropriate engagement path.