Skip to content
AI Datacenter

Dedicated GPUs. Not a shared endpoint.

Civic data is the wrong thing to hand to a public inference API. Civiq.plus runs its model workloads on dedicated GPU capacity in its own AI datacenter, so tenant data stays inside infrastructure we control, throughput is predictable under load, and a model version never changes underneath a deployment without someone deciding it should.

Dedicated

GPU capacity, not shared

Pinned

Model version per deployment

Zero

Third-party training on your data

Full

Audit of every inference run

Why it matters

What owning the inference layer actually buys you

These are not abstract benefits. Each one closes a gap that opens the moment inference happens on somebody else's shared infrastructure.

Your data does not leave

Inference happens on hardware we operate. Citizen feedback, field reports and community signals are never handed to a third-party model provider to process.

  • No third-party training on tenant data
  • Residency stays inside the deployment boundary
  • Same tenant isolation as the rest of the platform

Throughput you can plan around

Dedicated capacity means a queue depth you control. A national broadcast or a surge of voice reports does not sit behind someone else's traffic.

  • No shared-tenant rate limits
  • Capacity reserved per deployment
  • Batch and real-time paths separated

Model versions stay put

A public endpoint can change the model underneath you. Here a version is pinned per deployment and only moves when you decide it should.

  • Version pinned and recorded on every run
  • Side-by-side evaluation before promotion
  • Rollback without a vendor ticket

Every run is auditable

Because we operate the inference layer, the audit record can include what the platform actually asked the model and what came back.

  • Inputs, tool calls and outputs recorded
  • Confidence and assumptions captured
  • Human approval attached to the run

Workloads

What the GPUs are actually doing

The AI layer is not one model answering questions. It is a set of registered, permissioned agents doing specific jobs — transcribing a field report in Telugu, collapsing four hundred complaints into one issue, tracking how a narrative moved across channels. Those have very different latency and throughput profiles, which is why they run on separate paths.

  • Real-time paths kept clear for speech and classification
  • Batch work queued so it cannot starve live requests
  • Capacity sized for surge, not steady state
  • Every run attributed to the agent that asked for it

Inference routing

Dedicated capacity
Voice reports
Citizen feedback
Media signals
Survey text
Real-timequeue
  • Speech recognition74%
  • Language detection46%
  • Issue classification63%

Prioritised. Never queued behind batch.

Batchqueue
  • Narrative clustering58%
  • Embeddings & retrieval41%
  • Impact simulation29%

Yields to real-time under surge.

Reserved GPU pooltenant-isolated
AllocatedHeadroom reserved for surge

Workload profile

Where the capacity goes

AI workloads and their execution paths
WorkloadWhat it doesPath
Speech recognitionField workers record in their own language; audio is transcribed and language-detected before anything else runsReal-time
Translation & localisationRegional-language content and feedback moved between languages for analysis and responseReal-time
Issue classificationFree text and transcripts mapped onto the canonical issue taxonomyReal-time
Deduplication & clusteringHundreds of reports about one broken line collapsed into a single operational issueStreaming
Narrative clusteringSemantically related narratives grouped, with velocity and drift tracked over timeBatch
Embeddings & retrievalVector indexing for semantic search across feedback, media and documentsBatch
Summarisation & briefsDaily and breaking briefs generated from evidence the platform already holdsScheduled
Simulation & impactCounterfactual scenarios and before/after estimates for the measurement layerBatch

Pipeline

How a request travels

  1. 01

    Request enters scoped

    The calling agent's data scope, geographic scope and policy are resolved before any work is queued.

  2. 02

    Routed by class

    Real-time paths (speech, classification) and batch paths (clustering, embeddings) use separate queues so one cannot starve the other.

  3. 03

    Runs on dedicated GPUs

    Execution happens on reserved capacity, on the model version pinned for that deployment.

  4. 04

    Recorded in full

    Inputs, model and version, tool calls, output, confidence and assumptions are written to the audit log.

  5. 05

    Gated before it acts

    Anything high-impact stops at a human approval, with the evidence attached.

  6. 06

    Measured afterwards

    The recommendation is linked to what was actually done and whether the condition improved.

Governance

The controls that travel with every run

The inference layer inherits the platform's security model rather than sitting beside it. Same tenant isolation, same audit, same approval gates.

Isolation

Inference workloads are scoped to a tenant. Nothing from one deployment is visible to another, at the queue, the cache or the storage layer.

Encryption

Encrypted in transit to the inference layer and at rest in any staging store. Keys are held in the same managed vault as the rest of the platform.

Scoped agents

Each registered agent carries its own data scopes, geographic scope, cost ceiling and latency ceiling. It cannot reach a district it was not scoped for.

Retention

Prompts and outputs follow the data class of their inputs. Nothing is kept longer than the policy for that class allows.

Approval gates

High-impact generated material does not publish on model output alone. A person sees the evidence, the assumptions and the confidence first.

Capacity headroom

Sized for surge rather than steady state, because civic demand is spiky — an incident, a broadcast or a deadline all arrive at once.

What we will not do with your data

Owning the hardware only matters if the policy around it is clear. These are architectural constraints, not settings someone can toggle under pressure.

  • No training or fine-tuning on tenant data
  • No sharing with third-party model providers
  • No covert individual-level profiling or persuasion scores
  • No generated material published without human approval
  • No retention beyond the data class of the input

Questions

What teams ask about the AI layer

Why not just use a public inference API?

Three reasons that matter for civic data specifically. Tenant data would be processed by a third party, which is difficult to justify for citizen feedback containing personal information. Throughput would sit behind shared rate limits at exactly the moments demand spikes. And the model can change underneath you, which quietly invalidates the version pinning that makes an audit record meaningful.

Is tenant data used to train models?

No. Tenant data is used to serve that tenant's requests and nothing else. It is not used to train or fine-tune models, and it is not shared with a third-party model provider for processing.

Can inference run inside our own infrastructure?

Yes, on the National tier. Where a deployment requires it, the inference layer can run in your environment rather than ours, under the same agent registry and audit model.

What happens if capacity runs out during a surge?

Real-time paths are prioritised over batch, so speech recognition and classification keep working while clustering and embedding jobs queue. Dashboards degrade to last-known state and label it as stale rather than showing a gap as a result.

How do you evaluate a model before promoting it?

New versions run side by side against the pinned version on the same inputs, and the difference is reviewed before anything is promoted. Because runs are recorded with their model version, a regression can be traced to a specific promotion.

Does the AI layer make decisions on its own?

No. Agents cluster, summarise, detect anomalies and propose options. Broadcasts, sensitive messages and high-impact recommendations all pass through an explicit human approval, and the approver sees the evidence and confidence rather than just the output.

Want the infrastructure detail?

Capacity, hardware and residency specifics are covered in the security package, available under NDA.