MLOps · 04 of 5

Serving & monitoring

ACCEPT, REJECT or ABSTAIN from Triton, and the signals that start retraining.

InputSigned modelLocked threshold
Verdict APITriton
ACCEPTREJECTABSTAIN
01

Three answers, not two

A model that may say it is not sure is safer than one forced to guess.

Into each decisionVerdict
Triton verdict APIone answer per input

Point at a source to see what it feeds, or at a result to see where it comes from.

02

One input, one verdict

Each input gets an answer from the verdict API, and every answer is logged.

1 of 5

Input arrives

Read from the storage where it already lives.

03

What we watch in production

Prometheus and Grafana dashboards, with drift alerts that start the retraining path.

SourcesAI Modeling & MLOps case study, NGT (Sep 2026)AI-First DevOps Transformation: Services & Solutions, NGT (Oct 2026)NGT Service Offering v3.2 (Jul 2026)Machine Learning Platform with Kubeflow, NGT reference deckPlatform Engineering v1.2, NGT (Sep 2026)Data Platform Ops & DataOps Service Catalog, NGT (Sep 2026)FPT AI Factory service offering, FPT Smart Cloud (Nov 2025)