E-Solutions logo

AI Ops (Monitoring AI Systems in Production)

E-Solutions

RemoteFull timeMid levelPosted today
Apply with JobAssist

About the role

Role: AI Engineer – AI Ops (Monitoring AI Systems in Production)

Location: Argentina Remote

Duration: Full-Time

Job Details:

An AI Engineer in AI Ops is responsible for operating, monitoring, and maintaining AI models and agent-based systems once they are live in production. The role ensures AI systems remain reliable, performant, compliant, and aligned with business expectations over time, closing the “last‑mile” gap between model development and sustainable production use

Key Responsibilities

1. Production Monitoring & Health

Monitor AI models and agents in production for performance, latency, errors, and availability.

Track statistical health indicators such as model drift, data distribution changes, and output stability.

Observe business KPIs linked to AI behaviour (e.g. accuracy impact, false‑positive cost, efficiency).

2. Incident Management & Recovery

Detect and triage production incidents related to AI behaviour or degradation.

Execute rollbacks, throttling, or model disabling where thresholds are breached.

Support root‑cause analysis and post‑incident reviews to prevent recurrence.

3. Model & Agent Lifecycle Operations

Support deployment, versioning, and release of AI models and agents using CI/CD‑style pipelines.

Maintain registries and metadata covering model ownership, lineage, risk classification, and approvals.

Support models and agents move safely through environments (dev → test → production).

4. Governance, Risk & Compliance

Ensure AI systems adhere to Responsible AI principles, internal controls, and audit requirements.

Maintain audit trails, logs, and approval artefacts required by risk, compliance, and regulators.

Support fairness, bias, explainability, and transparency monitoring in production.

5. Tooling & Platform Integration

Integrate AI systems with monitoring, logging, and alerting platforms (e.g. dashboards, metrics stores).

Work with cloud infrastructure (containers, event streaming, APIs) supporting scalable AI operations.

Collaborate with product, engineering, and data teams to standardise AI Ops patterns and blueprints.

Skills & Experience (Baseline)

Strong Python skills and experience supporting ML or LLM‑based systems.

Understanding of Model Ops / MLOps, especially the operational phase after deployment.

Experience with:

Monitoring and logging systems

CI/CD pipelines

Containerised deployments (e.g. Docker‑based runtimes)

Familiarity with cloud platforms (Azure preferred) and production troubleshooting.

Ability to work cross‑functionally with product, data science, engineering, and risk teams.

Millions of jobs, with real people getting hired every day

20,000+
New jobs added daily
7,000,000+
Verified job listings
500,000+
Tailored applications submitted
FAQ

Questions, answered

Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.

Yes. This role at E-Solutions was screened before publishing – we confirmed the employer before listing it.

The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.

This position can be done from anywhere, with no in-office requirement.

Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.