About This Role
This role focuses on designing, building, and operating production-grade AI and LLM-powered applications. The Machine Learning Engineer will deliver scalable, secure, and reliable backend services within an enterprise AI platform across development, test, and production environments.
Responsibilities
- Develop and maintain Python (FastAPI) services for end-to-end AI workflows (ingestion, processing, inference, persistence)
- Design systems for long-running tasks, including retries, timeouts, and failure handling
- Implement secure authentication and authorization using Microsoft Entra ID (Azure AD), JWT, and Managed Identity
- Integrate with Azure OpenAI (LLMs, embeddings) and retrieval pipelines (RAG/vector search)
- Ensure robust CI/CD pipelines, testing strategies, and release controls across environments
- Work with PostgreSQL and Azure Blob Storage for reliable data persistence
- Build strong observability using Application Insights/Azure Monitor
- Follow security, governance, and Responsible AI practices for enterprise deployments
- Contribute to and adopt shared libraries, ensuring backward compatibility and smooth rollouts
Requirements
- Strong experience building production Python services (FastAPI, async programming)
- Hands-on experience with Docker and containerized deployments
- Experience with Azure (App Services, Managed Identity, RBAC)
- Knowledge of CI/CD, GitHub workflows, and testing strategies (pytest)
- Experience with LLM integration (Azure OpenAI) and AI pipelines
- Solid understanding of API security, authentication, and system design
- Familiarity with PostgreSQL, object storage, and enterprise environments
