Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at LiteLLM was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.
This high-stakes, high-visibility role involves owning the end-to-end migration of LiteLLM from Python to Rust, with a focus on performance and reliability. The engineer will plan the migration directly with the CTO, structure the codebase for Rust, and lead a gradual, stability-first rollout. Every decision will aim to achieve the lowest-latency, highest-throughput AI gateway without compromising the reliability enterprise customers depend on.
Nice to have:
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Its platform empowers developers by providing secure, reliable access to LLMs and adjacent services. LiteLLM is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Call every LLM API like it's OpenAI [100+ LLMs].
Headquarters
San Francisco / Remote (US)
Open jobs
7
Website
litellm.ai