LLM Ops & Infrastructure Jobs

49open22 new this week

Manage the infrastructure and operations needed to run large language models in production.

Browse 49 LLM Ops & Infrastructure roles from 31 companies across 57 locations, including Anduril, OpenAI, and Anthropic. 28 fully remote · latest posted .

Common skillsEngineering29Software : Software Platform : Dope5SRE4Mission Systems : Battlespace Awareness Engineering : Battlespace Awareness Radar3Corporate Technology : Infrastructure Engineering : Network Engineering3Security3Software Engineering - Infrastructure3Software : Software Platform 3
49 jobs

Latest LLM Ops & Infrastructure jobs

Showing 20 of 49
Anthropic

IT Systems Engineer, Client Platform Engineer, macOS

Anthropic·Boston, MA; Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY; Washington, DC·$285,000 - $325,000
1w
Remote
Anthropic

Staff+ Site Reliability Engineer, Safeguards ML Infra

Anthropic·Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY·$320,000 - $485,000
1mo
Remote
Usul

Technical Staff: DevOps Engineer

Usul·San Francisco Office·$160,000 - $240,000
1w
Full-time
On-site
Anthropic

IT Systems Engineer, Mobile Client Platform Engineer

Anthropic·Boston, MA; Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY; Washington, DC·$285,000 - $325,000
1mo
Remote
Anthropic

AI Infrastructure Operations, Demand Planning

Anthropic·San Francisco, CA | New York City, NY·$320,000 - $405,000
2mo
On-site
OpenAI

Software Engineer, DevOps

OpenAI·San Francisco·$177,000 - $327,000
2w
Full-time
Remote
Anthropic

Machine Learning Infrastructure Engineer, Safeguards Research

Anthropic·San Francisco, CA | New York City, NY·$350,000 - $500,000
2mo
On-site
Anthropic

Staff+ Infrastructure Engineer, Cluster Infrastructure

Anthropic·San Francisco, CA | New York City, NY | Seattle, WA·$320,000 - $485,000
5mo
On-site
OpenAI

AI Infrastructure Engineer, pAGI

OpenAI·San Francisco·$266,000 - $500,000
1mo
Full-time
Remote
Anthropic

Pre-training Data Infrastructure Engineer

Anthropic·San Francisco, CA·$500,000 - $850,000
6mo
On-site
OpenAI

Engineering Manager, Client Platform Engineering

OpenAI·San Francisco·$401,000 - $445,000
1mo
Full-time
Remote
OpenAI

Technical Program Manager, Model Deployment & Capacity

OpenAI·San Francisco·$257,000 - $445,000
1mo
Full-time
On-site
Modal

Inference Engineering and Product Lead

Modal·San Francisco·$300,000 - $350,000
1mo
Full-time
On-site
OpenAI

AI Systems Engineer, Codex Agents

OpenAI·San Francisco·$230,000 - $385,000
5mo
Full-time
On-site
OpenAI

Senior Staff Software Engineer, Identity Infrastructure Engineering

OpenAI·San Francisco·$347,700 - $385,000
5mo
Full-time
Remote
Simple AI

Infrastructure Engineer

Simple AI·San Francisco·$140 - $250,000
1mo
Full-time
On-site
OpenAI

Data Center Infrastructure Engineering Program Manager (Network and Whitespace)

OpenAI·San Francisco·$257,000 - $327,000
5mo
Full-time
On-site
OpenAI

Inference Engineer, Robotics

OpenAI·San Francisco·$380,000 - $380,000
18mo
Full-time
Remote
Cursor

Software Engineer, ML Platform

Cursor·San Francisco
1mo
Full-time
On-site
Town

AI Context & Data Infrastructure Engineer

Town·San Francisco·$250,000 - $300,000
1mo
Full-time
On-site

Showing 20 of 49 jobs

About LLM Ops & Infrastructure roles

LLM Ops & Infrastructure manage the infrastructure and operations needed to run large language models in production.

AI LLM Jobs currently tracks 49 open LLM Ops & Infrastructure positions across 31 AI companies in hiring hubs like San Francisco, Costa Mesa, and Remote. New listings are added daily as our crawlers index company career pages directly - never from third-party scrapers.

Job ads in this category most frequently mention Engineering, Software : Software Platform : Dope, SRE, and Mission Systems : Battlespace Awareness Engineering : Battlespace Awareness Radar as required or preferred skills. Use the filters above to narrow by location, work mode, or specific company.

Frequently asked

About LLM Ops & Infrastructure roles on AI LLM Jobs.

How many LLM Ops & Infrastructure jobs are available?
There are currently 49 open LLM Ops & Infrastructure positions on AI LLM Jobs, aggregated daily from top AI companies' career pages.
Which companies are hiring LLM Ops & Infrastructure roles?
Companies actively hiring for LLM Ops & Infrastructure include Anduril, OpenAI, and Anthropic - along with many other AI-first companies. Click any company name to see all of their open roles.
Are there remote LLM Ops & Infrastructure jobs?
Yes - 28 of the 49 LLM Ops & Infrastructure positions are fully remote. Use the Work mode filter or visit /remote-ai-jobs to see only remote openings.
Where are LLM Ops & Infrastructure roles concentrated?
LLM Ops & Infrastructure hiring is strongest in San Francisco, Costa Mesa, California, United States, and Remote, Global. You can filter by location above to narrow the list to a specific city or country.
How often is this page updated?
New LLM Ops & Infrastructure listings are added daily as our crawlers index career pages from AI companies. Cached results refresh every 5 minutes.

Related searches

Refine your LLM Ops & Infrastructure search by location, work mode, or company.

Never Miss an AI Job

Get the top AI & LLM jobs delivered to your inbox every week. Curated, not spammy.

Join 1,000+ AI professionals. Unsubscribe anytime.