Systems Generalist, GPT Infrastructure

OpenAI is seeking a Systems Generalist for the GPT Infrastructure team to build an automated inference optimization platform. This role involves designing APIs, collaborating with various teams, and ensuring reliable workflows in AI model deployment. OpenAI is dedicated to ensuring that artificial general intelligence (AGI) benefits all of humanity. Our mission requires building not only world-class AI models, but also the infrastructure that enables those models to be deployed reliably, efficiently, and at global scale. As demand for AI continues to grow, we are expanding the ways OpenAI can bring high-performance inference capacity online across a diverse hardware ecosystem.

• •Design, build, and operate durable APIs and control-plane services for multi-hour or multi-day optimization campaigns, including scheduling, retries, budgets, checkpoints, artifact lineage, and observability.
• •Build secure partner-side runner and grader software that can compile, execute, verify, and benchmark candidate artifacts on third-party accelerator hardware.
• •Integrate hardware profiles, ISA and toolchain context, compilers, runtimes, and inference-serving engines into a repeatable optimization workflow.
• •Turn research prototypes into reliable product surfaces with clear contracts, debuggable failure modes, reproducible outputs, and excellent developer ergonomics.
• •Develop correctness and performance evaluation systems spanning latency, throughput, memory use, utilization, and cost efficiency.
• •Build artifact, provenance, and qualification workflows that make optimized kernels, binaries, configurations, and reports safe to review and deploy.
• •Collaborate with Research, Inference Engineering, Infrastructure, Security, Product, and Strategic Partnerships to deliver production-ready solutions.
• •Drive technical architecture and execution across ambiguous, cross-functional initiatives that connect OpenAI systems with partner environments.