Advertisement

Software Engineer, Training Infrastructure at Thinking Machines Lab, San Francisco (Visa Sponsorship Available)

cma9ja3 min read50

Looking for software engineer training infrastructure jobs in San Francisco with visa sponsorship? Thinking Machines Lab is hiring a Software Engineer, Training Infrastructure in San Francisco or New York.

Advertisement

software engineer training infrastructure jobs in San Francisco - programmer working on code

Photo: Computer programmer typing code via Wikimedia Commons / Pixabay (Free-Photos), public domain / CC0.

Advertisement

Software Engineer Training Infrastructure Jobs in San Francisco: Overview

Job Title Software Engineer, Training Infrastructure
Employer Thinking Machines Lab
Location San Francisco, California or New York, New York
Salary $300,000–$400,000 per year
Job Type Full-time, On-site
Experience 4+ years software engineering with production distributed systems
Visa Sponsorship We sponsor visas (not guaranteed for every candidate or role)
Closing Date Not specified in the available job information

About the Employer

Thinking Machines Lab builds AI that extends human will and judgment. It trains frontier models with Inkling, develops the Tinker fine-tuning API, and creates interfaces for human-AI communication.

Job Responsibilities

  • Design, build, and operate the distributed training infrastructure behind Tinker and internal frontier model training, covering scheduling, orchestration, checkpointing, and recovery
  • Improve training throughput and cost efficiency through profiling, parallelism strategies, memory optimization, and kernel- and communication-level tuning
  • Bring up and optimize training support for new open-weights and in-house model architectures, including mixture-of-experts models
  • Build reliability into the platform with automated failure detection, job recovery, multi-tenant isolation, and observability
  • Support efficient multi-tenant LoRA fine-tuning and tightly coupled sampling and training for reinforcement learning workloads
  • Collaborate with the Tinker API, frameworks, and product teams to keep the infrastructure and user-facing SDK consistent

Requirements

  • 4+ years of software engineering experience, including building and operating production distributed systems
  • Strong programming skills in Python, plus experience in a systems language such as C++, Rust, or Go
  • Hands-on experience with large-scale model training or inference infrastructure, using frameworks such as PyTorch
  • Track record of debugging complex performance and reliability issues in distributed environments
  • Preferred: experience with LLMs at scale, LoRA or RL pipelines, Kubernetes/Slurm, observability tooling, or open-source ML systems contributions

Visa Sponsorship and International Applicants

Visa sponsorship is stated but not guaranteed for every role or candidate. Thinking Machines Lab states it will work with a successful applicant to find the right visa route. The role is open to international applicants who are the right fit. Relocation support is available as needed. Browse more Visa Sponsorship Jobs for other confirmed roles.

Salary and Benefits

  • Generous health, dental, and vision benefits
  • Unlimited PTO
  • Paid parental leave
  • Relocation support as needed
What you need to Know
Pros
  • High salary range
  • Visa sponsorship stated
  • Frontier AI work
Cons
  • Sponsorship not guaranteed
  • On-site only
  • No closing date given

How to Apply

Applications are handled through Ashby. Submit a CV or resume via the official link. No specific cover letter requirement is stated in the available information.

Apply to this Job

Advertisement

Browse more USA Jobs and Technology Jobs on CMAJobs.

Advertisement

Join the discussion 0

No comments yet. Be the first to share your thoughts.

Leave a comment