Looking for software engineer training infrastructure jobs in San Francisco with visa sponsorship? Thinking Machines Lab is hiring a Software Engineer, Training Infrastructure in San Francisco or New York.

Photo: Computer programmer typing code via Wikimedia Commons / Pixabay (Free-Photos), public domain / CC0.
Software Engineer Training Infrastructure Jobs in San Francisco: Overview
| Job Title | Software Engineer, Training Infrastructure |
| Employer | Thinking Machines Lab |
| Location | San Francisco, California or New York, New York |
| Salary | $300,000–$400,000 per year |
| Job Type | Full-time, On-site |
| Experience | 4+ years software engineering with production distributed systems |
| Visa Sponsorship | We sponsor visas (not guaranteed for every candidate or role) |
| Closing Date | Not specified in the available job information |
About the Employer
Thinking Machines Lab builds AI that extends human will and judgment. It trains frontier models with Inkling, develops the Tinker fine-tuning API, and creates interfaces for human-AI communication.
Job Responsibilities
- Design, build, and operate the distributed training infrastructure behind Tinker and internal frontier model training, covering scheduling, orchestration, checkpointing, and recovery
- Improve training throughput and cost efficiency through profiling, parallelism strategies, memory optimization, and kernel- and communication-level tuning
- Bring up and optimize training support for new open-weights and in-house model architectures, including mixture-of-experts models
- Build reliability into the platform with automated failure detection, job recovery, multi-tenant isolation, and observability
- Support efficient multi-tenant LoRA fine-tuning and tightly coupled sampling and training for reinforcement learning workloads
- Collaborate with the Tinker API, frameworks, and product teams to keep the infrastructure and user-facing SDK consistent
Requirements
- 4+ years of software engineering experience, including building and operating production distributed systems
- Strong programming skills in Python, plus experience in a systems language such as C++, Rust, or Go
- Hands-on experience with large-scale model training or inference infrastructure, using frameworks such as PyTorch
- Track record of debugging complex performance and reliability issues in distributed environments
- Preferred: experience with LLMs at scale, LoRA or RL pipelines, Kubernetes/Slurm, observability tooling, or open-source ML systems contributions
Visa Sponsorship and International Applicants
Visa sponsorship is stated but not guaranteed for every role or candidate. Thinking Machines Lab states it will work with a successful applicant to find the right visa route. The role is open to international applicants who are the right fit. Relocation support is available as needed. Browse more Visa Sponsorship Jobs for other confirmed roles.
Salary and Benefits
- Generous health, dental, and vision benefits
- Unlimited PTO
- Paid parental leave
- Relocation support as needed
- High salary range
- Visa sponsorship stated
- Frontier AI work
- Sponsorship not guaranteed
- On-site only
- No closing date given
How to Apply
Applications are handled through Ashby. Submit a CV or resume via the official link. No specific cover letter requirement is stated in the available information.
Browse more USA Jobs and Technology Jobs on CMAJobs.







Join the discussion 0
No comments yet. Be the first to share your thoughts.