Looking for software engineer inference jobs in San Francisco with visa sponsorship? Thinking Machines Lab is hiring a Software Engineer, Inference in San Francisco or New York.

Photo: Sf skyline via Wikimedia Commons, public domain (Sarah C-M).
Software Engineer Inference Jobs in San Francisco: Overview
| Job Title | Software Engineer, Inference |
| Employer | Thinking Machines Lab |
| Location | San Francisco, California or New York, New York |
| Salary | $300,000–$400,000 per year |
| Job Type | Full-time, On-site |
| Experience | Experience operating large-scale, latency-sensitive production systems |
| Visa Sponsorship | We sponsor visas (not guaranteed for every candidate or role) |
| Closing Date | Not specified in the available job information |
About the Employer
Thinking Machines Lab builds AI that extends human will and judgment. It trains frontier models with Inkling, develops the Tinker fine-tuning API, and creates interfaces for human-AI communication.
Job Responsibilities
- Operate and scale the production inference systems that serve live traffic, including Tinker’s multi-tenant serving platform
- Own the rollout process for new models, model versions, and inference optimizations, ensuring safe, incremental deployment to production
- Build and improve observability, alerting, and capacity planning so the team can detect, diagnose, and resolve production issues quickly
- Partner with inference and research teams to productionize new serving techniques without compromising reliability
- Lead incident response for production inference issues, driving root cause analysis and durable fixes
- Design for graceful degradation, failover, and redundancy so that serving stays resilient as usage grows
- Manage capacity and cost tradeoffs for serving infrastructure as traffic and model sizes scale
Requirements
- Experience operating large-scale, latency-sensitive production systems
- Proficiency in Python and Go or another systems language
- Experience with observability, monitoring, and incident response for production services
- Strong understanding of distributed systems and how they fail at scale
- Preferred: experience running production inference for large language models or other generative models
Visa Sponsorship and International Applicants
Visa sponsorship is stated but not guaranteed for every role or candidate. Thinking Machines Lab states it will work with a successful applicant to find the right visa route. The role is open to international applicants who are the right fit. Relocation support is available as needed. Browse more Visa Sponsorship Jobs for other confirmed roles.
Salary and Benefits
- Generous health, dental, and vision benefits
- Unlimited PTO
- Paid parental leave
- Relocation support as needed
- High salary range
- Visa sponsorship stated
- Production AI serving
- Sponsorship not guaranteed
- On-site only
- Latency-sensitive production work
How to Apply
Applications are handled through Ashby. Submit a CV or resume via the official link. No specific cover letter requirement is stated in the available information.
Browse more USA Jobs and Technology Jobs on CMAJobs.







Join the discussion 0
No comments yet. Be the first to share your thoughts.