Looking for software engineer jobs in San Francisco or New York with visa sponsorship? Thinking Machines Lab is hiring a Software Engineer, Inference to own production model serving systems.
Software Engineer Jobs in San Francisco: Overview
| Job Title | Software Engineer, Inference |
| Employer | Thinking Machines Lab |
| Location | San Francisco, CA or New York City, NY |
| Salary | $300,000–$400,000 per year |
| Job Type | Full-time, on-site |
| Experience | Not specified in the available job information |
| Visa Sponsorship | Available, not guaranteed for every candidate |
| Closing Date | Not specified in the available job information |
About the Employer
Thinking Machines Lab builds AI that extends human will and judgment. It trains frontier models, develops tools for personalisation, and creates interfaces for human-AI collaboration.
Job Responsibilities
- Operate and scale production inference systems serving live multi-tenant traffic
- Own the rollout process for new models and inference optimisations
- Build and improve observability, alerting and capacity planning
- Partner with research teams to productionise new serving techniques
- Lead incident response and root-cause analysis for production issues
- Design for graceful degradation, failover and redundancy
- Manage capacity and cost trade-offs as traffic and model sizes scale
Requirements
- Essential: Experience operating large-scale, latency-sensitive production systems
- Essential: Proficiency in Python and Go or another systems language
- Essential: Experience with observability, monitoring and incident response
- Essential: Strong understanding of distributed systems and failure modes
- Desirable: Experience running production inference for large language models
- Desirable: Experience with deployment systems such as canarying or feature flags
Visa Sponsorship and International Applicants
Thinking Machines Lab states it sponsors visas. While it cannot guarantee success for every candidate or role, if the candidate is the right fit the company is committed to working through the visa process together. Relocation support is available as needed.
Salary and Benefits
- Generous health, dental and vision benefits
- Unlimited PTO
- Paid parental leave
- Relocation support as needed
- High salary range
- Visa sponsorship stated
- Production systems ownership
- On-site requirement
- Sponsorship not guaranteed
- Competitive process
How to Apply
Applications go through the company’s Ashby board. Submit a CV. No cover letter is specified as required.
Browse more Technology Jobs and USA Jobs on CMAJobs.
Join the discussion 0
No comments yet. Be the first to share your thoughts.