Advertisement

Software Engineer, Inference at Thinking Machines Lab – San Francisco or New York (Visa Sponsorship Available)

cma9ja3 min read10

Looking for software engineer inference jobs in San Francisco with visa sponsorship? Thinking Machines Lab is hiring a Software Engineer, Inference in San Francisco or New York.

Advertisement

software engineer inference jobs in San Francisco - San Francisco skyline

Photo: Sf skyline via Wikimedia Commons, public domain (Sarah C-M).

Advertisement

Software Engineer Inference Jobs in San Francisco: Overview

Job Title Software Engineer, Inference
Employer Thinking Machines Lab
Location San Francisco, California or New York, New York
Salary $300,000–$400,000 per year
Job Type Full-time, On-site
Experience Experience operating large-scale, latency-sensitive production systems
Visa Sponsorship We sponsor visas (not guaranteed for every candidate or role)
Closing Date Not specified in the available job information

About the Employer

Thinking Machines Lab builds AI that extends human will and judgment. It trains frontier models with Inkling, develops the Tinker fine-tuning API, and creates interfaces for human-AI communication.

Job Responsibilities

  • Operate and scale the production inference systems that serve live traffic, including Tinker’s multi-tenant serving platform
  • Own the rollout process for new models, model versions, and inference optimizations, ensuring safe, incremental deployment to production
  • Build and improve observability, alerting, and capacity planning so the team can detect, diagnose, and resolve production issues quickly
  • Partner with inference and research teams to productionize new serving techniques without compromising reliability
  • Lead incident response for production inference issues, driving root cause analysis and durable fixes
  • Design for graceful degradation, failover, and redundancy so that serving stays resilient as usage grows
  • Manage capacity and cost tradeoffs for serving infrastructure as traffic and model sizes scale

Requirements

  • Experience operating large-scale, latency-sensitive production systems
  • Proficiency in Python and Go or another systems language
  • Experience with observability, monitoring, and incident response for production services
  • Strong understanding of distributed systems and how they fail at scale
  • Preferred: experience running production inference for large language models or other generative models

Visa Sponsorship and International Applicants

Visa sponsorship is stated but not guaranteed for every role or candidate. Thinking Machines Lab states it will work with a successful applicant to find the right visa route. The role is open to international applicants who are the right fit. Relocation support is available as needed. Browse more Visa Sponsorship Jobs for other confirmed roles.

Salary and Benefits

  • Generous health, dental, and vision benefits
  • Unlimited PTO
  • Paid parental leave
  • Relocation support as needed
What you need to Know
Pros
  • High salary range
  • Visa sponsorship stated
  • Production AI serving
Cons
  • Sponsorship not guaranteed
  • On-site only
  • Latency-sensitive production work

How to Apply

Applications are handled through Ashby. Submit a CV or resume via the official link. No specific cover letter requirement is stated in the available information.

Apply to this Job

Advertisement

Browse more USA Jobs and Technology Jobs on CMAJobs.

Advertisement

Join the discussion 0

No comments yet. Be the first to share your thoughts.

Leave a comment