Looking for AI evaluation software engineer jobs in the USA? METR is hiring a Member of Technical Staff, Evaluation Execution in Berkeley, California, with possible H-1B sponsorship for in-person work.
AI Evaluation Software Engineer Jobs in Berkeley USA: Overview
| Job Title | Member of Technical Staff, Evaluation Execution |
| Employer | METR |
| Location | Berkeley, California |
| Salary | $328,380–$578,583 per year |
| Job Type | Full-time, On-site or hybrid preferred |
| Experience | Strong software engineering and infra fundamentals required |
| Visa Sponsorship | Likely sponsor cap-exempt H-1B for in-person roles |
| Closing Date | Not specified in the available job information |
About the Employer
METR is a nonprofit research organization that develops scientific methods to assess AI capabilities, risks, and mitigations, with a focus on threats related to AI R&D automation and misalignment.
Job Responsibilities
- Run models on tasks by integrating them into agent scaffolds and checking results carefully
- Communicate results and takeaways through graphs, write-ups and stakeholder discussions
- Build software to improve the speed, reliability and informativeness of evaluations
- Manage projects for live evaluations involving multiple concurrent threads
- Coordinate professionally with leadership, lab contacts and external stakeholders
Requirements
- Strong software engineering skills with solid infrastructure fundamentals
- Ability to dig into unfamiliar systems, debug from logs and fix performance bottlenecks
- Speed, scrappiness and ability to identify high-impact solutions quickly
- High attention to detail for reviewing transcripts and technical details
Visa Sponsorship and International Applicants
If you lack US work authorization and would like to work in-person, METR can likely sponsor a cap-exempt H-1B visa for this role. Hybrid work is preferred with the technical team in the Berkeley office 3-5 days per week, though some flexibility exists. Applicants should confirm eligibility in the application.
Salary and Benefits
- Salary range $328k–$578k per year depending on level, higher for exceptional candidates
- 401(k) with 100% match up to 8% of salary, employer-paid life insurance
- Unlimited PTO and 21-week parental leave
- Catered lunch and dinner, in-office gym, medical/dental/vision with high premium coverage
- Relocation support for Bay Area, wellness and professional development stipends
- High compensation range
- Possible H-1B sponsorship
- Mission-driven AI safety work
- High competition expected
- In-person preference
- Capacity constraints on response times
How to Apply
Apply through the official Lever application form. Submit the required additional information including work authorization status and location preferences.
Application Tips
- Highlight software engineering experience with infrastructure and debugging in your application.
- Note any AI research or evaluation-related work if relevant.
Browse more USA Jobs and Technology Jobs on CMAJobs.








Join the discussion 0
No comments yet. Be the first to share your thoughts.