Looking for software engineer jobs in San Francisco with visa sponsorship? Exa is hiring a Software Engineer, Web Crawling.
![]()
Photo: Samenwerkende programmeurs in modern kantoor via Wikimedia Commons, licensed CC BY-SA 4.0.
Software Engineer Jobs in San Francisco with Visa Sponsorship: Overview
| Job Title | Software Engineer, Web Crawling |
| Employer | Exa |
| Location | San Francisco |
| Salary | $150,000–$300,000 per year plus equity |
| Job Type | Full-time, On-site |
| Experience | Extensive experience building and scaling web crawlers |
| Visa Sponsorship | Available for international candidates including STEM OPT, OPT, H1B, O1, E3 |
| Closing Date | Not specified in the available job information |
About the Employer
Exa is an applied AI lab building a search engine from scratch. It builds massive-scale infrastructure to crawl the web, train embedding models, and develop vector databases. It has raised $350m from Lightspeed, Benchmark, and a16z and powers search for companies including Cursor and HubSpot.
Job Responsibilities
- Build a distributed crawler that can handle 100M+ pages per day
- Optimize crawl politeness and rate limiting across thousands of domains
- Design systems to detect and handle dynamic content, JavaScript rendering, and anti-bot measures
- Create intelligent crawl scheduling and prioritization algorithms for maximum coverage efficiency
Requirements
- Extensive experience building and scaling web crawlers, or ability to ramp up quickly
- Experience with a high performance language such as C++ or Rust
- Familiarity with TypeScript, Playwright, modern web design, and Chrome DevTools Protocol
- Comfort optimizing systems to an exceptional degree
Visa Sponsorship and International Applicants
This is an in-person opportunity in San Francisco. Exa is happy to sponsor international candidates (e.g., STEM OPT, OPT, H1B, O1, E3).
Salary and Benefits
- Salary range $150,000 to $300,000 with equity
- Benefits not further specified in the available job information
- Visa sponsorship available
- Competitive salary plus equity
- In-person San Francisco role
- Requires specialized crawler experience
- On-site only
How to Apply
Apply through the Ashby job board. The application process details are on the posting.
Browse more Technology Jobs and USA Jobs on CMAJobs.








Join the discussion 0
No comments yet. Be the first to share your thoughts.