Advertisement

Software Engineer, Web Crawling at Exa, San Francisco (Visa Sponsorship Available)

cma9ja2 min read30

Looking for software engineer jobs in San Francisco with visa sponsorship? Exa is hiring a Software Engineer, Web Crawling.

Advertisement

software engineer jobs in San Francisco with visa sponsorship - programmers collaborating in modern office

Photo: Samenwerkende programmeurs in modern kantoor via Wikimedia Commons, licensed CC BY-SA 4.0.

Advertisement

Software Engineer Jobs in San Francisco with Visa Sponsorship: Overview

Job Title Software Engineer, Web Crawling
Employer Exa
Location San Francisco
Salary $150,000–$300,000 per year plus equity
Job Type Full-time, On-site
Experience Extensive experience building and scaling web crawlers
Visa Sponsorship Available for international candidates including STEM OPT, OPT, H1B, O1, E3
Closing Date Not specified in the available job information

About the Employer

Exa is an applied AI lab building a search engine from scratch. It builds massive-scale infrastructure to crawl the web, train embedding models, and develop vector databases. It has raised $350m from Lightspeed, Benchmark, and a16z and powers search for companies including Cursor and HubSpot.

Job Responsibilities

  • Build a distributed crawler that can handle 100M+ pages per day
  • Optimize crawl politeness and rate limiting across thousands of domains
  • Design systems to detect and handle dynamic content, JavaScript rendering, and anti-bot measures
  • Create intelligent crawl scheduling and prioritization algorithms for maximum coverage efficiency

Requirements

  • Extensive experience building and scaling web crawlers, or ability to ramp up quickly
  • Experience with a high performance language such as C++ or Rust
  • Familiarity with TypeScript, Playwright, modern web design, and Chrome DevTools Protocol
  • Comfort optimizing systems to an exceptional degree

Visa Sponsorship and International Applicants

This is an in-person opportunity in San Francisco. Exa is happy to sponsor international candidates (e.g., STEM OPT, OPT, H1B, O1, E3).

Salary and Benefits

  • Salary range $150,000 to $300,000 with equity
  • Benefits not further specified in the available job information
What you need to Know
Pros
  • Visa sponsorship available
  • Competitive salary plus equity
  • In-person San Francisco role
Cons
  • Requires specialized crawler experience
  • On-site only

How to Apply

Apply through the Ashby job board. The application process details are on the posting.

Apply to this Job

Advertisement

Browse more Technology Jobs and USA Jobs on CMAJobs.

Advertisement

Join the discussion 0

No comments yet. Be the first to share your thoughts.

Leave a comment