Oxylabs is looking for a skilled Web Scraping Engineer to join the Web Intelligence team, which focuses on delivering large-scale, custom datasets for diverse clients. In this role, you will take ownership of end-to-end scraping projects, building high-scale crawlers and parsers in a fast-paced environment where speed and efficiency are prioritized.
Key responsibilities
- Design and build high-scale crawlers, scrapers, and infrastructure capable of handling millions of requests.
- Take full ownership of projects from initial client requirements to final delivery without needing detailed specifications.
- Write functional, reusable code in Python or Go while leveraging AI-driven IDEs to maximize development output.
- Collaborate within the data platform to ensure the seamless building and delivery of large-scale datasets.
- Justify technical decisions and participate in code reviews to maintain high-quality solutions.
Requirements
- Multiple years of backend development experience using Python or Go, or deep expertise in web scraping.
- Strong familiarity with web scraping fundamentals, including parsing, headless browsers, and databases like PostgreSQL or BigQuery.
- High level of independence and a business-first mentality that values rapid delivery over absolute perfection.
- Hands-on experience and comfort using AI-driven development tools such as Cursor or Claude Code.
- Ability to thrive in a fast-paced environment and handle direct feedback constructively.
What we offer
- Opportunity to work on large-scale data projects using a modern tech stack including Python, Go, and Google Cloud.
- Exposure to advanced scraping tools like Playwright and Camoufox in a professional, remote-first environment.
- A culture that encourages technical autonomy and the use of cutting-edge AI development tools.
- Collaboration with a team focused on data engineering and high-impact web intelligence solutions.