Oxylabs is looking for a skilled Web Scraping Engineer to join the Web Intelligence team, focusing on building and delivering large-scale, custom datasets. You will work in a fast-paced environment, taking full ownership of projects and leveraging AI-driven development tools to create efficient, high-scale scraping solutions.
Key responsibilities
- Design and build high-scale crawlers, scrapers, and infrastructure capable of handling millions of requests.
- Own projects end-to-end, translating client requirements into custom solutions from scratch.
- Write functional, reusable code in Python or Go while maximizing efficiency through AI-driven IDEs.
- Collaborate with the team to justify technical decisions and ensure the delivery of high-quality datasets.
- Utilize and improve internal scraping tools to adapt to changing project priorities.
Requirements
- Multiple years of backend development experience using Python or Go.
- Strong understanding of web scraping fundamentals, including parsing, headless browsers, and databases like PostgreSQL or BigQuery.
- High level of independence and a business-first mentality that prioritizes speed and delivery.
- Hands-on experience with AI-driven development tools such as Cursor or Claude Code.
- Ability to thrive in a fast-paced environment with a focus on practical, functional results.
What we offer
- Opportunity to work on large-scale data engineering projects in a fully remote environment.
- Access to a modern tech stack including Python, Go, Google Cloud, and advanced scraping frameworks.
- A collaborative team culture that values direct communication and technical ownership.
- Exposure to cutting-edge AI-driven development workflows and tools.