Experienced Web Scraping Engineer - Python

Oxylabs is a leading provider of proxy and web data scraping solutions, supporting thousands of global businesses, including Fortune 500 companies. We are looking for an experienced Web Scraping Engineer to join our team and help maintain our massive infrastructure, which handles over 60PB of monthly data traffic.

Key responsibilities

• Develop and maintain scalable web scrapers and back-end solutions for complex parsing challenges.
• Define resilient scraping strategies and implement techniques to unblock websites effectively.
• Improve system observability and performance to ensure high success rates.
• Collaborate with a global team to build and optimize advanced data extraction products.

Requirements

• Strong proficiency in Python and experience with asynchronous programming.
• Solid understanding of computer science fundamentals, including data structures and algorithms.
• Practical knowledge of network protocols, specifically TLS/SSL, and browser automation tools.
• Experience with version control using Git and familiarity with web scraping techniques.
• Ability to utilize browser Dev Tools and open-source tools to solve scraping problems.

What we offer

• Opportunity to work on one of the largest and most advanced scraping infrastructures in the world.
• A supportive team environment that encourages knowledge sharing and professional growth.
• Exposure to high-scale systems processing hundreds of thousands of requests per second.
• A fully remote work environment that values expertise and technical innovation.