Job Title: Technical Lead Python Scraping About the Role: We are looking for a highly skilled Technical Lead Python Scraping to lead our web scraping initiatives. The ideal candidate will have deep expertise in Python-based web scraping, data extraction, and automation. You will be responsible for architecting and developing robust scraping solutions while ensuring data quality, performance, and scalability. Key Responsibilities: Lead the design, development, and maintenance of web scraping solutions. Architect scalable scraping systems capable of handling large-scale data extraction. Develop, test, and optimize scraping scripts using Python and related frameworks. Ensure compliance with legal and ethical guidelines for web scraping. Implement strategies to avoid blocks, captchas, and IP bans using proxies and headless browsers. Collaborate with data engineers and analysts to ensure data integrity and usability. Optimize data storage and processing pipelines for efficiency. Troubleshoot and resolve scraping issues quickly and effectively. Keep up-to-date with the latest web scraping techniques and technologies. Mentor and guide junior developers in best practices and coding standards. Required Skills & Qualifications: 5+ years of experience in Python programming with a strong focus on web scraping. Expertise in libraries such as Scrapy, BeautifulSoup, Selenium, and Playwright. Strong understanding of web technologies, HTTP protocols, and browser automation. Experience with anti-bot mechanisms, captchas, and proxy management. Proficiency in database technologies (SQL, NoSQL) for efficient data storage. Familiarity with cloud services (AWS, GCP, or Azure) for scalable scraping deployments. Strong debugging and problem-solving skills. Experience leading teams and mentoring junior developers. Excellent communication and collaboration skills. Preferred Qualifications: Experience with machine learning for data extraction and NLP techniques. Knowledge of DevOps practices and CI/CD pipelines. Understanding of big data processing frameworks like Spark.,
Employement Category:
Employement Type: Full time Industry: IT Services & Consulting Role Category: Not Specified Functional Area: Not Specified Role/Responsibilies: Technical Lead Python Scraping Job in Actowiz