Web Scraping Specialist (100% remote)
Web Scraping Specialist (100% remote)
💰 Salary: 6,000 - 20,000$ per month
🕦 Full-time
☑️ Contract signed through EOR
🌴 100% Remote
We’re looking for a Web Scraping Specialist to join a focused team. Your role will involve leading data-gathering initiatives, refining collection methodologies, and analyzing results. The ideal candidate will help us advance our mission to reshape how publicly available online information is accessed and utilized.
Requirements
Independently capable of collecting data from sophisticated and dynamic web interfaces, with a proven track record shown through previous work samples.
Strong programming skills in Python and JavaScript, with extensive experience using common data extraction toolkits and browser automation frameworks.
Understanding of concurrent execution models (async/threading) and strategies for scalable, distributed data collection.
Solid foundation in core web technologies: HTML structure, CSS selectors, client-side JavaScript, and DOM manipulation.
Hands-on experience with schema-flexible databases (e.g., MongoDB) for designing optimal data storage and ensuring consistency.
Experience applying ML techniques for tasks like data normalization, classification, or forecasting.
Familiarity with major cloud platforms (AWS, GCP, Azure) for deploying and orchestrating large-scale data collection tasks.
A demonstrated contribution to community-driven projects in the domains of data acquisition or processing is a plus.
Key Responsibilities
Script Development: Build, debug, and enhance reliable code to systematically collect data from the web.
Complex Navigation: Solve technical challenges like pagination and AJAX/JavaScript-driven content loading during data retrieval.
Data Processing: Clean, validate, and structure raw data into usable formats.
Storage & Management: Implement and optimize database solutions for storing large volumes of collected data.
System Maintenance: Monitor automated processes, perform root-cause analysis on failures, and ensure pipeline health.
Get to know DevsData:
We are a technology consulting company and a recruitment agency, delivering software solutions to clients from Europe and the US. We work 100% remotely, in an international team, including people from Asia, London, or San Francisco. We employ people with experience in international corporations as well as students of the best technical and business universities.
Find out more: https://devsdata.com/
Web Scraping Specialist (100% remote)
Web Scraping Specialist (100% remote)