#1 Job Board for tech industry in Europe

  • Job offers
  • Web Scraping Engineer
    New
    Python

    Web Scraping Engineer

    San Diego
    5 000 - 10 000 USDNet/month - B2B
    Type of work
    Full-time
    Experience
    Senior
    Employment Type
    B2B
    Operating mode
    Remote

    Tech stack

      Playwright

      nice to have

      Selenium

      nice to have

      React

      nice to have

    Job description

    Founded in 2017, REPS & Co. has rapidly become a leader in data analytics in the entertainment industry. Recognized on the Forbes list of America's Best Startup Employers, we focus on delivering advanced analytics that support data driven decisions. Our solutions provide comprehensive insights and forecasts, enabling us to have a better understanding and response to supply and demand in the ticketing world. With a commitment to driving innovation, REPS & Co. helps shape a dynamic market environment.


    We are looking for an organized, experienced, and driven Senior Software Engineer. The Software Engineer will be responsible for delivering great code and pushing forward our software. We are focusing engineers to build teams with the right people and contribute to successful communication across the company. The ideal candidate for this position is a self-starter who can work well in a fast-paced environment. We are looking for creative problem solvers and diverse thinkers, people who care about culture as well as customers and features.


    We believe that how we do things is as important as what we do. You are an inventive, industrious builder that loves all things technology and you are capable of on-time execution. Good strategic thinking, passion for quality, curiosity, and dedication in fun and collaboration are what lead to great results. Great products reflect the teams that build them.


    The ideal candidate will be responsible for:

    • On-time delivery of quality software based on various cloud architecture
    • Willingness to collaborate with and mentor your teammates to help them do the same


    Qualifications:


    • Scraping developer with over 4 years of experience as a backend software engineer, specializing in C#, Python, and Golang as primary languages. Proficient in JavaScript and TypeScript, with a strong ability to build and optimize robust data scraping solutions.
    • Successful experience with architectural patterns for large, high-scale web applications (well-designed API’s, high-volume pipelines, efficient algorithms) in cloud technologies.
    • Experience in working with a microservices architecture – including strong API design, management, and use, messaging and event-handling (i.e., SQS, SNS, Kafka), and consumable data patterns.
    • Experience coding to write to and read from relational data systems (MySQL, Postgres, Redshift, etc.)
    • In-memory data stores (Redis/Memcached) and NoSQL data systems (MongoDB/CouchDB).
    • Building DevOps (CI/CD) pipelines from code repositories (GitHub) and secure coding practices (OWASP and SANS).
    • Experience in building a platform and user experience that streams individualized, personalized content and that leverages repeatable, data-based patterns
    • Knowledge of Agile and Scrum principles and a willingness to hone your use of agile methods
    • Consistently deliver completed work independently but know how to work within your team to get help as needed
    • Strong team-oriented mindset with heavy focus on collaboration and mentorship
    • Strong communication and interpersonal skills (integrity, patience, empathy, etc.)


    Technical Skills:


    • Experience in web scraping, leveraging both requests-based scrapers and browser automation. Experienced in bypassing various bot detection schemes
    • AWS Cloud components (Lambda / SAM (Serverless), Step Functions, SQS, SNS, RDS, Airflow, Glue, EC2, S3)
    • Relational Database design and development (preferably with experience handling high volumes of data – millions of records and up)
    • Strong Python experience (or strong C# with a willingness to work in Python, or both)
    • ReactJS
    • Strong experience with SDLC best practices
    • Troubleshooting / Performance tuning
    • Structured Agile experience


    Availability to work Pacific Time Zone


    5 000 - 10 000 USD

    Net/month - B2B

    Check similar offers

    Python developer to Labs team

    New
    Planner 5D
    4.16K - 5.2K USD
    Gdańsk
    , Fully remote
    Fully remote
    Python
    asyncio
    RabbitMQ

    Senior Software Engineer, Backend (Storage Services Engineering)

    New
    Affirm
    6.13K - 8.16K USD
    Kraków
    , Fully remote
    Fully remote
    Distributed systems
    Python
    AWS

    Senior Python Developer

    New
    Relock
    3.66K - 6.5K USD
    Houston
    , Fully remote
    Fully remote
    Python
    Go
    Backend

    Senior Software Engineer (Data)

    New
    DNA Technology
    5.38K - 7.79K USD
    Warszawa
    , Fully remote
    Fully remote
    Python
    SQL
    Data Management

    Remote Senior Python Developer

    New
    Montrose Software( Polska) Sp.z.o.o
    4.64K - 6.59K USD
    Warszawa
    , Fully remote
    Fully remote
    Python
    C++
    Git