Data Engineer (Apache Spark)

Are you ready to take on the challenge?

We’re looking for a Data Engineer to join our team in Warsaw or remotely.

Advance your career with Sunscrapers, a leading force in software development that is now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in a company that values ambition, technical excellence, trust-based partnerships, and actively supports contributions to R&D initiatives.

As a Data Engineer, you’ll play a pivotal role in building a robust data platform that drives engagement solutions for leading healthcare brands. Your work will directly support the development of omnichannel digital health experiences, empowering consumers to access the programs, benefits, and care they need.

In this role, you’ll leverage cutting-edge technologies such as Apache Spark, Databricks, and Delta Tables to design and implement scalable data solutions. You’ll enable actionable insights by integrating diverse data sources, building efficient pipelines, and supporting data-driven decision-making.

Your responsibilities will include:

• Design and manage batch data pipelines, including file ingestion, transformation (e.g., CSV to structured formats), and Delta Lake/table management,
• Implement scalable architectures for batch and streaming workflows,
• Leverage Microsoft equivalents of BigQuery for efficient querying and data storage.

Requirements

What's important for us?

• At least 3 years of professional experience as a data engineer,
• Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar,
• Excellent command of spoken and written English, at least C1,
• Strong professional experience with Apache Spark,
• Hands-on experience in managing production spark clusters either in Databricks,
• Experience in CI/CD of data jobs in Spark,
• Great analytical skills and attention to detail - asking questions and proactively searching for answers,
• Creative problem-solving skills,
• Great customer service and troubleshooting skills.

You'll score extra points for:

• Experience with BigQuery,
• Experience in managing data governance in the healthcare space.

Benefits

What do we offer?

• Working alongside a talented team that’s changing the image of Poland abroad.
• Flexible working hours and remote work possibility.
• Comfortable office in a penthouse in central Warsaw equipped with all the necessary tools to conquer the universe (Macbook, external screen, ergonomic chairs).
• Fully equipped kitchen with fruit, hot and cold drinks.
• Multisport card & Private medical care.
• Culture of good feedback: evaluation meetings, mentoring.
• We value and appreciate our engineer's eagerness to learn and improve so we strongly encourage and support their growth!