The Challenge
As an enterprise producing millions of connected appliances each year, we are generating massive amounts of data. As part of our data mesh journey, your task as a Data Platform Engineer is to build, develop, operate, and maintain a self-serve data platform that will support data and AI products. You will establish foundational capabilities for development teams to apply data engineering practices effectively and facilitate analytics work. There are plenty of exciting use cases to be considered!
The Team
The Data Product team supports business functions across the company, turning raw data into valuable insights and actions. This team is a key enabler in supporting the company’s digital transformation, driving and operationalizing the data products strategy within the Digital Experience organization. As the center of enablement for data handling and advanced analytics, the team is instrumental in implementing the data mesh framework within our domain.
The role
As a Data Platform Engineer, your primary mission will be to help us build a self-serve data platform tailored to different data personas, including both tech-savvy users ("Coders") and non-technical users ("Clickers"). You will be instrumental in crafting services that meet the diverse needs of these personas, ensuring that our platform is accessible, efficient, and robust. Your role will involve architecting and developing scalable data solutions, providing technical guidance to other team members, and continuously monitoring and optimizing the platform performance. Your expertise will enable our teams to leverage data more effectively, empowering them to turn raw data into actionable insights.
What you'll do as a Data Platform Engineer:
- Design cloud solutions and architecture using AWS services and databricks.
- Optimize cloud costs and ensure efficient resource utilization
- Knowledge of data platform engineering to integrate and manage data pipelines in AWS
- Ensure interoperability and integration of various systems and applications
- Ensure scalability, reliability, and performance of enterprise systems
- Ensure data quality and integrity across various platforms and systems
- Measure the success and performance of built capabilities
- Build and maintain scalable and reliable self-serve Data Platform
- Collaborate with Data Product manager, Engineering lead and engineering community in order to establish and maintain effective working relationships.
- Work in established agile product management framework
Required experience:
- Experience in building cost effective and performant data pipelines
- Proficiency in Infrastructure as Code (IaC) tools (e.g. Terraform)
- Experience with DevOps practices and tools (CI/CD, Docker, Kubernetes)
- knowledge of AWS security best practices and compliance (multi regions data transfers)
- Proficiency in PII management (pseudonymization, anonymization)
- Experience in data governance principles (policy-as-code)
- Proficiency in database management and data warehousing solutions
- Knowledge of data governance practices (data cataloging, access control, lineage, audit,….)
- Programming experience in SQL and Python, preferably in an Apache Spark setup
- Decent experience in developing and maintaining Databricks platform
- A Master- or Bachelor’s degree in in Computer Science (or equivalent)
You demonstrate:
- Collaboration - contributes to a highly collaborative environment that enables a cross functional team to flourish.
- Communication - effectively exchanges information and ideas with confidence and respect, able to demonstrate progress, raise issues and articulate changes on a frequent basis.
- Empathy - can understand and acknowledge the emotions and perspectives of others during conversations.
- Problem-Solving - able to connect the dots between insights, strategy, and conceptual direction; is outcome - as opposed to task - orientated.
- Adaptability & Resilience - can effectively navigate change, challenges, and setbacks while maintaining a positive and flexible approach.
- Proactivity - eager to learn and grow, sees challenges as opportunities, seeks and - is responsive to - feedback.
- Responsibility - accountable, reliable, and proactive in building systems and handling dependencies, contributing to a trustworthy and effective team dynamic.
Where you'll be:
- While embracing a hybrid work model, your main location will be our state-of-the-art office in Warsaw's vibrant Wola district
- You will be part of a dynamic international team where English is the natural language.