Senior Data Engineer

Dear Consultant,

Job Description:

We are seeking a highly skilled Senior Data Engineer with expertise in Databricks and Data Engineering. The ideal candidate will have a strong background in data modeling and lakehouse solutions while ensuring optimal data ingestion, transformation, and security. This role requires hands-on experience with key Databricks components and an understanding of data architecture best practices.If this is you, share your CV as soon as possible.

Job Title: Senior Data Engineer - Databricks

Location: Wipro Warsaw Office (Hybrid/3 days a week)

Experience: 7-8+ years

End Client Industry: Automotive Industry

Key Responsibilities:

• Design and implement data ingestion and transformation pipelines using Databricks Lakehouse Platform for batch and streaming data.
• Develop and maintain Databricks Workflows for data flow tracking, health monitoring, and performance optimization.
• Utilize Delta Lake tables for monitoring and visualizing performance, data quality, and reliability metrics.
• Orchestrate diverse workloads for Delta Live Tables, PySpark, and other Databricks-native solutions.
• Ensure data security and governance using Unity Catalog, Delta Sharing, and security frameworks.
• Strong understanding and application of data modeling best practices to optimize reporting and analytics.

Must-Have Skills:

• 8+ years of experience in Data Engineering.
• Expertise in Databricks, Delta Lake, PySpark, Lakeflow, Delta Live Tables, Delta Sharing, and Unity Catalog Security.
• Hands-on experience with Databricks Workflows for managing data pipelines and job orchestration.
• Strong skills in data modeling and BI-driven data structures.

Good-to-Have Skills:

• Experience with Azure Data Factory or Fivetran (preferred but not mandatory).
• Knowledge of Power BI for data visualization and reporting.

Client Notes:

• This role is focused on Data Engineering, not Data Science. The ideal candidate should have extensive knowledge of Databricks-native capabilities such as PySpark, Lakeflow, Delta Live Tables, Unity Catalog, and Delta Sharing, rather than relying on third-party ingestion tools.
• Power BI experience is a plus.
• Strong BI/Data Modeling skills are expected from a Data Engineer in this role.

If you have the right experience and expertise in Databricks Data Engineering, we invite you to join our dynamic team!