Data Engineer
Data
Data Engineer
Warszawa
Type of work
Undetermined
Experience
Senior
Employment Type
B2B, Permanent
Operating mode
Office
Tech stack
Data
Azure
data brick
Data Lake
Job description
Online interview
Location – Warsaw, Poland
Type of hire – Permanent/ B2B
We are looking for a resource for a Data Engineer with below skills.
- Candidate should have at least 5 + yrs experience working on data workflow development in Azure stack.
- Good understanding of developing end to end data ingestion pipelines in ADF and also using ADF for ETL orchestration
- Should be able to re-construct/migrate logic written in legacy application to Azure
- SQL skills which includes knowledge of SQL Server DDLs to create the data models and complex SQL calculation scripts for manipulating data per business logic.
- Candidate must have Azure Databrick expertise with SQL / Python / Spark (SQL mandatory)
- Expert at using tools to migrate existing data structures into SQL Server.
- Strong understanding of Data Bricks background architecture, and advanced concepts like Security and productionalization.
- Must have good understanding of understanding of provisioning of Databricks and Azure resources.
- Knowledge of CI/CD in the context of Azure DevOps is essential
- Should understand data quality concepts and write SQL scripts for specific for DQ checks.
- Must have a working experience in Azure DevOps and CI/CD tools at each phase of the SDLC cycle.
- Exposure to other Azure components like Blob storage, Data Bricks, AAS will be beneficial..
- Candidate should experience in Azure AAS and Power BI report development
- Strong experience in designing AAS models.
- Candidate must be familiar with Azure security model and Storage accounts.
- Good understanding of coding standards (code modularization, refactoring), testing automation
PFB offer/ benefits we provide:
- Competitive market salary based on professional experience and skills
- Benefit package (Health insurance, Multisport card) (Permanent employment)
- Multinational environment, where English is the primary language
- On-line training programs
Check similar offers
