Data Engineer

Data

Data Engineer

Data
Centrum, Warszawa

Larsen & Toubro Infotech

Undetermined
Permanent, B2B
Senior
Office
9 492 - 11 391 USDNet per month - B2B
7 119 - 8 306 USDNet per month - Permanent

Job description

Location – Warsaw, Poland
 
Type of hire – Permanent/ B2B
 
We are looking for a resource for a Data Engineer with below skills.

  • Candidate should have at least 5 + yrs experience working on data workflow development in Azure stack.
  • Good understanding of developing end to end data ingestion pipelines in ADF and also using ADF for ETL orchestration
  • Should be able to re-construct/migrate logic written in legacy application to Azure
  • SQL skills which includes knowledge of SQL Server DDLs to create the data models and complex SQL calculation scripts for manipulating data per business logic.
  • Candidate must have Azure Databrick expertise with SQL / Python / Spark (SQL mandatory)
  • Expert at using tools to migrate existing data structures into SQL Server.
  • Strong understanding of Data Bricks background architecture, and advanced concepts like Security and productionalization.
  • Must have good understanding of understanding of provisioning of Databricks and Azure resources.
  • Knowledge of CI/CD in the context of Azure DevOps is essential
  • Should understand data quality concepts and write SQL scripts for specific for DQ checks.
  • Must have a working experience in Azure DevOps and CI/CD tools at each phase of the SDLC cycle.
  • Exposure to other Azure components like Blob storage, Data Bricks, AAS will be beneficial..
  • Candidate should experience in Azure AAS and Power BI report development
  • Strong experience in designing AAS models.
  • Candidate must be familiar with Azure security model and Storage accounts.
  • Good understanding of coding standards (code modularization, refactoring), testing automation
 
PFB offer/ benefits we provide:

  • Competitive market salary based on professional experience and skills
  • Benefit package (Health insurance, Multisport card) (Permanent employment)
  • Multinational environment, where English is the primary language
  • On-line training programs

Tech stack

    Data

    advanced

    Azure

    advanced

    Data Lake

    regular

    data brick

    regular

Office location

Check similar offers
ERGO Technology & Services

ERGO Technology & Services

Office

Office

Undisclosed Salary
CI/CD
MS SQL
English
CDC
SeniorSeniorPermanentPermanent
New
ADVERTISEMENT: Recommended by Just Join IT
Check similar offers
ERGO Technology & Services

ERGO Technology & Services

Office

Office

Undisclosed Salary
CI/CD
MS SQL
English
CDC
SeniorSeniorPermanentPermanent
New
emagine Polska

emagine Polska

Warszawa

Remote

Remote

54USD/day
Airflow
Power BI
SQL
ADF
SeniorSeniorB2BB2B
New
PTT Consulting Sp. z o. o.

PTT Consulting Sp. z o. o.

Warszawa

Remote

Remote

41 - 47USD/h
TBM Studio
Data Warehousing
Cloud (AWS /Azure / GCP)
Power BI
Data integration (incl. SEI integration)
Data modeling
End-to-end building of data platform
SQL
Data orchestration tools
Python
SeniorSeniorB2BB2B
New
WeNet

WeNet

Warszawa

Remote

Remote

Undisclosed Salary
Airflow/Cloud Composer
Dataform/dbt
Docker
GCP
Terraform
Dataplex
SQL (BigQuery)
JavaScript
Python
CI/CD (GitHub Actions/Cloud Build)
SeniorSeniorB2B, PermanentB2B, Permanent
New
Cognizant Technology Solutions

Cognizant Technology Solutions

Warszawa

Remote

Remote

49 - 55USD/h
CI/CD
Azure
Databricks
SQL
Python
ADF
SeniorSeniorB2BB2B
New
ADVERTISEMENT: Recommended by Just Join IT