Senior Data Engineer

Data

Senior Data Engineer

Data
centrum, Warszawa +2 Locations

DCG

Go to company profile
Full-time
B2B
Senior
Hybrid
41 - 48 USDNet per hour - B2B

Job description

Responsibilities:

  • Design, build and maintain scalable ELT pipeline

  • Develop and optimize PLSQL queries and database objects for high performance data storage in Oracle

  • Write python-based data engineering scripts to process data

  • Implement CI/CD pipelines for data infrastructure and workflow automation

  • Understand and have experience of database change management

  • Work one or more of the major cloud vendor

  • Integrate and manage modern data stack

  • Monitor, debug and optimize data workflows and infrastructure performance

  • Ensure data quality, governance, and compliance with good practices

 

Requirements:

  • Experience with designing OLAP systems and applying techniques such as STAR schema and denormalization

  • Proficiency in Python and PL/SQL development

  • Experience with ELT/ETL development using GUI-based tools such as IBM DataStage, Azure Data Factory (ADF), Stitch, and Matillion

  • Knowledge of database management systems including Oracle, MS SQL Server, and Snowflake

  • Understanding of DevOps and CI/CD practices, including Git, Docker, Kubernetes, Terraform, and CI/CD tools such as Jenkins, Bamboo, and Azure DevOps

  • Experience with test automation tools such as Robot Framework and Selenium, including knowledge of different test scenarios

  • Knowledge of version control systems including Git, GitHub, and GitLab

  • Experience with workflow orchestration tools such as Airflow and Prefect

  • Knowledge of streaming and batch processing concepts, including Kafka

  • Very good command of English, both spoken and written

 

Offer:

  • Private medical care

  • Co-financing for the sports card

  • Constant support of dedicated consultant

  • Employee referral program

Tech stack

    Polish

    C1

    English

    B2

    ETL

    advanced

    PL/SQL

    advanced

    Kafka

    advanced

    SQL

    advanced

    Python

    advanced

Office location

About the company

DCG

DCG to przestrzeń, w której spotykają się potrzeby biznesu i ambicje ludzi. Znamy wartość dobrze dopasowanej współpracy, dlatego pomagamy kandydatom znaleźć środowisko, w którym będą mogli rozwinąć skrzydła, a firmom - z...
Company profile
Check similar offers
Polski Standard Płatności S.A.

Polski Standard Płatności S.A.

Warszawa

Hybrid

Hybrid

Undisclosed Salary
CI/CD
Spark
Go
NIFI
Flink
Apache Airflow
SQL
Beam
Python
NoSQL
SeniorSeniorPermanentPermanent
New
ADVERTISEMENT: Recommended by Just Join IT
Check similar offers
Polski Standard Płatności S.A.

Polski Standard Płatności S.A.

Warszawa

Hybrid

Hybrid

Undisclosed Salary
CI/CD
Spark
Go
NIFI
Flink
Apache Airflow
SQL
Beam
Python
NoSQL
SeniorSeniorPermanentPermanent
New
RITS Professional Services

RITS Professional Services

Warszawa

Hybrid

Hybrid

41 - 46USD/h
Informatica Powercenter
Apache Kafka
ScyllaDB / Scylla Cloud
PySpark
Apache Nifi
REST API
GCP
Apache Airflow
Oracle / PostgreSQL
Python
SeniorSeniorB2BB2B
New
Allegro

Allegro

Warszawa

Hybrid

Hybrid

4 987 - 6 897USD/month
AWS
Apache Beam
Spark
Azure
GCP
Java
Python
Scala
SeniorSeniorPermanentPermanent
New
emagine Polska

emagine Polska

Warszawa

Hybrid

Hybrid

41 - 44USD/day
AWS
Git
Spark
Hadoop
Linux
SQL
Python
Scala
SeniorSeniorB2BB2B
New
SNI

SNI

Hybrid

Hybrid

44 - 49USD/h
Informatica Powercenter
PySpark
Power BI
Azure Data Factory
Databricks
SQL
Python
SeniorSeniorB2BB2B
New
ADVERTISEMENT: Recommended by Just Join IT