All offersWarszawaDataData Engineer
Data Engineer
Data
DCG

Data Engineer

DCG
Warszawa
Type of work
Undetermined
Experience
Mid
Employment Type
B2B
Operating mode
Office
DCG

DCG

DCG to ludzie z pasją do nowoczesnych technologii🐱‍💻i takich też ludzi poszukujemy do naszego zespołu. Aktualnie jest nas ponad 450 świetnych ekspertów 🐱‍🚀. Ty też możesz być jednym z nich. Sprawdź 👉 www.dcg.pl/karierawit i dołącz do #TeamDCG 💚

Company profile

Tech stack

    C#
    advanced
    Shell
    regular
    Bash
    regular
    Powershell
    regular
    JSON
    regular
    SQL
    regular
    .NET Webservices
    junior
    Git CD/CI
    junior
    Azure DevOps
    junior
    Informatica
    junior

Job description

Online interview
Diverse CG is a modern technology company, gathering in its ranks IT related professionals. Due to the continuous development and the large number of recruitment projects that we carry out for our Partners, we are looking for a person for the position:

Data Engineer


Key Responsibilities:
  • Integrate third party provider data (via Files, APIs, Events)
  • Upgrade vendor components through their major and minor patches
  • Maintain connectivity with internal customer applications sourcing their data referential information via our WebServices, APIs, ETLs
  • Reduce platform complexity by reducing point to point connections and favoring API connectivity
  • Work in an agile environment directly in contact with our data management counterparts and SMEs in France
  • Build tools and services to reduce manual work carried out by either our support team or our Data Management team
  • Build data quality controls to monitor all our third-party data and data sent to our customers
  • Integrate and maintain data referential in our Data-platform
  • Build and maintain CI/CD Pipelines, shared libraries (data pipeline development, data quality, data lineage) and shared services (REST API, data viz, monitoring, scheduling)
  • Design and maintain APIs

Requirements: 
  • Scripting: Shell/bash, Powershell
  • Scheduling management - Control M API
  • Experience working with data of various formats (np. Avro, Parquet, JSON, CSV)
  • SQL expertise, knowledge of Microsoft SQL
  • Very good knowledge of C#
Ideally:
  • .NET Webservices
  • ETL management
  • API building/maintenance
  • Git CD/CI
Nice to have:
  • Azure Dev Ops
  • Informatica - IDQ
  • Financial knowledge around MDM
  • Neoxam NDH
  • Spark/Scala or Python
  • Kubernetees, Docker, Kafka

We offer:
  • B2B contract
  • Private medical coverage
  • Multisport card
  • Cooperation with an experienced team and an excellent working environment
  • An opportunity to work in an international, multi-cultural environment