Diverse CG is a modern technology company, gathering in its ranks IT related professionals. Due to the continuous development and the large number of recruitment projects that we carry out for our Partners, we are looking for a person for the position:
Data Engineer
Key Responsibilities:
- Integrate third party provider data (via Files, APIs, Events)
- Upgrade vendor components through their major and minor patches
- Maintain connectivity with internal customer applications sourcing their data referential information via our WebServices, APIs, ETLs
- Reduce platform complexity by reducing point to point connections and favoring API connectivity
- Work in an agile environment directly in contact with our data management counterparts and SMEs in France
- Build tools and services to reduce manual work carried out by either our support team or our Data Management team
- Build data quality controls to monitor all our third-party data and data sent to our customers
- Integrate and maintain data referential in our Data-platform
- Build and maintain CI/CD Pipelines, shared libraries (data pipeline development, data quality, data lineage) and shared services (REST API, data viz, monitoring, scheduling)
- Design and maintain APIs
Requirements:
- Scripting: Shell/bash, Powershell
- Scheduling management - Control M API
- Experience working with data of various formats (np. Avro, Parquet, JSON, CSV)
- SQL expertise, knowledge of Microsoft SQL
- Very good knowledge of C#
Ideally:
- .NET Webservices
- ETL management
- API building/maintenance
- Git CD/CI
Nice to have:
- Azure Dev Ops
- Informatica - IDQ
- Financial knowledge around MDM
- Neoxam NDH
- Spark/Scala or Python
- Kubernetees, Docker, Kafka
We offer:
- B2B contract
- Private medical coverage
- Multisport card
- Cooperation with an experienced team and an excellent working environment
- An opportunity to work in an international, multi-cultural environment