Data Engineer preferably with AI experience

emagine is looking for a Data Engineer to work with one of our partners. The right consultant will have the following experience and preferrably also have experience within AI.

Need-to-have competencies:

• Proven extensive experience with data engineering and building ETL pipelines

• Proven experience of working with cloud services, ideally in Microsoft Azure: Azure Data Factory, Azure Data Lake, Databricks/Spark, Function Apps

• Proficiency in SQL and Python (PySpark)

• Proven experience with processing large amounts of structured and, if possible, unstructured data and modelling principles towards both backend and frontend scenarios

• Self-driven, but aware of being part of a team and working using agile methodologies

• Able to work based on limited specifications and present various options of implementation for team review

• Clear communication in English

Nice-to-have competencies:

• Experience with Spark

• Experience with Analytics, Data Warehousing and BI

• Hands on experience with agile, DevOps and continuous integration / continuous delivery

• Experience with working with all/some of the following:

  • streaming data pipelines

  • messaging queues

  • serverless components

  • NoSQL databases

• Developing and consuming RESTful API services

• Experience in applying design principles (business process design tools included)

Other Details:

• Start: ASAP

• Duration: 4-6 months - most likely for the rest of the year

• Work Location: Aarhus - maybe with some flexibility

• Required Language: English

• Interview: Includes a case study to evaluate competency fit for rapid onboarding.

• Required language: English