#1 Job Board for tech industry in Europe

  • Job offers
  • Salary calculator
  • Top Companies
  • Geek
    • Azure Data Engineer
    Data

    Azure Data Engineer

    Larsen & Toubro Infotech

    Warszawa
    Type of work
    Undetermined
    Experience
    Mid
    Employment Type
    Permanent
    Operating mode
    Office

    Tech stack

      Azure

      regular

      Python

      regular

      Spark

      regular

      ADF

      regular

      DevOps

      regular

    Job description

    Online interview
    Detailed JD:

    1. Candidate must have at least 3-8 yrs experience in design and development of ETL solutions in Azure stack
    2. Strong understanding of Azure service components like ADF, Data Bricks, SQL DB / SQL Server, Azure Blob storage, AAS and Power BI. Should be able to show working experience across all these technologies. 
    3. Should be experienced in migrating on-prem and legacy DWH to Azure stack
    4. Must have a working experience in Azure DevOps and CI/CD tools at each phase of the SDLC cycle. All project management and test coordination will happen through DevOps and should be able to manage and drive deliverables and report status through DevOps.
    5. Candidate must be familiar with Azure security model and Storage accounts
    6. Candidate must have Azure Databrick expertise with Python / Spark (Scala would be great). Strong understanding of Data Bricks background architecture, and advanced concepts like Security and productionalization.
    7. Should be able to develop end to end automations in Azure stack – for ETL workflows, data quality validations and reporting, SIT automations through DevOps etc,
    8. Must have good understanding of understanding of provisioning of Databricks and Azure resources
    9. Good understanding of coding standards (code modularization, refactoring), testing automation
    10. Familiarity with Airflow will be an added advantage.
    11. Candidate must have at least 2-3 yrs experience in productionized applications.

    Tasks: 

    The detailed daily tasks are to be defined, however, at the high level, the following tasks should be considered:

    1. Working closely with business users to gather data requirements and convert them to techno-functional specs.
    2. Develop data solutions in Azure stack including identifying data sources, data modelling, designing and building data pipelines to ingest data to SQL Server using Azure Data bricks, development of AAS cubes for business reporting.
    3. Develop pragmatic and strategic automations for driving better data governance and operations excellence.
    4. Work with upstream and peer teams to setup the correct architecture to ingest data into 
    5. Executing test cases to unit test the development. Provide support through SIT and UAT cycles.
    6. Participate in daily scrum calls and demonstrate daily progress on planned activities. Provide technical help and guidance across other modules, if required.
     
    Long term objectives:

    1. The candidate is expected to establish a strong working relationship with the D&A client counterparts in Poland and entrench as the go-to architect for all future projects
    2. The client is embarking on several projects for modernization and migration to Azure cloud for data management and reporting. The candidate is expected to play a consulting role and become the local though partner from LTI
    3. The position will start by driving one of the major modernization projects with significant global user footprint. However, in the long run this will evolve into a strategically important position for identifying growth opportunities and bringing in the correct contextualized solutions for the client.

    Check similar offers