Data Engineer

Introduction & Summary: We are seeking a Data Engineer who has experience building, optimizing, and maintaining data pipelines (ETL/ELT), as well as strong knowledge of technologies such as Spark, SQL, and Python. This role is fundamental to ensuring the reliability, security, and efficiency of data handling processes, with a focus on innovation and continuous system evolution.

Main Responsibilities:

• The Data Engineer will be responsible for technical and data architecture;

• Building, optimizing, and maintaining data pipelines;

• Defining pipeline architecture and governance standards;

• Coordinating the technical deployment of pipelines;

• Ensuring technical execution, performance, and code reliability;

• Balancing technical and product vision, acting as a bridge between stakeholders;

• Implementing data tests and validations, handling errors and corrupted data;

• Automating and monitoring processes for continuous improvement;

• Evaluating and proposing new architectural approaches;

• Stimulating innovation and promoting new solutions.

Key Requirements:

• Experience in building and maintaining data pipelines (ETL/ELT);

• Proficiency in Spark, SQL, and Python;

• Knowledge of Delta Lake and data architecture;

• Experience with Azure Fabric;

• Ability to implement tests and ensure data quality;

• Ability to define and follow security standards and access policies.

Nice to Have:

• Experience with tools for data automation and monitoring.

• Knowledge of big data frameworks.

• Skills in data analysis and visualization.

• Experience in promoting Proof of Concepts (POCs) and the adoption of new technologies.

Other Details: This is a hybrid working model job, long-term position.