Data Engineer ETRM domain

Job Description

We are seeking a skilled ETRM Data Engineer to join our data engineering team and support critical initiatives in the Energy Trading and Risk Management (ETRM) domain. This role involves building robust data pipelines, integrating trading systems, and ensuring data quality across platforms such as Azure Data Factory, Databricks, and Snowflake.

You will collaborate closely with traders, analysts, and IT teams to design and implement scalable, high-performance data solutions that power decision-making in fast-paced trading environments.

Key Responsibilities

1. Design, develop, and maintain scalable data pipelines and ETRM systems
2. Lead data integration projects within the energy trading ecosystem
3. Integrate data from ETRM platforms such as Allegro, RightAngle, and Endur
4. Build and optimize data storage solutions using Data Lake and Snowflake
5. Develop and orchestrate ETL/ELT workflows using Azure Data Factory and Databricks
6. Write efficient, production-grade Python/PySpark code for data processing and analytics
7. Build and expose APIs using FastAPI for data services
8. Ensure data quality, consistency, and reliability across complex systems
9. Work closely with stakeholders to translate business requirements into technical data solutions
10. Optimize and enhance data architecture for scalability and performance

Mandatory Skills

1. Strong experience with Azure Data Factory (ADF)
2. Proficient in Data Lake architecture and best practices
3. Hands-on expertise with Snowflake and SQL
4. Solid experience in Python and PySpark
5. Knowledge of FastAPI for building scalable APIs
6. Proven work with Databricks in production environments

Nice to Have

1. Domain experience in ETRM / energy trading systems
2. Familiarity with Streamlit for internal dashboards

Experience integrating with Allegro, RightAngle, or Endur trading platforms