Senior Data Engineer

Summary:

The Senior Data Engineer will play a pivotal role in driving the creation of innovative AI solutions within a collaborative and agile team environment. The primary objective is to develop efficient data architectures and scalable data pipelines to support analytics and machine learning applications.

Responsibilities:

• Collaborate with product managers, designers, and engineers to build AI-enabled product features.

• Design, build, and maintain scalable data pipelines and ETL/ELT workflows.

• Develop and optimize data models and storage solutions for analytics and machine learning.

• Implement monitoring and validation tools to ensure data quality and reliability.

• Integrate modern data technologies to enhance the data ecosystem.

• Engage in code reviews and promote data engineering best practices.

• Stay updated on emerging data technologies and industry trends.

Key Requirements:

• 7+ years of experience as a Data Engineer or similar role.

• Proven track record in building scalable data platforms and pipelines.

• Hands-on experience with data orchestration tools like Airflow.

• Expertise in Python, with additional skills in SQL, Scala, or Java.

• Experience with data modeling and management, including SQL and NoSQL databases.

• Proficiency in cloud-based data infrastructure management (specifically Azure Fabric).

• Knowledge of modern data frameworks such as Spark or Databricks.

• Understanding of AI/ML data needs and MLOps workflows.

• Experience with streaming and real-time systems like Kafka, Kinesis, etc.

Nice to Have:

• Knowledge of distributed systems and data governance.

• Agile experience, particularly with SCRUM methodologies.

• Familiarity with project management tools like JIRA or Trello.

• Cloud certifications (a plus).

• Fluency in English, proficiency in French (a plus).

Other Details:

• Location: Pune, India (Hybrid working model - 3 days in office)

• Reporting Line: Reports to the Technical Lead

• Working Hours: CET Timezone