Senior/Mid Big Data Engineer (Scala or PySpark)

Currently We are looking for Big Data Engineer for one of our clients based in Kraków. The role is hybrid 2 days a week in Kraków office.

OUR ROLE & RESPONSIBILITIES

• Architect, implement, and optimize data processing pipelines using Scala or PySpark, Hadoop, and SQL for both real-time and batch data workflows.
• Partner with various teams to assess data requirements, designing scalable and high-performance solutions tailored to business objectives.
• Enhance and fine-tune Spark-based data processing to ensure optimal efficiency, reliability, and scalability.
• Maintain high data integrity, security, and governance across all stages of the data lifecycle.
• Diagnose and resolve technical challenges in data workflows, minimizing downtime and business disruptions.
• Keep up with the latest advancements in big data technologies, contributing to innovation and process improvements.
• Create and maintain thorough documentation, including system designs, deployment strategies, and operational procedures.
• Support and mentor junior team members, fostering knowledge-sharing and skill development.

TECHNOLOGY STACK:

• Core Technologies: Scala or PySpark, SQL, Hadoop.
• Bonus Skills: Experience with cloud-based messaging systems (e.g., Kafka, SQS), Apache Stack, and CI/CD practices.

WHAT YOU BRING TO THE TEAM:

• A minimum of 3-4 years of hands-on experience in data engineering or big data engineering roles.
• A degree in Computer Science, Mathematics, Engineering, or a related field, along with relevant industry experience.
• Strong SQL expertise, including advanced query optimization and database structuring.
• Proficiency in Scala, with a solid understanding of Object-Oriented Programming principles.
• Practical experience working with Spark and Hadoop ecosystems.
• Familiarity with Agile methodologies such as Scrum for efficient project execution.
• A keen interest in financial services and data-driven market analysis.
• Bonus: Exposure to Google Cloud Platform (GCP) or similar cloud-based data solutions.
• Excellent communication skills in English, with the ability to articulate technical concepts clearly.
• A proactive mindset, strong problem-solving skills, and a positive, team-oriented attitude.