Big Data Engineer

Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!

Roles & Responsibilities:

• To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…
• To use Scrum methodology, and be part of a high-performance team
• To document your solutions in the project partner tools: JIRA, Confluence, ALM.
• To certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team's delivery

Requirement:-

• More than 5 years of experience with Spark with Scala, software design patterns, and TDD
• Experience working with big data – Spark, Hadoop, Hive is a must – Azure Databricks be a plus
• Agile approach for software development
• Experience and expertise across data integration and data management with high data volumes
• Experience working in Agile
• Continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)
• Experience with different database structures, including (Postgres, SQL, Hive)
• English (at least B2+)