Hadoop Admin / Data Engineer

Why us?

We are part of the ALTEN Group – a leading European provider of engineering and technology consulting services.

Join ALTEN Polska and let’s grow together!

🌎Location: Kraków/ Warsaw/ Remote

Hadoop Admin role is expected to contribute to the design and build system capabilities on the key on-premise Hadoop big data platform. The person would be entrusted to develop solutions/design ideas focusing on product requirements, resiliency and automation of the underlying data processing clusters. Implementing new capabilities and identify design ideas to enable the software to meet the acceptance and success criteria, these requirements may be backend (containerized services, APIs) and front end (UI), as well as various integration and automation tasks. An ideal candidate should be comfortable in multiple areas of the software stack and corporate IT deliveries. They will work with solution architects to build platform components and overall capabilities within the ecosystem of IT systems within Data Technologies

As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process:

• Big Data development, automated testing of new and existing components in an Agile, DevOps and dynamic environment

• Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Spark, and MapReduce access for the new user

• Executes the review / acceptance / tuning and ensures environment availability 24x7

• General operational excellence. This includes good troubleshooting skills, understanding of system’s capacity and bottlenecks.

Must Haves:

• Strong problem-solving skills and adaptability to a complex environment

• Providing technical support and design Hadoop Big Data platforms (preferably Cloudera distributions like Hive, Beeline, Spark, HDFS, Kafka, Yarn, Zookeeper etc.), handle and identify possible failure scenario (Incident Management), respond to end users of Hadoop platform on data or application issues, report and monitor daily SLA that identifies vulnerabilities and opportunities for improvement.

• Hands-on experience with large scale Big Data environment builds, capacity planning, performance tuning and monitoring, including end-to-end Cloudera cluster installation.

• Handling Hadoop security activities using Apache Ranger, Knox, TLs, Kerberos and Encryption zone management.

• Expertise in software installation and configuration, orchestration, and automation with tools such as Jenkins/Ansible.

• Improve the current estate by incorporating the use of centralized S3 data storage (VAST) throughout the platform processing stack

• 5+ years experience in engineering solutions in a Big Data on-prem or cloud environment.

We offer

• A full-time contract (B2B also possible)

• Well-defined career path at the European leader in engineering & IT consulting

• Participation in company conferences, trainings, workshops, integration meetings, etc.

• Certification and training opportunities

• Opportunity to relocate and work in different ALTEN Polska branches

• After completion of the project, opportunity to engage in a subsequent one within the company.

• Work in company with #GreatPlaceToWork Certificate

Benefits

• Medicover medical care

• Medicover dental care

• Medicover Benefits platform / Medicover Sport card

• Employee referral program

• E-learning platform

• Layette for a newborn employee’s child

• Group life insurance

• Pension scheme

Do not hesitate and join our team!