Hadoop Developer
Data
Hadoop Developer
JIT Team
Warszawa
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Office
JIT Team
Jit Team – the human factor of IT. We build software development teams for our clients operating in various branches of business. We believe that the most important factor is the human factor. Our main value are JIT people - excellent specialists.
Tech stack
Hadoop
Hive
Impala
Kafka
Ozzie
Pig
Scoop
NoSQL
ETL
Job description
Hi! We are JIT TEAM and we are looking for a Hadoop Developer to join one of our customer's team!
Scope:
Building a new customer account reporting engine to (over the coming years) replace an existing legacy customer account reporting solutions across our home markets. A pre-requisite is that we consolidate all account and payment transaction data in the bank to Hadoop, so we have dozens of data formats and integration points both upstream and downstream. The project has two delivery streams: CA that deliver new reports to Corporate customers in ISO XML format and CBP that will deliver old legacy reports to all 10M customers in the Nordics.
Responsibilities:
As an expert Big Data Developer you will be responsible for a successful design and implementation of a high-performing, flexible, robust, scalable and easily maintainable global reporting solution for the Bank.
Required skills/competencies
Hadoop; Hive; Impala; Kafka; Splunk
Other skills/competencies:
Scope:
Building a new customer account reporting engine to (over the coming years) replace an existing legacy customer account reporting solutions across our home markets. A pre-requisite is that we consolidate all account and payment transaction data in the bank to Hadoop, so we have dozens of data formats and integration points both upstream and downstream. The project has two delivery streams: CA that deliver new reports to Corporate customers in ISO XML format and CBP that will deliver old legacy reports to all 10M customers in the Nordics.
Responsibilities:
As an expert Big Data Developer you will be responsible for a successful design and implementation of a high-performing, flexible, robust, scalable and easily maintainable global reporting solution for the Bank.
Required skills/competencies
Hadoop; Hive; Impala; Kafka; Splunk
Other skills/competencies:
- Deep understanding of the principles of distributed systems
- Knowledge and experience with Apache Hadoop, Hive, Oozie, Pig, Sqoop, Impala, Kafka
- Experience with NoSQL databases: MongoDB, Cassandra, HBase or similar
- Experience with building ETL/ETL pipelines
- Production experience with performance tuning of Hadoop/Spark solutions
- Familiar with OOD and design patterns
- Experience from large-scale system integration projects
- Working with RDBMS and knowledge of SQL
- Integration towards RESTful and SOAP/OSB-services
- Knowledge and experience with web servers such as Tomcat, Jetty or Weblogic
- Knowledge and experience with tools like Maven, Git, and the Atlassian suite (Stash/Bitbucket, Jira, Confluence)
- Hands-on experience with Redhat, Linux shell scripting
- Hands-on experience with writing Apache Spark-based applications in Scala
- 7+ years of software development
We provide an attractive benefit packet:
- life insurance
- sports card
- private medical care
- English lessons
Check our social media:
https://www.facebook.com/jit.team.poland/
https://www.instagram.com/jit.team/?hl=pl