Junior Big Data Operations Engineer
Data
Junior Big Data Operations Engineer
Commerzbank AG
Łódź
Type of work
Undetermined
Experience
Junior
Employment Type
Permanent
Operating mode
Office
Tech stack
Linux
Unix
SQL
Databases
Scheduling tools
Kubernetes
Docker
Applications Servers
Hadoop
HDP
Job description
Online interview
Main tasks:
- Working in cross-functional cells and deep involvement in the development process from the beginning in order to support the cell in implementing operational requirements such as monitoring, traceability and resilience
- Daily monitoring of production processes and incidents, taking the necessary measures and responsible coordination of problem solving in the cell and beyond the cluster and the key area
- Responsibility for technical users and all configuration items related to your product in prelive and production
- Installation and configuration of the dedicated applications in prelive and production and rollout of increments using our continuous integration and continuous deployment environment
What we expect from you:
- Linux/Unix and shell scripting - good knowledge
- SQL / Databases - good knowledge
- Scheduling tools (like Cron, UC4 or similar)
- Experience with cloud solutions such as e.g. GCP – Google Cloud Platform (preferred), AWS, Azure or Kubernetes
- Experience with Applications Containers like Docker, Docker Compose and Docker-Swarm
- Experience with Applications Servers, e.g. Tomcat, Jetty
- Readiness for business travels to Germany (few trips within first months due to gain training)
Nice to have:
- Experience with Hadoop ecosystem or willingness to learn
- Cloudera or Hortonworks Data Platform (HDP)
- Monitoring tools experience such as Grafana, Nagios, Zabbix, Prometheus
- CI/CD tools, e.g. Jenkins, TeamCity
- Version Control tools, e.g. GIT (preferred), SVN
- Jira, Bitbucket, Confluence
- Knowledge of ITIL processes (certificates is an advantage but no required)
- Data quality topics - practical experience
- Python, PySpark, Java/Scala
- Spark/Beam