DevOps Engineer

At Madiff, we connect top IT talent with cutting-edge companies through remote Agile teams and nearshore outsourcing. With operations in Poland, Portugal, France, and the UK, we specialize in AI, DevOps, Cybersecurity, supporting industries like Telecom, Banking, and Hi-Tech.

We are seeking a DevOps Engineer – Kafka Specialist to join a hybrid team in the banking sector. The role focuses on Kafka cluster management, DevOps automation, and production support for critical application environments.

You will be responsible for managing high-availability Kafka clusters, optimizing system performance, and supporting application deployments and infrastructure troubleshooting.

Main responsibilities:

1. Manage and maintain Kafka clusters in production environments
2. Monitor Kafka performance using tools like Burrow, identifying lags and bottlenecks
3. Configure topics, partitions, replication, and manage Zookeeper coordination
4. Deploy and configure Kafka infrastructure using Ansible
5. Collaborate with developers to support application releases and environment scaling
6. Coordinate with Cloudera support for Kafka-specific issues
7. Maintain and support MirrorMaker/SRM for cross-cluster replication
8. Support disaster recovery processes and participate in on-call rotations
9. Parse logs and integrate with tools such as Logstash
10. Work with cross-functional teams to optimize performance and stability

Requirements:

1. Proven experience operating Kafka clusters in production
2. Deep knowledge of Kafka internals: topics, partitions, replication, Zookeeper
3. Hands-on experience with Ansible for configuration management
4. Exposure to Cloudera Kafka distribution (preferred)
5. Knowledge of SQL
6. Experience with MirrorMaker/SRM for replication
7. Familiarity with Kafka monitoring and log processing tools
8. Willingness to support critical environments via on-call rotations
9. Effective communication and collaboration skills

What we offer:

1. Hybrid work model with one day per week on-site in Warsaw
2. Opportunity to work on mission-critical infrastructure in a leading banking organization
3. Collaboration with experienced infrastructure and development teams
4. Comprehensive medical care