DevOps Engineer – Kafka Specialist

At Madiff, we connect top IT talent with cutting-edge companies through remote Agile teams and nearshore outsourcing. With operations in Poland, Portugal, France, and the UK, we specialize in AI, DevOps, and Cybersecurity – supporting industries like Telecom, Banking, and Hi-Tech.

We are looking for a Kafka Infrastructure Engineer

to join a high-performing team focused on building and maintaining robust streaming infrastructure. You’ll be working on complex enterprise environments, ensuring the reliability and performance of Kafka-based platforms

that support key business applications and services.

Responsibilities:

• Manage and maintain high-availability Kafka clusters in production

• Monitor Kafka using tools like

  Burrow

  , identify lags and performance bottlenecks

• Handle

  topic configurations

  ,

  partitioning

  ,

  replication

  , and

  Zookeeper

  coordination

• Deploy and configure Kafka environments using

  Ansible

• Work with developers to support application releases and environment expansions

• Liaise with Cloudera support on Kafka-specific issues

• Maintain and support

  MirrorMaker/SRM

  for cross-cluster replication

• Support

  DR processes

  and participate in on-call rotations

• Log parsing and integration (e.g.

  Logstash

  )

• Collaborate with cross-functional teams to optimise performance and stability

Requirements

• Strong experience operating Kafka clusters in a production environment

• Knowledge of Kafka internals:

  topics, partitions, replication, Zookeeper

• Hands-on experience with

  Ansible

  for configuration management

• Exposure to

  Cloudera Kafka

  distribution (nice to have)

• Knowledge of

  SQL

• Experience with

  MirrorMaker/SRM

• Familiarity with

  log processing

  tools and

  Kafka monitoring

• Readiness to work on-call and support critical environments

• Good communication skills and ability to collaborate across teams

Benefits

• Hybrid work model

  – 1 day per week

  in the client's office in Warsaw

• Comprehensive medical care

• Solid, competitive salary.

• Work in multilingual, multinational and multicultural environment on international projects