Kafka Specialist

We are seeking an experienced Technology Specialist - Kafka to design, administer, automate, secure, and optimise enterprise Kafka platforms supporting mission-critical banking applications.

This role is responsible for ensuring the stability, scalability, resilience, and security of Kafka environments while driving automation, DevOps best practices, and cloud adoption.

The successful candidate will combine deep Kafka platform engineering expertise with Linux administration, Infrastructure-as-Code, observability, and cloud engineering to deliver highly available event streaming infrastructure that supports modern banking systems and real-time data integration.

Key Responsibilities

Kafka Platform Administration

• Install, configure, upgrade, patch and maintain enterprise Kafka clusters.
• Administer Confluent Platform and/or Confluent Cloud environments.
• Manage brokers, topics, partitions, replication and consumer groups.
• Optimise Kafka cluster performance, throughput and latency.
• Perform capacity planning and scaling of Kafka infrastructure.
• Troubleshoot broker failures, replication issues and performance bottlenecks.
• Support production incidents and perform root cause analysis.

Platform Engineering

• Design highly available Kafka platforms across multiple environments.
• Implement resilient architectures for business-critical messaging workloads.
• Configure multi-broker clusters with appropriate replication and fault tolerance.
• Support disaster recovery and high availability strategies.
• Maintain platform documentation and operational runbooks.

DevOps & Automation

Develop and maintain automation to reduce manual operational effort.

Responsibilities include:

• Infrastructure as Code
• Platform provisioning
• Automated deployments
• Configuration management
• CI/CD integration
• Environment standardisation

Typical technologies include:

• Terraform
• Ansible
• Python
• Bash
• Azure DevOps
• Git

Linux Platform Administration

Provide specialist Linux administration supporting Kafka infrastructure.

Responsibilities include: