Role Summary
The Senior Kafka Administrator / Developer will design, build, operate and improve enterprise Kafka and event-streaming platforms across AWS and Kubernetes, including Amazon EKS. The role requires strong hands-on Kafka administration, integration development, cloud-native operations and production support experience.
The role works closely with application, integration, cloud, security and operations teams to deliver reliable event-driven solutions, resolve complex issues, automate repeatable tasks and support platform lifecycle, governance and service improvement activities.
Key Responsibilities
· Administer and support Kafka platforms, including brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and related services.
· Design and develop Kafka producers, consumers, stream-processing components and reusable integration patterns using Java, Spring Boot, Python or similar technologies.
· Deploy, operate and improve Kafka and supporting components on Kubernetes and Amazon EKS using Helm, CI/CD, GitOps and approved cloud-native patterns.
· Manage platform reliability, resilience, capacity, performance, patching, upgrades, backup, recovery and lifecycle activities across production and non-production environments.
· Troubleshoot complex issues across applications, brokers, connectors, schemas, networking, storage, certificates and cloud infrastructure.
· Implement monitoring, alerting and dashboards for broker health, throughput, latency, replication, disk usage, consumer lag and connector health.
· Apply security and governance controls, including TLS, authentication, authorisation, ACLs, secrets, certificates, least-privilege access and vulnerability remediation.
· Support incidents, problems, changes and releases, including root-cause analysis, runbook improvement and automation of recurring operational tasks.
· Guide application teams on topic design, partitioning, message contracts, schema evolution, retries, dead-letter handling, idempotency and supportability.
· Maintain architecture, configuration, operational, recovery and support documentation.
Technical Leadership
· Act as the senior technical point of contact for Kafka platform design, engineering and operational matters.
· Mentor engineers, review technical work and promote consistent engineering and operational standards.
· Lead planning for upgrades, migrations, resilience improvements and platform modernisation.
· Communicate risks, dependencies, options and recommendations clearly to technical and business stakeholders.
Key Skills & Experience
Technical Experience
· Strong hands-on experience administering Apache Kafka or Confluent Platform in complex enterprise environments.
· Solid understanding of Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and MirrorMaker.
· Experience developing Kafka producers, consumers and integration services using Java, Spring Boot, Python or equivalent technologies.
· Hands-on experience with Kubernetes and Amazon EKS, including Docker, Helm, storage, networking, ingress, secrets and identity integration.
· Working knowledge of AWS services such as EKS, EC2, S3, IAM, CloudWatch, Route 53 and core networking services.
· Experience with CI/CD, GitOps and Infrastructure as Code tools such as Jenkins, Argo CD, Terraform or CloudFormation.
· Strong Linux, networking, TLS, DNS, certificate and distributed-systems troubleshooting capability.
· Experience with observability tools such as Prometheus, Grafana, CloudWatch, Dynatrace, Splunk or equivalent.
Preferred Qualifications
Kafka Developer • Sydney, New South Wales, Australia
The role focuses on designing and delivering solutions across the Microsoft 365 ecosystem to help Australian businesses improve productivity, collaboration, and operational efficiency.It sits withi... Show more
Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Applicants will be expected to work at the AEC's.Hybrid working arrangements (i.AEC office and remote ... Show more
C# Developer (OOP) - Leading Quantitative Trading Firm.C# Developer (OOP) - Leading Quantitative Trading Firm.Get AI-powered advice on this job and more exclusive features.Direct message the job po... Show more
At Globant, we are working to make the world a better place, one step at a time.We enhance business development and enterprise solutions to prepare them for a digital future.With a diverse and tale... Show more
Senior Data architect - 6 Month contract.Senior Data architect - 6 Month contract.Senior Data architect - 6 Month contract.Be among the first 25 applicants.Senior Data architect - 6 Month contract.... Show more
Sydney | Hybrid | Up to $160K + Super (flexible to $170K + Super for exceptional candidates).Are you a Senior Java Engineer who thrives on complexity, loves solving deep technical problems, and wan... Show more
At Globant, we are working to make the world a better place, one step at a time.We enhance business development and enterprise solutions to prepare them for a digital future.With a diverse and tale... Show more
Salt has partnered with a global proprietary trading company that is looking for a.You will join Futures & Options Team and will have the chance to work closely with traders and the firm’s top tech... Show more
Get AI-powered advice on this job and more exclusive features.This range is provided by Tech Mahindra.Your actual pay will be based on your skills and experience — talk with your recruiter to learn... Show more
We are looking for a highly skilled Axiom Developer to join our Treasury Technology team supporting a major Australian banking program.The role will focus on designing, developing, enhancing, and s... Show more
Aristocrat is seeking a Game Designer focusing on mathematics for Class 3 Casino Games for Australian and global markets.Collaborate with designers and mathematicians to ensure high-quality game ma... Show more
The Apex Group was established in Bermuda in 2003 and is now one of the world’s largest fund administration and middle office solutions providers.Our business is unique in its ability to reach glob... Show more
A local government authority is seeking a Senior Cloud Systems Administrator to implement and support cloud solutions, primarily within the Azure ecosystem.The successful candidate will manage Micr... Show more
Unlock your potential with a prestigious opportunity alongside an award-winning, data-driven industry leader! A tremendous opportunity awaits a Data Architect to collaborate a highly respected team... Show more
Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Professional Services team at Squiz.You'll implement the Squiz DXP ensuring the technical solution is ... Show more
As a C# Developer in the Core Trading Technology Team, you will be involved in the analysis, design and development of applications in a Front Office trading environment.This software includes a co... Show more
NXT GIG is seeking an experienced and highly skilled SAP CRM ABAP Developer to join our dedicated technology team.In this role, you will be responsible for developing, enhancing, and maintaining AB... Show more
TheDriveGroup has partnered with a game-changing tech innovator aiming to disrupt the big players in a multi-billion-dollar industry.The company is committed to an exceptional workplace with a rich... Show more
Business Unit: Information & Digital Technology.Title: Senior Cloud Systems Administrator, Temporary - Full-time Role, 35 hours per week.Competitive Salary Package (subject to skills and experience... Show more
Rural Affinity is searching for a Compliance Officer to join on a 6-month contract in St Leonards, Australia.You will strengthen compliance frameworks, ensuring regulatory obligations are met while... Show more
%20INC.){kind=logo}
