Talent.com
Tata Consultancy Services
kafka ArchitectTata Consultancy Services • Melbourne, AU
kafka Architect

kafka Architect

Tata Consultancy Services • Melbourne, AU
30+ days ago
Job description

Job Description

Roles and Responsibilities

  • Design, deploy, and operate Apache Kafka / Confluent Platform / Confluent Cloud in large-scale, distributed environments.
  • Define and implement Kafka broker architecture, Schema Registry, Kafka Connect, and consumer group strategies.
  • Establish eventing standards, schema governance, topic naming conventions, retention policies, and platform guardrails.
  • Drive enterprise event-driven architecture (EDA) adoption beyond Kafka infrastructure (event design, patterns, and contracts).
  • Event-Driven Design & Stream Processing
  • Lead event-driven use case design and implementation, collaborating with domain and application teams.
  • Design and build stream processing applications using Flink, Kafka Streams (KStreams) or equivalent frameworks (Spark Streaming, Google Dataflow, etc.).
  • Support real-time data processing, enrichment, aggregation, and stateful streaming use cases.
  • Deploy and manage Kafka and streaming workloads on Kubernetes (GKE preferred; AKS/EKS acceptable).
  • Use Helm, Kustomize, and Kubernetes Operators for repeatable and scalable deployments.
  • Integrate Kafka platforms with cloud-native services such as compute, storage, and messaging systems.
  • Security, Access Control & Compliance
  • Design and enforce platform and data security controls, including ACLs / RBAC, TLS/mTLS, certificate management, and secrets management.
  • Implement cloud IAM, Secret Manager, and Cloud KMS (or equivalent AWS/Azure services).
  • Embed code and infrastructure security using tools such as Snyk, SonarQube, Nexus, Trivy.
  • Observability, Reliability & Operations
  • Build and operate monitoring and observability solutions (New Relic, Sumo Logic, or similar tools such as Splunk, Datadog, AppDynamics).
  • Support incident triage, root‑cause analysis, capacity planning, and performance tuning.
  • Define SLOs, SLIs, and operational runbooks for Kafka and streaming platforms.
  • DevOps, Automation & CI/CD
  • Develop Infrastructure as Code (IaC) using Terraform.
  • Implement and maintain CI/CD pipelines using GitLab CI or equivalent tooling (GitHub Actions, Jenkins, ArgoCD, Harness).
  • Automate platform operations and validations using Shell/Bash and Python.
  • Consulting & Enablement
  • Act as a Kafka subject‑matter expert, mentoring teams and reviewing solution designs.
  • Provide architectural guidance during solution design, reviews, and production readiness assessments.
  • Collaborate with enterprise architects, security teams, and SRE/DevOps functions.

Desired Competencies (Technical/Behavioral)

Must‑Have

  • Kafka & Eventing (Intermediate – Advanced)
  • Schema Registry, Kafka Connect, Consumer Groups
  • Confluent Platform / Confluent Cloud
  • Event‑driven architecture standards and governance
  • Stream Processing (Intermediate)
  • Experience operating real‑time streaming applications
  • GKE / AKS / EKS
  • Security & Access Controls (Must Have)
  • ACLs, RBAC
  • OAuth 2.0, TLS/mTLS
  • Certificate and secrets management

Observability & Monitoring (Must Have)

  • New Relic, Sumo Logic, or equivalent tools
  • Messaging Systems (Intermediate)
  • GCP Pub/Sub or AWS SQS / Azure messaging / JMS
  • Infrastructure as Code
  • Terraform
  • CI/CD & Containerisation
  • GitLab CI or equivalent
  • Docker

Good‑to‑Have

  • Prior experience in enterprise integration, supply chain, retail, or logistics domains
  • Exposure to multi‑region, high‑throughput Kafka deployments
  • Confluent, Kubernetes, or Cloud certifications

Attractive Compensation & Rewards

We offer a highly competitive salary package aligned with the Australian market, complemented by performance‑based incentives, recognition programs, and comprehensive employee benefits. Your achievements are celebrated, and your contributions truly matter.

Equal Opportunity Employer

TCS is an equal opportunity employer. All qualified applicants will be considered without regard to race, colour, religion, gender, gender identity, sexual orientation, national origin, disability, veteran status, or any other characteristic protected by applicable law.

Note: Compensation details are accurate as of this posting and may be adjusted in line with Australian laws and market conditions. Applicants may be asked to attend interviews in person or via video conference and present valid identification during the process.

#J-18808-Ljbffr

Create a job alert for this search

Kafka Architect • Melbourne, AU

Similar jobs

Azure Integration Architect – Landing Zone & CAF Expert

NCS Group AustraliaMelbourne, AU

A leading technology services firm is seeking a Senior Azure Integration Engineer for a 3-month contract in Melbourne.In this role, you will lead Azure readiness assessments and design Azure Landin... Show more

 • Promoted

Enterprise Architect

Michael PageMelbourne, VIC, AU

Fixed-term contract with the potential for career growth and development.Our client is a well-established not-for-profit organisation committed to making a meaningful difference in the community.As... Show more

Digital Architect

DuluxGroupMelbourne, AU

Digital Architect – DuluxGroup.Direct message the job poster from DuluxGroup.DuluxGroup is a leading marketer and manufacturer of premium brands that help people create better spaces to live and wo... Show more

 • Promoted

Responsys Digital Journeys Architect

World Vision AustraliaMelbourne, AU

A global humanitarian organization is seeking a Digital Communications Specialist based in Melbourne.This role involves building and optimizing digital journeys using Oracle Responsys across email,... Show more

 • Promoted

Data Architect – Hybrid Melbourne, Lead Architecture

VAT TalentMelbourne, AU

A specialist IT staffing firm is seeking an experienced Data Architect for a contract opportunity in Melbourne.The role involves driving architectural direction, governance, and maintaining documen... Show more

 • Promoted

EL1 Enterprise Architect, Data Standards Body

Commonwealth TreasuryMelbourne, AU

Join the Data Standards Body (DSB) in delivering high‑quality regulatory standards for Australia’s Digital ID System and the Consumer Data Right (CDR) frameworks.The DSB is part of Treasury’s Digit... Show more

 • Promoted

Identity Architect

Jenny Barbour IT and Project RecruitmentMelbourne, AU

Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Jenny Barbour IT and Project Recruitment.We are seeking an experien... Show more

 • Promoted

Solution Architect

Hexagon Autonomy & PositioningMelbourne, VIC, AU

As a Solution Architect you will play a key role in the technical leadership of Hexagons solution’s delivery.You will work with internal stakeholders and customer’s to provide solution design, deli... Show more

Enterprise Architect

Bendigo BankMelbourne, AU

We’ve never been ‘just a bank’.Just like you should never be ‘just an employee’.We’re united in our belief that in banking, better can be bigger, and together we’re making it happen.As an Enterpris... Show more

 • Promoted

Solutions Architect

Lovisa Pty LtdMelbourne, AU

Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.We are a fashion-forward jewellery brand that caters to anyone and everyone, with over 150 new styles ... Show more

 • Promoted

EL1 Azure Cloud (FullCAM) Application Architect

Softtest pays pty ltdMelbourne, Victoria, Australia
Quick Apply

Australian Citizens residing in Australia with Baseline Clearance only respond.The Department is seeking an experienced Application Architect / Technical Lead to play a pivotal role in the modernis... Show more

Senior Kafka Architect (Contract) – Melbourne

Hastha SolutionsMelbourne, AU

Hastha Solutions is seeking an experienced Kafka Architect for an urgent contract position in Melbourne, requiring 12 to 18 years of experience in Java and Spring Boot.The ideal candidate will have... Show more

 • Promoted

Enterprise Architect- Rise - Melbourne

The Body ShopSouthbank, VIC, AU

At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you.We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to h... Show more

Enterprise Architect- Rise - Melbourne

SAPMelbourne, AU

At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you.We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to h... Show more

 • Promoted

Solution Architect

EnergyAustraliaMelbourne, AU

Solution Architect – Trading & Operations.Reporting into the Enterprise Architect – Trading, the Solution Architect will provide solution leadership and advisory, develop and implement solutions al... Show more

 • Promoted

Senior Pega LSA Architect | 10+ yrs | Cloud/Kubernetes

ITbilityMelbourne, AU

A leading IT consulting firm is seeking a Melbourne Pega LSA Consultant who is CLSA certified on 8.The role requires understanding and breaking down user stories into tasks, guiding a team, and cre... Show more

 • Promoted

Enterprise Architect

ALOIS AustraliaMelbourne, AU

The EUC & EUT Enterprise Architect is responsible for designing, governing, and optimizing the End User Computing and End User Technology landscape across the organization.This role ensures that al... Show more

 • Promoted

Knowledge Platform Architect

Cbus Super FundMelbourne, AU

A leading superannuation fund in Melbourne is seeking a Knowledge Management Specialist to design and implement a cloud-based platform.The ideal candidate will have experience in Knowledge Manageme... Show more