Talent.com
Lead Data Engineer

Lead Data Engineer

IngrityCouncil of the City of Sydney, New South Wales, Australia
30+ days ago
Job description

Overview

We’re looking for an experienced Lead Data Engineer to shape, deliver, and optimise data solutions on Google Cloud Platform. This is a hands-on leadership role where you’ll combine deep technical expertise with solution design and team guidance, working closely with both engineering peers and business stakeholders.

You’ll play a key role in building high-performing data platforms, architecting new features, and ensuring that best practices in data engineering are consistently applied.

What You'll Be Doing

  • Lead and support a team of engineers, guiding design, architecture, and delivery.
  • Own projects end-to-end — from planning to execution — ensuring solutions meet both technical and business goals.
  • Build, optimise, and maintain data pipelines and platform features leveraging GCP technologies.
  • Write, review, and test high-quality Python code, ensuring scalability and reliability.
  • Contribute to solution design, technical patterns, and system architecture for cloud-based data environments.
  • Manage deployments in containerised and clustered environments (Docker, Kubernetes).
  • Collaborate with operational and business stakeholders, translating requirements into scalable technical solutions.
  • Apply strong knowledge of SQL, data modelling, and big-data querying tools (BigQuery, Hive, Spark, Presto, Redshift, etc.).
  • Implement orchestration frameworks such as Airflow or Argo Workflows to manage pipelines.
  • Maintain source control and CI / CD practices (Bitbucket, GitHub, or similar).
  • Apply security best practices across all data engineering workflows.

What You'll Bring

  • Proven experience leading or mentoring engineering teams, with a track record of delivery in complex projects.
  • Strong hands-on programming ability in Python and comfort reviewing others’ code.
  • Expertise in SQL and database design, including complex queries and DDL.
  • Solid experience with GCP data services (BigQuery, Dataflow, Pub / Sub, Dataform, Cloud Storage).
  • Familiarity with modern architecture patterns, API integrations, and data platforms.
  • Experience deploying and operating solutions in containerised / cloud environments (Docker, Kubernetes).
  • Comfort working in Linux / Unix environments.
  • Exposure to security, compliance, and governance practices in cloud data systems.
  • Background in high-data-volume industries such as financial services, energy, or enterprise environments (highly regarded).

    • Why Join Us

  • Influence and shape the technical direction of modern, cloud-driven data platforms.
  • Collaborate with enterprise and mid-market clients on high-impact projects.
  • Work in an environment that values technical excellence, growth, and accountability.
  • Lead a team while still keeping your hands on the code.

    • Sydney, Australia

    Must hold full Australian working rights

    Seniority level

  • Mid-Senior level

    • Employment type

  • Contract

    • Job function

  • Other

    • Industries

  • Software Development

    • Referrals increase your chances of interviewing at Ingrity by 2x

    Get notified about new Data Engineer jobs in Sydney, New South Wales, Australia .

    #J-18808-Ljbffr

    Create a job alert for this search

    Lead Data Engineer • Council of the City of Sydney, New South Wales, Australia