Talent.com
Clicks IT Recruitment
Lead Data EngineerClicks IT Recruitment • Melbourne, AU
Lead Data Engineer

Lead Data Engineer

Clicks IT Recruitment • Melbourne, AU
14 days ago
Job description

Lead Data Engineer

QLD, WA, ACT, VIC, NSW, NT, SA, TAS

Until June 2027 with 12 months extension

Baseline Clearance Required

We are seeking an experienced Lead Data Engineer to play a key role in the development of a nationally significant AI and data capability focused on workforce, education and skills intelligence. Working within a multidisciplinary team of Data Scientists, Information Management specialists and policy experts, you will design, build and maintain scalable data and AI infrastructure that supports advanced analytics, machine learning, NLP and Generative AI solutions.

Key duties and responsibilities as a Lead Data Engineer:

  • Designing, developing and maintaining scalable data ingestion, transformation and processing pipelines for structured and unstructured data sources.
  • Applying modern data engineering practices to support the collection, preparation, cleansing, validation and integration of skills-related datasets.
  • Developing automated data quality, testing and validation capabilities that support reliable and reproducible analytical outcomes.
  • Designing and implementing repeatable validation pipelines that support the assessment, monitoring and quality assurance of AI and NLP model outputs.
  • Collaborating with Data Scientists to operationalise machine learning, NLP and Generative AI solutions within scalable production environments.
  • Developing and maintaining model-serving, deployment and API integration capabilities that support analytical products and downstream systems.
  • Implementing data governance, metadata management, lineage tracking and versioning practices to support transparency, traceability and reproducibility.
  • Developing and maintaining cloud-based and distributed data processing environments capable of supporting large-scale data and AI workloads.

Skills & Experience Essential

  • Demonstrated experience designing, building and maintaining scalable data pipelines and data platforms.
  • Strong expertise in data ingestion, transformation, automation and bulk processing workflows.
  • Experience working with cloud-based and distributed data environments.
  • Advanced Python development skills.
  • Proven experience deploying Machine Learning, NLP and/or Generative AI solutions into production environments.
  • Experience supporting end-to-end delivery of AI-enabled products and services.

Please note you will need to have an existing AGSVA Baseline security Clearance to apply for this role

At Clicks we embrace diversity, inclusion and equal opportunity. First Nations people are encouraged to apply.

We provide reasonable adjustments, including alternate formats to the recruitment process for individuals with a disability. If you require an adjustment to be made during the recruitment process, please call 1300 254 257 or emailadjustments@clicks.com.au

#J-18808-Ljbffr

Create a job alert for this search

Lead Data Engineer • Melbourne, AU

Similar jobs

Data Engineer

KoganSouth Melbourne, VIC, AU

Australian eCommerce, and the software we build is used by millions of customers every day.You'll join a fast-moving engineering team with real ownership, shipping to production daily and using AI ... Show more

Senior Data Engineer

UniSuperMelbourne, AU

At UniSuper, we exist to deliver strong retirement outcomes for our members.We bring people together around a shared purpose and take pride in being a high-performing, collaborative and forward-loo... Show more

 • Promoted

Senior Audit Data Engineer Lead

NABMelbourne, AU

A leading financial institution is seeking a Senior Audit Manager to lead a team of data professionals.You will ensure audit processes are backed by reliable, scalable data products.Ideal candidate... Show more

 • Promoted

Lead Engineer

Plus Also StudiosMelbourne, AU

Plus Also Studios is a creative technology business from Howatson+Company that helps clients embrace technology and refocus their marketing investment on the high value strategic tasks that drive t... Show more

 • Promoted

Data Engineer

Quantexa LimitedMelbourne, AU

It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can.Our technology started out in FinTech, helping tackle ser... Show more

 • Promoted

Data Engineer - Denodo

Clicks IT RecruitmentMelbourne, AU

Clicks IT Recruitment provided pay range.This range is provided by Clicks IT Recruitment.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.We are ... Show more

 • Promoted

Senior Lead, Data Analytics — Enterprise Data Leader

University of the Sunshine CoastMelbourne, AU

The University of the Sunshine Coast is seeking a Senior Lead, Data Analytics to enhance its enterprise data and analytics capability.This role involves leading data-driven initiatives and ensuring... Show more

 • Promoted

Data Engineer

DownerMelbourne, AU

Reporting to the Data Analytics and Reporting Manager and working closely with the project team, you will play a pivotal role in driving data ingestion, modelling, and maintenance pipelines within ... Show more

 • Promoted

Data Engineer - Cloud Pipelines & Enterprise Analytics

Virginia Polytechnic Institute and State University (VT)Melbourne, AU

Simonds is seeking a hands-on Data Engineer to design and evolve a modern data platform.You will build and maintain data integration pipelines, support cloud data initiatives and deliver high-quali... Show more

 • Promoted

Senior Data Engineer

FujitsuMelbourne, AU

We use technology to make happier lives.We are a global leader in technology and business solutions that transform organisations and the world around us.We have a long heritage of bringing innovati... Show more

 • Promoted

Senior Data Engineer

Vivanti ConsultingMelbourne, AU

We’re a growing global tech consultancy.Some of the world’s biggest businesses turn to us to help bring their data, AI, cloud and digital solutions to life.We’re the home base for talented technolo... Show more

 • Promoted

Data Engineer: Azure Databricks & ETL Pipelines

CareCone GroupMelbourne, AU

A technology solutions firm in Victoria, Australia is seeking candidates proficient in SQL for data wrangling, transformation, and analysis.Ideal applicants should have strong programming skills in... Show more

 • Promoted

Senior Data Engineer: Cloud Data Platform Expert

SlalomMelbourne, AU

Slalom is seeking a skilled Data Engineer in Melbourne, Australia.In this role, you will deliver innovative data solutions using AWS, Azure, and GCP, while collaborating with forward-thinking organ... Show more

 • Promoted

Principal Data Engineer

Professional Search GroupDocklands, VIC, AU

Lead AI & Data Platform Engineer.Lead AI & Data Platform Engineer.In this role, you will bridge the gap between advanced Data Engineering and production-grade MLOps, designing resilient, pe... Show more

Data Engineer

N2S.GlobalMelbourne, AU

Strong hands-on Python engineering skills, including production-grade code, modular design, testing, packaging, and modern tooling (uv/poetry, pydantic, FastAPI, async patterns).Practical AI engine... Show more

 • Promoted

Cloud Data Engineer for AI & Data Solutions

PractivMelbourne, AU

Were you the kid who never stopped asking 'why'? The one who took things apart just to see how they worked? If you've carried that curiosity into your data career, and now you don't just ask why, y... Show more

 • Promoted

Senior Data Engineer

FDJ UNITEDMelbourne, AU

Referrals increase your chances of interviewing at FDJ UNITED by 2x.Data Engineering pipeline design and implementation experience within a commercial environment.Deliver robust data solutions for ... Show more

 • Promoted

Lead Databricks & Azure Data Engineer

BI & DW AustraliaMelbourne, AU

BI & DW Australia is seeking a Databricks Engineer to start immediately for a major project.This role involves leading the technical delivery of end-to-end data projects, focusing on Microsoft's mo... Show more

 • Promoted

Data Engineer

Helfie.AIMelbourne, AU

Helfie is on a mission to redefine global preventative healthcare.We’re pioneering an entirely new operating system for human health – empowering billions with instant, affordable health checks and... Show more

 • Promoted

Data Engineer

WhizdomMelbourne, AU

Step into a role where your analytical mindset, investigative curiosity and commitment to national security truly matter.This full‑time position places you at the centre of sensitive, high‑impact w... Show more