Talent.com
Paxus - Technology + Digital Talent
Data Product Development Data Engineer | NV1+Paxus - Technology + Digital Talent • Melbourne, AU
Data Product Development Data Engineer | NV1+

Data Product Development Data Engineer | NV1+

Paxus - Technology + Digital Talent • Melbourne, AU
4 days ago
Job description

Data Product Development Data Engineer | NV1+

Melbourne preferred | On-site 3-5 days per week | NV1 minimum

We are seeking an experienced Data Product Development Data Engineer to join a large and complex Federal Government data engineering environment.

This role is focused on taking raw data brought into a central data platform, conforming and integrating datasets, developing transformation logic and building reusable data products.

You'll work extensively with Apache Spark, Python, Apache NiFi, Apache Iceberg and Azure DevOps, developing scalable data solutions within a secure enterprise environment.

What you'll be doing

  • Build and maintain data engineering solutions within a large enterprise data platform.
  • Transform and conform raw data into structured, reusable datasets.
  • Integrate multiple datasets to develop data products.
  • Develop distributed data processing solutions using Apache Spark and Python.
  • Build and maintain integration workflows using Apache NiFi.
  • Work with Apache Iceberg to support modern data storage and processing.
  • Use Azure DevOps for source control and engineering delivery.
  • Develop and optimise transformation and integration logic.
  • Troubleshoot and enhance existing data engineering solutions.
  • Work with platform, engineering and technical stakeholders to turn data requirements into working solutions.

What you'll need

Mandatory:

  • At least 1 year of Apache Spark experience using Python.
  • At least 1 year of Azure DevOps experience.
  • At least 1 year of Apache NiFi experience.
  • Experience with Apache Iceberg.
  • Current NV1 security clearance or higher.
  • Ability to work on-site 3-5 days per week.

Highly regarded:

  • NV2 clearance.
  • Melbourne-based.
  • Cloudera exposure.
  • Microsoft SQL Server experience.
  • Azure Cloud experience.

Why consider this opportunity?

This is an opportunity to work within a significant enterprise data platform and focus on the engineering work that turns raw data into usable, integrated data products.

The role would suit an experienced Data Engineer who enjoys solving complex data problems, working with modern distributed processing technologies and building practical data solutions.

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability.

#J-18808-Ljbffr

Create a job alert for this search

Data Product Development Data Engineer | NV1+ • Melbourne, AU

Similar jobs

Data Engineer (Denodo) - Virtualized SAP Data

Clicks IT RecruitmentMelbourne, AU

A leading consultancy firm in Australia is seeking a Data Engineer specializing in Denodo to join their high-impact data platforms team.The role involves designing virtualized data models, integrat... Show more

 • Promoted

Senior Data Engineer: Scalable Pipelines, dbt & Kubernetes

FDJ UNITEDMelbourne, AU

A reputable gaming company in Melbourne is seeking a Senior Data Engineer to deliver robust data solutions and support analytics teams.The ideal candidate will have extensive experience with data e... Show more

 • Promoted

Google Data Engineer - GCP

NCS Group AustraliaMelbourne, AU

This role is responsible for building and scaling the massive, reliable data infrastructure that powers critical decisions, product features, and advanced analytics across our organization—impactin... Show more

 • Promoted

Data Engineer

KoganSouth Melbourne, VIC, AU

Australian eCommerce, and the software we build is used by millions of customers every day.You'll join a fast-moving engineering team with real ownership, shipping to production daily and using AI ... Show more

Data Engineer - Azure Databricks

CareCone GroupMelbourne, AU

Interested candidate can share share their resume at rahul. Show more

 • Promoted

Data Platform Engineer

University of MelbourneMelbourne, AU

Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.University of Melbourne provided pay range.This range is provided by University of Melbourne.Your actu... Show more

 • Promoted

Data Engineer

AmpstekMelbourne, AU

Software Engineer (Python) – Analytics Platform Team (open to remote across ANZ).Be among the first 25 applicants.Hands‑on with advanced SQL, Python etc.Hands‑on in working on Cloud like Azure and ... Show more

 • Promoted

Remote Data Engineer: PySpark, Databricks & SaaS Pipelines

Halo Labs Pty LtdMelbourne, AU
Remote

A data solutions firm based in City of Melbourne is seeking a skilled data engineer to design and implement scalable data pipelines across Azure and AWS environments.The ideal candidate will have e... Show more

 • Promoted

Data Engineer: Onboarding & Automation for Defence

WhizdomMelbourne, AU

Whizdom is seeking a skilled Data Engineer to support sensitive internal investigations for a federal government department.This full-time role involves onboarding data to an Enterprise Data Platfo... Show more

 • Promoted

Senior Data Engineer

UniSuperMelbourne, AU

At UniSuper, we exist to deliver strong retirement outcomes for our members.We bring people together around a shared purpose and take pride in being a high-performing, collaborative and forward-loo... Show more

 • Promoted

Senior Observability Engineer - Hybrid Data-Driven Platform

FurōMelbourne, AU

A dynamic tech startup based in Melbourne is seeking a Senior Observability Engineer for a 6-month contract.This role involves designing and implementing observability solutions using Datadog, work... Show more

 • Promoted

Integration & Data Engineer (On Site)

Hyperware ConsultingMelbourne, AU

We are seeking an experienced Data Integration Engineer for a short-term role with the opportunity for full-time employment for the right candidate.The successful candidate will be required to work... Show more

 • Promoted

Data Engineer

Virginia Polytechnic Institute and State University (VT)Melbourne, AU

The Simonds story all started in 1949 with a passionate family man, Gary Simonds.He envisioned a builder that Australians could rely on to guide them through the process of crafting their perfect h... Show more

 • Promoted

Lead Engineer

Plus Also StudiosMelbourne, AU

Plus Also Studios is a creative technology business from Howatson+Company that helps clients embrace technology and refocus their marketing investment on the high value strategic tasks that drive t... Show more

 • Promoted

Data Engineer

DownerMelbourne, AU

Reporting to the Data Analytics and Reporting Manager and working closely with the project team, you will play a pivotal role in driving data ingestion, modelling, and maintenance pipelines within ... Show more

 • Promoted

Senior Data Engineer

FujitsuMelbourne, AU

We use technology to make happier lives.We are a global leader in technology and business solutions that transform organisations and the world around us.We have a long heritage of bringing innovati... Show more

 • Promoted

Senior Product Development Engineer

Daniels HealthMelbourne, AU

Our story began with a passionate idea that we could change the world.And to be honest, we’ve never stopped believing that.In 1986 it was a simple concept that microbiology teamed with innovation a... Show more

 • Promoted

Senior Data Engineer: Build Scalable Analytics Pipelines

BlinqMelbourne, AU

A forward-thinking technology company in Melbourne is seeking a Senior Data Engineer to manage its data analytics infrastructure.In this role, you'll be responsible for driving data quality, suppor... Show more

 • Promoted

Principal Data Engineer

Professional Search GroupDocklands, VIC, AU

Lead AI & Data Platform Engineer.Lead AI & Data Platform Engineer.In this role, you will bridge the gap between advanced Data Engineering and production-grade MLOps, designing resilient, pe... Show more

Software Development Engineer - Search Platform

Rome2RioMelbourne, AU

Software Development Engineer - Search Platform.Software Development Engineer - Search Platform.Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Rome... Show more