Talent.com
Principal Data Engineer
Principal Data EngineerPromote Project • Australia
Principal Data Engineer

Principal Data Engineer

Promote Project • Australia
30+ days ago
Job description

Principal Data Engineer

Salary

£70,000 - £90,000 a year

Job Type

Remote job

Hi, we’re Smoove, part of the PEXA Group.

Our vision is to simplify and revolutionise the home moving and ownership experience for everyone. We are on a mission to deliver products and services that remove the pain, frustration, uncertainty, frictionand stress that the current process creates.

We are a leading provider of tech in the property sector – founded in 2003, our product focus has been our conveyancer two-sided marketplace, connecting consumers with a range of quality conveyancers to choose from at competitive prices via our easy-to-use tech platform. We are now building out our ecosystem so consumers can benefit from our services either via their Estate Agent or their Mortgage Broker, through smarter conveyancing platforms, making the home buying or selling process easier, quicker, safer and more transparent.

Why join Smoove?

Great question! We pride ourselves on attracting, developing and retaining a diverse range of people in an equally diverse range of roles and specialisms – who together achieve outstanding results. Our transparent approach and open-door policy make Smoove a great place to work and as our business expands, we are looking for ambitious, talented people to join us.

Cloud delivery model

We are seeking an experienced Principal Data Engineer to define, lead, and scale the technical strategy of our data platform. This is a senior, hands‑on leadership role at the intersection of architecture, governance, and engineering excellence, where you will shape how data is collected, processed, and delivered across the organisation.

You will own the end‑to‑end quality, performance, and scalability of our data systems – from raw ingestion through to trusted datasets powering business‑critical analytics and reporting. This includes setting standard and influencing the strategic roadmap for data infrastructure.

Our stack is built on both AWS and Azure, using Databricks across data domains and you will lead the evolution of this ecosystem to meet future business needs.

You’ll ensure that data is secure, compliant, discoverable, and business‑ready, enabling analysts, data scientists, and stakeholders to make confident, data‑driven decisions.

This role is ideal for a highly technical leader who thrives at both the strategic and execution levels : someone equally comfortable defining architecture with executives, mentoring senior engineers, and optimising distributed pipelines at scale.

Role Responsibilities

  • Design and oversee scalable, performant, and secure architectures on Databricks and distributed systems.
  • Anticipate scaling challenges and ensure platforms are future‑proof.
  • Lead the design and development of robust, high‑performance data pipelines using PySpark and Databricks.
  • Define and ensure testing frameworks for data workflows.
  • Ensure end‑to‑end data quality from raw ingestion to curated, trusted datasets powering analytics.
  • Establish and enforce best practices for data governance, lineage, metadata, and security controls.
  • Ensure compliance with GDPR and other regulatory frameworks.
  • Act as a technical authority and mentor, guiding data engineers.
  • Influence cross‑functional teams to align on data strategy, standards, and practices.
  • Partner with product, engineering, and business leaders to prioritise and deliver high‑impact data initiatives.
  • Build a culture of data trust, ensuring downstream analytics and reporting are always accurate and consistent.
  • Evaluate and recommend emerging technologies where they add value to the ecosystem.

Skills & Experience Required

  • Broad experience as a Data Engineer including technical leadership.
  • Broad cloud experience, ideally both Azure and AWS.
  • Deep expertise in PySpark and distributed data processing at scale.
  • Extensive experience designing and optimising in Databricks.
  • Advanced SQL optimisation and schema design for analytical workloads.
  • Strong understanding of data security, privacy, and GDPR / PII compliance.
  • Experience implementing and leading data governance frameworks.
  • Proven experience leading the design and operation of a complex data platform.
  • Track record of mentoring engineers and raising technical standards.
  • Ability to influence senior stakeholders and align data initiatives with wider business goals.
  • Strategic mindset with a holistic view of data reliability, scalability, and business value.
  • Sound like you?

    We at Smoove are ready so if this role sounds like you, apply today.

    To be conducted as part of post offer employment checks : The personal information we have collected from you will be shared with Cifas who will use it to prevent fraud, other unlawful or dishonest conduct, malpractice, and other seriously improper conduct. If any of these are detected, you could be refused certain services or employment. Your personal information will also be used to verify your identity. Further details of how your information will be used by us and Cifas, and your data protection rights, can be found at https : / / pexa.co.uk / applicant-policy / .

    GDPR Compliance Digital Completion UK Limited (trading name “PEXA”), Optima Legal Services Limited (trading name "Optima Legal") and Smoove Limited (a holding company which comprises of the following wholly owned trading subsidiary companies : United Legal Services Limited, United Home Services Limited, Legal-Eye Limited, and Amity Law Limited) are all owned directly by DigCom UK Holdings Limited, which is a wholly owned subsidiary of PEXA Group Limited in Australia (ACN 140 677 792; ASX : PXA) (referred to collectively as “PEXA Group”). When we process your applicant personal data for recruitment purposes, we do so as a controller. If as part of the recruitment process, we share your personal data with another company within the PEXA Group, that company may process your personal data as either an independent controller or, in certain circumstances, a joint controller. By applying for this role, you consent to us processing your personal data in accordance with the UK General Data Protection Regulation ("UK GDPR") and the Data Protection Act 2018, and further information can be found in our privacy notice https : / / pexa.co.uk / applicant-policy / .

    Please mention the word WISELY and tag RMjYwMDoxZjFjOmU6MjMwNTo0MWRlOmQyM2Y6YzQzOTo3MjM3 when applying to show you read the job post completely (#RMjYwMDoxZjFjOmU6MjMwNTo0MWRlOmQyM2Y6YzQzOTo3MjM3). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're human.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Data Engineer • Australia

    Similar jobs
    Senior Data Engineer

    Senior Data Engineer

    Theresolutionlawgroup • Australia
    View below the job description in addition to the application form.Join our dynamic team as a Manager, Engineering, where you’ll play a pivotal role in leading and inspiring our talented engineerin...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ResellPress • Australia
    View below the job description in addition to the application form.Join our dynamic team as a Manager, Engineering, where you’ll play a pivotal role in leading and inspiring our talented engineerin...Show more
    Last updated: 30+ days ago • Promoted
    Data engineer

    Data engineer

    Centelonsolutions • Australia
    Centelon is a modern, young technology company that carries an unflinching passion to help clients innovate, adapt and succeed. We are a business-technology products, solutions and services company....Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Warehouse Engineer, Big Data

    Senior Data Warehouse Engineer, Big Data

    Binance • Australia
    Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 280 million people in 100+ countrie...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer - Cloud-Native Pipelines & Analytics

    Data Engineer - Cloud-Native Pipelines & Analytics

    Insighture Pty • Australia
    A leading technology consultancy is seeking a motivated Data Engineer to join their team in Australia.The ideal candidate will have strong expertise in building and maintaining data pipelines, part...Show more
    Last updated: 16 days ago • Promoted
    Principal Data & AI Platforms Engineer-Perth or Brisbane

    Principal Data & AI Platforms Engineer-Perth or Brisbane

    BHP Group • Australia
    Principal Data & AI Platforms Engineer-Perth or Brisbane.Job State / Province : Western Australia.At BHP we support our people to grow, learn, develop their skills and reach their potential.With a glo...Show more
    Last updated: 5 days ago • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    Twine • Australia
    This role offers the opportunity to design, build, and maintain advanced ELT pipelines within a dynamic cloud-based environment. You will be responsible for ensuring the reliability, scalability, an...Show more
    Last updated: 15 days ago • Promoted
    Data Engineer

    Data Engineer

    Cloudwerx • Australia
    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Cloudwerx.Cloudwerx is a modern Salesforce, Snowflake & AI consultancy founded in 2018 to do things ...Show more
    Last updated: 30+ days ago • Promoted
    Junior Data Engineer

    Junior Data Engineer

    ZENTRO HIRING • Australia
    Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Junior Data Engineer (Remote / Hybrid). We’re looking for a motivated and detail-oriented.This entry-le...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EV World Africa • Australia
    View below the job description in addition to the application form.Join our dynamic team as a Manager, Engineering, where you’ll play a pivotal role in leading and inspiring our talented engineerin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Career Success Australia • Australia
    Data Engineers are in high demand, so an Internship in this particular stream of data science is a terrific way to start your career. Through this Data Engineer Internship, you will learn a wide ran...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Thepetloom • Australia
    Join our dynamic team as a Manager, Engineering, where you’ll play a pivotal role in leading and inspiring our talented engineering professionals. As a key driver of success, you’ll oversee project ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer : Cloud, Data & AI Solutions

    Data Engineer : Cloud, Data & AI Solutions

    Cloudwerx • Australia
    A leading data consultancy in Australia is seeking multiple Data Engineers with strong cloud-based data engineering experience. Contributors will design, build, and implement scalable data solutions...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Heart Foundation Group • Australia
    About Us – Have a Heart for Change!.At the Heart Foundation, we believe everyone deserves a healthy heart.Heart disease is still the nation’s number one cause of death, and since 1959 we’ve led the...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - ELT Pipelines (Snowflake, Airflow, dbt)

    Data Engineer - ELT Pipelines (Snowflake, Airflow, dbt)

    Twine • Australia
    A leading freelance marketplace is seeking a Data Engineer to design, build, and maintain advanced ELT pipelines in a cloud-based environment. Responsibilities include managing legacy and modern dat...Show more
    Last updated: 15 days ago • Promoted
    Data Engineer, AI-Driven Consumer Products

    Data Engineer, AI-Driven Consumer Products

    Bain & Company • Australia
    A global consultancy is looking for a Data Engineer to enhance their analytics solutions.This role entails collaborating across teams to build scalable backend systems, optimizing databases, and de...Show more
    Last updated: 28 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Cybernetix • Australia
    Join our dynamic team as a Manager, Engineering, where you’ll play a pivotal role in leading and inspiring our talented engineering professionals. As a key driver of success, you’ll oversee project ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data & AI Platform Engineer

    Senior Data & AI Platform Engineer

    BHP Group • Australia
    A leading resources company in Australia is seeking a Principal Data & AI Platforms Engineer.This role involves engineering scalable data and AI solutions, collaborating across teams, and maintaini...Show more
    Last updated: 5 days ago • Promoted