Talent.com
Principal Data Engineer
Principal Data EngineerDeputy • Council of the City of Sydney, New South Wales, Australia
Principal Data Engineer

Principal Data Engineer

Deputy • Council of the City of Sydney, New South Wales, Australia
30+ days ago
Job description

Deputy is a global SaaS remote‑first workforce management company with hubs in Sydney, Melbourne, San Francisco and London, plus team members working remotely across the United States.

Our platform serves over 1.5 million workers and 375,000 workplaces across 100+ countries. We are backed by top global investors and recently achieved Unicorn status.

At Deputy, we’re improving the world of work, one shift at a time, for 80% of the world’s workforce : hourly workers. These are the dedicated employees who keep our world running – from baristas to nurses, cleaners to delivery drivers, florists to factory workers. Despite their vital role in society, most workplace technology has focused on those workers who sit behind a desk, but at Deputy, we transform the frontline. When businesses use Deputy, their workplaces thrive – the business is more profitable, compliant, and productive, while the workers are more engaged and happier at work.

If you’re passionate about creating solutions that put people first and helping businesses and their teams thrive, join us at Deputy and make an impact where it matters most!

The Role

At Deputy, our mission is to simplify shift work and create thriving workplaces. Data is at the heart of how we achieve this, powering everything from product innovation to exceptional customer experiences. We are looking for a Principal Data Engineer to be the technical cornerstone of our data team, leading the charge in building a scalable and reliable data platform that will support our next phase of growth.

This is a foundational, strategic role. You will have the autonomy to shape our data architecture, champion engineering best practices, and set the technical vision for how we use data across the company. This role is a perfect blend of hands‑on technical leadership and strategic influence, where you will not only build powerful data systems but also mentor a talented team and partner with leaders across the business.

Responsibilities

Architect and Evolve Our Core Data Platform

You will own the technical vision and roadmap for our data platform, steering its evolution on our modern cloud stack and ensuring it meets the demands of a rapidly scaling business.

  • Own the Architecture : Design, implement, and refine a robust data lakehouse architecture (e.g., Medallion) using Databricks and Delta Lake to ensure data reliability and performance.
  • Build Scalable Ingestion Frameworks : Develop and maintain resilient, reusable patterns for ingesting data from a diverse set of sources, including our systems, transactional databases, event streams, and third‑party SaaS APIs.
  • Define Data Modelling Standards : Lead the implementation of our core data modelling principles (e.g., Kimball dimensional modelling) to produce curated, intuitive datasets for business intelligence and product analytics.
  • Implement Robust Governance : Use tools like Unity Catalog to establish a comprehensive data governance framework, covering data lineage, fine‑grained access controls, and a user‑friendly data catalogue.
  • Manage Platform Performance and Cost : Develop and implement strategies for monitoring, optimising, and forecasting our Databricks and cloud expenditure, ensuring the platform is both powerful and cost‑effective.

Champion Engineering Excellence and Best Practice

You will be the driving force for maturing our data operations, embedding a culture of quality, automation, and reliability into everything we do.

  • Automate Everything with CI / CD : Implement and advocate for automated CI / CD pipelines (e.g., using GitHub Actions) for all data assets, including dbt models, infrastructure changes, and Databricks jobs.
  • Embed Git‑Based Workflows : Champion a Git‑first culture for all data transformation code, establishing clear processes for branching, code reviews, and version control.
  • Embed Automated Data Quality : Implement comprehensive, automated data quality testing at every stage of our pipelines using tools like dbt test, ensuring data is accurate and trustworthy.
  • Introduce Data Observability : Establish thorough monitoring, logging, and alerting for all data pipelines to proactively detect, diagnose, and resolve issues before they impact the business.
  • Be a Strategic Partner Across the Business

    You will connect the technical capabilities of the data platform to Deputy's strategic objectives, acting as a key advisor to stakeholders across the organisation.

  • Translate Business Needs into Technical Solutions : Collaborate directly with leaders in Product, Engineering, Sales, finance and Customer Success to understand their challenges and design data solutions that enhance our product, improve customer outcomes, and drive business strategy.
  • Guide Data Best Practices : Advise analysts, data scientists, and other stakeholders on how to best leverage the data platform for impactful analysis and data‑driven decision‑making.
  • Act as the Technical Authority : Serve as the go‑to expert on our data architecture, running workshops and design sessions to align technical direction with business needs.
  • Lead, Mentor, and Elevate Our Data Team

    As a technical member of the team, you will be instrumental in upskilling your colleagues and shaping the future of the data function at Deputy.

  • Mentor and Coach : Actively mentor data analysts and engineers through pair programming, constructive code reviews, and technical guidance to grow their skills in Python, SQL, and data modelling.
  • Foster a Community of Practice : Lead initiatives like a ‘data guild’ to encourage knowledge sharing, explore new technologies, and collaboratively solve complex problems.
  • Shape the Team’s Future : Partner with data leadership to define career progression pathways for data engineering and take a leading role in interviewing and hiring new team members.
  • Skills & Experience

  • Mastery of data architecture principles, data modelling frameworks (e.g., dimensional modelling), and a strong understanding of data governance and security best practices.
  • A strong software engineering mindset, with significant experience implementing CI / CD for data, Git‑based workflows, and automated data quality testing.
  • Exceptional communication and stakeholder management skills, with a proven ability to translate complex technical concepts for non‑technical audiences and influence business decisions.
  • A genuine passion for leadership and mentorship, with a track record of elevating the technical skills of those around you.
  • Tech Stack

  • Dbt
  • Databricks, Unity Catalog
  • Terraform
  • AWS : Redshift, Dynamo DB, API gateway, Cloud Watch, Lambda, Streaming with Kinesis / Firehose, Glue, Bedrock
  • Stitch & Fivetran
  • Languages required include advanced SQL, Python
  • Employee Perks

  • Enjoy a flexible remote‑first work policy (with a work‑from‑home stipend to set you up for success!)
  • Own A piece of Deputy via our Employee Share Ownership Plan (ESOP)
  • Take paid parental leave to support you and your family
  • Stay protected with Group Salary Continuance Insurance
  • Access support through our Employee Assistance Program
  • Enjoy additional leave days — including study assistance, celebration days and volunteering
  • Join our global working groups focused on collaboration, belonging and connection
  • Get creative at our annual Hackathons
  • Take advantage of our novated leasing for electric vehicles, internet reimbursement and more!
  • Deputy believes in equal opportunity and that inclusiveness and diversity promotes innovation. Our global team members are from a variety of cultures. And we welcome different perspective and skills.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Engineer • Council of the City of Sydney, New South Wales, Australia

    Related jobs
    Principal Engineer

    Principal Engineer

    Roman Health Pharmacy LLC • Council of the City of Sydney, New South Wales, Australia
    At Xero, we’re here to help supercharge small businesses.We do this by automating routine tasks, surfacing actionable insights and connecting businesses with the right data, advisors and apps.When ...Show more
    Last updated: 30+ days ago • Promoted
    Principal / Senior Data Engineer (Data Platforms)

    Principal / Senior Data Engineer (Data Platforms)

    Simple Machines • Council of the City of Sydney, New South Wales, Australia
    Principal / Senior Data Engineer (Data Platforms).Location : Darlinghurst, Sydney, Australia.Simple Machines is a leading independent boutique technology firm with a global presence, including teams...Show more
    Last updated: 30+ days ago • Promoted
    Principal Consulting AI / Data Engineer

    Principal Consulting AI / Data Engineer

    DyFlex Pty Ltd • Council of the City of Sydney, New South Wales, Australia
    DyFlex is an established SAP Platinum Partner with offices across Australia.We are recognised as a leader in our area of SAP expertise. We deliver fit-for-purpose SAP solutions, and our services ran...Show more
    Last updated: 25 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Ingrity • Council of the City of Sydney, New South Wales, Australia
    We’re looking for an experienced.This is a hands-on leadership role where you’ll combine deep technical expertise with solution design and team guidance, working closely with both engineering peers...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data / AI Platform Engineer

    Principal Data / AI Platform Engineer

    Evolution Australia • Council of the City of Sydney, New South Wales, Australia
    Be among the first 25 applicants.Direct message the job poster from Evolution Australia.Building Data & AI teams across Australia @ Evolution. Join a leading Australian enterprise to work on a.This ...Show more
    Last updated: 11 days ago • Promoted
    Principal Engineer AI Search

    Principal Engineer AI Search

    Dovetail • Council of the City of Sydney, New South Wales, Australia
    Dovetail is the worlds leading AI-first customer insights hub on a mission to improve the quality of every thing.Were redefining what it means to be connected to your customer giving everyone on th...Show more
    Last updated: 1 day ago • Promoted
    Platform Data Engineer

    Platform Data Engineer

    Macquarie Bank Limited • Council of the City of Sydney, New South Wales, Australia
    Within Commodities and Global Markets, our Data Platform team is responsible for building and maintaining the data warehouse and re-usable ETL pipelines for engineering teams.You will work on build...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Platform Engineer

    AWS Data Platform Engineer

    Synechron • Sydney, New South Wales, Australia
    We are seeking a seasoned AWS Data Platform Engineer.The successful candidate will be responsible for designing and implementing scalable and efficient data storage and retrieval systems, optimizin...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Platform Engineer

    Lead Data Platform Engineer

    Publift • Council of the City of Sydney, New South Wales, Australia
    Publift is a dynamic Adtech company dedicated to empowering online publishers and websites to maximize their revenue from display ads. We are passionate about driving publisher growth and have an am...Show more
    Last updated: 3 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Sleek • Council of the City of Sydney, New South Wales, Australia
    We are looking for a Principal Data Engineer that is excited about the mission and outcomes over the next 6-12 months.Work closely with cross-functional teams to translate our business vision into ...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer, Data Reliability

    Principal Engineer, Data Reliability

    Roman Health Pharmacy LLC • Council of the City of Sydney, New South Wales, Australia
    At Xero, we’re here to help supercharge small businesses.We do this by automating routine tasks, surfacing actionable insights and connecting businesses with the right data, advisors and apps.When ...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer

    Principal Engineer

    News Corporation • Sydney, New South Wales, Australia
    We have an exciting role for a (Infrastructure) Principal Engineer, who will be responsible for helping with the design and development of the AWS and GCP architectures for protecting business crit...Show more
    Last updated: 30+ days ago • Promoted
    Platform Engineer - Data

    Platform Engineer - Data

    Whizdom • Council of the City of Sydney, New South Wales, Australia
    Whizdom Sydney, New South Wales, Australia.This range is provided by Whizdom.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Our client is a pre...Show more
    Last updated: 22 days ago • Promoted
    Principal Engineer

    Principal Engineer

    Catalyst Growth Services • Sydney, New South Wales, Australia
    Scale-up Partner | Connecting Execs to Tech and Talent for AI adoption.Fully Remote with optional office in Sydney.Building upon an already outstanding product team, we\u2019re now hiring for a cru...Show more
    Last updated: 30+ days ago • Promoted
    Engineer - Data Platforms

    Engineer - Data Platforms

    HUB24 Limited • Council of the City of Sydney, New South Wales, Australia
    HUB24 leads the wealth industry as the best provider of integrated platform, technology and data solutions.At HUB24, we know the smartest investments start with our people.We are innovative and amb...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer

    Principal Engineer

    at • Council of the City of Sydney, New South Wales, Australia
    Lead the technology that moves a nation.Sydney | Hybrid - 2 days Office.Every day, millions of Australians rely on this business to keep life moving. Behind every on‑time order, every seamless deliv...Show more
    Last updated: 3 days ago • Promoted
    Principal Engineer, Data Reliability

    Principal Engineer, Data Reliability

    Xero • Council of the City of Sydney, New South Wales, Australia
    Be among the first 25 applicants.At Xero, we’re here to help supercharge small businesses.We do this by automating routine tasks, surfacing actionable insights and connecting businesses with the ri...Show more
    Last updated: 25 days ago • Promoted
    Platform Data Engineer

    Platform Data Engineer

    Macquarie Group • Council of the City of Sydney, New South Wales, Australia
    Be among the first 25 applicants.Within Commodities and Global Markets, our Data Platform team is responsible for building and maintaining the data warehouse and re‑usable ETL pipelines for enginee...Show more
    Last updated: 30+ days ago • Promoted