Talent.com
westbury partners
Lead Data Engineering Architectwestbury partners • Sydney, NSW, AU
Search for other jobs
Lead Data Engineering Architect

Lead Data Engineering Architect

westbury partners • Sydney, NSW, AU
1 day ago
Job description

Job Description

Lead the design and delivery of scalable data platforms and pipelines, combining technical expertise, architecture, mentorship, and strategic leadership to enable trusted, high-performing, data-driven decisions.

\n

What You'll Do:

\n

Shape the future of data engineering by leading the architecture, development, and delivery of scalable data platforms, pipelines, and analytical solutions. You’ll turn complex data challenges into reliable, high-performance solutions that create meaningful business impact.

\n

Your responsibilities will include:

\n

    \n
  • Lead the design and development of scalable ETL/ELT pipelines and modern data platforms.
  • \n
  • Define engineering standards, architecture patterns, development methodologies, and best practices.
  • \n
  • Build and optimise data warehouses, data lakes, and lakehouse solutions.
  • \n
  • Champion data quality, security, governance, availability, and performance.
  • \n
  • Lead architecture reviews, technical discussions, code reviews, and solution design sessions.
  • \n
  • Mentor data engineers and promote strong engineering practices across the team.
  • \n
  • Establish effective monitoring, testing, documentation, CI/CD, and deployment processes.
  • \n
  • Troubleshoot complex pipeline, performance, infrastructure, and data issues.
  • \n
  • Evaluate emerging technologies and recommend solutions that balance innovation, scalability, and cost.
  • \n
  • Partner with Data Scientists, BI Developers, Analysts, Software Engineers, Product Managers, and business stakeholders.
  • \n
  • Drive continuous improvement across data architecture, engineering processes, productivity, and technical debt.
  • \n
  • Support cloud-based initiatives while ensuring robust, scalable, and cost-effective solutions.
  • \n

\n

Why Join Us:

\n

This is an opportunity to combine hands-on engineering with genuine technical leadership. You’ll have the influence to shape data architecture, establish engineering standards, mentor talented professionals, and deliver platforms that directly support business growth and smarter decision-making.

\n

About You:

\n

    \n
  • You’re an experienced data engineering professional with7+ years of relevant experience and at least2 years leading or mentoring engineering teams . You bring strong SQL and programming skills, extensive ETL/ELT experience, and a solid understanding of data modelling, warehousing, distributed systems, and scalable data processing.
  • \n
  • You’re comfortable working with cloud platforms and modern technologies such as Spark, Kafka, Airflow, Databricks, Snowflake, BigQuery, or equivalent solutions. You understand software engineering practices including version control, CI/CD, automated testing, and deployment.
  • \n
  • You’re also a confident technical leader who can communicate complex ideas clearly, collaborate across disciplines, solve challenging problems, and make pragmatic architectural decisions.
  • \n

\n

#DataEngineering #DataEngineer #DataEngineeringLead #DataArchitecture #DataPipelines #ETL #ELT #CloudComputing #DataWarehouse #DataLake #DataLakehouse #ApacheSpark #Databricks #DataGovernance #TechnicalLeadership

Create a job alert for this search

Lead Data Engineering Architect • Sydney, NSW, AU