Talent.com
This job offer is not available in your country.
Senior Azure Data Engineer

Senior Azure Data Engineer

Bluefin ResourcesSydney, AU
30+ days ago
Salary
A$170,000.00–A$200,000.00 yearly
Job type
  • Full-time
Job description

The Senior Data Engineer will be responsible for the following :

  • Designing and building scalable, reliable, and efficient data pipelines and architectures on the Azure platform.
  • Developing and maintaining data models (conceptual, logical, and physical), metadata management, and data cataloguing processes.
  • Working closely with cross-functional teams to understand data requirements and develop data solutions aligned with business objectives.
  • Designing and implementing data security and access control measures.
  • Leveraging DevOps tools for automating the deployment process and ensuring reliable deployment of data solutions.
  • Creating and maintaining documentation of data architecture, data flow, and data quality standards.
  • Participating in Scrum meetings and ceremonies, such as sprint planning, daily stand-ups, and sprint retrospectives.
  • Troubleshooting and resolving production issues in a timely and efficient manner.
  • Implementing and maintaining master data management systems and processes.
  • Providing technical guidance and mentorship to junior members of the team.

Tech Requirements :

  • Strong experience with Azure Data Warehouse
  • Knowledge of Azure Data Factory (ADF) for setting up data warehouses on Azure
  • Proficiency in SSIS and SQL
  • Familiarity with Azure services such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure Stream Analytics, Azure Data Catalogue, ML Studio, AI / ML, Azure Functions, Azure DevOps, CI / CD, Azure Event Hubs, Logic Apps, Apache Spark, Docker Containers, Azure HDInsight, and Azure Databricks
  • Experience with big data technologies such as Hadoop, Spark, and Kafka
  • Good programming skills in Python and / or Scala
  • Experience with MDM, metadata management, and data cataloguing
  • Solid understanding of data security, data classification, and access control measures
  • Good understanding of Data Governance
  • Familiarity with Microsoft Power BI
  • Excellent problem-solving skills
  • Excellent communication skills and ability to work collaboratively with cross-functional teams
  • Consulting experience on Azure is a plus!

    • Competencies

    The ideal candidate should possess the following competencies :

  • Data modeling and architecture
  • Data processing and storage
  • Data quality and governance
  • Data integration and ETL
  • Data analytics and machine learning
  • Programming and scripting
  • Cloud computing

    • This is a great chance to showcase your talents and grow your skills in a fast-paced and collaborative environment. You will also enjoy competitive compensation, flexible work arrangements, and a supportive culture that values your contributions.

    Create a job alert for this search

    Senior Data Engineer • Sydney, AU