Data Engineer

About the job Data Engineer

Role Data Engineer

Required Technical Skill

1) Strong Data Engineering skills using Azure and Pyspark

2) Good Knowledge on SQL

3) Preferred experience in Big data / Hadoop technologies like

Spark, Hive, Hbase and Kafka.

4) Preferred experience in ETL process.

5) Good Communication Skills

Desired Experience Range 5 – 10 years

Location of Requirement Perth / Australia

Desired Competencies (Technical / Behavioral Competency)

Must-Have

1. Strong Data Engineering skills using Azure and Pyspark (or

Databricks, Hadoop / Spark using Java / Scala)

2. Experience in Azure Data Factory and other Azure services

ADLS, Azure SQL, Blob Storage)

3. Experience in loading and transforming the data using spark or

any big data technologies( Hive, Kafka, Hbase ,Spark or Storm).

4. Very good SQL knowledge

5. Knowledge in Azure Devops

6. Good Communication skills

Good-to-Have

1. ETL Process experience in any Cloud or any on-premise big data

platform.

2. Azure Solution Architecture Data Engineer Certification

3.Good data warehousing concepts