Talend DI with Snowflake
XPT Software Australia Pty • Sydney, New South Wales, Australia
12 hours agoApply
Job description
Job description: Talend DI with Snowflake
Job Description
- Primary Skills: Talend DI, Snowflake
- Skills: SQL, Power BI, Azure, Openflow, Snowpipe, Apache Airflow, GitHub
Must Have Experience:
- Lead the design and development of data pipelines using Talend and Snowflake.
- Architect and optimize data warehousing solutions in Snowflake, leveraging features like Snowpipe for real-time data ingestion.
- Ensure data integrity, security, and governance across systems.
- Collaborate with data analysts, scientists, and business teams to define data strategies.
- Demonstrated expertise in Talend ETL tool and Snowflake data warehousing.
- Experience with data modeling, database management, and data pipeline optimization.
- Develop and maintain high-performance SQL queries for data extraction and transformation.
- Extract and integrate data from various APIs, ensuring seamless data flow.
- Implement ETL processes and ensure efficient data flow using tools like Apache Airflow for orchestration.
- Monitor and troubleshoot data pipeline performance.
- Guide and mentor junior data engineers.
- Utilize GitHub for version control and collaborative development.
Additional Responsibilities:
- Deep understanding of all core Snowflake concepts and features.
- Design and Implement Data Solutions: Develop scalable and efficient data solutions to support business intelligence and analytics needs.
- Performance Tuning: Optimize Snowflake queries and Talend jobs for performance and cost efficiency.
- Data Quality Management: Implement data quality checks and validation processes to ensure the accuracy and reliability of data.
- Automation: Automate repetitive data tasks and processes using tools like Openflow and Airflow to improve efficiency and reduce manual intervention.