Azure Senior Data Engineer

Location Cape Town
Discipline: IT & Telecoms
Job type: Permanent
Contact name: Erika Reeves

Contact email: erika@networkersint.co.za
Job ref: 33755
Published: 7 days ago

Job Advertisement

Overview

Are you a talented and experienced Senior Data Engineer looking to join a dynamic Business Transformation team? In this role, you will be crucial in ingesting, cleansing, and modeling data into unified Kimball datasets that support Business Intelligence reporting and Data Science machine learning use cases. If you are passionate about technology and possess strong Azure data skills, software development practices, and data analysis expertise, we want to hear from you!

Responsibilities

  • Ingest data from various sources and apply cleansing rules to ensure data quality.

  • Model data into single source of truth Kimball datasets and create high-quality code using traditional software practices.

  • Monitor pipelines to ensure business critical data processing meets time constraints and data quality expectations.

  • Integrate into the data team’s workflow, perform ad-hoc analysis of structured and unstructured data, and document datasets in the data catalogue.

  • Collaborate with data owners/stewards to ensure high-quality, compliant deliveries and document solution design.

Qualifications, Skills & Experience

Must Have:

  • Strong Azure data skills, including Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps & Logic Apps, and Azure Stream Analytics.

  • Proficiency in PySpark, Delta Lake, Unity Catalog, Python, and SQL.

  • Knowledge of Kimball data modeling, software development practices, and data analysis.

  • Excellent written and verbal communication skills.

  • Minimum of 2 years of experience as an Architect and a passion for technology.

Nice To Have:

  • Experience with Azure DevOps, other languages (e.g., C#, PowerShell), IaC, test-driven development, streaming technologies, Power BI engineering, Certified SCRUM Developer, and machine learning/AI.

Day-to-day

As a Senior Data Engineer, you will be responsible for ingesting and modeling data, creating high-quality code, monitoring data pipelines, collaborating with the data team, and ensuring compliance with legislation. You will also have the opportunity to perform ad-hoc data analysis and contribute to the documentation of solution design.

Benefits

  • Competitive salary

  • Flexible working hours

  • Opportunities for professional development and growth

  • Dynamic and collaborative work environment

  • Comprehensive benefits package

If you are ready to make amazing happen and drive transformation through data engineering, apply now.