Data Engineer

SUMMARY:
Our client is looking for a highly skilled and driven Data Engineer to join their dynamic team in Sandton. If you have a passion for data management, cloud technologies, and are proficient in SQL, Python, and ETL processes, this is your opportunity to make an impact in a fast-paced, innovative environment.

POSITION INFO:
Key Responsibilities:

• Develop, optimize, and manage data pipelines and data storage solutions.
• Work with ETL/ELT tools such as SSIS, Data Factory, Synapse, AirFlow, Glue, Fire Hose, or similar AWS tools.
• Set up and manage data ingestion processes across Azure, AWS, or GCP environments.
• Work closely with cross-functional teams to design and implement scalable data solutions.
• Ensure optimal database performance by understanding SQL internals, including execution plans, wait types, isolation levels, DMVs, and indexing.
• Optimize and write complex queries, focusing on high performance.
• Leverage data visualization tools such as Power BI, SSRS, Tableau, or QlikView to produce actionable insights.
• Develop and maintain version control using Git, and participate in CI/CD pipeline management for deployment strategies.

• Bachelor’s Degree in Computer Science, Software Engineering, Informatics, or Information Systems. Equivalent qualifications or certifications combined with significant industry experience may also be considered.
• 3-5 years of professional experience working with Microsoft SQL Server, Sybase, or Postgres SQL.
• Strong T-SQL knowledge and experience writing and optimizing complex queries.
• Intermediate Python development skills with familiarity in data-related libraries (e.g., Pandas, PySpark, Numpy).
• Hands-on experience with NoSQL DB systems and understanding of Hadoop, Spark, Map Reduce, and MPP systems.
• Experience with cloud platforms (Azure, AWS, or GCP) and related data ingestion processes.
• Working knowledge of SQL Server and database design.
• Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, Power BI Data Analyst, MCSA/MCSE SQL Server 2012/2014) are a plus.
• Proficient in version control and CI/CD practices with Git and repositories such as GitHub or Bitbucket.
• Advantageous: Experience in C# or Java, and understanding of microservices architecture and containerization (e.g., Docker, Kubernetes).