GCP Data Engineer

Recruiter:

PBT Group

Job Ref:

3994666555

Date posted:

Tuesday, October 29, 2024

Location:

Cape Town, South Africa

SUMMARY:
-

POSITION INFO:

Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure high-quality data availability for advanced analytics and machine learning initiatives.

Key Responsibilities:

Design, build, and maintain scalable data pipelines and ETL processes on GCP to support a variety of data applications, including analytics, reporting, and machine learning.
Implement and manage data warehouses and data lakes using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Cloud Composer.
Develop, maintain, and enhance data models in line with business requirements, optimising for performance and scalability.
Collaborate with cross-functional teams to understand business needs, translate them into technical solutions, and provide data access solutions tailored to specific use cases.
Conduct regular performance tuning, capacity management, and data quality checks to ensure the efficiency, security, and reliability of data infrastructure.
Implement security best practices, including data encryption, access control, and compliance with organisational and regulatory standards.
Develop and maintain comprehensive documentation on data architecture, data models, and processes.

Qualifications:

Bachelor’s Degree in Computer Science, Information Systems, Engineering, or a related field.
3+ years of experience as a Data Engineer with hands-on expertise in designing, building, and optimising data architectures on GCP.
Proficiency in SQL and Python for data transformation, automation, and integration.
Strong knowledge of GCP tools: BigQuery, Cloud Dataflow, Cloud Storage, Cloud Composer (Apache Airflow), Pub/Sub, and Cloud Functions.
Experience with data modelling, ETL processes, and data warehousing concepts.
Experience with Apache Kafka or other streaming platforms is beneficial.
Familiarity with CI/CD tools and DevOps practices for data pipelines, such as Docker, Terraform, or Kubernetes, is advantageous.

Skills:

Analytical and problem-solving skills: Ability to diagnose complex data issues, recommend and implement solutions efficiently.
Attention to detail and commitment to data quality: Ensures that data is accurate, reliable, and adheres to company standards.
Communication and collaboration skills: Strong written and verbal communication abilities, capable of working well with both technical and non-technical stakeholders.
Self-motivated and adaptable: Able to work independently in a fast-paced environment, with a proactive approach to learning and adopting new technologies.

Preferred Competencies:

Certifications in Google Cloud (e.g., Professional Data Engineer) are a plus.
Experience with machine learning workflows and integration with data pipelines.
Knowledge of data governance principles and experience implementing data quality frameworks.

Why Join Us: This role offers the opportunity to work with cutting-edge cloud technology within a dynamic and collaborative environment. You’ll have the chance to make a significant impact on our data strategy and contribute to innovative projects that push the boundaries of data engineering on GCP. If you’re a dedicated GCP Data Engineer with a vision for data-driven success, we’d love to hear from you!

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Site Reliability Engineer (SRE) (CH1078)
Location: Stellenbosch
Salary:
19 days ago

Pharmacist
Location: Cape Town
Salary:
The Centre for TB Research Innovation (CTBRI) Unit, based at the University of Cape Town Lung Institute (www.lunginstitute.co.za) require applications for a PHARMACIST* on a Fixed Term Contract. The main purpose of this position is to manage the pharmacy according to South African Pharmacy Council (SAPC), Medicines Control Council (MCC), Pharmacy Guidelines and Instructions for DAIDS Cl...
13 days ago

Community Health Worker
Location: Cape Town
Salary:
The Centre for Lung Infection and Immunity (CLII) (http://www.lunginstitute.co.za), invites applications for a COMMUNITY HEALTH WORKER* on a 6-month Fixed Term Contract (Full-Time, 40 hours per week). CLII is based within the Division of Pulmonology in the Department of Medicine at UCT and is committed to the pursuit of excellence in research, treatment, training and prevention of TB in South...
27 days ago

Research Nurse
Location: Cape Town
Salary:
The Centre for Lung Infection and Immunity (CLII) (http://www.lunginstitute.co.za), has a number of new and exciting studies starting and require applications for RESEARCH NURSES*. CLII is based within the Division of Pulmonology in the Department of Medicine at UCT and is committed to the pursuit of excellence in research, treatment, training and prevention of TB and COVID-19 in Southern Afr...
27 days ago

QA and QC Officer
Location: Cape Town
Salary:
The Allergy and Immunology Unit (AIU), based at the University of Cape Town Lung Institute(www.lunginstitute.co.za), requires applications for a QUALITY ASSURANCE AND QUALITY CONTROL OFFICER* to work on a Fixed Term Contract. The main purpose of this position is to ensure that all essential study- and participant-related documents are present in the participant binders to individually and col...
27 days ago

Respiratory Technologist
Location: Paarl
Salary:
The University of Cape Town Lung Institute requires applications for a Respiratory Technologist* on a Fixed Term Contract to be based at the Drakenstein Child Health Study site in Paarl. The successful candidate will be based at Paarl Hospital. The respiratory technologist will support a busy clinical research team, and be responsible for respiratory function testing of child and adolescent s...
30 days ago

Software Engineer / Firmware Engineer - Sports Technology
Location: Stellenbosch
Salary: Annually
Do you want to work on cutting-edge solutions that enhance how the world experiences sports? My client is looking for a talented Firmware engineer to join their dynamic team in Stellenbosch, where they’re transforming the sports industry with innovative products that track balls and equipment across various sports. Their technology is trusted by coaches, athletes, and events worldwide t...
2 days ago

Desktop Support Engineer
Location: Cape Town
Salary:
ATM SA is a dynamic and growing organization dedicated to delivering exceptional IT solutions and support services. We are seeking a skilled and customer-focused Desktop Support engineer to join our team and ensure seamless IT operations across our organization.
3 days ago

Dialler Administrator
Location: Cape Town
Salary: market related Monthly
Summary:The Dialler Administrator (Junior engineer) is responsible for overseeing the smooth functioning of the Dialler system within the Contact Centre Operations. This includes overseeing campaign loads, dialing frequency, dialing attempts and continuous dialing optimization. The Dialler Administrator will be responsible for ensuring there is a constant workflow for Contact Centre Operations by ...
13 days ago

Software Engineer (Special Projects)
Location: Cape Town
Salary:
A Global International Defense company is seeking a Software engineer to join their Special Project Department. This exciting opportunity to join a fast-growing company is located in Cape Town and offers an exciting role in a niche industry.CPT | Permanent | On-site | Salary negotiable
21 days ago