Data Engineer

Recruiter:

Optim-G Sourcing

Job Ref:

PTA000024/IK

Date posted:

Friday, February 21, 2025

Location:

Centurion, South Africa

SUMMARY:
We are seeking a skilled Data Engineer with strong ETL experience, a programming background, and expertise in Linux environments. The ideal candidate will be responsible for designing, building, and maintaining scalable data
pipelines to support business intelligence and analytics needs.

The role requires to collaborate closely with data scientists, analysts, and software engineers to ensure efficient data integration and transformation processes.

POSITION INFO:
Minimum Qualifications and Work Experience Required:

Minimum a 3-year degree in Information Technology. Preferable B.Sc. Computer Science,
Bcom Informatics (Honours), B.Eng with Computer Science
3+ years of experience in data engineering, ETL development, or related roles.
Proficiency in SQL and experience with relational
databases (PostgreSQL, MySQL, SQL Server, etc.)
Experience in a financial sector would be beneficial
Ab Initio certification beneficial

Programming skills Required:

Any of 'C', 'C++, Java Cobol and other procedural OO Languages.
UNIX knowledge, in particular scripting. All consultants will use UNIX.
Knowledge of a major database: Oracle, DB2, Teradata, Sybase, Informix, Hyperion
Knowledge or awareness of Business MetaData
Knowledge or awareness of scheduling
Knowledge or awareness of data quality and data cleansing (e.g. tools such as SAS Dataflux,
Trillium et al)
Knowledge or awareness of real-time applications or web services
Knowledge or awareness of data warehousing

Responsibilities:

Develop, implement, and maintain ETL pipelines to ingest, transform, and store data from multiple sources.
Design and optimize data models for analytics and reporting.
Work with big data technologies and cloud platforms to ensure scalable and efficient data processing.
Develop and maintain data integration solutions between various systems and databases.
Monitor and troubleshoot data pipeline issues, ensuring data integrity and reliability.
Automate data workflows using scripting and scheduling tools.
Optimize SQL queries and database performance.
Ensure compliance with data governance, security, and best practices.
Collaborate with cross-functional teams to understand data needs and
develop solutions accordingly.

Similar jobs you might be interested in:

Database Engineer
Location: Johannesburg
Salary:
Our external client in the Logistics sector is seeking a database Engineer to join their team in the East of Johannesburg. Must have 8 years experience in designing, supporting and maintaining 2019/2022, IIS, Microsoft Systems and databases systems in Microsoft SQL Server 2016/WSUS, Remote Desktop Services and PowerShell. Must also have experience in managing operations in environments with cluste...
9 days ago

Database Engineer
Location: Johannesburg
Salary: 400 000 Annually
Are you an experienced database Engineer looking to join a dynamic IT infrastructure team? We are hiring a skilled database Engineer to support IT infrastructure at an engineering level within a globally recognized organization!
16 days ago

Database Administrator
Location: Springs
Salary: 30 000 Monthly
database administrator
1 day ago

Database Administrator
Location: Bryanston
Salary: 641,254 Annually
To ensure performance, integrity and security of the companies database, involvement in the design, development and integrity of the database, as well as in data mining and day to day operation and maintenance of the database
1 day ago

Data Engineer
Location: Centurion
Salary:
We are seeking a skilled Data Engineer with strong ETL experience, a programming background, and expertise in Linux environments. The ideal candidate will be responsible for designing, building, and maintaining scalable datapipelines to support business intelligence and analytics needs.The role requires to collaborate closely with data scientists, analysts, and software engineers to ensure efficie...
1 day ago

Manager: Business Analysis
Location: Johannesburg
Salary:
1 day ago

Financial Manager: Business Analysis
Location: Johannesburg
Salary:
1 day ago

Senior Technical Lead (Digital Platforms)
Location: Johannesburg
Salary:
Our client in the telecoms sector is seeking a professional Senior Technical Lead (Digital Platforms). Contract duration for 6 months.
3 days ago

Database Developer
Location: Johannesburg
Salary: 500000 Annually
In search of database Developer to apply their skills in JHB!
6 days ago

Enterprise Integration Manager
Location: Pretoria
Salary: Market Related
My client is looking for an Enterprise Integration Manager, the successful candidate will be responsible for defining and implementing the integration strategy, frameworks, and best practices to ensure seamless connectivity between enterprise applications, cloud services, and third-party systems.
9 days ago