Software Engineer - big data analytics platform

Recruiter:

MECS Africa

Job Ref:

CPT000420/LB

Date posted:

Wednesday, November 20, 2024

Location:

Johannesburg, South Africa

SUMMARY:
Our client that is based in Gauteng has a vacancy for a suitably qualified Software Engineer to work within a big data analytics platform.

POSITION INFO:
Responsible for the requirements, design, development, testing and documentation of new and legacy data ingestion, integration, processing, and storage software to meet the requirements of the company's IoT Platform Solution.
This IoT solution is a big data analytics platform for the mining industry which requires a focus on collecting, processing, contextualising, and managing data assets thus turning it into information, and finally leveraging this information to address the 4 pillars of analytics - descriptive, diagnostic, predictive, and prescriptive.

Responsibilities:

Data ingestion
Data integration
Data processing
Data storage
Digital twin management
Data management and governance

Experience and Qualifications:

Bachelor’s degree in computer/software engineering, computer science
Masters or doctoral level degree (advantageous)
2-5 years’ experience in computer science, software, or computer engineering, applied math, physics, statistics, or related fields.
Experience with wireless and network communication technologies such as Wi-Fi, GSM, LoRaWAN, Bluetooth, TCP/IP.
2-5 years’ experience with data lake and warehousing solutions.
2-5 years’ experience with either Python, Java, C++, C#, Sparql , SQL databases.
2-5 years’ experience with either Apache Kafka (producers/consumers/connectors), Apache NiFi, Apache Spark, Apache ActiveMQ, MQTT, Modbus, REST API.
Experience with developing, building and releasing of containerised services and microservice architectures using Docker.
Experience within big data platforms, structured, unstructured and semi-structure data management.
Experience with data analytics, machine learning and AI (advantageous)
Experience with workflow management tools and BPMN eg. Camunda (advantageous)
Experience with distributed systems and cluseter orchestration systems such as Kubernetes.

Similar jobs you might be interested in:

Software Engineer - big data analytics platform
Location: Johannesburg
Salary:
Our client that is based in Gauteng has a vacancy for a suitably qualified software engineer to work within a big data analytics platform.
1 day ago

Graduate Software Engineer
Location: Johannesburg
Salary: 300 000 Annually
Elevate Your Career as a software engineer – Innovate, Design, and Deliver Cutting-Edge Solutions.Join an industry-leading technology firm seeking a dynamic software engineer. Here’s your opportunity to design intuitive applications, contribute to secure, high-quality code, and stay ahead of the curve with continuous learning. Your role involves designing, developing, and maintaining s...
Today

Software Engineer
Location: Johannesburg
Salary:
software engineers (Contract)We have an exciting opportunity for software engineer's at our client who specializes in digital platform transformation. We are looking for candidates with comprehensive experience in software development, system analysis, and business intelligence.
1 day ago

Junior Software/computer/embedded Engineer
Location: Centurion
Salary: Neg
Centurion-based client who develops electronic solutions and product development. Junior software development engineer required to development software on C/C++ and Python. PC/Server platform – Windows and Linux programming in C, C++, C#, Java, PHP, SQL, Assembler.
3 days ago

Embedded Software Engineer - Radio Integration
Location: Pretoria
Salary:
Embedded software engineer (Radio Integration) is required at an established company in Lynnwood, Pretoria. BEng (Electronic engineering) or Computer engineering with 0-5 years of software development experience.
9 days ago

Graduate/Software Engineer
Location: Johannesburg
Salary:
My client, based in Bryanston, is urgently looking for an entry-level Graduate or candidate with 1 to 2 years of technical support experience to join their dynamic organization. The incumbent will be responsible for customer support and the development of support material.
10 days ago

Senior Software Engineer
Location: Pretoria
Salary:
Exciting Opportunity: Senior software engineer – Pretoria East. Our client is on the lookout for a highly skilled and experienced Senior software engineer to join their innovative team in Pretoria East. In this pivotal role, you will be responsible for designing, developing, and maintaining advanced software solutions that align with both business and integration requirements.
13 days ago

Senior Software Engineer
Location: Pretoria
Salary:
Our client is seeking a talented and experienced Senior software engineer to join their dynamic team in Pretoria East. You will be responsible for designing, developing, and maintaining cutting-edge software solutions to meet both business and integration requirements. If you’re passionate about building innovative systems and collaborating with cross-functional teams, this is the perfect op...
13 days ago

Software Engineer – Midrand/ Centurion -Semi-Remote – Contract - R742 Per Hour
Location: Pretoria
Salary: 1424640
software engineer – Midrand/ Centurion -Semi-Remote – Contract - R742 Per Hour
15 days ago

Senior C# Software Engineer – Bedfordview (Hybrid) – up to R1.2m per annum
Location: Johannesburg
Salary: 1 200 000
Senior C# software engineer – Bedfordview (Hybrid) – up to R1.2m per annum
15 days ago