Big Data Engineering Lead

SUMMARY:
Big Data Engineering Lead, IT industry, Johannesburg, South Africa.

POSITION INFO:

Our client. a renowned organization in the Information Technology sector is seeking to URGENTLY appoint a dynamic Big Data Engineering Lead to be based in Johannesburg, South Africa.

MAIN PURPOSE FOR THE ROLE:

• To lead the technical delivery team, using experience to deliver right sized and well architected solutions to meet targets.
• To demonstrate solidly grounded experience working in Azure to understand the available technology choices and selectively implement services safely and securely.
• To demonstrable experience working with the technologies and processes, such as Data Bricks, Python, Unity catalog, DevOps (CI/CD) and Plotly.
• To lead data Scientists, within the company’s Data Services team or those that work for their strategic partners and clients.

KEY COMPETENCY REQUIREMENTS:

• At minimum a bachelor’s degree in computer science or another closely related discipline,
• At least 5-8 years’ of working experience in a related field.
• Proven work experience as a senior data engineer, or as a Data Engineering Lead Strong Data Bricks and Python skills are a must.
• SQL skills as an alternative to Python will also be considered
• Possess solidly grounded understanding of how big data solutions / NoSQL solutions differ from standard data solutions and the ability to explain why choices made might be different.
• Possess extensive experience in working with cloud services: Azure, AWS, or GCP.
• Highly honed communication and presentation skills, with the ability to convey complex concepts to non-technical stakeholders.
• Ability to ensure consistent Client Services relationship building with internal and external stakeholders to ensure smooth business processing.
• Ability to develop new improved processes and to facilitate discussions with external and internal stakeholders.
• Be strongly committed to Client experience.
• Have working knowledge to enable business communications between business areas.
• Acumen to effectively participate and contribute to a culture that builds rewarding relationships, facilitates feedback, and provides exceptional client service.
• Ability to establish trust and creditability with respect to Data in the financial market.
• Ability to develop and maintain productive and collaborative working relationships with colleagues, peers, and stakeholders.
• Ability to continuously develop own expertise in terms of professional, industry, and legislation knowledge.
• Solidly grounded knowledge to contribute to continuous innovation through the development, sharing, and implementation of new ideas.
• Ability to work proactively and independently to deliver precise and accurate work.
• Ability to take ownership of driving personal career development.
• Acumen to demonstrate working with a strictly agile project methodology, including breaking down features and user stories for the team of data engineers into appropriately sized deliverables and where required, defining standards, performing code reviews, and validating for quality.
• Ability to display an inquisitive, detailed-orientated nature, and be unafraid to ask difficult questions, or challenge the status quo when the need arises.
• Acumen for leveraging financial industry experience to build a modern, secure, scalable solution that is appropriate for the clients and partners that the company services.
• Ability to make use of, and develop cost-effective, right-sized solutions and services within Microsoft Azure’s Cloud Platform to meet the core platform needs.
• Ability to displays consideration of the increasing risks faced as a society and as an organisation and suggests appropriate responses about the solutions being built.
• Possess Finance knowhow to Identify solutions to enhance cost -effectiveness and increase operational efficiency.
• Ability to provide input into the risk identification processes and communicate recommendations in the appropriate forum. This experience will allow the candidate to propose appropriate solutions and alternatives.
• Strong DevOps understanding, including CI/CD ...

KEY ROLES AND RESPONSIBILITIESl

• Accountable for the end-to-end technical solutions.
• Ensure that key decisions, once discussed and debated, are appropriately understood, and implemented. Collaborate with the Product Development Lead and the Business Enablement Lead to ensure that all stakeholder expectations are met.
• Ensure that the company’s Edge platform can cater to all varieties of data, including batch and real-time, and is safe, secure, scalable, and stable.
• Manage the work items on behalf of the team, breaking down and assigning work items per sprint.
• Managing elements of sprint planning.
• DevOps CI/CD pipeline management, control, and oversight.
• Engage other platform owners and agree on optimal integration paths and methods.

Apply Now!

WILLINGNESS TO RELOCATE TO JOHANNESBURG IS ESSENTIAL. SHOULD THIS OPPORTUNITY NOT BE ALIGNED WITH YOUR CAREER ASPIRATIONS, KINDLY FORWARD IT TO A FRIEND.

NB! This job is now closed. You can apply for other jobs by uploading your CV.