Data Integration Developer

SUMMARY:
Our client, a software solutions company, is recruiting for a Data Integration Developer to join their dynamic team, to design, develop, and maintain data pipelines from various sources into the data warehouse.

POSITION INFO:
Data Integration Developer
Fully Remote, Centurion

Qualifications:

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or related field (relevant work experience may be considered)

• Proven experience as an ETL Developer or Data Engineer, with expertise in ETL tools like Informatica, Talend, Apache Nifi, SSIS, or similar frameworks
• Strong SQL skills and experienetce with relational databases (e.g., SQL Server, Oracle, PostgreSQL)
• Familiarity with cloud-based data solutions (e.g., AWS Redshift, Azure Synapse, Google BigQuery)
• Experience with scripting languages (Python, PowerShell, Bash) for automation and data processing
• Proficient in API testing tools (SoapUI, Postman)
• Knowledge of data modeling, database design, and data warehousing
• Experience with cloud data services (AWS, Azure, GCP) and cloud-native ETL tools (e.g., AWS Glue, Azure Data Factory)
• Knowledge of big data technologies (Hadoop, Spark) and large dataset handling
• Familiarity with Git and CI/CD processes for ETL development
• Experience with data governance, security, and compliance (GDPR, HIPAA)
• Proficient in programming languages like Python, Java, Scala, or C#

• Design, develop, and implement ETL processes to load data from various sources into data warehouses
• Collaborate with stakeholders to gather and understand data requirements
• Optimize and maintain existing ETL workflows for performance and scalability
• Ensure data quality with validation, cleansing, and error-handling procedures
• Monitor ETL jobs, troubleshoot issues, and ensure process availability
• Document ETL architecture, data flows, and transformation logic
• Collaborate with data engineers and architects to support the overall data architecture
• Develop automated data integration and reporting solutions
• Participate in data integration and migration projects
• Ensure ETL processes comply with data security and privacy regulations