Data Integration Engineer
Australia, Perth
Fulltime: 40 hrs a week
Experience: 6-9 Years
Information Technology
Introduction
Brunel are partnered with a leading Energy and Resource company to deliver the best work opportunities for IT & Technical professionals within Australia. We currently have a contract oppurtintiy for a seeking an Data Integration Engineer - to work on a contract basis.
About this role
The Data Integration Engineer will play a key role in developing, maintaining, and supporting data integration and ingestion platforms within AWS. This role is central to ensuring seamless and reliable data flow between internal systems, APIs, and cloud data warehouses, enabling accurate, timely, and secure data availability for analytics and operational systems.Working primarily with AWS Lambda (Python), Redshift, and API-based data pipelines, the Data Integration Engineer will deliver scalable, well-documented, and automated ingestion solutions.
Responsibilities:
- Implement, test and deploy AWS Lambda functions for daya ingestions from relational DBs and REST APIs, landing into S3/Redshift.
- Build robust API-API integrations (auth, paging, idempotency, retries, error handling).
- Monitor and triage ingestion failures; maintain observability (CloudWatch logs/metrics, alerts).
- Maintain and improve existing Lambda connectors for legacy integration platform / old warehouse.
Is this you?
- Formal qualifications in Computer Science, Engineering, or a related technical field.
- Proven experience building and supporting AWS Lambda-based data ingestion and integration pipelines using Python
- Strong understanding of SQL, data warehousing concepts, and working knowledge of Amazon Redshift (or equivalent).
- Proficiency in API integration-REST, JSON, OAuth, pagination, and error/retry handling.
- Hands-on experience with AWS services such as S3, IAM, CloudWatch, and Step Functions.
- Familiarity with Git, CI/CD pipelines, and general DevOps practices for serverless deployments.
- Exposure to Apache Kafka, Databricks, or Spark environments is advantageous.
What we offerÂ
- Salary sacrificing
- Employee Assistance Program (EAP)
- Corporate discounts
About Brunel:
Brunel is a recruitment and flexible workforce solution provider which connects talented people with opportunities throughout Australasia and around the world. We specialise in highly skilled roles across a variety of technical, professional, trades and craft disciplines, pairing candidates with industry-leading projects and organisations on a contract, permanent or secondment basis.
Operating in Australasia since 1997, Brunel has major bases of operation in Perth, Sydney, Brisbane and Port Moresby, which are further backed by the strength and reach of a truly global network spanning over 45 countries, 120 offices and 45 years of successful operation.
Brunel is proud to be equal opportunity employer and encourages applications from Aboriginal and Torres Strait Islander and female candidates.
Do you have questions?
If you have any questions or would like to discuss the details of this role, please contact Joel Bellinger-Brown.