Data Engineer - #1701195

Data Engineer, Glasgow (Remote Working)

Day Rate: £450 Per Day

Duration: 3 months (extension possible)

IR35 Status: Outside IR35

Overview

We are seeking an experienced Data Engineer Contractor to deliver a robust, scalable data integration pipeline on the Azure platform. This role requires hands-on expertise in API ingestion, orchestration, and transformation into a well-designed data warehouse structure, including star schema design for downstream analytics.

You’ll play a key role in building end-to-end data flow from source APIs to a SQL-based DWH, ensuring data is clean, reliable, and analytics-ready.

Key Responsibilities

• Develop Python-based ETL scripts to extract data from external REST APIs


• Implement incremental loading strategies using watermarking or change detection


• Orchestrate workflows using Azure Function Apps or Docker containers


• Integrate processes into Azure Data Factory (ADF) pipelines


• Design and implement star schemas suitable for reporting and analytics use cases


• Write and optimize T-SQL stored procedures for transformation


• Establish monitoring, logging, and alerting for pipeline reliability


• Contribute to CI/CD pipelines for deployment automation


• Maintain clear and concise technical documentation throughout

Essential Skills & Experience

• Advanced Python skills for building data extraction and transformation workflows


• Solid experience across Azure data services, particularly:


• 
  Azure Function Apps or Docker


• Azure Data Factory (ADF)


• Azure SQL / Synapse


• Strong experience in designing star schemas and dimensional modelling for analytics


• Strong SQL development skills (stored procedures, indexing, performance tuning)


• Experience with incremental data loading patterns (e.g. watermarking)


• Proven ability to build and support reliable, production-grade data pipelines
  


• Working knowledge of CI/CD tools (e.g. Azure DevOps, Git)