Data Engineer - Spark & Scala - #2179982

GIOS Technology

Date: 1 day ago

City: Glasgow

Salary: £36 - £38 / hour

Contract type: Contractor

We are hiring: Data Engineer – Spark & Scala

Location: Glasgow, UK – Hybrid (2–3 days onsite)

Strong hands-on experience with Apache Spark and Scala for processing, transforming and validating large-scale datasets.
Experience developing and maintaining data pipelines and orchestration workflows using Apache Airflow.
Proficiency in Python, SQL and PostgreSQL for data processing, validation, reconciliation and troubleshooting.
Experience with production support, investigating failed workflows, data mismatches, missing files and pipeline failures.
Familiarity with GitLab, CI/CD, Docker and controlled software release practices.
Understanding of data quality, monitoring, logging, auditability and operational resilience.
Experience with Starburst/Trino, AWS S3, Kubernetes or OpenShift would be an advantage.

Key Skills: Apache Spark / Scala / Python / Apache Airflow / SQL / PostgreSQL / Starburst / Trino / GitLab / CI/CD / Docker / Data Engineering / Production Support

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Project Manager

First Recruitment Group,

2 hours ago

Location: Glasgow / Clyde Area (Hybrid Working Available) Contract: Long-Term Contract Opportunity Security Clearance: SC Clearance Required or Ability to Obtain An exciting opportunity has arisen for an experienced Project Manager to join a major infrastructure programme delivering complex engineering...

Mechanical Engineer (Safety Review)

confidential,

2 hours ago

Are you a Mechanical Engineer looking to play a key role in the safety and long-term operation of critical nuclear infrastructure? Do you have experience carrying out Periodic Safety Reviews (PSRs) and assessing the ongoing fitness for service of engineering...

New Business Underwriter

Lawes Consulting Group,

18 hours ago

ROLE OVERVIEW A leading insurance organisation is seeking an experienced Development Underwriter to join their growing team. This is an excellent opportunity for a motivated professional who enjoys building strong broker relationships and delivering high‑quality underwriting service within the SME...