Data skills (Spark + Scala) - #2185203

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you

Role Title: Data skills (Spark + Scala)

Location: Glasgow (Hybrid 2/3 days per week)

Duration: 31/12/2026

Role Description:

JD:

Key Accountabilities

· Develop, maintain and troubleshoot data orchestration workflows using Apache Airflow for extract generation, data publishing, feed delivery and operational batch processes.

· Build and support reusable engineering components using Python, Scala and Sharedview Spark to process, transform and validate large-scale finance datasets.

· Design, write and optimise SQL/PostgresQL and Starburst/Trino queries for metadata processing, data validation, reconciliation and operational investigation

· Support Output Gateway production issues including failed DAGs, delayed extracts missing files, data mismatches, checksum failures, logs, status updates and downstream delivery exceptions

· Contribute to platform engineering and release activity using GitLab, Docker and controlled CI/CD practices across DEV, UAT and production-like environments

· Enhance monitoring, logging, alerting, audit tracking and automation to improve operational stability, supportability and evidence for control processes

· Work with application, platform, database, infrastructure and downstream teams to diagnose issues end-to-end and implement safe, controlled fixes

· Maintain a strong risk and control mindset by ensuring changes are tested reviewed, documented and released under Barclays technology, security and change standards.

Desirable skills/Preferred Qualifications:

· Experience with Starburst/Trino, AWS S3 concepts and distributed query behavior for large dataset validation and troubleshooting

· Exposure to React JS or API-driven operational user interfaces for configuration, monitoring and support workflows

· Familiarity with OpenShift, Kubernetes, Helm or container platform deployments ir enterprise environments.

Understanding of financial data controls, auditability, reconciliation, lineage operational resilience and data quality expectations.

If you are interested in this position and would like to learn more, please send through your CV and we will get in touch with you as soon as possible. Please note, candidates are often Shortlisted within 48 hours.