Login with LinkedIn

Technology & consulting jobs

< Back to the job list

Data Engineer, permanent, London

£45,000 to £75,000

London / Permanent / Ref: SC3127-071118

My client who are a Fintech company in London are in need of an experienced Senior Data Engineer to lead the process of upgrading, building, and optimising their new data warehouse/lake combo. The right candidate will combine software development and project management skills, and they will be required to set and drive the roadmap of the project.

You will help create a scalable, robust, and efficient data-warehousing solution powering the analytical needs of the whole company.

What you'll be doing:

  • Liaise with data analysts, data scientists and decision makers such as product owners and business analysts to gather requirements
  • Build scalable, reliable, maintainable, secure and high-performance data warehouse (Redshift) platform and data lake (S3) combo powering the analytical needs of the whole company
  • Lead the design, development and implementation of various data pipelines using AWS based big data technologies
  • Data Modelling in Redshift and Hive/Glue to ensure data integrity, ease of data access and query efficiency

Tech stack:

  • Data Pipeline:AWS S3, Lambda, Glue, Redshift and Kinesis/Kafka
  • ETL:Job orchestration using Airflow or AWS Glue or Custom ETL/ELT
  • SQL:Postgres/SQL Server/Redshift
  • Python:Pandas, NumPy and boto3 AWS SDK
  • Big Data Technologies: Spark, Athena/Presto, Glue/Hive Data Catalo

Essential skills:

  • 4+ years of experience in Data Engineering
  • Strong understanding of Python Data Structures and algorithms
  • Experience with data pipelines and ETL/ELT process using Python
  • Experience with data modelling and data architecture optimisation
  • Experience with Postgres, SQL Server or Redshift databases
  • Proficient in writing complex SQL statements
  • Experience with different AWS services and Spark
  • Understanding of software development life cycle and practices such as coding standards, code reviews and version control using Git
  • Experience working with CI/CD

Job reference: SC3127-071118

Alexander Ash Consulting is acting as an agency Apply now

Register with us

Upload your CV, create a profile, manage your applications and create
live job alerts by email Find out more.