Capco Logo

Capco

Principal Data Engineer - AWS

Posted 6 Days Ago
Be an Early Applicant
Hybrid
London, England
Senior level
Hybrid
London, England
Senior level
The Principal Data Engineer will design, build, and deploy AWS-based data pipelines for financial services, ensuring scalable and resilient solutions.
The summary above was generated by AI

Principal Data Engineer - AWS 
Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent

Engineer future-ready data platforms that power financial transformation.

The Role
We’re looking for a Principal Data Engineer with AWS to join our growing team of engineering experts driving next-gen transformation for Tier 1 financial services clients. You’ll play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across the financial services industry.

What You’ll Do

  • Design and build end-to-end data pipelines leveraging AWS-native tools and modern data architectures.

  • Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems.

  • Apply AWS Well-Architected Principles to ensure scalability, security, and resilience.

  • Lead in the development of robust, tested, and fault-tolerant data engineering solutions.

  • Support and mentor junior engineers, contributing to knowledge sharing across the team.

What We’re Looking For

  • Proficient in one of Python, Scala or Java, with strong experience in Big Data technologies such as: Spark, Hadoop etc.

  • Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis).

  • Proficiency in AWS cloud environments.
  • Proven experience developing modern data architectures including Data Lakehouse and Data Warehousing.
  • A solid understanding of CI/CD practices, DevOps tooling, and data governance including GDPR.

Bonus Points For

  • Expertise in Data Modelling, schema design, and handling both structured and semi-structured data.

  • Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks.

  • Exposure to AWS Lake Formation and automation of ingestion and transformation layers.

  • Background in delivering solutions for highly regulated industries.

  • Passion for mentoring and enabling data engineering best practices across teams.

Why Join Capco

  • Deliver high-impact technology solutions for Tier 1 financial institutions

  • Work in a collaborative, flat, and entrepreneurial consulting culture

  • Access continuous learning, training, and industry certifications

  • Be part of a team shaping the future of digital financial services

  • Help shape the future of digital transformation across FS & Energy

We offer a competitive, people-first benefits package designed to support every aspect of your life:

  • Core Benefits: Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover.

  • Mental Health: Easy access to CareFirst, Unmind, Aviva consultations, and in-house first aiders.

  • Family-Friendly: Maternity, adoption, shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement.

  • Family Care: 8 complimentary backup care sessions for emergency childcare or elder care.

  • Holiday Flexibility: 5 weeks of annual leave with the option to buy or sell holiday days based on your needs.

  • Continuous Learning: Minimum 40 Hours of Training Annually: Take your pick—workshops, certifications, e-learning—your growth, your way. Also, Business Coach assigned from Day One: Get one-on-one guidance to fast-track your goals and accelerate your development.

  • Healthcare Access: Convenient online GP services.

  • Extra Perks: Gympass (Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance.

Inclusion at Capco
We’re committed to a barrier-free, inclusive recruitment process. If you need any adjustments at any stage, just let us know – we’ll be happy to help. We welcome applicants from all backgrounds. At Capco, we value the difference you make, and the differences that make you. Our #BeYourselfAtWork culture champions diversity, equity and inclusivity, and we bring a collaborative mindset to our partnerships with clients and colleagues. #BeYourselfAtWork is the cornerstone of our success and a value that our employees live and breathe every day.

Top Skills

Aws Glue
Boto3
Hadoop
Java
Kafka
Kinesis
Lambda
Python
Rds
Redshift
Scala
Spark
Spark Streaming
Step Functions

Similar Jobs at Capco

2 Days Ago
Hybrid
London, England, GBR
Mid level
Mid level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead data analytics initiatives for financial institutions, utilizing predictive modeling and data visualization tools to drive insights and innovation.
Top Skills: Power BIPythonQlikRSparkSQLTableau
3 Days Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Senior Data Scientist will lead data science projects, develop AI and ML solutions, and guide and train junior data scientists. They will work on transitioning prototypes to production while collaborating with other teams.
Top Skills: AWSAzureGCPHadoopHiveKerasMl Libraries (SpacyNumpyPythonRedshiftScipySparkSparkmlSQLTensorFlowTransformers)
4 Days Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead the creation of user-centric digital products in financial services, overseeing design delivery and advocating for quality and accessibility.
Top Skills: Adobe CcFigmaSketch

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account