As a Lead Data Engineer, you will design and implement scalable data architectures, manage data processes, and mentor junior engineers while ensuring data governance and quality across projects.
Job Description
Job Description
Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.
As a Lead Data Engineer at JPMorgan Chase within the Compliance Technology Team which is aligned to Corporate Technology division , you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm's business objectives.
Job responsibilities
Required qualifications, capabilities, and skills
Preferred qualifications, capabilities, and skills
Job Description
Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.
As a Lead Data Engineer at JPMorgan Chase within the Compliance Technology Team which is aligned to Corporate Technology division , you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm's business objectives.
Job responsibilities
- Provides recommendations and insight on data management, governance procedures, and intricacies applicable to the acquisition, maintenance, validation, and utilization of data
- Designs and delivers trusted data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way
- Defines database back-up, recovery, and archiving strategy
- Generates advanced data models for one or more teams using firm wide tooling, linear algebra, statistics, and geometrical algorithms
- Approves data analysis tools and processes
- Creates functional and technical documentation supporting best practices
- Advises junior engineers and technologists
- Evaluates and reports on access control processes to determine effectiveness of data asset security
- Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
- Formal training or certification on Data Engineeringconcepts and 5+ years applied experience
- Demonstrated leadership abilities, including leading and mentoring a team of data engineers.
- Expertise in designing and implementing scalable data architectures and pipelines.
- Strong proficiency in programming languages such as Python and PySpark.
- Experience with AWS cloud platform including their data services.
- In-depth knowledge of data warehousing solutions and ETL processes.
- Ability to work collaboratively with cross-functional teams, including data scientists, analysts, and business stakeholders.
- Experience with data governance and ensuring data quality and integrity.
- Proficiency in Big Data technologies, with a strong focus on Performance Optimization using best practices
- Excellent communication skills, with the ability to convey complex technical concepts to non-technical audiences.
- Experience with version control systems like Git and CI/CD pipelines for data engineering workflows.
Preferred qualifications, capabilities, and skills
- Experience with Databricks using PySpark
- Solid understanding of the Parquet file format.
- Experience with ETL tools, and experience in ETL process
- Familiarity with machine learning frameworks and integrating them into data pipelines.
Top Skills
AWS
Big Data
Databricks
ETL
Pyspark
Python
Similar Jobs at JPMorganChase
Financial Services
The Site Reliability Engineer III is responsible for designing, implementing, and maintaining data streaming technologies using Kafka and other tools, ensuring security and stability in cloud environments.
Top Skills:
AWSAzureCloud FoundryGCPGitJavaJenkinsJIRAKafkaKubernetesPuppetPythonTerraformUnix Shell Scripting
Financial Services
As a Payroll Product Associate, you'll support product strategy, analyze metrics, contribute to solution discovery, and collaborate with teams in an Agile environment.
Top Skills:
JIRAOracle Hcm Pay And Time
Financial Services
As a Lead Software Engineer, you'll build scalable solutions, ensure code security, optimize performance, and collaborate within teams to deliver innovative products.
Top Skills:
Java,Kotlin,Cloud-Native Solutions,Open-Source Technologies
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
