EXL Logo

EXL

Data Engineer

Posted One Month Ago
Remote
Hiring Remotely in United States
85K-140K Annually
Expert/Leader
Remote
Hiring Remotely in United States
85K-140K Annually
Expert/Leader
Lead architecture, development, and optimization of a cloud-native data platform. Design high-volume batch and streaming pipelines, optimize data processing across AWS, Snowflake, Redshift, and Athena, and implement Iceberg-based data management. Establish security, privacy, observability, and DataOps practices while mentoring engineers, guiding technical direction, collaborating with data science teams, and delivering scalable petabyte-level data infrastructure.
The summary above was generated by AI

Work Location: United States
Work Mode      : Remote
Pay Range       :$85K-$140K /Yr Base + Annual Bonus

 The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale. Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position. The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process

For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits

Job Overview:

We are seeking an experienced and visionary Senior Full-Stack Data Engineer to lead the architecture, development, and optimization of a next-generation data platform. This is a critical role for an individual with over 10 years of deep data engineering expertise, capable of driving technical direction, mentoring team members, and delivering high-impact solutions in a fast-paced project environment..

Responsibilities
  • Platform Strategy & Leadership 
    • Technical Direction: Define and champion the architectural roadmap and best practices for our end-to-end data pipelines, ensuring scalability, reliability, and security across the platform.
    • Team Mentorship & Project Velocity: Act as a primary technical mentor, guiding a team of engineers, conducting code reviews, and aggressively driving the project timeline to ensure rapid delivery of data products.
    • Stakeholder Collaboration: Partner with Data Scientists, Analysts, and business stakeholders to translate complex requirements into robust, production-ready data solutions.
    • Collaboration with Data Scientists and ML Engineers:  Data Accessibility, Support for Model Development, Data Quality Assurance
  • Data Pipeline Development & Management
    • Ingestion & Transformation: Design, build, and optimize high-volume data ingestion and transformation jobs using tools like dbt Core, AWS Glue, ensuring data quality and integrity.
    • Workflow Orchestration: Develop and maintain sophisticated data pipelines using orchestrators such as Dagster, focusing on modularity and reusability.
    • Streaming & Real-time Integration: Implement and manage real-time data flows utilizing Confluent platforms or native AWS streaming services (e.g., Kinesis) for immediate data availability.
    • Data Security and Privacy: Data Anonymization, Compliance with Regulations
    • Be well versed with DataOps and DevOps fundamentals
  • Assist and drive the Data Ecosystem Management & Monitoring
    • Open Table Formats & Management: Implement and maintain the Iceberg open table format, utilizing tools for efficient schema evolution and data management.
    • Compute Engine Optimization: Optimize query performance and cost efficiency across our primary compute engines: Snowflake, Amazon Redshift, and AWS Athena.
    • Observability & Monitoring: Integrate comprehensive monitoring and observability into all pipelines using Splunk to ensure high availability, rapidly identify bottlenecks, and troubleshoot production issues
Qualifications
  • 10+ Years of hands-on, progressive experience in Data Engineering, Data Architecture, or a closely related Full-Stack Data role
  • Deep conceptual understanding of core data engineering principles, ETL/ELT patterns, and metadata management 
  • Proven track record of building and managing petabyte-scale data infrastructure in a cloud-native environment 
  • Insurance industry experience preferred but not mandatory
  • Tools:
    • Cloud Environment: AWS (S3, IAM, VPC, etc.)
    • Experience with Talend, dbt Core, Iceberg, AWS Glue Catalog, Snowflake, Redshift, Athena, Splunk, AWS streaming services, Git

Strong SQL, Pyspark and Python

Similar Jobs

11 Hours Ago
In-Office or Remote
CA, USA
123K-223K Annually
Senior level
123K-223K Annually
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and maintain the technical foundation for sales compensation, including commission systems, integrations, data pipelines, calculation logic, data models, testing, access controls, audit trails, reconciliation, and release practices. Partner with Sales Compensation Operations, Finance, Payroll, and technical teams to implement approved compensation plans and ensure accurate, explainable, reproducible commission results.
Top Skills: Access ControlsAPIsAudit TrailsAutomated TestingData ModelingData PipelinesExcelLookerPigmentSalesforceSQLVersion Control
Yesterday
Remote
US
106K-170K Annually
Junior
106K-170K Annually
Junior
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Build and maintain scalable production data pipelines and cloud data infrastructure. Ensure data quality, observability, lineage, governance, and cost-efficient performance. Develop data platform tooling, semantic and metrics layers, and enterprise data models supporting analytics, reporting, AI applications, and operational decisions. Collaborate with Analytics, Engineering, Product, operations, and business stakeholders while contributing to architecture, code reviews, testing, and technical standards.
Top Skills: AirflowAWSAzureBigQueryClaudeDbtDelta LakeDockerGCPGithub CopilotJavaPythonRedshiftScalaSnowflakeSnowflake Cortex AiSQLTerraform
Yesterday
In-Office or Remote
73K-130K Annually
Junior
73K-130K Annually
Junior
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Designs and maintains scalable data pipelines, cloud data environments, and governed semantic models for BI and analytics. Develops Python-based processing scripts, Snowflake solutions, Azure ETL/ELT pipelines, orchestration workflows, and CI/CD automation. Builds AI-powered workflows and Copilot skills to improve engineering operations, while collaborating with BI and cross-functional teams on an agile roadmap. The role also mentors junior engineers and promotes governance, reliability, security, and performance standards.
Top Skills: Apache AirflowSparkAzure Data FactoryCi/CdCopilotDatabricksDbtGithub ActionsAzurePythonSnowflake

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account