Senior Data Platform Engineer

Job Overview

The Senior Data Platform Engineer of the Shared Data Platform plays a pivotal role in designing and developing innovative services to enhance Arrowstreet Capital’s data infrastructure. The primary objective is to streamline the ingestion and transformation of new data sources, enabling rapid delivery of actionable analytics across the firm. You will collaborate with stakeholders from various departments to gather requirements and identify process improvements that optimize data flow. Additionally, you will design flexible abstractions and frameworks, ensuring that platform solutions can be efficiently tailored to meet the diverse needs of internal clients.

Responsibilities

• Define and execute the technical roadmap for the platform that can support batch and real-time data sets using modern data processing frameworks.

• Oversee and contribute to building features for data discovery, lineage, governance, ingestion operation, cost management, performance, etc.

• Lead and assist the team in investigating potential improvements achieved by adopting new data technologies and frameworks.

• Achieve high quality metrics through automated testing, robust operational tooling, and highly-available cloud architecture.

• Production support of the platform to avoid disruption to investment processes.

• Collaborate closely with business stakeholders to understand their data needs, translate business objectives into scalable and efficient data engineering solutions.

• Partner with IT operations and cloud security teams to ensure platform solutions are secure, scalable, and reliable.

• Develop and mentor a junior Data Engineers

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering or a related discipline

• At least 5 years of experience working with data lakes, data warehousing, and/or database systems, including processing frameworks like Spark, Hadoop, Presto, etc.

• You strive to write elegant code, and you're comfortable with picking up new technologies independently

• You are fluent in at least one major programming language (e.g. Python, C#)

• Hands-on experience working with AWS. and automation through infrastructure as code with one of the Terraform, Pulumi, Cloudformation and CDK etc.

• Experience designing and deploying APIs and client libraries using tools such as OpenAPI, FastAPI, or similar frameworks.

• You have experience with real-time streaming processing with Kafka, Kinesis, and Apache Flink etc.

The base salary range for this position is $135,000 - $325,000 per year.

Arrowstreet Capital operates a robust talent acquisition program, and we also seek to compensate and reward our employees competitively within our industry and in line with our merit-based culture. Our approach to total compensation includes base salaries and annual discretionary bonuses, as well as a robust benefits package. The determination of a successful candidate’s base salary placement within the listed range will vary based on the candidate’s relevant experience and qualifications (which may also include relevant certifications, credentials and other education), the job responsibilities and scope, the commensurate resulting level of the position and other relevant factors. The listed range is also an estimate, and additional information regarding base salary and other elements of total compensation offered by Arrowstreet Capital to successful applicants will be communicated during the recruitment process.  

Arrowstreet Capital is a Boston-based systematic investment firm that manages global equity portfolios for institutional investors around the world. 

All qualified applicants will receive consideration for employment without regard to sex, race, color, religion, national origin, ancestry, genetic information, age, pregnancy, medical condition, disability, veteran or military status, marital status or any other characteristic protected by federal, state, or local law.

Arrowstreet Capital is committed to working with and providing reasonable accommodations for qualified individuals with disabilities and disabled veterans. If you need a reasonable accommodation for any part of the employment process due to a disability, contact us to discuss the nature of your request and contact information.