Informa Logo

Informa

Staff Engineer – Data Platform and Lakehouse

Posted 2 Days Ago
In-Office or Remote
Hiring Remotely in New York, NY
180K-220K Annually
Senior level
In-Office or Remote
Hiring Remotely in New York, NY
180K-220K Annually
Senior level
Lead the design and implementation of a cloud-native Data Platform for AI and analytics, collaborating with cross-functional teams to enhance product offerings.
The summary above was generated by AI
Company Description

Curinos empowers financial institutions to make better, faster and more profitable decisions through industry-leading proprietary data, technologies and insights. With decades-long expertise in the financial services industry and a relentless focus on the future, Curinos technology and analytics ecosystem allows clients to anticipate customer needs and optimize their go-to market decisions in an increasingly competitive market.

Curinos operates in a hybrid/remote model, and this position is fully remote in the United States or hybrid in the Greater New York, Boston or Chicago metropolitan areas.

Job Description

We are seeking and experienced  Staff Engineer – Data Platform and Lakehouse  to lead the design and implementation of our cloud-native Data Platform  that support AI, advanced analytics, and machine learning applications in our ecosystem of B2B SaaS applications in the FinTech vertical You’ll work with a diverse team of talented engineers, AI and ML scientists, and product managers to build our next generation data and AI platforms, support migration of products from legacy infrastructure, and help product engineering teams leverage the Data platform and Lakehouse to launch new products and build new genAI applications. As a company that specializes in data-driven insights, the reliability, scalability, and effectiveness of our data & AI platforms are integral to our product offerings.  This role requires deep technical expertise, strategic thinking, and strong collaboration across engineering, data science, and product teams.

Responsibilities:

  • Design and implement scalable, secure, and maintainable data platforms on Databricks and AWS cloud infrastructure.
  • Provide architectural leadership across engineering domains, ensuring consistency, scalability, and resilience
  • Architect distributed data processing systems using Apache Spark and optimize for performance and scalability.
  • Lead development of reusable data pipelines and workflows using Databricks Workflows.
  • Translate business objectives into platform capabilities in collaboration with Product Managers and cross-functional teams.
  • Support AI/ML initiatives through robust data engineering, including feature engineering, model deployment.
  • Champion best practices in ETL/ELT, data quality, monitoring, observability, and Agile development.
  • Drive adoption of data governance standards: access control, metadata management, lineage, and compliance.
  • Establish and maintain CI/CD pipelines and DevOps automation for data infrastructure.
  • Evaluate and integrate emerging technologies to enhance development, testing, deployment, and monitoring.

Salary Range: $180,000 -$220,000 (plus bonus)

Qualifications

Desired Skills and Expertise:

  • 15+ years of experience in software development, covering the full SDLC: ideation, design, development, testing, deployment, and support.
  • Strategic mindset, capable of aligning technical decisions with business goals and driving architectural vision.
  • Excellent collaboration and communication skills across functions, including data scientists, MLOps engineers, and product managers.
  • Advanced proficiency in Python and SQL, with a strong foundation in software engineering principles.
  • Extensive experience with distributed computing frameworks, particularly Apache Spark, including performance tuning and scalability.
  • Required hands-on experience with Databricks, including Unity Catalog, Feature Store, and Delta Live Tables.
  • Proficiency in data pipeline orchestration tools using Databricks Workflows, Airflow, or AWS Glue; Databricks required.
  • Strong command of data engineering best practices and tools, including ETL/ELT design, data quality validation, monitoring, and observability. Experience with Monte Carlo preferred.
  • Proven ability to build scalable, cloud-native data architectures on Databricks, AWS, Azure, or GCP; Databricks required.
  • Experience enabling AI/ML workloads including feature engineering, model deployment, and real-time processing.
  • Strong understanding of data governance and security, including access control, data lineage, compliance, and metadata management.

 

Additional Information

Why work at Curinos?  

  • Competitive benefits, including a range of Financial, Health and Lifestyle benefits to choose from 
  • Flexible working options, including home working, flexible hours and part time options, depending on the role requirements – please ask! 
  • Competitive annual leave, floating holidays, volunteering days and a day off for your birthday!
  • Learning and development tools to assist with your career development 
  • Work with industry leading Subject Matter Experts and specialist products 
  • Regular social events and networking opportunities 
  • Collaborative, supportive culture, including an active DE&I program 
  • Employee Assistance Program which provides expert third-party advice on wellbeing, relationships, legal and financial matters, as well as access to counselling services 

Applying: 

We know that sometimes the 'perfect candidate' doesn't exist, and that people can be put off applying for a job if they don't meet all the requirements. If you're excited about working for us and have relevant skills or experience, please go ahead and apply. You could be just what we need! 

If you need any adjustments to support your application, such as information in alternative formats, special requirements to access our buildings or adjusted interview formats please contact us at [email protected] and we’ll do everything we can to help.

Inclusivity at Curinos: 

We believe strongly in the value of diversity and creating supportive, inclusive environments where our colleagues can succeed.  As such, Curinos is proud to be an Equal Opportunity Employer. We do not discriminate on the basis of race, color, ancestry, national origin, religion, or religious creed, mental or physical disability, medical condition, genetic information, sex (including pregnancy, childbirth, and related medical conditions), sexual orientation, gender identity, gender expression, age, marital status, military or veteran status, citizenship, or other protected characteristics. 

Top Skills

Airflow
Spark
AWS
Aws Glue
Azure
Databricks
GCP
Python
SQL

Similar Jobs

33 Minutes Ago
Easy Apply
Remote
United States
Easy Apply
110K-145K Annually
Senior level
110K-145K Annually
Senior level
Healthtech • Insurance • Other • Sales • Software
The Manager of Contracting Operations will lead a team to improve efficiencies in onboarding agents. Responsibilities include hiring, training, and optimizing contracting processes while collaborating with cross-functional teams.
Top Skills: AirtableDialpadIntercomTicketing Systems
35 Minutes Ago
Remote or Hybrid
USA
15-40
Internship
15-40
Internship
Artificial Intelligence • Cloud • Internet of Things • Machine Learning • Analytics • Industrial
As a Part-Time Student in Industrial Intelligence, you will analyze data sets, extract insights, and collaborate to deliver data-driven solutions.
Top Skills: AIAlgorithmic Modeling TechniquesApplied Statistical AnalysisBayesian StatisticsDatabricksGitJupyter NotebooksMachine LearningOperations ResearchOptimizationPysparkSignal ProcessingSQL
35 Minutes Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
132K-165K
Senior level
132K-165K
Senior level
Artificial Intelligence • Healthtech • Telehealth
Lead the design and execution of enablement programs to enhance sales performance, drive behavior change, and improve revenue initiatives. Collaborate with sales teams to develop targeted training and support materials, analyze performance gaps, and assess enablement effectiveness for better outcomes.
Top Skills: Gong

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account