Sr. Data Engineer

| Greater Boston Area
Sorry, this job was removed at 11:30 a.m. (EST) on Friday, July 24, 2020
Find out who's hiring remotely in Greater Boston Area.
See all Remote Developer + Engineer jobs in Greater Boston Area
Easy Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Abacus Insights is a mission-driven, start-up technology company that is focused on improving health outcomes, lowering the cost of healthcare, and delivering a more seamless healthcare experience. At our core, we are passionate about advancing healthcare and improving people’s lives through technology.

Abacus Insights provides a flexible, efficient, and secure platform that organizes and exchanges data from various sources and formats, allowing healthcare companies to uncover differentiated insights that address their customers’ needs. Our employees know that they play an active role in keeping our customers data safe and are responsible for ensuring that our comprehensive policies and practices are met.

With our deep expertise in cloud-enabled technologies and knowledge of the healthcare industry, we have built an innovative data integration and management platform that allows healthcare payers access to data that has been historically siloed and inaccessible. Through our platform, these health insurance payers can ingest and manage all the data they need to transform their business by supporting their analytical, operational, and financial needs.

Through this mission and passion to aid people and population health, we have built a highly successful SaaS business that is heavily funded (since our founding in 2017 we have raised over 53 million) by leading VC firms who have deep expertise in the healthcare and technology industries. At Abacus, we are solving problems of massive scale and complexity in an industry that is not only ripe for disruption but requires innovation. We see massive growth in our future and would love for you to be a part of it!

Our Connector Engineering team is looking to bring on an experienced Senior Data Engineer. If you are interested in being a guiding voice on a critical feature delivery team, this position is for you. The connector engineering team is responsible for delivering the data pipelines that ingest and process diverse sources of data. This includes building large batch processing and streaming systems. You will be exposed to every area of our platform and AWS services (Serverless – Lambda, EMR – Hadoop/Spark, EKS – Kubernetes, etc.) but even more so, help drive the evolution of the product and team as we continue to grow rapidly. We believe heavily in architecture evolution and you will bring your experience on best practices as we build out new components of the platform.

Responsibilities:

  • Help deliver against our roadmap for upcoming new features
  • Designing, implementing, testing, and maintaining our data pipelines
  • Optimizing data delivery, designing or re-designing infrastructure for greater scalability, availability, and reliability.
  • Spearheading the implementation of data management and governance procedures within the company
  • Ensuring data integrity and accuracy within our various data pipelines
  • Become an expert in AWS and other cloud service providers (currently we deploy on AWS but who knows what the future holds)
  • Help make the deployment process predictably predictable through proactive thinking, persistence, promoting best practices, and cross team collaboration with our technical and non-technical teams
  • Consult on architecture to separate sensitive healthcare data among multiple customers in a multi-tenant environment

What you bring to the Abacus Team:

  • In-depth knowledge of the design and maintainability of “big data” data architectures, notably data lakes, columnar databases, large batch processing (Spark, Hadoop), stream processing (Kafka) and message queuing
  • In-depth experience with AWS data services (EMR, Glue, Athena, Redshift, Kinesis, SQS, DynamoDB or MongoDB), serverless architectures (Lambda) and container architectures (Kubernetes)
  • In-depth experience building and shipping highly scalable and distributed systems on cloud platforms.
  • Strong programming skills (Python, Java or other OOP languages)
  • Strong experience with hands-on data analysis and modeling of large data sets.
  • Strong project management and organizational skills.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience coupled with a willingness to learn new things
  • Desire to contribute individually, with the ability both to self-direct work and to collaborate with others on the technology team
  • Familiarity with infrastructure automation using Terraform and GitLab CICD
  • Comfort with uncertainty and a desire to be close to business problems
  • Background working in an Agile delivery framework
  • 5+ years of experience with data engineering and “big data” architecture

Bonus:

  • Experience with other Cloud Data Warehouses (Big Query, Snowflake)

Equal Opportunity Employer:
As a mission-led technology company that is helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. We are dedicated to building diverse teams, and as such provide equal employment opportunities to all employees and applicants for employment. As well as prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Read Full Job Description
Easy Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavascriptLanguages
    • PythonLanguages
    • SqlLanguages
    • ReactLibraries
    • ReduxLibraries
    • DockerFrameworks
    • GraphQLFrameworks
    • KafkaFrameworks
    • KubernetesFrameworks
    • SparkFrameworks
    • TerraformFrameworks
    • AWS RedshiftDatabases
    • SnowflakeDatabases
    • DatabricksDatabases
    • AWS (Amazon Web Services)Services
    • GitHubServices
    • GitLabServices
    • Microsoft AzureServices
    • Google AnalyticsAnalytics
    • TableauAnalytics
    • InVisionDesign
    • ConfluenceManagement
    • JIRAManagement
    • DocuSignCRM
    • ZohoCRM

Location

We're in the heart of Boston's Financial District, a short walk to all MBTA bus/train lines, including North & South stations. Shop in the historic Faneuil Hall or visit tasty lunch spots in the North End. We embrace a hybrid working culture; our employees can enjoy the city's hustle or stay home.

An Insider's view of Abacus Insights

What are some social events your company does?

We've had fun social events like the battle of the bands and ax throwing. Since our workforce went primarily remote in 2020, we've had to get creative, finding success with virtual cooking classes, murder mysteries, daily morning coffee chats, and Thursday evening happy hours. We recently got together for peddle boat excursion in the Boston harbor.

Ali

People Operations Partner

How do you collaborate with other teams in the company?

My job requires that I partner with many people across the company, from Engineering and Product Management to Legal and UX. I’m consistently impressed by everyone’s generosity with their time, customer focus, and willingness to partner with me.

Karyn

Sr. Technical Writer

How has your career grown since starting at the company?

Since joining Abacus, I've been trusted and given the necessary tools to do my job and help grow this amazing company. I've been exposed to so many different sectors of the business and my experience learning and growing from my colleagues has been unmatched. It’s nice to be a part of something that I know is going to help people in the long run.

Anne

Lead UX Designer

How do you make yourself accessible to the rest of the team?

We are a small but growing company, we have beads working remotely across the country. Remaining connected to the team is critical and I use as many of the existing tools as possible - email, Slack, Zoom, Confluence - the list goes on. It is more likely that I will access my team!

Minal

CEO, Founder

What's the biggest problem your team is solving?

Our Foundational Marts offering helps pull data from multiple sources into a data warehouse and makes it actionable and accessible to our clients. With data coming from many places, we must keep that data secure, accurate, and up to date. Snowflake, Databricks, and Serverless make it possible to bring this data altogether in a meaningful way.

Pat

Principal Software Engineer & Team Lead

What are Abacus Insights Perks + Benefits

Culture
Volunteer in local community
Partners with nonprofits
Abacus partners with The Wonderfund, a non-profit focused on providing comfort and dignity to children in traumatic situations and enrich childhoods that have been impacted by abuse and neglect.
Team based strategic planning
Employee-led culture committees
Hybrid work model
In-person all-hands meetings
Employee awards
Flexible work schedule
Remote work program
Diversity
Mean gender pay gap below 10%
Hiring practices that promote diversity
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability insurance
Dental insurance
Vision insurance
Health insurance
Life insurance
Pet insurance
Wellness programs
Mental health benefits
Financial & Retirement
401(K)
Company equity
Performance bonus
Child Care & Parental Leave Benefits
Generous parental leave
Family medical leave
Return-to-work program post parental leave
Vacation & Time Off Benefits
Unlimited vacation policy
Generous PTO
Paid volunteer time
Paid holidays
Paid sick days
Office Perks
Commuter benefits
Company-sponsored outings
Free snacks and drinks
Home-office stipend for remote employees
Onsite gym
Professional Development Benefits
Job training & conferences
Lunch and learns
Promote from within
Mentorship program
Online course subscriptions available
Paid industry certifications
Personal development training

More Jobs at Abacus Insights

Easy Apply
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about Abacus InsightsFind similar jobs like this