Senior Software Engineer (Big Data), Massive Graph Processing

| Remote
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Senior Software Engineer (Big Data), Massive Graph Processing


LiveRamp is the leading data connectivity platform for the safe and effective use of data. Our platform powers people-based customer experiences that improve the relevance of marketing and allow consumers to connect with the brands and products they love. We thrive on solving fascinating technical problems and enabling our customers’ success—and we’re always looking for smart, kind, compassionate people to help us blaze a trail.

 

Mission: LiveRamp makes it safe and easy for businesses to use data effectively.

 

We on the Identity Engineering team maintain the graph processing engine that connects the trillions of different identifiers for consumers and the devices they use online. Help us process this trillion edge graph as quickly and efficiently as possible.

 

You will:

  • Collaborate with a team of supportive and passionate software engineers, product, infrastructure and other internal partners remotely to tackle challenging problems, plan and execute on development projects that build, enhance and customize our high-performance data ingest, partitioning, graph and edge building systems.
  • Foster a positive environment of integrity, operational excellence, initiative and empower the team to achieve a high level of technical productivity, reliability, and simplicity by developing in Java and leveraging tools like Docker, Kubernetes, Terraform, Gradle, Jenkins, GCP, Hadoop and Spark.
  • Design with privacy and security-first principles and err on the side of shipping fast and iterating.

Your team will: 

  • Find feedback to be important in helping us grow as individuals and as a team; we’re always looking for chances to kindly share positive and constructive feedback and we aim to accept feedback with grace.
  • Follow a Scrum-based devops model with a few guiding principles:
    • Support, trust and motivate the people involved
    • Continuous software delivery and process improvement
    • Minimize barriers to development and leverage automation
  • Work on:
    • Edge Ingestion and Partitioning Framework: We could never process all trillion edges at once and luckily we don’t have to. Instead we process subgraphs that contain specific types of edges. Our edge ingestion and partitioning leverages LiveRamp’s Seek MSJ framework to efficiently incorporate new data into existing edge stores.
    • Path Computation as a Service: We provide a service to other LiveRamp engineering teams for finding specific types of paths within our massive graph. It services 80,000 requests, 10PB data per day and this is possible due to its use of highly scalable Spark jobs and intelligent caching mechanism.
    • Project categories: besides product requests and enhancements, we work on projects in performance and cost optimization, security and legal compliance, reliability and quality initiatives, as well as architectural refreshes such as POC in restructuring our data to be more streaming/real time friendly, new REST API for relevant services, migration of apps to Spark, Parquet, and other new technologies that could make our processing faster, more scalable, maintainable and cost effective.

About you: 

  • Have 3+ years of experience writing and deploying object oriented production code.
  • Have 2+ years of experience using cloud based platform such as GCP, AWS, Azure or similar technologies
  • Strong ability to break down complex problems to their essential components, design and implement elegant solutions for them.
  • Have a passion for building large-scale distributed systems and are comfortable writing maintainable and high performance code.
  • Comfortable evaluating and adapting to the latest tools and technologies.
  • You love mentoring junior engineers and deploying software that conforms to best practices.
  • Have a startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive.
  • Excellent communication and presentation skills.
  • Bachelor of Science in Computer Science or related degree.
 

Bonus Points:

  • Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Spark, Kafka, Hive, or Apache Beam
  • Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle
  • Experience with designing and implementing interfaces and infrastructure for large scale systems and RESTful APIs

Benefits:

  • People: work with talented, collaborative, and friendly people who love what they do.
  • In-Office Food: enjoy catered meals, boundless snacks, and the occasional food truck.
  • Fun: we host in-person and virtual events such as game nights, happy hours, camping trips, and sports leagues. 
  • Work/Life Harmony: flexible paid time off, remote work opportunities, and paid parental leave. 
  • Whole Health Package: medical, dental, vision, and disability insurance. Plus mental health support (via Talkspace) and fitness reimbursement up to $100 per month. 
  • Savings: our 401K matching plan helps you plan ahead.
  • Remote Work Support: a comprehensive program to assist you in setting up a home office that works for you
  • Location: Work remotely from home. 

More about us:

LiveRamp’s mission is to connect data in ways that matter, and doing so starts with our people. We know that inspired teams enlist people from a blend of backgrounds and experiences. And we know that individuals do their best when they not only bring their full selves to work but feel like they truly belong. Connecting LiveRampers to new ideas and one another is one of our guiding principles—one that informs how we hire, train, and grow our global team across eight countries and four continents.

LiveRamp is an affirmative action and equal opportunity employer (AA/EOE/W/M/Vet/Disabled) and does not discriminate in recruiting, hiring, training, promotion or other employment of associates or the awarding of subcontracts because of a person's race, color, sex, age, religion, national origin, protected veteran, disability, sexual orientation, gender identity, genetics or other protected status. Qualified applicants with arrest and conviction records will be considered for the position in accordance with the San Francisco Fair Chance Ordinance. California residents: Please see our California Personnel Privacy Policy for more information regarding how we collect, use, and disclose the personal information you provide during the job application process.

To all recruitment agencies: LiveRamp does not accept agency resumes. Please do not forward resumes to our jobs alias, LiveRamp employees or any other company location. LiveRamp is not responsible for any fees related to unsolicited resumes.

#LI-Remote (Recruiters - remove this tag if the role is NOT a remote position)


Read Full Job Description
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
    • JavascriptLanguages
    • PythonLanguages
    • ReactLibraries
    • FlaskFrameworks
    • HadoopFrameworks
    • SparkFrameworks
    • PostgreSQLDatabases

Location

Located in the middle of Boston's Seaport district, we're steps from fabulous dining, entertainment and shopping. And just steps from the T!

An Insider's view of LiveRamp

What are some social events your company does?

Everything from themed monthly team lunches, office happy hours, SummerRamp family camp outing, volunteer groups, Pride celebrations, guest speakers, baking competitions to fitness classes. Our Workplace Experience team is always planning unique events and celebrations.

Abram

Workplace Experience Site Lead

How do you collaborate with other teams in the company?

Within LiveRamp. I collaborate frequently with many different teams, including other data science teams (on tools and methodologies), client teams (to understand our customer needs), the engineering teams (to improve data pipelines processes) and our product and operations team (to streamline my science solutions and turn them into products).

Dan

Senior Data Scientist

What makes someone successful on your team?

Taking initiative! We strive to find the type-S personalities… type-startup! Embrace your natural entrepreneurial drive and commitment to make an impact and be recognized and rewarded by our likeminded type-S team & leadership.

Jonathan

Director, Customer Operations

What are LiveRamp Perks + Benefits

Diversity
Dedicated Diversity/Inclusion Staff
Highly diverse management team
Unconscious bias training
Diversity Employee Resource Groups
A few LiveRamp ERGs: - EQUAL (LGBTQIA focus) - LiveRamp Veterans - Latinx at LiveRamp - Black at LiveRamp - Filipinos at LiveRamp - Rampability - Women at LiveRamp More ERGs coming soon!
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
LiveRamp employees can contribute up to $2,700 annually to their FSA, and up to $5,000 per household.
Disability Insurance
Short-term disability insurance pays a benefit equal to 100% or 60% depending on years of service and length of disability. LTD pays a benefit equal to 60% of pay, up to a maximum of $15,000 per month
Dental Benefits
We offer 2 types of dental plans, both of which over 100% of preventative care. The basic plan has an annual benefit maximum of $1,500 per person and the major plan has a maximum of $2,000 per person.
Vision Benefits
The vision benefits plan covers 100% for annual eye exams with allowances up to $170 for glasses ($200 for featured frames) and $130 for contact lenses.
Health Insurance Benefits
LiveRamp offers you a choice 3-4 of medical plan options. Our medical plans are designed to help keep you healthy and also assist you in times of illness or unexpected injury.
Life Insurance
Life insurance is equal to 2 times an employee's annual salary, up to $500,000.
Pet Insurance
Our pet insurance policy reimburses up to 90% of out of pocket expenses.
Wellness Programs
Retirement & Stock Options Benefits
401(K)
401(K) Matching
LiveRamp provides employees with a 401(k) matching plan managed by T. Rowe Price. We match 100% of contributions up to 6% of an employee's annual gross pay.
Employee Stock Purchase Plan
LiveRampers can purchase RAMP stock at a 15% discount each month. You may participate through convenient payroll deductions and contribute 10% from each paycheck (post-tax).
Performance Bonus
Match charitable contributions
Child Care & Parental Leave Benefits
Child Care Benefits
The Bright Horizons Family Solutions program offers your family high-quality back-up child and adult/elder care, plus access to regular caregivers, pet care, tuition discounts, & more.
Generous Parental Leave
We provide up to 16 weeks of parental leave for the primary and secondary caretaker.
Flexible Work Schedule
Based on your team, LiveRampers can enjoy flexible work scheduled such as start and end times, and remote work opportunities.
Remote Work Program
LiveRamp's remote work program, Ramp Remote, providing employees with Home Office Furniture & Equipment, Ergonomics Assistance, and Internet Upgrade and Exercise Equipment reimbursements.
Family Medical Leave
Adoption Assistance
Company sponsored family events
Acme co. sponsors family oriented events Annually.
Vacation & Time Off Benefits
Unlimited Vacation Policy
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Home Office Stipend for Remote Employees
LiveRamp aims to ensure our employees have the resources they need to work comfortably and effectively at home by offering a home office stipend and internet upgrade reimbursement.
Professional Development Benefits
Tuition Reimbursement
We will reimburse you up to $5,250 per year for courses leading to a graduate or undergraduate degree related to your LiveRamp job role or based on LiveRamp’s business needs.
Diversity Program
More Jobs at LiveRamp15 open jobs
All Jobs
Data + Analytics
Design + UX
Dev + Engineer
Legal
Operations
Project Mgmt
Sales
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Save jobView LiveRamp's full profileSee more LiveRamp jobs