Photon Logo

Photon

Data Engineer - USA

Posted 4 Hours Ago
Remote
Hiring Remotely in United States
46K-161K Annually
Senior level
Remote
Hiring Remotely in United States
46K-161K Annually
Senior level
Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.
The summary above was generated by AI
Greetings Everyone

 
 

 

Who are we? 

For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.

About the team:

We seek innovative, entrepreneurial, and passionate engineers dedicated to delivering exceptional user experiences. Your passion and ownership mindset are as vital as the high engineering standards, code quality, and world-class architectural skills we uphold.

We manage billions of mail messages with advanced backend systems and algorithms, including NLP, GenAI, and ML techniques. Our infrastructure extracts information, creates enhanced content, and integrates diverse data sources to amplify key insights. This work presents rewarding technical challenges for high-caliber engineers eager to tackle impactful problems.

Responsibilities:

  • ​ Contribute to Mail Intelligence Mission: Support the development of AI/ML capabilities that enhance user personalization and insights.
  • ​ Innovate and Personalize: Assist in building scalable solutions that identify user interests and habits, contributing to personalized user experiences.
  • ​ Data Pipeline and Insights Development: Design and implement robust data pipelines using frameworks like DataProc, Dataflow, and Composer. Streamline data processing and orchestration, utilize Data Lake and Pub/Sub for storage and streaming, and create insightful visualizations with Looker Studio to support AI/ML initiatives.
  • ​ Collaboration: Work closely with cross-functional teams in the USA to integrate data solutions that enhance user experiences.
  • ​ Data Governance: Implement robust data governance practices to maintain data quality and compliance across the organization.
  • ​ Optimization: Continuously improve data workflows for efficiency and scalability.
  • ​ Technical Strategy: Collaborate with tech leads to align data strategies with business goals.
  • ​ Feedback and Recovery: Implement mechanisms to handle data processing failures gracefully.
  • ​ Tradeoff Management: Balance cost, quality, and speed in data solutions to optimize performance.

A lot about YOU

  • ​ Educational Background: You have a strong foundation in computer science, data engineering, or a related field, with a focus on big data technologies and cloud platforms.
  • ​ Technical Skills: You are proficient in programming languages such as SQL, Python, or Java, and have experience with big data frameworks like Hadoop, Spark, or Kafka. You excel in using stream and batch processing frameworks and data visualization tools, and are skilled in implementing data governance practices.
  • ​ Data Engineering Expertise: You have advanced skills in designing and implementing data pipelines, ensuring data quality and integrity.
  • ​ AI Tools Usage: You have experience with AI development tools such as Cursor, Copilot, and Claude.
  • ​ Problem-Solving Ability: You possess strong analytical skills and a knack for solving complex data challenges using innovative approaches.
  • ​ Collaboration: You are a team player who can work effectively with cross-functional teams, including tech leads and architects, to deliver high-quality data solutions.
  • ​ Passion for Innovation: You are enthusiastic about leveraging data engineering to drive innovation and enhance user experiences.
  • ​ Attention to Detail: You maintain high standards for data quality and are committed to delivering robust, scalable solutions.
  • ​ Continuous Learning: You are eager to stay updated with the latest advancements in data engineering and apply them to improve.

Qualifications

  • ​ Educational Requirement: Bachelor's degree in Computer Science, Data Engineering, or a related field; a Master's degree is a plus.
  • ​ Experience: 5+ years in data engineering, big data processing, or a related field.
  • ​ Technical Proficiency: Strong skills in SQL, Python, or Java, with experience in big data technologies like Hadoop, Spark, or Kafka.

Proficient in stream and batch processing frameworks and data visualization tools. Skilled in implementing data governance practices.

  • ​ Cloud Experience: Proficiency with public cloud platforms, especially Google Cloud Platform (GCP).
  • ​ Problem-Solving Skills: Demonstrated ability to solve complex problems and implement efficient, scalable solutions.
  • ​ Collaboration Skills: Experience working with international teams and cross-functional collaboration.
  • ​ Communication Skills: Strong verbal and written communication skills for effective collaboration with US-based teams.
  • ​ Continuous Improvement: Eagerness to learn and adapt to new data technologies and methodologies.

Preferred Qualifications

  • ​ Mail Experience: Prior experience working with email systems or related technologies is a plus.
  • ​ Personal Attributes: Self-driven and detail-oriented, with a passion for tackling challenges. Strong teamwork spirit, excellent communication skills, and the ability to multitask and manage expectations effectively.
  • ​ Cloud Experience: Experience with public cloud platforms, especially Google Cloud Platform (GCP), is preferred.
  • ​ Technologies: Experience with specific technologies such as DataProc, Dataflow, Composer, Data Lake, Pub/Sub, and Looker Studio.

Compensation, Benefits and Duration

Minimum Compensation: USD 46,000
Maximum Compensation: USD 161,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is available for independent contractors
No applications will be considered if received more than 120 days after the date of this post

Similar Jobs

An Hour Ago
Remote
United States
Senior level
Senior level
Cloud • eCommerce • HR Tech • Information Technology • Analytics
Develop and maintain security observability dashboards for vulnerability scans, actions, and traceability. Gather requirements with stream leads, design and implement dashboards, provide team training on the stack, and support ongoing dashboard creation.
Top Skills: AngularFlaskGrafanaPostgresPower BIPythonTableau
21 Days Ago
Remote
United States
33K-118K Annually
Senior level
33K-118K Annually
Senior level
Agency • Information Technology
Design, build, and maintain ETL/ELT data pipelines and orchestration using Airflow, Python, and PySpark. Develop custom connectors, implement DataOps and CI/CD for data workflows, monitor and troubleshoot pipelines, validate data quality, and document processes while collaborating with cross-functional teams and supporting large-scale distributed data systems.
Top Skills: Apache AirflowApache KafkaApache SupersetGitHiveKubernetesLinuxOpenshiftPysparkPythonSnowflakeSparkSQLSsisTrino
5 Days Ago
Remote or Hybrid
United States
190K-240K Annually
Senior level
190K-240K Annually
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
As a Senior Data Engineer at Jellyfish, you'll build and maintain data pipelines, optimize orchestration, automate CI/CD processes, and enhance data integration while ensuring high performance and reliability.
Top Skills: AirflowBigQueryDagsterDatabricksDbtPrefectPysparkPythonRedisSnowflakeSQLTerraform

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account