Senior Data Engineer – Data Analytics & BI

SUMMARY:   

The Senior Data Engineer designs, builds, and maintains large-scale data infrastructure and analytics solutions that power business insights across the organization. The ideal candidate brings deep expertise in SQL, Python, and data visualization, with a strong track record of delivering self-service reporting platforms, scalable ETL pipelines, and high-quality dashboards that enable data-driven decision making. In this role, you will partner closely with cross-functional stakeholders to translate complex data needs into clear, actionable solutions while upholding engineering best practices in architecture, performance, and data quality. 

PRIMARY DUTIES: 

• Triage requests for people data and ad hoc reports, prioritize requests, and effectively communicate appropriate delivery expectations. 
• Collaborate with partners and stakeholders to create dashboards that display meaningful and actionable key performance indicators (KPIs). 
• Create visualizations from which leaders can easily draw insights and recommendations. 
• Build and automate easy-to-use, self-service reports and dashboards. 
• Provide direction and coaching to end users on how to use and interpret metrics. 
• Document reporting requirements with partners by collaborating with relevant Data Analytics team members on iterations and changes to core dashboards and solutions. 
• Pull, organize, and analyze relevant data from multiple sources using tools such as Tableau, VS Code, and Jupyter Notebook, and programming languages such as SQL and Python. 
• Partner and align with cross-functional teams including Data Engineering and Data Science, executing best practices in data gathering, pipeline design, and analytics. 
• Audit data integrity, investigate concerns, and establish processes to streamline and improve data quality. 
• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and deliver data from diverse internal and external sources. 
• Improve the performance of ETL tasks through good architecture and code optimization. 
• Be part of the on-call team and monitor and address operational issues to ensure reliability and uptime of data systems. 
• Stay current with emerging trends in data engineering, analytics tooling, and cloud-based data platforms. 

COMPETENCY: 

• Experience with Apache Hive and Presto for large-scale distributed query processing. 
• Familiarity with machine learning algorithms and data science workflows. 
• Experience with large-scale data migration projects, including requirements gathering, pipeline design, and operational support. 
• Mentoring experience with junior engineers and analysts. 
• Familiarity with DevOps principles and their application to data management and deployment workflows. 

REQUIRED EDUCATION: 

• BA/BS/MS in a field that emphasizes data analysis and visualization (e.g., computer science, social sciences, physical sciences, math, engineering, or statistics), or equivalent work experience. 

EXPERIENCE: 

• 8+ years of experience with SQL, including complex query optimization and working with large-scale relational and columnar databases. 
• 5+ years of experience in Python for data engineering, including pipeline development, automation, and data transformation. 
• 8+ years of experience creating custom reports and dashboards and building visualizations in Tableau or comparable tools. 
• Experience with data management, specifically validating and auditing data and reports from multiple systems. 
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform, and distributed data technologies such as Spark or Hadoop. 

LANGUAGE SKILLS: 

• Excellent presentation and communication skills, including the ability to explain technical subject matter to a non-technical audience and influence stakeholders at all levels. 
• Ability to produce clear technical documentation including design specs, runbooks, and data dictionaries. 

QUALIFICATIONS:

• Proficiency in SQL and relational database systems, as well as NoSQL databases such as MongoDB or Cassandra. 
• Strong Python programming skills with experience in orchestration tools such as Apache Airflow and data transformation tools such as DBT. 
• Demonstrated ability to navigate ambiguity and operate effectively in a fast-paced, rapidly evolving environment, shifting fluidly between strategic initiatives and tactical analysis requests. 
• A “do it the right way” mindset with commitment to proper documentation, thorough testing, and engineering excellence. 

PHYSICAL DEMANDS: Regular use of hands and fingers to operate a computer keyboard, mouse, and other office equipment. Regular, repetitive movements such as typing, mouse movements, and scrolling. Ability to hear and understand spoken communications, both in person and via remote communication tools (e.g., phone, video conferencing). Ability to see and read computer screens and printed documents, as well as adjust focus. This includes prolonged periods of looking at a computer screen.