Description
Entrada AI, Inc. is looking for a highly skilled Data Engineer to join our growing team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence. You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and efficiency of our client’s Databricks solution.
Key Responsibilities
Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.
Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.
Optimize data architectures and workflows for performance, scalability, and cost-efficiency.
Collaborate with data scientists and analysts to understand data requirements and ensure that data systems meet their needs.
Ensure data quality, integrity, and security by implementing best practices in data governance and management.
Develop and maintain documentation for data systems, including data models, flow diagrams, and operational procedures.
Stay current with emerging technologies and trends in data engineering, and apply them to improve existing systems.
Qualifications
Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
3+ years of experience in data engineering or related fields, with a focus on large-scale data systems
2+ years of experience with Databricks
Proficiency in SQL and experience with databases such as MySQL, PostgreSQL, or NoSQL databases
Strong programming skills in languages such as Python, Java, or Scala.
Experience with ETL tools and frameworks and data pipeline orchestration.
Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
Strong understanding of data warehousing concepts, data modeling, and schema design.
Excellent problem-solving skills and attention to detail.
Strong communication skills and ability to work effectively in a team-oriented environment.
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
