Design and manage data infrastructure projects for clients, develop large-scale pipelines, collaborate in Agile/DevOps environments, and utilize cloud platforms.
Object Computing, Inc. (OCI)
OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure for internal and client projects within our AI/ML & Data Insights team.
About OCI
We provide a collaborative environment focused on innovation, leveraging open-source software and strategic partnerships with Amazon and Google to build transformative technology solutions.
Job Responsibilities
- Design, build, and optimize large-scale data pipelines (Azure, AWS, GCP)
- Develop data ingestion and storage solutions.
- Implement scalable APIs and ensure system performance.
- Manage big data infrastructure and cloud deployments.
- Collaborate with developers, designers, and data scientists.
- Work in an Agile/DevOps environment.
Core Competencies
- ETL data engineering (Databricks, SQL Server, Snowflake, BigQuery, Apache Spark).
- Proficiency in Go, Java, Python, or Scala.
- Proficiency in CI/CD pipelines and Infrastructure as Code (IaC) (Terraform, CDK, Ansible).
- Hands-on experience with event-driven architectures (Kafka, Pulsar).
- Strong knowledge of data warehousing, SQL/NoSQL databases, and cloud platforms.
- Experience with distributed computing, DevOps tools, and data governance.
- Familiarity with Delta Lake, Unity Catalog, Delta Sharing, and DLT.
Preferred Qualifications
- Degree in Computer Science, Data Engineering, or a related field, or equivalent experience.
- Experience with AI/ML-driven data solutions and real-time data processing.
- Expertise in building scalable APIs and integrating with modern analytics tools (Power BI, Tableau, QuickSight).
- Cloud certifications (Databricks, AWS, Azure, GCP).
Top Skills
Ansible
Spark
AWS
Azure
BigQuery
Cdk
Databricks
Delta Lake
Delta Sharing
GCP
Go
Java
Kafka
Power BI
Pulsar
Python
Quicksight
Scala
Snowflake
SQL Server
Tableau
Terraform
Unity Catalog
Similar Jobs
Big Data • Cannabis • eCommerce • Logistics • Database • Business Intelligence • Big Data Analytics
Design and maintain a data analytics platform, build ETL pipelines, standardize and model data, optimize database performance, and ensure data quality.
Top Skills:
AirbyteAWSDbtExcelGithub ActionsGlueHevoMetabaseModeMySQLPostgresPower BIPythonSnowflakeSparkSQLTerraformThoughtspot
Fintech • Machine Learning • Payments • Software • Financial Services
Lead diverse tech projects focusing on AI and data security. Collaborate on design, coding, and operations while mentoring others.
Top Skills:
AtlasAWSAws AthenaC++DatabricksDatahubDockerGoGCPJavaKubernetesLangchainLanggraphMcpAzureNoSQLOpenmetadataPythonRdbmsRustSnowflakeSQL
Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
The Principal EDC Developer manages EDC systems for clinical trials, overseeing eCRF development, system configurations, and integrations while ensuring compliance with industry standards.
Top Skills:
CtmsEcoaInformIrtMedrioRaveSASSharepointVeeva CdmsZelta
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories