Design, build, and maintain Databricks-based data pipelines and ETL/ELT processes using Python and SQL. Optimize workflows for performance and cost, support data modeling and cloud integrations (Azure/AWS/GCP), monitor and troubleshoot pipelines, document best practices, and collaborate with cross-functional teams.
Position Overview
V4C.ai is seeking a motivated Data Engineer to join our remote team in the United States. In this role, you will support the design, development, and maintenance of data solutions using Databricks, helping clients and internal teams process, transform, and analyze data effectively. You'll work on building reliable data pipelines and workflows in a collaborative environment, gaining hands-on experience with modern data engineering tools and cloud technologies.
Key Responsibilities- Collaborate with team members and stakeholders to understand data requirements and contribute to building scalable data pipelines and workflows in Databricks.
- Develop and implement ETL/ELT processes using Databricks, Python, SQL, and related tools to ingest, transform, and prepare data.
- Assist in optimizing data workflows for better performance, reliability, and cost-efficiency within Databricks environments.
- Support the creation and maintenance of data models, tables, and integrations in cloud platforms (Azure, AWS, or similar).
- Work closely with cross-functional teams (data analysts, scientists, and engineers) to deliver clean, accessible data for analytics and reporting.
- Monitor data pipelines, troubleshoot basic issues, and contribute to documentation and best practices.
- Stay curious about new Databricks features and data engineering trends to support ongoing improvements.
- Bachelor's degree in Computer Science, Data Science, Engineering, Information Systems, or a related field (or equivalent practical experience).
- 1-2 years of professional experience in data engineering, data processing, analytics engineering, or a closely related role (internships, co-ops, or academic projects with relevant tools count toward this).
- Hands-on experience and comfort building basic data pipelines or transformations.
- Proficiency in Python and SQL; experience with Scala is a plus but not required.
- Basic understanding of cloud platforms such as Azure, AWS, or GCP (ex: working with storage, compute, or data services).
- Solid analytical and problem-solving skills with attention to detail and a focus on writing clean, maintainable code.
- Strong communication skills and ability to work collaboratively in a remote team environment.
- Eagerness to learn, take ownership of tasks, and grow within data engineering.
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Design and build data infrastructure, pipelines, and integration solutions using cloud and big-data tools. Develop data lakes/warehouses, ensure data quality and security, apply data modeling and DAGs, use Databricks, Airflow, and Hadoop, and collaborate with clients to deliver actionable insights.
Top Skills:
Apache AirflowApache HadoopAWSAzure Data FactoryDagsData LakeData WarehouseDatabricksDimensional ModelingAzure
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead design and implementation of data infrastructure, pipelines, and integrations using cloud platforms. Manage teams and client accounts, ensure data quality, security, and compliance, deploy scalable solutions (Databricks, Snowflake), mentor junior staff, and identify data-driven business opportunities.
Top Skills:
Amazon Web Services (Aws)Azure Data FactoryDatabricksSnowflake
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build and maintain scalable data pipelines and automated workflows using Python, Airflow, DBT and cloud warehouses. Partner with Analytics, Sales and Marketing to deliver curated marketing datasets, enforce data quality through validation and CI/CD, and support production deployment and monitoring of Enterprise Data Lake/ODS solutions.
Top Skills:
Apache AirflowDbtGitGitlab Ci/CdJenkinsJinjaPythonRedshiftSnowflakeSQL
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
