Design, build, and maintain scalable ETL pipelines and data warehouse architecture using BigQuery, Databricks, and GCP. Ingest and transform high-volume data from Postgres, REST APIs, and other sources, improve reporting, create reusable code and tests, and collaborate in an Agile/SCRUM environment.
Bitwave is a rapidly expanding startup that specializes in software for businesses that use digital assets and crypto. Our platform provides cryptocurrency accounting, tax tracking, bookkeeping, digital asset treasury management, crypto AR / AP tooling, and we recently added full DeFi support (lending pool, liquidity pools, NFTs, etc).
Responsibilities- Use Google Big Query and GCP Suite or similar big data tools to deliver on datawarehouse and reporting requirements
- Use with Databricks and similar ETL tools to perform data extract and transformation of high volume (10’s of millions) of records
- Architect, Design, and Build pipelines to move large amounts of data from variety of sources (postgres DBs, REST APIs, Databricks etc)
- Improve existing data warehouse architecture to enable robust user facing and internal reporting
- Handle large amounts of data and complex integration processes
- Build reusable code and libraries for future use
- Expertise with Firestore a plus
- Expertise with Typescript, JavaScript, SQL, Python or similar languages
- 5+ year’s experience in programming primarily around JavaScript, SQL, Python
- Experience in Web3, dapps is a plus
- Proficient understanding of client-side scripting and JavaScript frameworks, including jQuery
- Expertise in ETL tools, data extraction, storage and transformation
- Expertise in writing and consuming web services
- Strong experience working in Agile environment and understanding of SCRUM process, CI / CD, GCP
- Strong written and verbal communication skills
- Bachelor’s degree in Computer Science or related discipline
- Interest in digital assets, decentralized finance, and cryptocurrencies
- Be passionate about software quality, writing your own tests, and more
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead design and implementation of data infrastructure, pipelines, and integrations using cloud platforms. Manage teams and client accounts, ensure data quality, security, and compliance, deploy scalable solutions (Databricks, Snowflake), mentor junior staff, and identify data-driven business opportunities.
Top Skills:
Amazon Web Services (Aws)Azure Data FactoryDatabricksSnowflake
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build and maintain scalable data pipelines and automated workflows using Python, Airflow, DBT and cloud warehouses. Partner with Analytics, Sales and Marketing to deliver curated marketing datasets, enforce data quality through validation and CI/CD, and support production deployment and monitoring of Enterprise Data Lake/ODS solutions.
Top Skills:
Apache AirflowDbtGitGitlab Ci/CdJenkinsJinjaPythonRedshiftSnowflakeSQL
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Principal Data Engineer, you will design and implement LLM, AI-powered security data platforms, mentor engineers, and drive the adoption of data solutions across teams.
Top Skills:
AirflowAWSBigQueryDaskDockerFlinkGCPKafkaKubeflowKubernetesLangchainLlamaindexMlflowMlops ToolsOciPulsarPythonSagemakerSnowflakeSparkVertex Ai
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
