Designs, builds, and maintains scalable batch and streaming data pipelines, ETL/ELT workflows, data models, and Python transformations. Writes optimized SQL, monitors pipeline reliability, troubleshoots failures, implements data-quality validation, and supports security and governance practices. Collaborates with engineers, analysts, stakeholders, and clients to define data contracts, improve platforms, document lineage, and deliver reliable analytics data.
This is a remote position.
About KIS
KIS is a global technology consultancy, 100% remote and headquartered in the United States. We partner with companies ranging from innovative startups to large multinational organizations, helping them build modern, scalable, and high-impact technology solutions.
Our global team works on challenging projects across different industries, combining technical excellence, innovation, and close collaboration with our clients.
We are currently looking for a Mid-Level Data Engineer to join our team and work on a challenging project for one of KIS's leading international clients.
As a Mid-Level Data Engineer, you will be responsible for designing, building, and maintaining reliable and scalable data solutions. You will work closely with engineers, analysts, and stakeholders to ensure high-quality, accessible, and well-structured data across the organization.
Your responsibilities will include:
- Design, build, and maintain end-to-end data pipelines, including batch and/or streaming workflows, from ingestion through transformation and delivery.
- Develop and operate reliable, scalable, and high-performing ETL/ELT workflows.
- Write efficient, production-grade SQL queries for data extraction, transformation, and analytics use cases.
- Implement and maintain data models, including star schemas and incremental models, optimized for analytics and reporting.
- Develop reusable, modular, and maintainable Python code for data transformations and pipeline logic.
- Monitor data pipelines, troubleshoot failures, and perform root cause analysis across code, orchestration tools, data sources, and cloud services.
- Ensure data quality by implementing automated validation checks, including schema validation, freshness checks, and row-level assertions.
- Collaborate with analysts, backend engineers, and other stakeholders to define data contracts and ensure reliable data availability.
- Actively participate in planning, estimation, and prioritization of data engineering tasks.
- Proactively identify risks related to performance, scalability, and data integrity, proposing effective mitigation strategies.
- Contribute to the continuous improvement of data platforms, engineering processes, and team best practices.
- Write and maintain clear technical documentation for data pipelines, schemas, and data lineage.
- Communicate clearly with team members and clients, proactively raising questions and concerns when requirements or priorities are unclear.
Requirements
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design and operate scalable batch and streaming data platforms supporting machine learning and generative AI. Build pipelines for structured, unstructured, OCR, document, and image data; develop RAG, semantic search, and LLM-powered solutions; and establish data quality, observability, governance, orchestration, and deployment practices. Partner with stakeholders, lead platform scalability and cost optimization, mentor engineers, and translate ambiguous needs into production-ready technical roadmaps while securely handling sensitive data.
Top Skills:
AirflowAmazon KinesisSparkAWSAzureAzure Event HubsChart.JsDatabricksDeequDelta LakeDockerGithub ActionsGCPGreat ExpectationsJavaKafkaKubernetesLlmsMlopsPlotlyPysparkPythonRagScalaSeabornSnowflakeSQLTerraform
Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Configure and maintain Adobe Experience Platform and Real-Time CDP data pipelines, XDM schemas, datasets, identity resolution, Profile enablement, segmentation readiness, and destination activation. Validate data quality, troubleshoot ingestion and identity issues, manage sandboxes, and implement privacy, consent, governance, and access controls. Partner with architects, data engineers, consultants, analysts, data scientists, and marketing teams to support reporting, personalization, and machine learning readiness.
Top Skills:
Adobe AnalyticsAdobe Experience PlatformAdobe I/O RuntimeAdobe Journey OptimizerAdobe Real-Time CdpAdobe Source ConnectorsAdobe TargetAPIsAWSAzureBatch IngestionBigQueryCcpaData PrepEltETLGCPGdprJavaScriptPythonQuery ServiceRedshiftSalesforce CdpSegmentSnowflakeSQLStreaming IngestionWeb SdkXdm
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead cloud data modernization by designing and building cloud-native ETL/ELT pipelines, data warehouses, and lakehouse architectures using Azure, Snowflake, and Databricks. Ensure data quality, security, governance, CI/CD, and healthcare interoperability while mentoring engineers and collaborating with stakeholders to deliver scalable, HIPAA-compliant analytics platforms.
Top Skills:
AdlsApache AirflowAzureAzure Data Factory (Adf)Azure Data Lake Storage Gen2 (Adls Gen2)Azure OpenaiCi/CdCptDatabricksDatabricks GenieDatabricks Mosaic AiDockerEltETLFhirGitGithub ActionsHcpcsHl7Icd-10KafkaKubernetesLlmsLoincPysparkPythonRag PipelinesSnowflakeSnowflake CortexSparkSQL ServerSsisTerraformVector StoresVisioX12 Edi (837/835/834)
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
