Lead the design and development of Azure-based big data solutions, including batch and real-time ETL/ELT pipelines, data architecture, ingestion, curation, warehousing, and storage. Build solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, SQL, and related Azure services. Support Salesforce migration and integration while applying strong RDBMS, data management, and big data design expertise.
Expertise on Azure platforms including Azure Databricks, ADLS, and its various components, • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure SQL Database, Azure Functions, Logic apps, Spark and Python programming etc. • Expertise on Azure platforms including Azure Databricks and its various components, including Delta Lake. • Strong understanding of data architecture and data management principles. • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic apps, Spark Knowledge etc. • In-depth Knowledge on designing of ETL Piplines for Batch and Real time in Azure data factory and Azure datafactory • Hands on experience on Function apps , Event Hubs,, Web apps , API M. • Good have to experience on Migration to Salesforce • Strong experience with designing ETL/ELT Pipelines/Data flows using Azure Data Factory as Primary skill and SSIS/Informatica as additional skills. • Proficiency in programming languages such as Python, SQL, Spark notebooks and Scala. • Must have strong development & design skills in leading RDBMS environments e.g. MS SQL Server and Oracle 10g. • Experience of Big data approach, architectural concepts, data sourcing/ ingestion/ curation and storage mechanisms. • Experience with real-time / near-real-time Data warehousing concepts and Design approaches.
Hexaware Technologies Boston, Massachusetts, USA Office
Boston, United States
Similar Jobs
Insurance
Leads engineering support and architecture for enterprise-scale healthcare data platforms on Azure. Designs Databricks, Synapse, Data Factory, and Data Lake solutions; builds batch and real-time pipelines, analytical data models, BI solutions, and automated data quality frameworks. Implements machine learning and AI-assisted development, integrates low-code systems, ensures HIPAA compliance, and translates business needs into technical solutions. Mentors engineers, resolves technical issues, supports Agile delivery, and partners with healthcare business leaders on Medicare and Medicaid analytics initiatives.
Top Skills:
Arm TemplatesAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsAzure Event HubsAzure Machine LearningAzure SynapseGithub CopilotHipaaKafkaAzureMicrosoft O365PegaPower BIPysparkPythonSalesforceScalaSitecoreSpark StreamingSQLTableauTerraform
Information Technology • Consulting
Design, build, and optimize end-to-end ETL/ELT pipelines using Python and PySpark for large structured and unstructured datasets. Ensure data quality through validation and reconciliation, troubleshoot performance issues, implement CI/CD and code review practices, and collaborate with IT and business stakeholders to translate requirements into scalable data solutions.
Top Skills:
AWSAzureBitbucketCi/CdData WarehousingDistributed ComputingEtl/EltGCPGitHadoopMicrosoft Sql ServerPysparkPythonSparkSQL
Information Technology • Consulting
Lead the development of data pipelines and transformations in Azure Databricks, converting Scala programs to PySpark while leveraging various Azure technologies.
Top Skills:
AdfAzure Data Lake Gen 2Azure DatabricksDelta LakePysparkPythonSparkSynapse Analytics
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
