Lead design and implement cloud-based data platforms and GenAI solutions using AWS/Azure/GCP, Databricks, and Snowflake. Build scalable ETL/ELT pipelines, deploy ML/LLM models, define data governance and compliance, advise clients, manage delivery, and mentor cross-functional teams.
Title: Data and AI Architect (Lead/Manager Level)
Location: New York
Overview:
We are seeking a Data and AI Architect with a proven track record in designing and implementing data platforms and AI solutions using cloud technologies (AWS, Azure, GCP), Databricks, and Snowflake. The ideal candidate will combine technical expertise, hands-on experience, and leadership capabilities to deliver impactful solutions for our clients, including the development and deployment of GenAI solutions for next-generation business applications.
Key Responsibilities:
Solution Design and Implementation
- Architect and implement modern data platforms using cloud technologies such as AWS, Azure, and GCP.
- Build scalable and efficient data pipelines leveraging Databricks and Snowflake to support diverse client needs.
- Design and deploy AI/GenAI solutions, including machine learning models, natural language processing tools, and predictive analytics, to address complex business challenges.
Data Governance and Quality
- Develop data governance frameworks to ensure data quality, security, and compliance with industry regulations.
- Implement best practices for data lineage, monitoring, and cataloging using tools like Databricks and Snowflake.
- Work with clients to establish policies for managing data assets and ensuring compliance with GDPR, CCPA, and other regulatory requirements.
Client Engagement and Delivery
- Act as a trusted technical advisor to clients, translating business challenges into actionable data and AI strategies.
- Lead workshops, provide guidance on architecture decisions, and ensure alignment with client objectives.
- Manage solution delivery, including resource planning, timeline tracking, and adherence to budget constraints.
Technology Expertise and Innovation
- Stay current on advancements in cloud platforms, Databricks, Snowflake, and AI technologies to recommend innovative solutions.
- Explore and implement GenAI technologies to create transformative solutions such as personalized customer experiences, generative content creation, and intelligent automation.
- Contribute to the development of reusable frameworks and accelerators to enhance delivery efficiency.
Team Leadership and Development
- Provide technical leadership to cross-functional teams, ensuring high-quality delivery of data and AI projects.
- Mentor team members on cloud technologies, data platforms, and AI frameworks.
- Foster a collaborative environment to encourage innovation and continuous learning.
Qualifications:
- Experience: 6–10 years of experience in data architecture, engineering, or analytics, including client-facing or consulting roles.
- Cloud Expertise: Hands-on experience with AWS, Azure, and GCP, including data storage, compute, and analytics services.
- Data Platforms: Strong knowledge of Databricks and Snowflake, including experience with ETL/ELT workflows, performance tuning, and scaling.
- AI/GenAI Knowledge: Experience designing and deploying AI/GenAI solutions using frameworks like TensorFlow, PyTorch, Hugging Face, and advanced large language models (LLMs) such as OpenAI's GPT and Google's Gemini.
- Technical Skills: Proficiency in SQL, Python, Spark, and other data engineering and analytics tools.
- Leadership: Ability to lead technical teams and manage client engagements effectively.
- Education: Bachelor’s degree in Computer Science, Data Science, or a related field; advanced degree preferred.
Preferred Skills:
- Certification in AWS, Azure, or GCP architecture.
- Familiarity with tools such as dbt, Apache Airflow, and Kafka.
- Knowledge of customer data platforms and data-driven marketing strategies.
Compensation, Benefits and Duration
Minimum Compensation: USD 100,000
Maximum Compensation: USD 300,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Similar Jobs
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
Operate and maintain Insitu unmanned aircraft systems, conduct preflight planning and mission briefings, collect and analyze flight data, perform troubleshooting and field maintenance, coordinate with customers and subject-matter experts, manage spares inventory, and deploy worldwide in austere environments to support customer missions.
Top Skills:
Basic NetworkingIntegratorRq21ScaneagleUas Platforms
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
Operate and maintain Insitu unmanned aircraft systems, plan and execute missions, collect/analyze payload and video data, perform pre/post-flight checks and maintenance, support customers in field deployments, and complete inventory and mission reporting. Deployable to remote/austere locations up to 70% travel.
Top Skills:
Basic NetworkingIntegratorRq21ScaneagleUas
Digital Media • Information Technology • News + Entertainment
Field-based enterprise seller responsible for developing territory strategy, prospecting and closing mid-market and enterprise multi-location accounts. Delivers face-to-face presentations, builds partner relationships, positions Comcast Business solutions, ensures customer retention, and meets/exceeds financial targets while coordinating with internal teams.
Top Skills:
23)Business ContinuityCustomer Premise Equipment (Cpe)CybersecurityDisaster RecoveryEthernetLanMan (Metropolitan Area Network)Network SecurityNetworking Protocols (Layers 1Sd-WanVoipVpnWanWdm
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
