Design and optimize Databricks ETL/ELT pipelines on Azure using PySpark, SQL, Delta Lake, and Kafka. Build CDC and near-real-time processing solutions, ingest data from diverse sources, implement data quality controls, and apply SCD Type 1 and Type 2 modeling. Automate workflows with Databricks Workflows and GitHub-based CI/CD while collaborating in an Agile environment.

Serve as the subject matter expert for electronic trading analytics applications. Analyze source code, data, architecture, and complex distributed systems; translate business requirements into technical designs; create system diagrams; manage JIRA work items; coordinate developers, QA, product owners, and stakeholders; and support production environments and releases. The role requires systems analysis, software development, cloud, data analytics, and trading systems expertise.