Lead architecture and build large-scale, low-latency real-time data and streaming systems for a security platform. Design distributed streaming infrastructure with Apache Flink, write production Java and Rust code, optimize scalability and reliability, mentor engineers, and drive long-term technical strategy in collaboration with product and security stakeholders.
This role is for one of the Weekday's clients
Salary range: Rs 15000000 - Rs 26000000 (ie INR 150-260 LPA)
Min Experience: 8 years
Location: United States
JobType: full-time
We are seeking a Principal Engineer to architect and build large-scale, real-time data systems that power a modern security platform. This is a high-impact, high-ownership role where you will lead core architectural decisions, design distributed streaming infrastructure from the ground up, and shape long-term technical strategy.
You will operate at the intersection of real-time data processing, distributed systems, and security intelligence—solving complex engineering problems at scale. This opportunity is ideal for someone who thrives in ambiguity, takes end-to-end ownership, and has experience building scalable systems in security or related domains.
RequirementsKey Responsibilities
- Architect and develop large-scale real-time data processing systems using Apache Flink
- Design highly reliable, low-latency distributed systems capable of handling high-throughput workloads
- Write production-grade code in Java and/or Rust
- Lead system design discussions and define engineering standards and best practices
- Own scalability, performance optimization, reliability, and observability across services
- Mentor engineers and elevate the technical quality of the team
- Collaborate closely with product and security stakeholders to translate requirements into resilient technical solutions
- Drive long-term architectural decisions and contribute to technical roadmap planning
- 8+ years of experience building backend or distributed systems
- Strong hands-on expertise with Apache Flink
- Advanced programming skills in Java
- Production experience with Rust
- Deep understanding of distributed systems, streaming architectures, and real-time data pipelines
- Experience building high-throughput, low-latency systems
- Strong foundations in system design, concurrency, and performance optimization
- Experience in cybersecurity, threat detection, observability, or data security domains
- Background in processing high-volume event streams (logs, telemetry, network data)
- Familiarity with Kafka, stateful stream processing, and real-time analytics
- Experience in high-growth or early-stage startup environments
- Proven track record of building systems from 0 → 1 or significantly scaling existing platforms
- High ownership over foundational architectural decisions
- Opportunity to build and scale mission-critical infrastructure
- Work on complex, real-world security challenges
- Collaborate within a small, high-caliber engineering team
- Direct influence on product direction and long-term technology strategy
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Senior sales engineer for Zscaler's Healthcare Zero Trust Branch. Deliver technical product presentations, gather customer requirements, lead product evaluations and custom configurations, and design evaluation test plans to drive successful cloud-native Zero Trust deployments.
Top Skills:
DlpEnd-User MonitoringFirewallsIpsecProxiesRouting ProtocolsSd-WanSslSwgVpnsZero TrustZscaler
Software • Defense
Build, operate, and secure cloud-native and edge infrastructure including Kubernetes, artifact pipelines, application streaming, and air-gapped appliances. Partner with product, GRC, and mission owners to design, deploy, and harden systems, remediate vulnerabilities, support audits (IL5/IL6/JWICS), and ensure trusted artifact delivery across environments.
Top Skills:
Air-Gapped AppliancesApplication StreamingArtifact PipelineAWSAws GovcloudAzure GovernmentCve RemediationFedrampGoJwicsKubernetesKubernetes OperatorsAzureMulti-Cluster KubernetesPythonRustSoc 2StigTypescript
Big Data • Information Technology • Software • Analytics • Energy
As a Principal Software Engineer, lead the design and implementation of features, mentor engineers, and ensure high software quality and performance across the PET product suite.
Top Skills:
AtlassianBitbucketDatabricksGitJenkinsNode JsPythonReactTypescript
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
