Optimize LLM inference on modern GPUs by analyzing GPU architecture, memory access, kernels, and performance bottlenecks. Develop, debug, reverse-engineer, and optimize CUDA kernels and low-level GPU operations for matrix multiplication, attention, and neural network layers. Benchmark latency, throughput, and utilization using frameworks such as vLLM, SGLang, TensorRT-LLM, Triton, and FlashAttention. Investigate technically challenging AI systems and high-performance computing problems.
Description
MWDN is a global IT outstaffing company with 23+ years of experience that connects exceptional tech talent with leading companies across Israel, the USA, Great Britain, and Western Europe. We offer opportunities to work on international products in a stable and professional environment.
Why does MWDN rock?Here’s what you can expect when you join MWDN:
- Security: We carefully vet our clients to minimize risks and ensure reliability and timely payments - no fraud or unpleasant surprises.
- Career support: If a project isn’t the right fit, we support you and actively help find new opportunities that match your skills and career goals.
- Legal assistance: We provide guidance on legal matters, including opening and managing your independent contractor or sole proprietorship status, taxes, and related processes.
- Professional development: We offer English courses and professional growth opportunities, as well as team-building events.
Why choose us? MWDN is ranked among the top 5 IT employers in our region according to DOU. We take pride in our transparency and strong commitment to our team. Curious to learn more? See what our employees say about working with us on DOU.
What is your new project?We’re looking for a highly technical engineer or researcher with deep expertise in GPU computing, CUDA, and LLM inference optimization to work on challenging problems at the intersection of AI systems and high-performance computing.
This opportunity is ideal for someone who enjoys understanding how things work under the hood — from GPU architecture and low-level kernels to LLM inference engines and performance bottlenecks.
What makes this project exciting?- Investigate and optimize LLM inference performance on modern GPUs.
- Work with inference and serving frameworks such as vLLM, SGLang, TensorRT-LLM, or similar systems.
- Analyze GPU execution, memory access patterns, kernel performance, and inference bottlenecks.
- Develop, optimize, debug, or reverse-engineer CUDA kernels and low-level GPU operations.
- Explore optimization techniques for matrix multiplication, attention mechanisms, and neural network layers.
- Benchmark performance and identify opportunities to improve latency, throughput, and GPU utilization.
- Work on technically challenging problems requiring strong analytical thinking and hands-on experimentation.
- Strong hands-on experience with CUDA and GPU programming.
- Deep understanding of GPU architecture, memory hierarchy, parallel execution, and performance optimization.
- Experience with LLM inference, AI systems, GPU kernels, or high-performance computing.
- Familiarity with one or more frameworks such as vLLM, SGLang, TensorRT-LLM, Triton, or FlashAttention.
- Experience debugging complex performance issues and investigating low-level system behavior.
- Strong problem-solving skills and the ability to communicate complex technical concepts in English.
Nice to have
- PhD or research experience in Computer Science, Machine Learning, Computer Architecture, or a related field.
- Publications, research projects, or meaningful contributions to open-source GPU/LLM infrastructure.
- Experience with PyTorch internals, distributed inference, quantization, KV cache optimization, or custom GPU kernels.
- Contributions to projects such as vLLM, SGLang, Triton, FlashAttention, or related repositories.
- People-first management with minimal bureaucracy
- A friendly company culture, proven by employees who choose to return
- Flexible working hours
- 29 days of PTO (18 working days per year pluse all national holidays)
- 10 paid recovery days
- Full financial and legal support for independent contractors
- Free English classes, with native speakers or Ukrainian teachers
- Dedicated HR support
Similar Jobs
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handles inbound calls and warm leads, consults customers on insurance needs, recommends appropriate Property and Casualty products and coverages, and converts prospects into policyholders. The role includes paid licensing and sales training, customer relationship management, persuasive selling, and adherence to remote-work requirements. Representatives must work four weekdays and one weekend day, maintain a professional home workspace, and meet specified internet-speed requirements.
Top Skills:
PcWired High-Speed Internet
eCommerce • Legal Tech • Professional Services • Software • Data Privacy
Manage a portfolio of established customer accounts via inbound and outbound calls, uncover upsell and retention opportunities, meet sales and retention targets, monitor purchasing patterns, perform follow-up outreach, and build long-term customer relationships in a metrics-driven environment.
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Provides remote technical customer support for Xtime and Cox Automotive products through phone, email, and chat. Resolves routine product and application issues, documents cases in CRM systems, trains and coaches customers, coordinates with internal teams, and follows up through resolution while meeting quality standards.
Top Skills:
Cox Automotive SuiteCRMGenesys PurecloudSalesforceXtime
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
