Senior AI Engineer

Looking for a Senior AI Engineer at OPSWAT in Ho Chi Minh City, Vietnam? This role focuses on the day-to-day work of a Senior AI Engineer.

OPSWAT, a global leader in IT, OT, and ICS critical infrastructure cybersecurity, delivers an end-to-end platform that gives public and private sector organizations and enterprises the critical advantage needed to protect their complex networks, secure their devices, and ensure c

Ready to take the next step? Apply Now.

Company Overview

OPSWAT protects critical infrastructure. Our goal is to eliminate malware and zero-day attacks. We believe that every file and every device pose a threat. Threats must be addressed at all locations at all times—at entry, at exit, and at rest. Our products focus on threat prevention and process creation for secure data transfer and safe device access. The result is productive systems that minimize risk of compromise. That’s why 98% of U.S. nuclear power facilities trust OPSWAT for cybersecurity and compliance.
OPSWAT. Trust no file. Trust no device.
www.opswat.com

Quick Details

• Job Type: Full-time
• Experience: Mid-Senior level

Key Responsibilities

• Design and build local LLM serving environments on GPU hardware, selecting GPU configurations based on VRAM, memory bandwidth, and workload.
• Install and maintain the full inference stack (NVIDIA drivers, CUDA, cuDNN, inference engines) across single and multi GPU deployments, including tensor and pipeline parallelism.
• Optimize LLM models for efficient GPU serving, balancing latency, throughput, memory, and cost.
• Apply quantization from FP32 to FP16/BF16, FP8, and FP4 using PTQ methods (GPTQ, AWQ, SmoothQuant) and QAT.
• Deploy and tune high throughput serving engines (vLLM, TensorRT-LLM, TGI), optimizing KV cache (PagedAttention), continuous batching, and speculative decoding.
• Build benchmarking for TTFT, inter token latency, throughput, GPU utilization, and cost per million tokens.

Requirements

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• 5+ years of experience in software engineering, with a focus on ML infrastructure, LLM inference, or model optimization.
• Hands on experience deploying and serving LLMs on GPU hardware in production.
• Strong understanding of quantization and model compression (FP8/FP4/INT8/FP4, GPTQ, AWQ, SmoothQuant, QAT).
• Experience with high throughput inference engines (vLLM, TensorRT-LLM, TGI, llama.cpp).
• Solid understanding of GPU architecture, CUDA, and the memory bandwidth bound nature of LLM inference.
• Proficiency in Python; familiarity with C++/CUDA is a strong plus.

Benefits

• This is a chance to work at the deep intersection of models, serving software, and hardware within a global cybersecurity company, delivering the performance that powers OPSWAT's AI products at scale.
• Explore innovative inference optimization and model compression techniques.
• Work in a global cybersecurity company.
• Opportunity to work with cutting-edge AI technology.