Senior Devops Engineer

2 days ago

Ho Chi Minh City, Ho Chi Minh, Vietnam MoMo (M_Service) Full time

We are seeking a
Senior AI Engineer (AI-Ops / MLOps)
to take a leading role in
designing, deploying, and optimizing large-scale AI systems
at MoMo. You will be responsible for
building robust, production-grade infrastructure
that enables fast iteration and reliable serving of
LLMs
, and
speech models

In this position, you will lead
AI deployment strategy
, mentor junior engineers, and collaborate with AI researchers to bridge the gap between
prototyping and scalable production
— ensuring that MoMo's AI innovations reach millions of users efficiently and safely.

Desciption

  • Utilize
    end-to-end
    AI infrastructure pipelines
    on top of existing MoMo infrastructure, from training to serving and continuous monitoring.
  • Lead the
    design and implementation
    of high-throughput
    model serving systems
    (e.g., vLLM, Triton, TensorRT, ONNX Runtime) and
    model serving techniques
    (in-flight batching, speculative inference)
  • Define model-level monitoring and alerting hooks integrated with MoMo's existing observability stack (Prometheus, Grafana).
  • Collaborate with DevOps/CloudOps teams,
    AI research
    ,
    data engineering
    , and
    backend
    teams to ensure smooth integration of AI models into MoMo's ecosystem.
  • Conduct
    performance benchmarking
    and
    capacity planning
    to maintain SLA compliance across AI services.
  • Focus on
    inference optimization
    strategies (quantization, batching, caching, pruning, GPU/TPU resource tuning).
  • Mentor and guide the AI-Ops/MLOps team on
    best practices
    in distributed serving, orchestration, and infrastructure reliability.
  • Evaluate new technologies and tools to improve
    scalability, cost efficiency, and model lifecycle automation
    .

Requirement

Qualifications

  • Bachelor's in
    Computer Science, Artificial Intelligence, Software Engineering
    , or a related discipline.
  • 3+ years of experience in
    AI infrastructure
    ,
    DevOps
    , or
    MLOps
    roles (with at least 1 years at a senior).
  • Familiar with container orchestration (Kubernetes, Docker) and
    infrastructure-as-code
    (Terraform, Helm).
  • Strong proficiency with
    Python
    and
    Bash scripting
    ; experience with
    Go
    or
    Rust
    preferred.
  • Proven experience deploying
    deep learning models
    (e.g., PyTorch, TensorFlow, JAX) at production scale.
  • Hands-on experience with
    CI/CD systems
    (Jenkins, Argo CD, GitHub Actions) and
    monitoring stacks
    (Prometheus, Grafana, ELK).
  • Strong understanding of
    distributed systems
    ,
    load balancing
    , and
    high-availability architectures
    .
  • Demonstrated ability to collaborate with researchers and translate prototypes into
    scalable, reliable production systems
    .

Nice to Have

  • Experience with LLM inference optimization (vLLM, LoRA adapters, quantization, multi-GPU scheduling).
  • Familiarity with speech or vision models and multi-modal AI pipelines.
  • Experience integrating LLM and speech models into scalable inference microservices.
  • Knowledge of feature stores, data versioning, and real-time feature serving (Feast, Redis, Kafka).
  • Background in security, privacy, or governance frameworks for AI systems.

  • Senior DevOps Engineer

    2 weeks ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Moatable Full time $60,000 - $120,000 per year

    Job Description:We are seeking an experienced and highly skilled Senior DevOps Engineer to join our dynamic team. The ideal candidate will have a strong background in AWS, Jenkins, GitLab CI, and Infrastructure as Code (IaC). As a Senior DevOps Engineer, you will play a critical role in enhancing our CI/CD pipelines, automating infrastructure, and ensuring...

  • DevOps Engineer

    7 days ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Adecco Talent Hub Full time

    Location:Etown Cong Hoa, Tan Binh, Ho Chi Minh City, VietnamType:Full-timeLevel:Senior / Team LeadContract:6 monthsSalary: Up to 78MJob Summary:We are looking for a Senior DevOps & Data Engineer to lead the design and implementation of scalable data pipelines and infrastructure, with a strong focus on Model Context Protocol (MCP). This role combines...

  • Senior DevOps Engineer

    5 days ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam YouNet Group Full time

    ABOUT YOUNET MEDIAYouNet Media,a member of YouNet Group, is the leading Social & E-commerce Intelligence company in Vietnam and Southeast Asia.Owning the complete Social Suite — SocialHeat, SocialTrend, and SocialLift — and leveraging EcomHeat from YouNet Group, the leading E-commerce Intelligence Platform, we provide both platforms and actionable...

  • Senior DevOps Engineer

    2 days ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Qode Full time

    We're hiring on behalf of our client's in the banking industry We are seeking an experienced Senior DevOps Engineer (AWS) to join the team and play a crucial role in supporting our engineering and business operations. The ideal candidate will be responsible for the implementation of tools and processes that enable rapid development and deployment of...

  • Senior DevOps Engineer

    2 days ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Qode Full time

    We're hiring on behalf of our client's in the banking industry We are seeking an experienced Senior DevOps Engineer (AWS) to join the team and play a crucial role in supporting our engineering and business operations. The ideal candidate will be responsible for the implementation of tools and processes that enable rapid development and deployment of...

  • Senior DevOps Engineer

    2 days ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Qode Full time

    Description We're hiring on behalf of our client's in the banking industry We are seeking an experienced Senior DevOps Engineer (AWS) to join the team and play a crucial role in supporting our engineering and business operations. The ideal candidate will be responsible for the implementation of tools and processes that enable rapid development and...

  • Senior DevOps Engineer

    2 days ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Qode Vietnam Full time

    We're hiring on behalf of our client's in the banking industryWe are seeking an experienced Senior DevOps Engineer (AWS)to join the team and play a crucial role in supporting our engineering and business operations. The ideal candidate will be responsible for the implementation of tools and processes that enable rapid development and deployment of...

  • Senior DevOps Engineer

    5 days ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Kyanon Digital Full time

    October 29, 2025Ho Chi MinhITFixed-Term Full-Time, Permanent Full-TimeKyanon Digital is a Vietnam-based tech powerhouse. We deliver world-class solutions to clients across the globe. At Kyanon Digital, we offer end-to-end solutions that encompass every facet of the digital landscape. With the slogan: "Digital Impact that Matters", this has guided our team of...

  • Senior Devops Engineer

    1 week ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Bestarion: Leading Outsourcing Company in Vietnam Full time

    Working Style : Remote fully or Hybrid at Bestarion officeWorking Time :Monday - Friday, 8:00 AM - 5:30 PM (Flexible depending on each project)1-hour daily standup Tuesday-Friday, likely from 9 PM to 10 PM VNT.Expectation to Travel to USA: The expectation is 1 - 4 trips/year, with each trip lasting 1-2 weeks.About the project: We're looking for a skilled...

  • Senior DevOps Engineer

    2 weeks ago

    Ho Chi Minh City, Ho Chi Minh, Vietnam Bestarion: Leading Outsourcing Company in Vietnam Full time $120,000 - $240,000 per year

    Company DescriptionBestarionis a subsidiary ofLarion, a well-established software outsourcing company in Vietnam with decades of experience delivering high-quality technology solutions.Inheriting Larion's strong foundation and technical expertise, Bestarion continues to grow as a trusted partner for clients worldwide.For over 15 years, Bestarion has provided...