Machine Learning Engineer — Distillation

Full-time · Remote

  • world
  • Posted 303 days ago
Apply on the company site

Checked at the source 8 h ago

With your free Joonow account, you continue to the company site and the job stays in your applications.

No real employer charges a fee, a course, an exam or a uniform. Suspicious?

Job description

About the Role

We’re looking for a Machine Learning Engineer focused on model distillation to help us build smaller, faster, and more efficient models without sacrificing quality. You’ll work at the intersection of research and production—taking cutting-edge techniques and turning them into systems that scale.

This is a hands-on role with real ownership: you’ll design distillation pipelines, run large-scale experiments, and ship models used in production.

What You’ll Do

  • Design and implement knowledge distillation pipelines (teacher–student, self-distillation, multi-teacher, etc.)

  • Distill large foundation models into smaller, faster, and cheaper models for inference

  • Run and analyze large-scale training experiments to evaluate quality, latency, and cost tradeoffs

  • Collaborate with research to translate new distillation ideas into production-ready code

  • Optimize training and inference performance (memory, throughput, latency)

  • Contribute to internal tooling, evaluation frameworks, and experiment tracking

  • (Optional) Contribute back to open-source models, tooling, or research

What We’re Looking For

  • Strong background in machine learning or deep learning

  • Hands-on experience with model distillation (LLMs or other neural networks)

  • Solid understanding of training dynamics, loss functions, and optimization

  • Experience with PyTorch (or JAX) and modern ML tooling

  • Comfort running experiments on multi-GPU or distributed setups

  • Ability to reason about model quality vs. performance tradeoffs

  • Pragmatic mindset: you care about shipping, not just papers

Nice to Have

  • Experience distilling LLMs or large sequence models

  • Experience with inference optimization (quantization, pruning, kernels, etc.)

  • Familiarity with evaluation for language models

  • Open-source contributions or research publications

  • Experience in early-stage or fast-moving startups

Why Join

  • Work on core model quality and cost efficiency—not side projects

  • High ownership and direct impact on product and roadmap

  • Small, senior team with strong research + engineering culture

  • Competitive compensation + meaningful equity

  • Remote-friendly, async-first environment

Joonow analysis

Joonow figures for this job, calculated from the jobs open on November 21, 2026.

Machine Learning Engineer salary

This job doesn’t list a salary. The median for the role is US$ 17,920 a month.

Median US$ 17,920

Half of the jobs pay between US$ 14,300 and US$ 22,080. Based on 41 open jobs that list a salary.

Other medians for the role: Remote: US$ 16,170.

See the Machine Learning Engineer salary guide

Hiring pace

Featherlessai has 14 open jobs on Joonow, in 3 cities.

See the 14 jobs from Featherlessai

Get ready for this job

Apply