We Love AI JobsResearch Scientist (Singapore)
Cantina LabsThe Research Scientist will work on post-training research for large-scale video-generation models, including distillation and preference-based tuning. The role also covers scalable video-data workflows and collaboration with data, infrastructure, and modeling teams to turn findings into model improvements.
Skills & Expertise
Key Responsibilities
Research distillation methods that improve video-generation efficiency while preserving or improving quality.
Develop reward models and preference-based fine-tuning workflows aligned with human judgments.
Collaborate with data, infrastructure, and modeling teams to translate research into model improvements.
Full Description
About Cantina:
Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.
About the Role:
Cantina is expanding, and we're looking for a Research Scientist to join our growing Singapore team! In this role, you will drive foundational research on video generation models, taking ownership across the full research cycle and driving post-training research. Furthermore, you'll collaborate closely with data, infrastructure, and adjacent modeling teams to translate research findings into durable model improvements.
What You’ll Do:
• Build and maintain scalable systems for ingesting, preprocessing, and delivering large-scale video data for model training
• Design and scale distributed data pipelines for preprocessing, dataset generation, and repeated dataset refreshes
• Own workflow orchestration, job scheduling, monitoring, and failure recovery for large-scale data processing jobs
• Implement and maintain containerized pipeline infrastructure using Kubernetes or equivalent orchestration systems
• Optimize cloud-based data storage and movement across providers (AWS, GCS, or Azure) for cost, throughput, and operational efficiency
• Define and implement best practices for dataset storage layout, versioning, caching, retention, and access patterns
• Build tooling to support deduplication workflows at scale, including near-dedup pipelines over large video corpora
• Research and develop distillation methods for large-scale diffusion and flow-based video generation models, including guidance distillation and adversarial distillation, with a focus on preserving or improving generation quality while reducing inference cost
• Develop reward models and preference-based fine-tuning pipelines that align video generation quality with human judgments across dimensions such as aesthetics, motion quality, and prompt adherence
• Analyze the relationship between base model behavior and post-training outcomes, and work with the foundation model team to inform pretraining decisions accordingly
What You’ll Bring:
• Strong hands-on experience building or scaling large-scale data systems or pipelines for machine learning workflows
• Experience with distributed data processing frameworks such as PySpark or Ray, and orchestration tools such as Airflow or equivalent
• Familiarity with containerization and container orchestration, including Docker and Kubernetes
• Experience working with cloud-based data storage and compute (AWS, GCS, and/or Azure), including tradeoffs around cost, throughput, storage layout, and access patterns
• Familiarity with video and media processing tools such as FFmpeg, PyAV, DALI, or OpenCV
• Familiarity with multimodal or media data, including video, image, text, and audio
• Strong research background in post-training methods for large-scale diffusion or flow-based generative models, with deep hands-on experience in distillation across both inference efficiency and quality preservation
• Experience with reward modeling or preference-based fine-tuning for generative models, including RLHF, DPO or equivalent alignment approaches
• Solid understanding of the interplay between pretraining and post-training, and how base model properties affect distillation and fine-tuning outcomes
• Proficiency in Python and modern machine learning frameworks, with a strong preference for PyTorch or JAX
• Track record of independent research, with the ability to drive projects from initial idea through experimental validation
• Publications at top-tier venues (NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) preferred
• Good understanding of the practical challenges involved in building reliable, scalable, and reproducible data workflows for machine learning systems
Benefits We Offer:
• Competitive salary and generous company equity
• Personal time off and paid holidays
• Health insurance
• Global travel insurance: Covers you when traveling internationally
• Monthly spending stipend: $500 (~S$635)
• Equipment: All equipment needed for your home office