Join Mirelo AI as a Research Scientist to develop cutting-edge multimodal models for audio generation in a rapidly growing company.
Posted by employer 9 months ago
First seen on Joblaze 1 week ago
Last verified on the company career page 1 day ago
Skills & Technologies
Role intensity
70% hands-on coding
AI in the day-to-day
Engineers explore and build new multimodal models for audio generation, pushing the boundaries of music, sound, and speech generation.
Requirements
Not disclosed in this posting: compensation, work arrangement, visa sponsorship.
Benefits
Joblaze summary
In this role, the Research Scientist will engage in hands-on research and development of multimodal generative models that convert video content into realistic audio, including music and speech. The position requires expertise in training large-scale models, proficiency in PyTorch, and familiarity with distributed training techniques. This opportunity is ideal for candidates with a strong background in machine learning research, particularly those who have experience with generative models and a collaborative mindset. Mirelo AI is at a critical growth stage, having recently secured significant funding to expand its innovative capabilities.
Joblaze insights
Quick facts
From the original posting
Mirelo AI is building the next generation of creative tools by generating realistic sound, speech and music from video.
We develop cutting-edge foundational generative AI models that "unmute" silent video content and create custom, hyper-realistic audio for gaming, video platforms, and creators. Our technology empowers global storytellers to transform their content.
We recently closed a $41 million Seed round co-led by Andreessen Horowitz and Index Ventures with participation from Atlantic, and are rapidly expanding across Product, Engineering, Go-to-Market, and Growth.
About the Role
At Mirelo, you’ll work at the centre of how we build the next generation of multimodal video-to-audio models. This role is deeply hands-on and research-heavy: with a great H100/200-per-engineer ratio you explore and build new multimodal models and push the boundaries of what’s possible in music, sound, and speech generation. You’ll collaborate closely across research and engineering, run focused ablations, and translate experimental results into clear next steps for the team. From data curation to deployment, you’ll help shape the full lifecycle of the models that power our products and partnerships.
Design, implement and train large-scale multimodal generative models for audio generation (diffusion and/or autoregressive models).
Explore new modeling ideas for audio generation (music, sound, speech) while taking inspiration from the language and image domains.
Develop and experiment with post-training for new capabilities (fine-grained control, in/out-painting, editing, …)
Conduct rigorous ablation studies, get actionable insights and communicate results to the team to discuss new research directions.
Contribute hands-on to all stages of model development including data curation, experimentation, evaluation, and deployment.
Hands-on experience in training large-scale generative models in a fast-paced research environment.
Deep understanding of cutting-edge methods and ML research in at least one of the domains: image, language, video or audio (specific audio experience not necessary, but nice to have).
Strong proficiency in PyTorch, transformer architectures, and the full ecosystem of modern deep learning.
Solid understanding of distributed training techniques—FSDP, low precision training, model parallelism
Strong track-record in working on generative models (publications in top-tier venues, open-source contributions or applied ML projects).
Proficiency with profiling, debugging, and optimizing single and multi-GPU operations using tools like Nsight or stack trace viewers.
Strong software engineering skills/experience in collaborating on large codebases that go beyond PhD research code.
Experience with generative models for audio (sound, music or speech) and audio codec design.
Join at a pivotal moment. We've secured fresh funding and are gaining traction - now is when your contributions can make a real difference to our success.
True ownership from day one. You'll have genuine autonomy and responsibility. Your ideas and work will directly shape our product and company direction.
Competitive compensation and equity. We offer strong packages that ensure you share in the success you help create.
Build for the next generation of creators. Be part of the innovation that will transform how creators work and thrive.
We welcome applications from all individuals, regardless of ethnic origin, gender, disability, religion or belief, age, or sexual orientation and identity.