Back to jobs

AI Engineer, Multimodal LLMs

Eloquent AI
San FranciscoFull-time
AI tools:PyTorchTensorFlow

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

Develops and deploys multimodal AI agents for enterprise conversations, with work spanning LLM architectures, speech, vision, and reinforcement learning. You’ll collaborate with software engineers, researchers, and product teams to improve model quality, efficiency, and real-world performance.

  • Permanent
  • On-site
  • 3+ years

Skills and expertise

PythonPyTorchTensorFlowLLMsLarge computer vision modelsFine-tuningInference optimizationAWS, GCP, or Azure

Key responsibilities

  • Build, deploy, and optimize AI agents for enterprise conversations.
  • Develop multimodal LLM architectures and refine training approaches for practical applications.
  • Evaluate agent performance and improve interactions through experiments and user simulations.

How this job compares

Compared with 329 open mid-level machine learning jobs on November 22, 2026.

Pay
This job does not publish its pay. The 119 open mid-level machine learning jobs that publish US pay start at $180K a year on average.
Similar open jobs
We Love AI Jobs lists 329 open mid-level machine learning jobs at 145 companies.
Remote work
This job is on site. 66 of the 329 mid-level machine learning jobs (20%) are remote.
AI in this role
High. AI is the core of the work: building, training or deploying AI systems. Building, optimizing, and evaluating AI agents and multimodal LLM architectures are central responsibilities. The role also involves fine-tuning models and improving inference performance.

Full description

Meet Eloquent AI

At Eloquent AI, we’re building the next generation of AI Operators—multimodal, autonomous systems that execute complex workflows across fragmented tools with human-level precision. Our technology goes far beyond chat: it sees, reads, clicks, types, and makes decisions—transforming how work gets done in regulated, high-stakes environments.

We’re already powering some of the world’s leading financial institutions and insurers, fundamentally changing how millions of people manage their finances every day. From automating compliance reviews to handling customer operations, our Operators are quietly replacing repetitive, manual tasks with intelligent, end-to-end execution.

Headquartered in San Francisco with a global footprint, Eloquent AI is a fast-growing company backed by top-tier investors. Join us to work alongside world-class talent in AI, engineering, and product as we redefine the future of financial services.

Your Role

As an AI Engineer at Eloquent AI, you will be at the forefront of building, deploying, and optimizing enterprise-grade AI agents that handle high-stakes conversations. You’ll work directly with software engineers, deep learning experts and AI researchers to design intelligent agents that understand, take action, and deliver real business impact.

This role requires a mix of software development, AI integration, and problem-solving skills, with the ability to customize, optimize, and scale AI models for real-world enterprise applications. If you're passionate about LLMs, conversational AI, and solving last-mile AI adoption challenges, this role is for you.

You will:

• Build, deploy, and optimize AI agents that engage in enterprise-grade conversations.

• Design & develop next-gen multimodal LLM architectures (LLMs, speech, vision, reinforcement learning)

• Explore optimal trade-offs between model quality and efficiency when translating research into practical solutions

• Refine training paradigms for real-world applications

• Integrate AI agents with enterprise systems via APIs, databases, and automation tools.

• Experiment rapidly to improve AI-driven interactions, response quality, and automation capabilities.

• Collaborate with cross-functional teams (engineering, research, and product) to shape Eloquent AI’s roadmap.

• Monitor and improve agents’ performance via user simulations and evaluations.

Requirements

• 3+ years of experience in software development, AI engineering, or NLP in a production environment.

• Strong proficiency in Python, with experience in frameworks like PyTorch and TensorFlow.

• Experience working with LLMs or large computer vision models, or generative AI models, including fine-tuning and inference optimization.

• Familiarity with APIs, cloud infrastructure (AWS, GCP, or Azure), and enterprise integrations.

• Ability to prototype, experiment, and iterate quickly to improve AI agents.

• Strong problem-solving skills and the ability to work closely with customers to refine AI solutions.

• Solid mathematical foundation of machine learning and deep learning techniques

Bonus Points If…

• You have experience with prompt engineering, parameter-efficient fine-tuning (PEFT), retrieval-augmented generation (RAG), reinforcement learning for LLMs.

• You’ve published AI research in top tier AI conferences like: NeurIPS, ACL, SIGIR, ICML and ICLR.

• You’ve contributed to open-source NLP projects.

• You’ve worked in a fast-paced startup environment and thrive in rapid iteration cycles.

Upload your resume once and Scout applies for you

Apply with Scout

Similar jobs