Back to jobs

Software Engineer - Evolving Agentic Frameworks

PranaTree
Toronto, Ontario, Canada
Contract
AI tools:
OpenAI
Anthropic
Vertex AI
LangChain
Applications go directly to the hiring team

Full Description

We are seeking a hands-on Engineering Lead to drive the design and delivery of agentic frameworks and Generative AI-powered products. This role combines deep technical ownership with team leadership, focusing on building scalable, intelligent systems that power next-generation applications.

You will lead a cross-functional team across backend, frontend, data science, DevOps, and QA—while remaining actively involved in architecture, coding, and delivery.

What You’ll Do

Technical Leadership & Architecture

* Own end-to-end architecture for agentic frameworks and GenAI systems, including RAG, orchestration, memory, and guardrails

* Design and evolve scalable agent frameworks that enable autonomous workflows and decision-making

* Make strategic build vs. buy decisions and select tools/frameworks (LangGraph, DSPy, etc.)

* Architect event-driven, microservices-based systems using Python (FastAPI) and Node/TypeScript

* Build and integrate LLM-powered applications using APIs (OpenAI, Anthropic, Bedrock, Vertex AI)

* Implement secure, scalable API layers (REST, gRPC, WebSockets) with robust authentication (JWT/OAuth2)

Hands-on Development

* Stay 50–60% hands-on, writing clean, production-grade, test-driven code

* Conduct code reviews, enforce best practices, and ensure high-quality delivery

* Troubleshoot and resolve complex system and performance issues

* Continuously improve system performance, reliability, and scalability

DevOps & Cloud Engineering

* Drive cloud-native deployments across AWS / Azure / GCP

* Champion DevSecOps practices:

* Infrastructure as Code (Terraform)

* CI/CD pipelines (GitHub Actions / Azure DevOps)

* Container orchestration (Kubernetes – EKS/AKS/GKE)

* Observability (Prometheus, Grafana, OpenTelemetry)

* Ensure systems meet security, privacy, and compliance standards (HIPAA, GDPR)

What You Bring

* 6+ years of software development experience, including 3+ years in a leadership role

* Strong expertise in Python and solid experience in TypeScript/JavaScript (Rust/Go is a plus)

* Experience designing and building agent-based systems, orchestration frameworks, or AI-driven workflows

* Hands-on experience with LLMs and GenAI ecosystems (OpenAI, Anthropic, Bedrock, Vertex AI)

* Experience working with vector databases (pg vector, Qdrant) and retrieval systems

* Strong understanding of distributed systems, APIs, and real-time communication (REST, gRPC, WebSockets)

* Proven experience deploying cloud-native systems on AWS/Azure/GCP (IAM, networking, autoscaling, managed services)

* Expertise in DevOps toolchains: Docker, Kubernetes, Helm, CI/CD pipelines

* Familiarity with frontend technologies (React, Next.js, Tailwind) and user-centric design

* Deep understanding of Agile methodologies, trunk-based development, and release strategies

* Excellent communication skills with the ability to translate complex technical concepts into business impact

Applications go to the hiring team directly