Backend Engineer: AI / Agent Systems

About the Client

Our client is an AI-native product company built to replace how billions of people manage their digital lives — starting with email, notes, and task tools that were never designed to be AI-native. It's backed by multi-million-dollar investment and built remote-first from day one, with a clear target: cut the time it takes users to get everyday things done by roughly 90%. That means solving the problems most AI products avoid — long-running workflows, persistent context, and reliable behavior under real-world, non-deterministic conditions. The team is small and high-talent-density by design, not by necessity, and moves at a pace that matches the scale of what it's building.

About the Role

As a Backend Engineer, AI, you'll own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly shape real-world experience. You'll build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

What You'll Work On

• Build and operate backend systems that serve AI-powered features in production

• Design inference pipelines, orchestration layers, and service boundaries around models

• Own production concerns: monitoring, logging, alerting, incident response

• Optimize latency and throughput across inference, caching, batching, and streaming

Requirements

• Strong backend engineering fundamentals in production environments

• Experience running high-throughput, low-latency services

• Familiarity with AI inference patterns (LLMs, embeddings, multimodal)

• Comfortable debugging distributed systems under load

• A bias toward shipping and learning from production behavior

Tech Stack

Python · Node.js · PyTorch · OpenAI / Anthropic / open-source LLMs · SQL & NoSQL · Kubernetes · Docker

What Success Looks Like

• Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput

• APIs are stable, clear, and support seamless integration with frontend and ML systems

• Production incidents are detected, diagnosed, and resolved quickly, minimizing user impact

• Iterative improvements based on real usage continuously raise system performance and reliability

What to Expect

The best products in the world are built by small, world-class, hands-on teams. Decisions are made collectively, at rapid speed — balancing high-quality shipping with fast learning. You'll be expected to bring structure, exercise judgment, and execute independently.

Compensation and benefits are competitive and vary by location; the package includes base salary and equity, discussed openly with you as part of the process.

If there's a fit, expect 3–4 interviews total, followed by a prompt, transparent decision.

Originally posted on Himalayas