Backend AI Engineer

Our client is building an AI-native personal assistant designed to help users manage conversations, tasks, and everyday workflows with minimal prompting. As an Android Software Engineer, you’ll play a key role in shaping the mobile experience, building a production Android application where AI is at the core of the product.
  
You will work on the backend layer connecting AI models, tools, APIs, and client applications, helping turn model capabilities into fast, stable, and reliable product experiences.

RESPONSIBILITIES

• Build and operate backend systems powering AI features in production.

• Design inference pipelines, orchestration layers, and service boundaries around AI models.

• Develop stable, observable APIs used across mobile and desktop clients.

• Work on systems supporting multi-step reasoning, tool use, persistent context, and real-world task completion.

• Optimize latency, throughput, reliability, and cost across inference workflows.

• Implement and improve caching, batching, streaming, and other performance strategies.

• Own production concerns including monitoring, logging, alerting, and incident response.

• Debug distributed systems under load and resolve production issues quickly.

• Collaborate closely with frontend and ML teams to ensure smooth product integration.

REQUIREMENTS

• Strong backend engineering experience in production environments.

• Experience building high-throughput, low-latency backend services.

• Strong understanding of distributed systems and production-scale architecture.

• Experience designing reliable APIs and service boundaries.

• Familiarity with AI inference patterns, including LLMs, embeddings, and/or multimodal systems.

• Ability to work with non-deterministic model behavior and build reliable systems around it.

• Experience with Python and/or Node.js.

• Experience with SQL and NoSQL databases.

• Practical knowledge of Docker and Kubernetes.

• Bias toward shipping, learning from production behavior, and improving systems iteratively.

• Ability to work independently in a fast-moving, high-ownership environment.

NICE TO HAVE

• Experience working directly with OpenAI, Anthropic, or open-source LLMs.

• Experience with PyTorch.

• Experience building AI agents, orchestration systems, or tool-using AI workflows.

• Experience with streaming APIs, batching, caching, or inference optimization.

• Experience supporting AI-powered products across mobile and desktop clients.

• Experience working on consumer-facing AI products.

WHAT THEY OFFER

• Cash and equity compensation

• EOR contract

• Remote-first setup with flexible hours as part of a distributed, global team

• Company laptop provided

• A quick hiring process – 3, occasionally 4, interviews, with fast decisions afterwards

ABOUT THE COMPANY
They’re an early-stage AI company building a proactive assistant aimed at the 5+ billion people currently stuck using non-AI-native tools for everyday things – email, notes, tasks.The focus is squarely on reliability: long-running workflows, persistent context, and tasks that actually get done, even though the underlying models aren’t fully deterministic.
Stage: Early-stage AI startup
Focus: Proactive AI assistant for everyday productivity
Work mode: Remote-first, distributed team