Agent blueprint

How to build a voice phone agent

Free blueprint for a voice phone agent. A low-code, single-agent, cloud-hosted stack with 12 connected components. Built around Voiceflow, HubSpot, Flowise, ChatGPT / OpenAI. Copy it, export it, or change the answers to fit your project.

Get the code
Your architecture

Voice agent

A low-code, single-agent, cloud-hosted stack with 12 connected components.

Sign in to save

Architecture map

Tap a component to see its connections

INTERFACE &TRIGGERSORCHESTRATIONREASONINGMEMORY &KNOWLEDGETOOLS &INTEGRATIONSMONITORING &SAFETYSPEECH-TO-TEXTDeepgramVOICE OUTPUTElevenLabsVISUAL AGENT CANVASFlowiseREASONING MODELChatGPT / OpenAIFAST HELPER MODELGroq CloudCONVERSATION MEMORYBuilt into yourorchestratorDOCUMENT INGESTIONBuilt-in knowledgebaseVECTOR DATABASEPineconeCRMHubSpotVOICE AGENT BUILDERVoiceflowGUARDRAILSInput & outputchecksTRACING & EVALUATIONLangfuse

Swipe sideways to see the whole map

Tool configuration

Interface & triggers

  • Speech-to-text

    Turns the caller's voice into text in real time

    Deepgram

    or AssemblyAI

  • Voice output

    Speaks the agent's reply naturally

    ElevenLabs

    or Cartesia, Play.ht

Orchestration

  • Visual agent canvas

    Drag-and-drop agent loop you can extend

    Flowise

    or Langflow, Dify

Reasoning

  • Reasoning model

    General-purpose model with tool calling

    ChatGPT / OpenAI

    or Claude, Gemini

  • Fast helper model

    Handles quick, routine steps to cut delay and cost

    Groq Cloud

    or Together AI, OpenRouter

Memory & knowledge

  • Conversation memory

    Keeps track of the current chat or task

    Built into your orchestrator
  • Document ingestion

    Splits and indexes your files and pages

    Built-in knowledge base

    or Firecrawl, LlamaIndex

  • Vector database

    Finds the most relevant passages for each question

    Pinecone

    or Weaviate, Qdrant

Tools & integrations

  • CRM

    Looks up and updates customer records

    HubSpot

    or Salesforce

  • Voice agent builder

    Designs call flows and hand-offs to people

    Voiceflow

    or Hume AI

Monitoring & safety

  • Guardrails

    Blocks unsafe input, prompt injection and data leaks

    Input & output checks

    or Allow-list of tool actions

  • Tracing & evaluation

    Records every step, cost and answer quality

    Langfuse

    or LangSmith, Weights & Biases

Set up your agent, step by step

Tick each step as you finish it. Your progress is saved with this plan in your AItooling account.

0 of 20 done

AItooling never signs up for you and never asks for your passwords or keys. You create each account yourself on the tool's own website, and only your ticks are saved here.

Sign in and save this plan to keep your progress in your account.

  1. 1Create your accounts

    • Sign up or install it, then make a new project for this agent.

    • Sign up and set up the place where people will talk to the agent.

    • Sign up and set up the place where people will talk to the agent.

    • Sign up, create an API key and set a monthly spending limit before anything else.

    • Sign up, create an API key and set a monthly spending limit before anything else.

    • Sign up and create a new database or index just for this agent.

    • Sign up and connect only the apps this agent needs, with read-only access where you can.

    • Sign up and connect only the apps this agent needs, with read-only access where you can.

    • Sign up and turn on logging so you can review what the agent does.

  2. 2Build it in this order

  3. 3Launch your agent

    • Copy the ready-made code for this agent. It hides secrets and personal data before the AI model sees them.

    • Put each key in a password manager or your hosting's secret settings. Never paste keys or passwords into AItooling or a chat.

    • Start small, read every answer yourself, and only then let other people use it.

Want to go deeper?

Read our step-by-step guides on building agents. Browse guides

More AI agent blueprints