n8n workflow that reads receipt photos from WhatsApp and records expenses automatically
Workflow Automation & AI

WhatsApp Receipt Scanner: Snap a Photo, Expense Recorded

An n8n automation that reads receipt photos sent over WhatsApp with AI vision, validates the data and records the transaction, with a guided chat and a manual-entry link when a receipt can't be read.

View All Projects

Project Overview


This is a WhatsApp-first expense capture automation built on n8n. Instead of opening an app and typing in every field, a user simply sends a photo of a receipt to a WhatsApp number and the system does the rest.

Logging expenses is a chore people skip. Receipts get lost, details are typed in days later, and the resulting records are incomplete. Forcing people into a separate app adds friction, while a plain chat bot breaks the moment a receipt is blurry, crumpled or in a format the AI can't read.

We built a resilient, multi-layer pipeline. Receipt images are analysed by a primary AI vision model, backed up by a second model, and, when neither can read the receipt, the bot switches to a short guided conversation. As a last resort it sends a secure link for manual entry. At every stage the user gets a clear WhatsApp reply, and no expense is silently lost.

Our Contribution

  • Workflow Architecture & Design
  • n8n Automation Development
  • WhatsApp Business Cloud API Integration
  • AI Vision & Receipt Data Extraction
  • Multi-Model Fallback Strategy
  • Conversation State Management
  • Input Validation & Error Handling
  • REST API & Database Integration
  • Magic Link Generation
  • Testing & Deployment

Key Features


  • Webhook intake of WhatsApp messages in real time, with delivery and read receipts filtered out
  • Receipt photo retrieval: picks the largest image, fetches the media URL and converts it to Base64
  • AI vision extraction of receipt details using Groq Vision with high-speed token inference
  • Automatic fallback to Cloudflare vision when the primary model fails, with output normalised to one format
  • Multi-currency detection handling USD ($), EUR (€), GBP (£), AUD ($), AED (د.إ), and INR (₹)
  • Readability check that decides between auto-recording and guided conversational entry
  • Guided chat that asks for payee, amount and purpose one step at a time with per-user state tracking
  • Amount validation with friendly re-prompts on invalid formatting or unrecognized symbols
  • Server health check before processing, with a clear message if the backend is down
  • Transaction insert via secure REST API with user authentication and company ledger assignment
  • Magic links to add a note after saving or to enter details manually when a receipt is unreadable
  • Privacy-first memory handling compliant with GDPR and enterprise data residency requirements
Four-stage pipeline: WhatsApp intake, receipt intelligence, expense validation and transaction recording
INTEGRATIONS

How It Works


WhatsApp Intake

A webhook receives every WhatsApp event. Status receipts are filtered out, and the sender's conversation state is loaded to decide whether this is a new receipt or an answer to an earlier question.

Receipt Intelligence

The workflow checks the server is reachable, picks the largest photo, downloads it as Base64 and sends it to Groq Vision. If that fails, Cloudflare vision runs as a fallback and its response is normalised.

Expense Validation

The parsed result is checked for readability. Readable receipts go straight to recording. Unreadable ones start a guided entry that collects payee, amount and purpose, validating the amount along the way.

Transaction Recording

A payload is built and inserted through the API. The user receives a WhatsApp confirmation with a magic link to add a note, or a clear message if they aren't registered.

PROJECT OUTCOME

Project Outcome

The automation turns expense logging into a single action: send a photo. It handles the messy reality of real receipts through layered fallbacks (a second AI model, a guided chat, then a manual-entry link), so users always have a way to finish. Every failure path ends in a clear WhatsApp message instead of a dropped expense, and the modular n8n design makes it easy to swap vision models, add steps or connect other systems.

Expense logged from one photo

Two AI vision models for resilience

Guided chat fallback

No expense silently lost

FAQ

WhatsApp Automation & n8n AI Workflow FAQs


When a user sends a receipt photo to the WhatsApp Business number, a real-time webhook triggers the n8n workflow. The image is processed through Groq Vision for high-speed OCR and extraction of vendor name, date, itemized amounts, taxes, and total. If the receipt is blurry, a Cloudflare Vision fallback processes it. If both fail, an interactive chat automatically engages the user to gather the missing details.

Yes. Appliquer Technologies builds custom business process automations for clients across North America, the United Kingdom, Europe, Australia, the UAE/GCC region, and India. We provide dedicated timezone overlap, complete WhatsApp Business API onboarding assistance, custom webhooks, secure cloud hosting (self-hosted n8n on AWS/GCP or cloud), and ongoing SLA support.

The extraction pipeline is programmed to recognize international currencies including USD ($), GBP (£), EUR (€), AUD ($), CAD ($), AED (د.إ), and INR (₹). It parses regional date formats (such as MM/DD/YYYY in the US vs. DD/MM/YYYY in the UK, Europe, and India) and isolates sales tax, VAT, or GST line items before committing the final record to your bookkeeping software.

Yes. Because n8n provides native integration nodes and customizable HTTP/REST connectors, the workflow can push verified expense payloads into QuickBooks Online, Xero, Zoho Books, NetSuite, SAP, FreshBooks, or proprietary PostgreSQL/MySQL databases. It can also upload the original receipt image as an audit-ready attachment.

n8n offers key enterprise advantages: it can be self-hosted in your own private cloud (AWS, GCP, DigitalOcean) for complete data privacy and sovereignty; it does not charge escalating per-task fees for high-volume transactions; it supports complex stateful branches and multi-turn loops; and it allows direct JavaScript/Python execution inside workflow nodes for advanced data transformations.

All communications over WhatsApp use end-to-end encryption via the WhatsApp Business Cloud API. Receipt media is processed transiently in volatile memory and can be hosted within EU or US AWS/GCP regions to comply with GDPR, CCPA, SOC 2, and local financial data residency requirements. No customer financial data is used to train third-party AI models.

That is where our multi-tiered failover shines. When both Groq and Cloudflare Vision flag low confidence, the workflow switches to a stateful guided chat that asks the user 3 quick questions in WhatsApp: payee, amount, and business category. If the user prefers typing in a browser, the bot instantly sends a secure, single-use magic link opening a pre-filled mobile web form. No transaction is ever dropped.

Yes. We engineer WhatsApp-based workflow automations for CRM lead capture, customer support triage, order status tracking, field staff check-ins, appointment scheduling, and automated quotation generators. Explore our AI development and custom software development services to learn more.

Want to Automate a Process Over WhatsApp?

From receipt capture to lead intake and customer support, we build n8n and AI automations that meet your team where they already work. Tell us what's slowing you down.