Features — everything Watari can do

A complete tour of the capability surface. Every integration degrades gracefully — anything you haven't configured simply says “that isn't set up yet” instead of breaking. Tool schemas in src/jarvis/brain/tools/ are the source of truth.

Voice (the whole point)

  • Always-listening wake word — openWakeWord, configurable phrase, runs on CPU; a spoken acknowledgement (“Yes, sir?”) the instant it fires so you know it heard you.
  • Speech-to-text — Deepgram (cloud) or Whisper (local, auto-detects six languages incl. Armenian/Ukrainian). Cloud→local fallback.
  • Text-to-speech — ElevenLabs (cloud) or Piper / Kokoro (fully local, offline). Auto-falls-back to local if the cloud voice can't be built.
  • Barge-in — interrupt mid-sentence on headphones/AirPods/glasses (auto-detected private endpoints); half-duplex on open speakers so it never hears itself.
  • Streaming & latency — speaks sentence-by-sentence as the model generates; instant pre-LLM acknowledgements mask first-token latency; per-turn TTFW logged.

His own mind

  • Multi-provider LLM with an ordered failover chain (Groq direct and/or an OpenAI-compatible proxy); empty/slow responses fail over automatically; providers are warmed at startup to cut cold-start latency.
  • Layered memory (details): L1 learned facts, L2 daily journal, L3 your Obsidian vault, L4 hot cache (Redis), L5 semantic recall by meaning. A background self-improvement pass quietly learns durable facts about you.
  • Conversation memory shared across every device (one brain), with a smart idle-reset so a new chat hours later doesn't drag stale context — and restart-durable so a reboot resumes mid-thread.

Proactive companion

  • Initiates on its own — routine, calendar, unread, open threads, self-health — within a daily budget + quiet hours so it's a companion, not a nag.
  • Morning voice briefing — what's overdue, due today, this week's deadlines, and recurring tasks, spoken (or a phone voice-note if you're away).
  • Modes by voice — focus (hold nudges), lockdown (go quiet), guest, commute, panic.

Reminders & true 24/7

  • Reminders — one-shot, absolute time, or daily; spoken if you're there, pushed to your phone (ntfy) if not.
  • PC-off recurring — an always-on VPS ticker owns repeating reminders so they fire even with every personal device asleep.
  • Background task queue — hand off long work (deep research, a big build), keep chatting, ask “how's that going?”, and get a voice note when it finishes.

Channels & knowledge

  • Telegram — read your DMs (without marking them seen), send messages/files, proactive voice notes, and stream music live into a group voice chat.
  • Web — answer-with-sources search (Tavily) and keyless page scraping (Jina Reader); a real, visible browser (Playwright) that can log in with your credentials when you ask.
  • Notion — search/read/append/comment, and a full tasks dashboard: create, update, complete, delete tasks by voice.
  • Gmail & Calendar — read/draft/send mail and read/create events (sending + writes are confirm-gated).
  • Smart home — Home Assistant device states + control (lights, scenes, climate, locks); locks/alarms confirm first. Local-first, no cloud.
  • Music — “play X” via YouTube Music (free), your Telegram playlist, or live into the music room.
  • Utilities belt (no keys) — weather, crypto, stocks, FX, unit/currency convert, news, Wikipedia, dictionary.

Control & self-improvement

  • This machine — create/delete files, list/kill/start processes, run shell (elevated raises a prompt), open apps — all behind the confirmation tier + path/secret guards.
  • Remote PC control — drive your laptop from your phone via an edge executor that connects out to the brain (no inbound ports).
  • Coding on its own source — read/write code, run the test suite, lint, and make reversible-only git commits (never force-push/reset); commits and pushes are confirm-first.
  • Protocols — password-gated routines: goodnight (stop), phoenix (restart self), ragnarok (restart the machine), backup, diagnostics, and more.

Identity & safety

  • Speaker biometrics — optional ECAPA voiceprint so it responds only to your voice and ignores the TV or a guest.
  • Enforced confirm-tier on every outward/destructive action, hard guards on secrets and protected paths, and an audit log with value-scrubbing.
  • Configurable identity — name, address, languages, persona — all from config.

Optional: an agent fleet

For deep multi-step domain work, Watari can delegate to an external OpenClaw fleet via a single team-lead agent — but it ships fully disabled with no host baked in. Most users never need it; enable it only if you run your own gateway (see Security).

Devices. All of the above reaches you on laptop, Mac, iPhone, Android, Mentra glasses (scaffold), Home Assistant, and a remotely-controlled PC — see Devices and Phones.