AI agent

JARVIS – voice-controlled AI assistant

Year
2026
Role
Solo – design, agent, infra
Status
Open source · built in public
Claude agentElectronwhisper.cppPowerShellWindows Task SchedulerTelegram Bot APIREST APIs
%
Local speech-to-text
08:30
Daily unattended brief
Financial actions allowed

What it is

JARVIS is a personal AI butler that runs my mornings. A voice-controlled, Iron-Man-style HUD sits on top of a scheduled agent pipeline that runs fully unattended and reports back before I wake.

The interface is an Electron HUD driven by 100% local speech-to-text (whisper.cpp), so voice never leaves the machine. Underneath, a headless Claude agent executes a daily routine against real APIs.

In July 2026 it went open source: a config-driven install with no personal values in the tree (CI-enforced), templated personality files so a fork sounds like its owner, secret-scanning CI, and adversarial-review-gated merges.

The unattended pipeline

  • Aggregates my git history, notes, job alerts, and a real bank feed (aggregates only) into a single grounded morning brief, then delivers it to my phone over Telegram at 08:30 – email optional.
  • Two-way Telegram remote: request a briefing or status from my phone, and text quick notes that surface in the next morning’s brief – with command de-duplication and at-most-once semantics.
  • Runs on Windows Task Scheduler with no human in the loop – collectors are plain PowerShell, covered by unit tests.
  • Integrates a jobs REST API (Jooble) for automated role discovery, with provider fallback and rate-aware querying.

Safety and secrets

  • Hard-coded safety rules: no financial actions, and every send is self-only – the send lock fails closed if no owner is configured.
  • OAuth token management with DPAPI-encrypted credentials at rest.
  • Failure alarms so a broken run surfaces loudly instead of failing silently.