I Tried the Open Source ElevenLabs Alternative (Voicebox)

Highlights

• VoiceBox serves as a local, open-source alternative to cloud-based voice AI services like ElevenLabs.

• The desktop application integrates voice cloning, system-wide dictation, multi-track editing, and local API support into a single interface.

• Running models locally eliminates subscription fees, character limits, and external cloud data dependencies.

• Integration via MCP (Model Context Protocol) allows coding agents like Claude or Cursor to provide audible, voice-based feedback.

• The software runs on devices with Apple Silicon, leveraging local hardware for performance.

Timeline

1. 00:00:00 - 01:35:00

   VoiceBox Features and Purpose

   VoiceBox aims to do for voice AI what Ollama does for local text models. It consolidates voice cloning, Whisper-powered dictation, and multi-track editing. Because it runs locally, users avoid subscription costs and character limits while maintaining control over sensitive audio data.

   • VoiceBox functions as a local, open-source AI voice studio.
   • It replaces multiple separate tools with one centralized desktop application.
   • The software operates entirely on local hardware, ensuring data privacy.
2. 01:35:00 - 03:58:00

   Practical Workflow and Performance

   On a Mac M4, the desktop application proves efficient for cloning voices and generating speech. Once a model downloads, the software produces waveforms locally without needing API keys or browser tabs. The dictation feature captures thoughts quickly for code comments or notes.

   • Setting up via the desktop app is faster than using Docker containers.
   • Voice profiles are created by recording or uploading audio and providing a corresponding transcript.
   • System-wide dictation allows users to convert speech into text directly within editors using a global hotkey.
3. 03:58:00 - 05:41:00

   Agent Integration and Comparisons

   While ElevenLabs offers high-quality, hosted results, VoiceBox provides unlimited, private usage. Developers can use the MCP server to make tools like Claude Code or Cursor trigger voice output, turning terminal-only feedback into spoken updates.

   • VoiceBox provides an alternative to ElevenLabs for those prioritizing local control over cloud-hosted convenience.
   • MCP support enables coding agents to speak feedback directly to the user.
   • The software streamlines workflows that previously required stitching together disparate tools like Piper and Whisper.
4. 05:41:00 - 07:35:00

   Setup and Considerations

   VoiceBox is in its early stages, meaning users might experience some friction with complex setups or long-form consistency. However, the ability to choose specific models, such as Shatterbox TTS Turbo, allows for better emotion control. For those seeking privacy and integration, it is a highly viable tool.

   • The software is free and requires only a download from the website or GitHub releases.
   • Windows users may encounter occasional GPU detection or export issues.
   • Restarting the application resolves most initial technical bugs.