Part 5 - ESP32-S3-Box-3B - Firmware details and installation guide - compile your own firmware

In this article, we will look at how I created my voice Assistant with On-Device Wake Word detection on an ESP32-S3-Box-3B using MicroWake Word to send commands to Home Assistant.

If you have manually changed the configuration file for your ESP32-S3-Box-3B,You need to compile your own firmware.

 

 

Home Assistant version:

ESPHome  version: 2024.5.5

Wake word engine location: On device

Board:ESP32-S3-BOX-3B

Platform:ESP32-IDF

 

 

Tools

Use the ESPHome dashboard add-on within Home Assistant.

Follow the steps in the ESPHome documentation

https://esphome.io/guides/getting_started_command_line

 

The configuration files are available on GitHub:

https://github.com/esphome/wake-word-voice-assistants/blob/main/esp32-s3-box-3/esp32-s3-box-3.yaml

 

 

Here's my ESP32-S3-Box-3B config that is working for voice assistant。

 

Set up Voice Assist Pipeline in Home Assistant OS

To set up voice assistant, we would need two components to create the Voice Assist pipeline in Home Assistant.

Whisper Addon

Piper Addon

And finally the entire Voice Assist pipeline.

You don't need to set up the Wake Word addon, as we will use the on-device Wake Word detection with the Micro Wake Word framework

 

So make sure to watch it and set up the Voice Assist pipeline

Config Voice assistant:

1.Settings > Voice assistants > Home Assistant > Select: STT, TTS and WAKE

Flashing Code to ESP32-S3-Box-3B with ESPHome Dashboard 

Example YAML snippet

substitutions:
  name: esp32-s3-box-3-5a7f28
  friendly_name: ESP32 S3 Box 3 Sala
  micro_wake_word_model: hey_jarvis
  
packages:
  esphome.voice-assistant: github://esphome/firmware/wake-word-voice-assistant/esp32-s3-box-3.yaml@main
esphome:
  name: ${name}
  name_add_mac_suffix: false
  friendly_name: ${friendly_name}

wifi:
  ssid: !secret wifi_ssid
  password: !secret wifi_password

voice_assistant:
  volume_multiplier: 4.0

Connecting ESP32-S3-Box-3B As Voice Assistant In Home Assistant

Once the ESP32-S3-Box-3B is flashed with the code in the above section, we will connect it to Home Assistant using the ESPHome Integration.

 

"ok nabu" wake word

 

useful links

https://smarthomecircle.com/How-I-created-my-voice-assistant-with-on-device-wake-word-using-home-assistant