Part 3 - ESP32-S3-Box-3B - Installing voice assistant from voice satellite projects
ESP32-S3-BOX-3B
This installs the latest, precompiled firmware for your S3-BOX
Threre two ways that flashing with the latest version of firmware from the web-installer. Installing from
https://esphome.io/projects/index.html
or
https://www.home-assistant.io/voice_control/s3_box_voice_assistant/
Users building a ready-made voice satellite projects (such as the ESP32-S3-Box-3B), will be able to update the device directly from Home Assistant without requiring the ESPHome add-on.
These devices can download their firmware directly from the web, no building required.
This tutorial will guide you to turn an ESP32-S3-BOX-3B into a Home Assistant voice assistant with https://esphome.io/projects/index.html
voice satellite projects
https://esphome.io/projects/?type=voice
Several people have mentioned that flashing with the latest version of firmware from the web-installer. Installing from
https://esphome.io/projects/index.html
or
https://www.home-assistant.io/voice_control/s3_box_voice_assistant/
This tutorial will guide you to turn an ESP32-S3-BOX-3B into a Home Assistant voice assistant.
In this tutorial, you will learn:
Connect the ESP32-S3-BOX-3B to your computer.
Install Voice Assistant(precompiled firmware)
Configure the ESP32-S3-BOX-3B Wi-Fi
Voice Assistant is installed on the ESP32-S3-BOX-3.
Capturing and processing audio on ESP32-S3-BOX-3B
Integrating micro wake word detection on device.
I bought 1 devices and following ESP32-S3-BOX-3B.
Followed this guide: ESP32-S3-BOX voice assistant - Home Assistant
I set up whisper, piper and openwakeword addons as described in the tutorial.
Once the the device was flashed and the steps completed from this part:
https://esphome.io/projects/index.html?type=voice
Table of Contents
Prerequisites
Hardware
1XEspressif ESP32-S3-BOX-3B
Software
Requires Home Assistant 2024.4 or newer.
add the ESPHome node ESP32 S3 Box 3 2d954c to Home Assistant via ESPHome Integrtion
USB_SERIAL_JTAG
Oher
This approach is supporting my theory that the Home Assistant voice assistant needs > 2 GB RAM to update/compile.
Home Assistant OS
Core 2024.7.1
Supervisor 2024.06.2
Operating System 12.3
Frontend 20240705.0
Installing ESPHome Addon.you will get ESPHome Dashboard
Step 1.Hardware connection
Step 1 Plug the USB-C cable into the box directly, not into the docking station (not into the blue part) and connect it to your computer.
Step 1.
Plug the USB-C cable into the box directly, not into the docking station
invoke “flash mode”
Hold the “boot” button，then power on
select JTAG com
hardware connection
usb box,not dock
test wakeup and command offline
USB cable you use can be used for data and is not a power-only cable.
pair via wifi
http://localhost:4999/boards/topic/31119/esp32-s3-box-3b/page/2#44489
Step 2 Installing the ESPHome firmware onto the ESP32-S3-BOX-3B
goto:ESP32-S3-BOX voice assistant - Home Assistant
step 2.1 choose the right tab ESP32-S3-BOX-3B
Open https://web.esphome.io. in Chrome or Edge browser.
Voice Assistant is installed on the ESP32-S3-BOX-3B
other
Firmware URL: https://firmware.esphome.io/wake-word-voice-assistant/esp32-s3-box-3/esp32-s3-box-3-esp32s3.ota.bin
Step 3 Device connected to the network via wifi
After selecting the Next button, on the S3-Box-3, tap the “Reset” button again.
Then, select the blue Connect button again, select the USB device and follow the prompts to configure the Wi-Fi.
On the Device side
Booting the ESP32-S3-BOX-3B,i get the 3 dots… and then the ‘grey house with the smiling face’ - So do believe the firmware is installed
The ESP32-S3-BOX-3B voice assistant has 6 illustrations to indicate its state.
https://www.home-assistant.io/images/assist/s3-box-status-images.png
Micro Wake Word on device
You don't need to set up the Wake Word addon, as we will use the on-device Wake Word detection with the Micro Wake Word framework
https://esphome.io/components/micro_wake_word.html
https://github.com/kahrendt/microWakeWord
micro_wake_word:195]: State changed from STARTING_MICROPHONE to DETECTING_WAKE_WORD
detail:http://localhost:4999/boards/topic/31119/esp32-s3-box-3b/page/2#44497
On the HA side
change Wake word engine location
Wake word engine location' - Set selected option to: On device
Test - talk ok nabu via bing translator
talk ok nabu via bing translator
https://cn.bing.com/translator/?ref=TThis&text=nabu+english+study&from=en&to=ZH-HANS
Debug - On the Device side logs
https://esphome.io/projects/index.html - connect -logs
[23:05:20][D][api.connection:146]: Home Assistant 2024.7.1 (192.168.2.120): Sending keepalive failed 1 time(s), will retry in 1000 ms
[23:11:50][D][select:062]: 'Wake word engine location' - Setting
[23:11:50][D][select:115]: 'Wake word engine location' - Set selected option to: In Home Assistant
[23:11:50][D][select:015]: 'Wake word engine location': Sending state In Home Assistant (index 0)
[23:11:50][W][micro_wake_word:183]: Wake word is already stopped
[23:12:20][D][esp32.preferences:114]: Saving 1 preferences to flash...
[23:12:20][D][esp32.preferences:143]: Saving 1 preferences to flash: 0 cached, 1 written, 0 failed
History of Micro wake word version
On device Micro wake word on ESP32-S3 is here - Voice: Chapter 6
On device Micro wake word updates on ESP32-S3 is here - Voice: Chapter 7
ESP-S3-BOX-3 Voice Assistant speaker volume too low
Esp32-s3-box-3 doesn’t respond anymore after 2 or 3 days on the wake word OK NABU
Useful links
This tutorial will guide you to turn an ESP32-S3-BOX-3B into a Home Assistant voice assistant.
https://www.home-assistant.io/voice_control/s3_box_voice_assistant/
Comments
Comments are closed