Welcome Home - Grove Shield for Seeed Studio XIAO - dumpling—li - CodeCraft Hub
Scene: Smart Home. Edge AI application on CodeCraft Hub for Smart Home use cases.
Devices / BOM: Grove Shield for Seeed Studio XIAO, Grove Vision AI V2, Seeed Studio XIAO ESP32S3, Grove - VART Crossover Cable 4Pin 20cm (5pcs), MP3 Module V4.0, UART Interface, mini MP3 Player/Walkman, powered by WT2605X, 2mm plywood or acrylic, R型膨胀铆钉, M3*60双通六角隔离柱
Smart Home application on CodeCraft Hub. This "emotion-driven" smart video doorbell seamlessly integrates visual recognition into daily life. By auto-identifying family and visitors, it shifts from "passive waiting" to "proactive greeting," offering a hardware solution that delivers emotional value and enhances well-being.
Documentation
This project is an "emotion-driven" smart video doorbell that seamlessly integrates visual recognition technology into daily life scenarios. The system can automatically identify family members and visitors, upgrading the experience from "passively waiting for a ring" to "proactively greeting by recognizing faces." It is a smart hardware solution designed to provide emotional value and enhance overall well-being.
Family Mode (Exclusive Welcome): Accurately recognizes registered family members and proactively plays customized greetings, enhancing the sense of ritual upon returning home.
Visitor Mode (Polite Reception): Upon detecting an unregistered face, it automatically triggers doorbell sound effects and polite prompts, balancing home security with visitor etiquette.
Deploy steps
- Burn the model
This is an image classification vision model trained using the Vision AI V2, with three categories: me, other people, and no one.
If you want to customize your own visual recognition model, you need to retrain it.
Deploy an AI model to your device (in-app tool on CodeCraft Hub).
- Hardware Connection
Insert the XIAO ESP32-S3 into the Grove Shield: Ensure the USB port aligns with the shield's orientation and press the pins firmly into place.
Connect the XIAO ESP32-S3 to your computer via a USB Type-C cable. Note: The Type-C cable must be a data cable, not a charging-only cable.
Connect the Vision AI V2 module (visual input) to the XIAO-ESP32's SDA/SCL pins.
GND → XIAO GND
VCC → XIAO 3.3V
SDA → XIAO D4
SCL → XIAO D5
Insert a FAT32‑formatted memory card, connect a speaker, then connect to the XIAO board's serial port. TX and RX are crossed (not side-by-side)!!!!
GND → XIAO GND
VCC → XIAO 3.3V
RX → XIAO D6
TX → XIAO D7
- Firmware Flashing
This application supports the XIAO ESP32‑S3 . Select the corresponding firmware based on your board.
Click the "Flash Firmware" button below, follow the prompts to select the appropriate serial port, and connect the device.
If the device is not recognized, double‑click the Reset button on the XIAO to enter Download Mode, then try again.
Flash firmware to your device (in-app tool on CodeCraft Hub).
- Powering On and Usage
After flashing is complete, press the reset button on the XIAO‑ESP32‑S3. The system will enter "Standby Sensing" mode.
Use the Vision AI V2 to train an image classification model. You can define three image categories:
You (the target person)
Other people (non-target individuals)
Environment (no one present – simply take photos facing an empty room)
Prepare a FAT32-formatted memory card. Save two audio recordings to the root directory as 0001.mp3 and 0002.mp3 (or 0001.wav and 0002.wav).
When the target subject faces the camera, the speaker plays 0001 (.mp3/.wav).
When anyone else faces the camera, the speaker plays 0002 (.mp3/.wav).
If no one is present, the speaker remains silent.
- Future Expandable Directions
Music and Voice Content Library: In future updates, a media library for music and voice materials can be established. It will allow users to customize background music, encouraging phrases, and welcome greetings, with the ability to automatically switch content based on the time of day, holidays, or specific scenarios.
Access Logs and Data Statistics: The system can record arrival times, recognition results, and broadcasted content to generate basic visitor logs. This is ideal for offices, classrooms, exhibition halls, and other environments that require foot traffic tracking.
Remote Notification Feature: When the system identifies a visitor or a specific individual, it can send alerts via mobile phone, WeChat, email, and other channels, ensuring users are notified of arrivals even when they are not on-site.
- File
0001.mp3
0002.mp3