Smart mushroom Classifier - Seeed Studio XIAO ESP32S3 - dumpling—li - CodeCraft Hub
Scene: Maker. Edge AI application on CodeCraft Hub for Maker use cases.
Devices / BOM: Seeed Studio XIAO ESP32S3, Grove Vision AI V2, Grove Shield for Seeed Studio XIAO, Grove - Universal 4 Pin Buckled 20cm Cable (5pcs), MP3
Maker application on CodeCraft Hub. Eating wild mushrooms is risky! Build an offline AI Mushroom Identifier to spot toxic ones. Place a mushroom under the lens to instantly see its name on an OLED, as MP3 audio alerts play. Master zero-code deployment and craft this hardcore STEM toy in minutes!
Documentation
Every year, people face life-threatening risks due to misidentifying wild mushrooms. Think building an AI hardware device to spot toxic mushrooms is too difficult? With SenseCraft, you can easily make one even with zero programming experience:
Upload a few images and train your model in minutes.
Deploy it directly to edge devices (like the XIAO ESP32C3) for real-world testing.
When you point the camera at a delicious Termite mushroom or a highly toxic Amanita muscaria, this system will use its OLED screen and voice broadcasts to quickly tell you whether it is toxic and safe to eat. It offers a super cool interactive experience to help you intuitively understand the combination of no-code AI and edge computing!
⚠️ Important Note: This project is strictly for educational and learning purposes; never use it for actual wild mushroom detection! You should never rely solely on AI to judge the safety of wild mushrooms. If you encounter an unidentified mushroom, discard it immediately and wash your hands!
Deploy steps
- Train your vision recognition model.
This Vision AI V2 image classification model detects four categories: Amanita, Death Cap, False Morel (three highly toxic mushrooms), and No Object.
Deploy an AI model to your device (in-app tool on CodeCraft Hub).
- Hardware Connection
Insert the XIAO ESP32-S3 into the Grove Shield: Ensure the USB port aligns with the shield's orientation and press the pins firmly into place.
Connect the XIAO ESP32-S3 to your computer via a USB Type-C cable. Note: The Type-C cable must be a data cable, not a charging-only cable.
Connect the Vision AI V2 module (visual input) to the XIAO-ESP32's SDA/SCL pins.
GND → XIAO GND
VCC → XIAO 3.3V
SDA → XIAO D4
SCL → XIAO D5
Insert a FAT32‑formatted memory card, connect a speaker, then connect to the XIAO board's serial port. TX and RX are crossed (not side-by-side)!!!!
GND → XIAO GND
VCC → XIAO 3.3V
RX → XIAO D6
TX → XIAO D7
Connect the OLED display to the XIAO board's I2C port to display the mushroom names and warning messages. It shares the same I2C pins with the Vision AI V2 module.
GND → XIAO GND
VCC → XIAO 3.3V
SDA → XIAO D4
SCL → XIAO D5
- Firmware Flashing
This application supports theXIAO ESP32‑S3 . Select the corresponding firmware based on your board.
Click the "Flash Firmware" button below, follow the prompts to select the appropriate serial port, and connect the device.
If the device is not recognized, double‑click the Reset button on the XIAO to enter Download Mode, then try again.
Flash firmware to your device (in-app tool on CodeCraft Hub).
- Powering On and Usage
After flashing is complete, press the reset button on the XIAO‑ESP32‑C3.
Termite mushroom detected → OLED: Y (YES) / termite / mushroom; MP3: Termite mushroom is edible and safe. It grows on termite nests. No toxin. You can cook and eat it. Do not confuse with poisonous look-alikes.
Amanita muscaria (fly agaric) detected → OLED: N (NO) / Amanita / muscaria; MP3: Amanita muscaria is poisonous. It contains neurotoxins. Do not eat. Symptoms include hallucinations and confusion. Seek medical help if ingested.
Unknown mushroom detected → OLED: Unknown / danger / (third line empty); MP3: Unknown mushroom – dangerous. Do not eat. Could be toxic. Discard it immediately. Wash your hands. When in doubt, keep away.
No mushroom (nothing under lens) → OLED: No / mushroom / (third line empty); MP3: No MP3 playback.
⚠️ Important note: This is for educational and science popularization purposes only. Never rely on AI or any mobile app to decide if a wild mushroom is safe to eat. Always consult real experts.
- Future Expandable Directions
Tactile Warning & Vibration Feedback: To solve the issue of the small 0.66" OLED screen being hard to read under bright outdoor light , a standard vibration motor can be added to provide intuitive physical alerts : it delivers pulse vibrations upon encountering unknown dangers , and triggers a continuous, intense vibration when detecting highly toxic mushrooms.
- File
Online AI Dubbing Tool： https://ttsmaker.cn/
The file must be placed in the root directory of the memory card, not inside any folder.
0001.wav
0002.wav
0003.wav