Gesture-Controlled Trash Bin Bot - Seeed Studio XIAO ESP32S3 Sense - zeller - CodeCraft Hub
Scene: Maker. Edge AI application on CodeCraft Hub for Maker use cases.
Devices / BOM: Seeed Studio XIAO ESP32S3 Sense, Grove Vision AI V2, Grove - Servo, Grove Shield for Seeed Studio XIAO, SparkFun MotorDriver - Dual TB6612FNG, DC Motor 12V, Power 12V
Maker application on CodeCraft Hub. The Gesture-Controlled Trash Bin Bot made based on Grove Vision AI Module V2 and XIAO ESP32S3
Documentation
In life, there are many unpredictable things. Sometimes you want something but inevitably lose it. Sometimes the parting comes even sooner than you expected. However, life goes on. One needs to regain confidence and keep moving forward.Recently, I used the products from SeeedStduio to create a gesture-recognition trash can robot, in order to address the embarrassing situation where I couldn't find the trash can after having breakfast.
Next, I will introduce to you how I made this project and the materials needed for it. If you have any questions, you can message me privately.
Deploy steps
- Deploy Gesture Recognition Model to VisionAI V2
The model trained using Vision V2 and SenseCraft is used to recognize gestures, and then the data is packaged and transmitted to XIAO ESP32S3 via IIC.
Deploy an AI model to your device (in-app tool on CodeCraft Hub).
- Flash firmware to ESP32-S3 Sense
Communicate with Grove Vision AI Module V2 using the IIC protocol, parse the received data, and then perform corresponding logical control based on the parsed information. The main controller makes the selection based on the specific actual situation. Currently, the expansion board module used supports all XIAO of Seeed Studio. However, it should be noted that the XIAO you are using supports development using the Arduino framework.
Code snippet included — open the application page to copy it.
I used four DC motors to control the movement of the car (forward and backward), and one servo motor to control the opening and closing of the trash can lid.
No camera is required.
Flash firmware to your device (in-app tool on CodeCraft Hub).
- Wiring
The wiring part is rather complicated. Please carefully check it before connecting to avoid damaging the motor drive and XIAO.
Picture1: general wiring diagram
Picture2: Actual wiring diagram
- 3D shell section
You can design your own enclosure according to actual needs using SolidWorks or Fusion360. Below is the enclosure I made. After printing, it is recommended to use self-tapping screws with a diameter of 2mm for fixation.
Main body part
shell
Side part.
Side
Assembly effect after printing
- Demo Video