...
| View file | ||||
|---|---|---|---|---|
|
Shot by Obinna Akahara
Narrated by Emily Cazes
Cart operation relies on a Pixy 2 for target recognition and discrimination as well as four SRF05 ultrasonic sensors for dynamic obstacle avoidance. A Particle Photon is the microcontroller used to integrate data from the sensors. The Pixy relies on hue data from its video feed to construct color blocks from the scene. Insert Pixy Screenshot The Pixy is a smart sensor because it integrates the data onboard and relays the result; this is desirable because that means that the microcontroller is free to perform other tasks. The reason why the Pixy is able to process video feed live is because it uses only color data and does not try to discriminate more complex visual artifacts like edges or other phyical features. Specific hues can be tagged and when these are found adjacently in color connected components the Pixy can detect this and relay the height, width, and relative location to the microcontroller. In a commercial setting each user would wear a unique color code in the form of a belt or armband so that they could be tracked. The primary downside of this method is that the Pixy is sensitive to lighting - we found that bright, matte colors worked best but reflectors as used in bikes or self-illumination codes could also be used more reliably.
...