How accurate is Zabble's AI in predicting bin fullness ?
July 8, 2021
July 8, 2021
Zabble Zero™ Mobile Tagging makes waste level and contaminant monitoring easy using just a mobile device. Zabble Zero™ AI also makes it faster and learns over time: When a user snaps a photo of a bin using a phone or a tablet, Zabble Zero™ AI suggests fullness levels and contamination items, and automatically alerts supervisors of any issues.
In this post, we take a deeper look into the performance of the suggested fullness algorithm. How often does a user need to modify the AI suggestion? Does it really work?
For this evaluation, we focused on dumpster tags from April and May. We looked at two different metrics:
Zabble Zero™ customers used the app’s AI to predict the fullness of dumpsters 735 times over two months. In 719 cases, users accepted the suggested fullness without making any changes. Only in a handful cases did they change the suggested fullness, and those changes were typically within 25%. (Zabble Zero™ AI predicts fullness in 25% increments.) This evaluation method suggests a 98% accuracy.
As users may not always review the suggested fullness, we conducted a photo evaluation as well. We took a random sample of 30 dumpster photos and, without looking at the suggested fullness results, entered our own estimation of the fullness %. And repeated this experiment 10 times.
In this one sample, in 68% of cases, the human estimation matched the AI suggestion exactly. In 89% of cases, the difference was close, or within 25%. (Note, estimating fullness by looking at a photo is not always accurate, as photo usability can vary.)
The average difference was 0%, meaning that differences will even out over many tags.
We repeated this evaluation multiple times, examining 10 samples of 30 entries each, to see if our results were consistent across different sets of photos.
Our photo evaluation results proved to be fairly consistent. Across the samples, the AI suggestions and human estimations matched 63% of the time, and were close 94% of the time. These are great results that show how Zabble Zero™ AI can help make zero waste campaign tracking fast and easy.
To learn more about Zabble Zero™ AI, please contact the Zabble team.
Friday, October 20, 2023
Monday, August 8, 2022
1966 Tice Valley Blvd, #105,
Walnut Creek, CA 94595