Grocery Vision

Grocery Vision is a computer vision application that simplifies the grocery checkout process. What does "simpler" mean? By simpler, we mean that users don't have to scan labels or memorize PLU codes.

We believe that computer vision, or more specifically object detection in this process, can be a solution to this problem because it provides a real-time way to detect objects in a variety that humans can only achieve after a long training period. However, in natural products such as in the fruit and vegetable department, there are also different shapes and colors, all of which can be assigned to one class and one product. There is a standard that must be followed to sell them as one product, but there remain natural differences between each fruit. Nevertheless, we have chosen this application for our Grocery Vision project.

To clarify the "we" briefly, we are 5 students from KIT who have a great interest in Data Science and software applications. That's why we all signed up for the AISS Applied in Computer Vision course and had a lot of fun together. We introduce ourselves a bit more detailed here.

In our application, we wanted to simplify the checkout process for products that need to be weighed. Our solution starts at the checkout. As you can see in the image, we use a camera that films a live video of the checkout.

Using the neural network previously trained on synthetic data, our application automatically detects the items and lists them on the screen. The prices from the system are then assigned to the products and processed into the total after the purchase is complete.

Summary of benefits: easier shopping for supermarket customers, shorter training period for new store employees. And POS system providers can offer a centralized solution for weighing and automatic product detection.