How to calculate calories from a photo
PlateSight team · Last updated: Wednesday, October 7, 2026
Weighing everything you eat and logging it item by item in an app is the most common reason people give up on calorie tracking. Calculating calories from a photo lightens that burden: you take a picture of your plate, and the software recognizes the foods, estimates the portion and calculates the calories. In this article we explain how the process works, when it gets things wrong, and how you can make the result more accurate.
Calorie calculation from a photo works in three steps
What happens behind the scenes is similar to what a dietitian does when looking at a plate. First the foods are recognized, then the amounts are estimated, and finally each food's nutritional values are multiplied by its amount.
- Recognition: The AI model that analyzes the image says what is on the plate: lentil soup, a slice of bread, a salad and so on.
- Amount estimation: Clues such as the size of the plate and the area and height the food covers are used to work out the approximate weight of each food in grams.
- Nutritional values: The calories, protein, carbohydrate and fat per 100 grams of each food are taken from a food table or from the model's own knowledge and calculated according to the weight.
The result arrives in a few seconds. A good app does not stop there; it lets you correct every item, because however accurate the third step is, a small error in the first two changes the result.
When does the estimate go wrong?
A photo only shows what is visible. That is why some situations are difficult for any software, and knowing them helps you interpret the result correctly.
- Invisible fat and sugar: Oil absorbed during frying, salad dressing and sugar in tea are often not visible in a photo. One tablespoon of olive oil is about 120 kcal; this can be the biggest source of error in the estimate.
- Mixed dishes: In casseroles, dishes served over rice, stuffed vegetables and pasta with sauce, the proportions of the ingredients vary from recipe to recipe.
- Depth: In a photo taken from above, you cannot tell how deep the soup in a bowl is. A photo taken from a slight angle to the side usually gives better results.
- Partly eaten plates: A photo taken at the start of the meal shows the amount put on the plate, not the amount you actually ate.
Practical tips for a more accurate result
- Take the photo before you start eating, in good light, with the whole plate in view.
- A fork or spoon next to the plate gives a clue about scale.
- If you added sauce, oil or sugar, add it as a separate item when you edit the result.
- Correct the portion to small, medium or large; replace a wrongly recognized food with the right one from the list.
- If you did not finish the plate, reduce the portion to account for what was left.
These small corrections take a few seconds but noticeably improve the total for the day. Remember: the goal is not a perfect number but a consistent record every day. Consistent estimates are enough to see trends and to talk with your dietitian effectively.
Food table or AI estimate?
A food's nutritional values can come from two sources. The first is a food table based on laboratory measurements; its values are averages but consistent. The second is the model's own estimate, which is useful for regional dishes that are not in the table. PlateSight first looks up the recognized food in the food table and uses the table value if it finds one; if not, it uses the model's estimate. You can look up the average values of a food in the calorie table.
Who is calorie calculation from a photo suitable for?
This method suits anyone who has no time or patience to weigh every meal but wants to see what they eat. People who want to lose weight, maintain their weight or simply eat in a more balanced way can easily follow their weekly trends with a photo log. It has an extra advantage for people who work with a dietitian: the dietitian sees not only the numbers but the plate itself, and can give concrete advice.
In cases that require clinical nutrition treatment, such as diabetes, kidney disease or a history of eating disorders, you should work with a dietitian or physician instead of relying on the calorie count alone. A photo log is useful in these cases too, but the person interpreting it should be a specialist.
Try it with your own plate
The easiest way to see how it works is to try it. In the Try your plate section, choose a meal photo from your computer and see the foods, grams and calories within seconds. Your photo is not stored. If you want to track every day, you can download the PlateSight app and log your meals from your phone. You may also want to read our article explaining how macros are calculated.