Accuracy
Can ChatGPT count calories from a photo? What the studies found
ChatGPT can estimate calories from a food photo, but published tests found about 36% average error. What the research says, better prompts, and what an app adds.
By Calorix team, Invikta 5 min read
Yes, roughly: ChatGPT can estimate the calories in a food photo, but published tests found large errors. In a 2025 study of 52 food photos, ChatGPT-4o and Claude 3.5 Sonnet missed the calories by 35.8% on average and under-counted more as portions grew; in another 2025 study, telling ChatGPT the cooking fat and ingredient amounts cut its average error from 31% to 14%. Unlike a calorie app, ChatGPT isn’t built to keep a daily log with targets, look up packaged food by barcode or sync with Apple Health.
Ask ChatGPT how many calories are in a photo of your dinner, and it will give you a number in seconds, often with a confident breakdown. That makes it tempting as a free calorie counter. Researchers have now tested exactly this, and their results are useful whether you use ChatGPT, another AI model or a calorie app.
What the studies found
| Study | Model | What was tested | Calorie error |
|---|---|---|---|
| Fridolfsson et al., 2025 | ChatGPT-4o, Claude 3.5 Sonnet, Gemini 1.5 Pro | 52 standardized food photos with weighed food | 35.8%, 35.8% and 64.2% on average |
| O’Hara et al., 2025 | ChatGPT-4 | 114 photos: 38 meals at 3 portion sizes | Identified 93% of foods; under-estimated medium and large meal weights |
| Rodríguez-Jiménez et al., 2025 | ChatGPT-5 | 195 dishes, with and without extra details | 30.5% from the photo alone; 24.4% with fat and sweetener details; 13.9% with ingredient amounts |
| Cinar et al., 2026 (pilot) | ChatGPT-4o | 9 simple and complex dishes | Up to 54.4% on calories for complex dishes |
General AI models miss by about a third
The most direct test comes from a 2025 study that gave three AI models 52 standardized photos of single foods and meals whose weights were known. ChatGPT-4o and Claude 3.5 Sonnet missed the calories by 35.8% on average; Gemini 1.5 Pro by 64.2%. All three under-estimated more as portions got bigger: errors were about 20 to 30% lower for small portions than for large ones.
Good at naming foods, weaker at amounts
A 2025 study of ChatGPT-4 on 114 meal photos, 38 meals each shown at three portion sizes, found it identified foods well, with 93% precision. Amounts were the problem: large meals that weighed 798 g on average were estimated at 530 g, and medium meals were under-estimated too, while small meals were close. Its estimates differed significantly from the true values for 10 of the 16 nutrients studied. One caveat in ChatGPT’s favor: on calories specifically, its median estimate was close to the true median in that study.
Details make a big difference
The strongest evidence that you can help comes from a 2025 study of ChatGPT-5 on 195 dishes. From the photo alone, its calorie estimates were off by 30.5% on average (123 kcal). Told the type and amount of fat, the sweetener, the fat content of dairy and the type of meat, the error fell to 24.4% (92 kcal). Given the ingredient list with amounts, it fell to 13.9% (53 kcal). A small 2026 pilot of ChatGPT-4o on nine dishes points the same way: errors reached 54.4% for calories and 76.5% for fat on complex dishes with hidden fat, and adding details made its estimates far more consistent. With only nine dishes, treat the 54% as a worst case, not an average.
Other findings worth knowing
- People still do better. In a 2026 test of 40 AI models, professional nutritionists estimated nutrients more accurately than every model, and photos from several angles didn’t help the models.
- AI can invent things. Researchers who built a dietary tool on GPT-4o found plain GPT-4o recognized 59% of foods from photos alone and warned about “hallucinations (fabricated items, units, or quantities)” (AJCN, 2025).
- Typed foods are easier than photos. When AI models were given food names as text instead of photos, their energy estimates agreed well with nutrient databases, with mixed dishes and condiments varying most (Journal of Nutrition, 2026).
Why ChatGPT misses on photos
The same three things trip up ChatGPT and photo calorie apps:
- Portion size. A photo is flat, so the depth of a bowl of pasta or rice is hard to judge, which is why big portions get under-counted.
- Hidden fat. Oil soaked into vegetables or butter melted into a sauce barely shows. One tablespoon of olive oil is 119 kcal, according to USDA FoodData Central.
- Mixed dishes. In a curry, a burrito or a casserole, the AI has to guess the recipe as well as the amount.
Dedicated apps aren’t immune: in a preliminary 2026 NIH test, the photo features of MyFitnessPal, Lose It!, Cal AI and Appediet under-counted weighed meals by 252 to 345 kcal on average, about a third. Our review of photo calorie apps covers that study and each app’s accuracy claims.
ChatGPT vs a calorie app
| Task | ChatGPT | A calorie tracking app |
|---|---|---|
| Estimate a meal from a photo or a description | Yes | Yes |
| A daily log with calorie and macro targets | Not built in | Yes |
| Packaged food by barcode | No database lookup | Yes, from a food database |
| Correct one ingredient and keep the total right | By asking again | Edit the line, the total updates |
| Weekly trends, streaks, reminders | No | Yes |
| Apple Health, widgets | No | Yes, in most iPhone apps |
| Best for | One-off questions, recipes, planning | Logging every day |
The estimate itself isn’t magic in either case: many calorie apps, Calorix included, use large AI models to read photos. The difference is what surrounds the estimate. In Calorix, a photo comes back as a list of ingredients with grams and a confidence badge you can correct, barcodes and nutrition labels cover packaged food, and everything lands in a log with your targets.
How to get better estimates from ChatGPT, or any AI
The research says the biggest gains come from telling the AI what the photo can’t show. A prompt like this one works better than a photo alone:
Estimate the calories, protein, carbs and fat in this photo. It’s about 180 g of cooked rice, 150 g of grilled chicken thigh and roasted vegetables cooked in about 1 tablespoon of olive oil. List each ingredient with the amount and calories you assumed, then the total.
- Give weights or sizes when you know them: grams from a scale, “a full dinner plate”, “half a cup”.
- Name the cooking fat and how much: oil, butter, ghee, cream.
- Mention sauces, dressings and drinks, which photos miss.
- Ask for a per-ingredient breakdown with its assumptions, so you can see where it guessed.
- Shoot at a 45-degree angle with the whole plate in frame, rather than straight down.
- Use the label for packaged food. The printed values beat any estimate.
The bottom line
ChatGPT can count calories from a photo well enough for a rough idea, and much better when you give it the amounts and the cooking fat. For tracking day after day, a calorie app adds the parts ChatGPT isn’t built for: a log with targets, barcodes, quick corrections and trends. Whichever you use, treat a photo estimate as a first draft. If you want a target to log against, start with our TDEE calculator.
Frequently asked questions
Can ChatGPT count calories from a photo?
It can give an estimate. In published tests, ChatGPT recognized most foods in meal photos, but its calorie estimates were off by about 30 to 36% on average and it tended to under-count large portions. Adding details such as the cooking fat and ingredient weights makes its estimates much closer.
How accurate is ChatGPT at counting calories?
In a 2025 study of 52 standardized food photos, ChatGPT-4o’s calorie estimates were off by 35.8% on average, the same as Claude 3.5 Sonnet, while Gemini 1.5 Pro was off by 64.2%. A 2025 study of ChatGPT-5 on 195 dishes found 30.5% error from the photo alone, falling to 13.9% when it was given the ingredient amounts.
Is ChatGPT better than a calorie counting app?
They do different jobs. ChatGPT is flexible for one-off questions. A calorie app keeps a daily log against your targets, reads barcodes and labels for packaged food, lets you correct each ingredient, and shows your trends over weeks. Photo estimates from apps also run low: in a preliminary 2026 NIH test, four apps under-counted weighed meals by about a third.
What’s a good ChatGPT prompt for counting calories?
Give it what a photo can’t show: the weight or size of each portion, how the food was cooked and with how much oil or butter, sauces and drinks, and ask for a per-ingredient breakdown with the assumptions it made. Then check the biggest items yourself.
Can ChatGPT track my calories every day?
You can keep a running conversation, but ChatGPT isn’t built as a food log: it doesn’t hold daily targets and totals, look up packaged foods by barcode, sync with Apple Health or show weekly trends. That’s what a calorie tracking app is for.
Is Cal AI more accurate than ChatGPT?
No study has compared them directly, so we can’t say. In the NIH test presented in July 2026, Cal AI’s photo feature under-counted weighed meals by 345 kcal on average; ChatGPT wasn’t part of that test, and the ChatGPT studies used different meals and methods.
Sources
- 1 Fridolfsson J, Sjöberg E, Thiwång M, Pettersson S. Performance Evaluation of 3 Large Language Models for Nutritional Content Estimation from Food Images. Current Developments in Nutrition, 2025.
- 2 O’Hara C, Kent G, Flynn AC, Gibney ER, Timon CM. An Evaluation of ChatGPT for Nutrient Content Estimation from Meal Photographs. Nutrients, 2025.
- 3 Rodríguez-Jiménez M, Martín-del-Campo-Becerra GD, Sumalla-Cano S, et al. Image-Based Dietary Energy and Macronutrients Estimation with ChatGPT-5: Cross-Source Evaluation Across Escalating Context Scenarios. Nutrients, 2025.
- 4 Cinar EN, Özler E, Arslan S, Yilmaz S. Image-based nutritional assessment: Evaluating the performance of ChatGPT-4o on simple and complex meals. Journal of Food Composition and Analysis, 2026.
- 5 Vedovelli L, Pugnaloni S, Lanera C, et al. Model architecture dominates nutritional estimation accuracy in vision-language systems. Scientific Reports, 2026.
- 6 Chen YJ, Chang CC, Hoang YN, et al. Customized multimodal Diabot-GPT-4o enhances accuracy of image-based dietary assessments in dietetic trainees in Taiwan: validation against weighed food records. American Journal of Clinical Nutrition, 2025.
- 7 Lawabni R, Solano OR, Kampen LL, et al. Evaluation of Energy and Nutrient Estimates from Large Language Models Using Text-Based Queries. Journal of Nutrition, 2026.
- 8 Charles O, Flacke EU, Turner S, et al. Photograph-Based AI Features in Calorie-Tracking Apps Underestimate Energy Content of Meals (NUTRITION 2026 abstract). Current Developments in Nutrition, 2026.
- 9 Oil, olive, salad or cooking. USDA FoodData Central (SR Legacy), 2019.