Articles on: Food Tracking

Multimodal Tracking Explained

Using AI to Track Your Meals


Our app uses advanced AI technology to make food tracking quick, easy, and accurate. Whether you prefer speaking, taking a photo, or typing, the AI assists you in logging your meals efficiently. Here's how to get started:


How to Track Food


  1. Access the Diary Screen


  • Open the Diary screen in the app.
  • Tap the "+" button to begin tracking your food.


  1. Choose Your Preferred Tracking Method


After tapping the "+" button, you can choose from the following options:


  • Voice: Say the name of your meal or food item (for example, “One cup of cooked oatmeal”). The AI will process your input and provide nutritional details.
  • Image: Take or upload a clear photo of your food. The AI will recognize the items, estimate portion sizes, and calculate nutritional values.
  • Text: Type in the name of the food or dish. The AI will retrieve relevant information such as calories and macronutrients.
  • Barcode Scanner: Scan the barcode of a packaged food item to get its nutritional content instantly.
  • Quick Track: Add a recently tracked meal, a saved favorite, or create a manual entry by specifying the name and calorie value.


Where have all the meals gone from my Diary?


Before you could only select Breakfast, Lunch, Snack and Dinner. With the new multimodal tracking view you get to create the number of meals you have during the day. Depending on the time of the day and the food you select, the Ai will try to guess what kind of meal you are having - if you want to change it, you can still do so with the push of a button.


  • You can either specify the meal in the text input (e.g. "For lunch today I had...") or you can select the meal manually from the chat view by pressing "Select meal type" up top.
  • If you have tracked a meal and it ended up on the wrong meal type you can easily change this by opening the meal from the Diary view and then change from Lunch to Dinner etc.


How can I add something to a meal that I have already tracked?

If you have already tracked a meal but forgot to add an ingredient or want to edit it you can do so by:


  1. Open the meal from the Diary view.
  2. Press "Add more food".


This will open up the chat view again and you can type in commands such as "add milk" or "replace milk with cream".


Tips for Best Results


  • Voice Input: Speak clearly and be specific (for example, “150 grams of grilled salmon with broccoli”).
  • Image Input: Use well-lit, focused photos. Try to keep the frame limited to the food you want to track.
  • Barcode Scanning: Ensure the barcode is fully visible and well-positioned in the scanner frame.
  • Quick Track: Ideal for frequent meals or when tracking on the go.


Important Notes on AI Accuracy

While the AI is designed to be highly accurate, there are a few limitations to keep in mind:


Food Recognition Limitations

  • Image-Based Tracking: Accuracy can be reduced by unclear images, multiple items in one photo, or complex dishes.
  • Voice/Text Input: Vague terms such as “a bowl of salad” can lead to less accurate results.


If needed, you can edit the meal in the chat by writing what you want to change (for example, “change tomato to bell pepper”).


Portion Size Estimates

  • The AI estimates portion sizes based on your input. These may not always reflect the actual quantity.
  • You can tap on the meal the AI generated and manually adjust the amount of each identified ingredient.


Food Data Variations

  • Different brands, recipes, and cooking methods affect nutritional content. The AI uses standardized data, which may not reflect all variations.


How to Improve Accuracy

  • Provide clear and detailed descriptions, including quantities (e.g., “200 grams of baked sweet potato”).
  • Use sharp, well-lit photos that focus only on the food you wish to track.


Switching Off Multimodal Tracking

If you prefer to use the traditional tracking methods:


  1. Open Settings: Go to the Settings menu in the app.
  2. Open Diary Settings: Under Settings in the app you have the a section that is called Diary Settings (Customise Diary on Android).
  3. Toggle Off Multimodal Tracking: Locate the "Multimodal Tracking" option and switch it off with the toggle.
  4. Track Food Manually: You can now continue using text search, barcode scanning, or any of the other options.


I Cannot Find The Multimodal Tracking Feature. Why?

There are two possible reasons:


  • Premium Access: This functionality is available only to users on a Premium plan.
  • Market Availability: Multimodal Tracking features are currently not released in all markets. They are, for example, not available in Russia and Belarus at this time.


Whether you choose AI assistance or traditional tracking methods, our goal is to help you monitor your meals effectively and stay aligned with your goals. Use the method that best suits your preferences.

Updated on: 12/08/2025

Was this article helpful?

Share your feedback

Cancel

Thank you!