Articles on: Food Tracking
This article is also available in:

Multimodal Tracking Explained (AI Tracking)

Update Overview


We’ve introduced a major update to Multimodal Tracking — a faster, clearer, and more intuitive way to track your meals. This redesigned experience helps you log food with fewer steps and brings all your everyday tools together in a simple, conversational layout.

What’s New


A familiar, conversational layout

The interface now mirrors modern AI chats, making it easier to follow and interact with from the moment you start.

Instant tracking for typed entries

Typing to log a meal now skips the extra mode-selection step. Your entry is tracked immediately. (Camera and voice options remain just one tap away.)

One place for scanning

Photo tracking and barcode scanning are now combined for a smoother, unified experience.

Smart suggestions

Your most frequently logged foods for the time of day appear above the input bar, helping you add everyday items even faster.


These updates all work together to make meal tracking more natural, quicker, and easier to use throughout your day.

Premium Access


Multimodal Tracking is a Premium feature. When you purchase Lifesum Premium, you are automatically opted in to Multimodal Tracking.


You can manually turn off Multimodal Tracking in order to return to the Classic Tracking Version by going to Diary Settings and deactivating Multimodal Tracking.

How to Track Food Using Multimodal Tracking


To begin tracking, press the "+" at the bottom of the app. This will open the main Chat Screen. From here, you can:

1. Enter food directly

Type in the chat to add food to your diary, or press the microphone icon to log using voice.

2. Use the Camera

Press the Camera icon in the bottom left corner to take a food photo or scan a barcode.

3. Use additional quick options

Press the + icon next to the Camera icon to access:


  • Recents — All recently logged meals across previous days.
  • Favorites — Your self-created Recipes, Meals, and Food Items. Filter by Meals, Favorites, or Food Items.
  • Quick Track — Create a manual entry by adding a meal name and its calorie/macronutrient values.


Important note for Recents

If you want to edit a previously tracked meal, you must first add it to your Diary. After that, open it from the Diary to adjust amounts or remove ingredients. If you edit it before adding it to your Diary, the changes will affect the original entry as well.

Assigning Meals


If you don’t specify which meal (Breakfast, Lunch, etc.) an item belongs to, the app will assign it based on:

  • The time of day, or
  • The type of food entered.

You can manually choose the meal category by selecting it at the top of the Chat Screen. When selecting a meal manually, you’ll also see the suggested calorie range for that meal, e.g., Breakfast (400–540 kcal).

Tracking for Different Dates


In the top right corner of the Chat Screen, you’ll find a Calendar icon. Press it to choose a different date to track under. If you are tracking for a date other than today, the date will appear red on the main screen.

Smart Suggestions


Above the input bar, you’ll find Smart Suggestions — the foods you most frequently log for the current time of day. These help you add your regular items with just one tap.

Editing Meals After Tracking


If you have already tracked a meal but forgot an ingredient or want to make changes, you can easily edit it:


  1. Open the meal from the Diary view.
  2. Press "Add more food".


This will reopen the Chat Screen, where you can type commands such as "add milk", "replace milk with cream", or other adjustments.

You can also edit meals directly in the chat by writing what you want to change (e.g., "change tomato to bell pepper").

Tips for Best Results


  • Voice Input: Speak clearly and be specific (e.g., “150 grams of grilled salmon with broccoli”).
  • Image Input: Use well-lit, focused photos. Keep the frame limited to the food you want to track.
  • Barcode Scanning: Ensure the barcode is fully visible and centered within the scanner frame.
  • Quick Track: Perfect for frequent meals or when tracking while on the go.

Important Notes on AI Accuracy


Food Recognition Limitations


  • Image-Based Tracking: Accuracy may decrease with blurry photos, multiple items in a single image, or complex dishes.
  • Voice/Text Input: Vague descriptions like “a bowl of salad” may lead to less accurate results.


Portion Size Estimates

The AI estimates portion sizes based on your input, and these may not always match your actual serving size. After the meal has been generated, you can tap the meal and manually adjust the amount of each ingredient.


Food Data Variations

Nutritional values can vary between brands, recipes, and cooking methods. The AI uses standardized data, which may not reflect all variations.


How to Improve Accuracy


  • Provide clear, detailed descriptions with quantities (e.g., “200 grams of baked sweet potato”).
  • Use sharp, well-lit photos that focus solely on the food you want to track.


This improved Multimodal Tracking experience aims to make meal logging smoother, clearer, and more aligned with your daily habits.

Updated on: 05/12/2025

Was this article helpful?

Share your feedback

Cancel

Thank you!