Multimodal Tracking Explained (AI Tracking)
Update Overview
We’ve introduced a major update to Multimodal Tracking — a faster, clearer, and more intuitive way to track your meals. This redesigned experience helps you log food with fewer steps and brings all your everyday tools together in a simple, conversational layout.
What’s New
A familiar, conversational layout
The interface now mirrors modern AI chats, making it easier to follow and interact with from the moment you start.
Instant tracking for typed entries
Typing to log a meal now skips the extra mode-selection step. Your entry is tracked immediately. (Camera and voice options remain just one tap away.)
One place for scanning
Photo tracking and barcode scanning are now combined for a smoother, unified experience.
Smart suggestions
Your most frequently logged foods for the time of day appear above the input bar, helping you add everyday items even faster.
These updates all work together to make meal tracking more natural, quicker, and easier to use throughout your day.
Premium Access
Multimodal Tracking is a Premium feature. When you purchase Lifesum Premium, you are automatically opted in to Multimodal Tracking.
You can manually turn off Multimodal Tracking in order to return to the Classic Tracking Version by going to Diary Settings and deactivating Multimodal Tracking.
How to Track Food Using Multimodal Tracking
To begin tracking, press the "+" at the bottom of the app. This will open the main Chat Screen. From here, you can:
1. Enter food directly
Type in the chat to add food to your diary, or press the microphone icon to log using voice.
2. Use the Camera
Press the Camera icon in the bottom left corner to take a food photo or scan a barcode.
3. Use additional quick options
Press the + icon next to the Camera icon to access:
- Recents — All recently logged meals across previous days.
- Favorites — Your self-created Recipes, Meals, and Food Items. Filter by Meals, Favorites, or Food Items.
- Quick Track — Create a manual entry by adding a meal name and its calorie/macronutrient values.
Important note for Recents
If you want to edit a previously tracked meal, you must first add it to your Diary. After that, open it from the Diary to adjust amounts or remove ingredients. If you edit it before adding it to your Diary, the changes will affect the original entry as well.
Assigning Meals
If you don’t specify which meal (Breakfast, Lunch, etc.) an item belongs to, the app will assign it based on:
- The time of day, or
- The type of food entered.
You can manually choose the meal category by selecting it at the top of the Chat Screen. When selecting a meal manually, you’ll also see the suggested calorie range for that meal, e.g., Breakfast (400–540 kcal).
Tracking for Different Dates
In the top right corner of the Chat Screen, you’ll find a Calendar icon. Press it to choose a different date to track under. If you are tracking for a date other than today, the date will appear red on the main screen.
Smart Suggestions
Above the input bar, you’ll find Smart Suggestions — the foods you most frequently log for the current time of day. These help you add your regular items with just one tap.
Editing Meals After Tracking
If you have already tracked a meal but forgot an ingredient or want to make changes, you can easily edit it:
- Open the meal from the Diary view.
- Press "Add more food".
This will reopen the Chat Screen, where you can type commands such as "add milk", "replace milk with cream", or other adjustments.
You can also edit meals directly in the chat by writing what you want to change (e.g., "change tomato to bell pepper").
Tips for Best Results
- Voice Input: Speak clearly and be specific (e.g., “150 grams of grilled salmon with broccoli”).
- Image Input: Use well-lit, focused photos. Keep the frame limited to the food you want to track.
- Barcode Scanning: Ensure the barcode is fully visible and centered within the scanner frame.
- Quick Track: Perfect for frequent meals or when tracking while on the go.
Important Notes on AI Accuracy
Food Recognition Limitations
- Image-Based Tracking: Accuracy may decrease with blurry photos, multiple items in a single image, or complex dishes.
- Voice/Text Input: Vague descriptions like “a bowl of salad” may lead to less accurate results.
Portion Size Estimates
The AI estimates portion sizes based on your input, and these may not always match your actual serving size. After the meal has been generated, you can tap the meal and manually adjust the amount of each ingredient.
Food Data Variations
Nutritional values can vary between brands, recipes, and cooking methods. The AI uses standardized data, which may not reflect all variations.
How to Improve Accuracy
- Provide clear, detailed descriptions with quantities (e.g., “200 grams of baked sweet potato”).
- Use sharp, well-lit photos that focus solely on the food you want to track.
This improved Multimodal Tracking experience aims to make meal logging smoother, clearer, and more aligned with your daily habits.
Updated on: 05/12/2025
Thank you!
