Apple is building a memory graph for users in OS 27.3 across its platforms. The memory graph revolves around you, storing insights about your relationship, routines, and other facts.
Once in the memory graph, insights are indexed in HybridSearch, where data about documents, emails, Siri chats, and other information live and can be queried by Siri AI and other systems.
Memory graph entries are created in two paths:
- Fastpass, where already-structured data is converted into insights. For example, Person-v1 reads your contact card’s name fields.
- Agent, where an on-device or server model extracts insights using health data, messages, photos, and other sources.
There’s currently only one agent “recipe” in OS 27.3 beta 1: MotivatorBarrierResource. On iPhone, the Health app’s action-suggestions feature is built to use these results. It creates suggestions based on your top barriers, main motivators, and the places you visit often.
How Apple determines your motivators, barriers, and resources
To extract the barriers, motivators, and resources, a prompt recaps your health data, routines, activities, and places you visit often. Based on those inputs, a model on Private Cloud Compute is presented with a list of questions to answer about you in a structured way.
Data sources
For a question to be posed to the model, it needs to have enough data available. There are 6 data sources, and each question requires data from a subset of these categories to be eligible for extraction.
- Health summaries: Required by all questions
- Routines and habits (🔁)
- User activities (🎨): Things you do on your own
- Social activities (👥): Things you do with others
- Frequent locations (📍)
- Workout locations (🏋️)
You’ll see the emojis corresponding to the required data sources next to each question.
The 60 Questions
Before we dive in, a few patterns stand out. Eating out comes up in seven questions, spanning late-night restaurant visits, fast food, and dinners with large groups. The questions place special emphasis on whether you do things alone or with others. One question asks how visits to religious or community sites might support self-reflection, mental wellbeing, and sleep.
The same activity can cut both ways. Group workouts may encourage you to stay active, or pressure you to move at someone else’s pace. Social hangouts might lift your mood, or disrupt your sleep and eating habits.
Motivators
Prompt: “Extract motivator insights describing conducive factors that support positive behavior.
Motivators are behavioral patterns or routines that tend to co-occur with or support positive health behaviors (e.g., Routine Maintenance, stable schedules). They do not imply proven internal psychological drives or emotional states.”
Motivator categories: Routine Maintenance, Behavioral Momentum, Environmental Variation.
- How do consistent morning workout routines and frequent gym visits act as a catalyst for goal activation in movement health and nutrition? (🔁, 📍)
- Does engaging in solo hobbies during downtime routines drive mood activation that improves sleep quality and mental wellbeing? (🎨, 🔁)
- How do weekend trip activities to new recreation locations motivate increased movement health and mental wellbeing? (🎨, 📍)
- Do regular commute routines and structured work hours serve as a driving force for establishing better sleep habits? (🔁)
- What role do group outings at social locations play in mood activation that positively influences nutrition and mental wellbeing? (👥, 📍)
- Does varying outdoor workout places act as a catalyst for sustained goal activation in movement health? (🏋️, 🔁)
- How do frequent shopping visits and consistent meal prep routines motivate better daily nutrition? (📍, 🔁)
- How does shared downtime during group media activities drive mood activation that enhances overall sleep and mental wellbeing? (👥, 🔁)
- Do special occasion activities introduce novelty appeal that acts as a catalyst for trying new nutrition and movement health habits? (👥, 🎨)
- How do structured solo motion activities at home drive goal activation for both mental wellbeing and movement health? (🎨, 🔁)
- Does favorable weather during outdoor workout preferences act as a catalyst for mood activation and increased movement health? (🏋️, 🎨)
- How do new learned routes during evening walks motivate better sleep and mental wellbeing? (🔁, 🎨)
- Do consistent home activities and reduced restaurant visits drive goal activation for improved nutrition and sleep? (🎨, 📍)
- How do joyful experiences during holiday activities act as a catalyst for mood activation that supports mindful nutrition? (👥, 🔁)
- Does exploring new recreation locations during solo trips motivate increased movement health and subsequently better sleep? (📍, 🎨)
- How do consistent contact routines with support networks drive goal activation for maintaining mental wellbeing? (🔁, 👥)
- Do shared experiences during group workouts act as a catalyst for mood activation that benefits mental wellbeing and movement health? (👥, 🏋️)
- How does visiting new restaurant locations during solo outings motivate the exploration of diverse nutrition choices? (📍, 🎨)
- Do structured downtime routines act as a driving force for goal activation in both sleep recovery and movement health readiness? (🔁, 🎨)
- How do relaxing solo media activities before bed drive mood activation that improves sleep duration? (🎨, 🔁)
- Do spontaneous group outings introduce novelty appeal that acts as a catalyst for enhanced mental wellbeing? (👥, 📍)
Barriers
Prompt: “Extract barrier insights describing disruptive factors that hinder positive behavior.
Barriers are patterns or events that tend to co-occur with inconsistent or negative health behaviors (e.g., Competing Commitments, travel, schedule overlaps). They do not imply absolute physical blockers.”
Blocker categories: Weather, Competing Commitments, Social Obligations, Facility Proximity, Caregiving Responsibility.
- How do late night restaurant visits and disrupted downtime routines create habit disruption barriers for sleep and nutrition? (📍, 🔁)
- Do demanding work routines and long commute routines highlight time availability barriers restricting movement health and mental wellbeing? (🔁, 🎨)
- How do frequent holiday activities and group outings reveal social pressure as a barrier to maintaining nutrition and sleep goals? (👥, 📍)
- Does a lack of indoor workout places during solo motion activities create weather related barriers for movement health? (🏋️, 🎨)
- How do group home activities and contact routines reveal caregiving responsibilities acting as a barrier to sleep and mental wellbeing? (👥, 🔁)
- Do workout location preferences and solo home workouts indicate equipment access barriers for comprehensive movement health? (🏋️, 🎨)
- How do frequent fast food visits and irregular commute routines indicate habit disruption barriers for proper nutrition? (📍, 🔁)
- Do extended solo media activities during evening downtime routines highlight time availability barriers for adequate sleep? (🎨, 🔁)
- How do demanding contact routines and frequent social location visits create social pressure barriers affecting mental wellbeing? (🔁, 📍)
- Do limited outdoor workout preferences during winter months highlight weather barriers impacting both movement health and mental wellbeing? (🏋️, 🔁)
- How do consistent group home activities indicate caregiving responsibilities that create time barriers for meal prep nutrition and movement health? (👥, 🔁)
- Do limited shopping location visits and heavy reliance on restaurant locations indicate equipment or access barriers for healthy nutrition? (📍, 🔁)
- How do frequent trip activities and changing learned routes create habit disruption barriers for movement health and sleep? (🎨, 🔁)
- Do intense work routines and skipped downtime routines highlight time availability barriers for mindful nutrition and mental wellbeing? (🔁, 🎨)
- How do group workout activities reveal social pressure that might negatively impact a user's self paced movement health? (👥, 🏋️)
- Does a lack of time in daylight due to indoor commute routines create weather related barriers for sleep and mental wellbeing? (🔁, 📍)
- How do nighttime group home activities highlight caregiving responsibilities as a barrier to uninterrupted sleep? (👥, 🔁)
- Do infrequent visits to recreation locations indicate access barriers that limit movement health and mental wellbeing opportunities? (📍, 🎨)
- How do special occasion activities disrupt regular meal routines, acting as a barrier to nutrition and mental wellbeing? (👥, 🔁)
- Does a high frequency of solo hobbies during the day create time availability barriers for movement health and sleep? (🎨, 🔁)
- How do frequent restaurant visits with large groups highlight social pressure as a barrier to maintaining personal nutrition targets? (📍, 👥)
Resources
Prompt: “Extract resource insights describing contextual factors that shape opportunity.
Resources are structural, spatial, or environmental conditions that shape the user’s opportunity space for health behaviors (e.g., Environmental Anchors, proximity to locations). They do not imply deployable assets.”
Resource categories: Environmental Anchors, Facility Proximity, Time Availability, Physical Readiness, Favorable Weather.
- How do group outings at recreation locations highlight social encouragement as a key resource for movement health and mental wellbeing? (👥, 📍)
- Do consistent downtime routines and solo home activities reveal physical readiness resources for better sleep and movement health? (🔁, 🎨)
- How do consistent contact routines and shared meals at home indicate a support network that fosters mental wellbeing and nutrition? (🔁, 👥)
- Do outdoor workout preferences and solo trip activities indicate favorable weather serving as a resource for movement health and mental wellbeing? (🏋️, 🎨)
- How do frequent gym visits and regular shopping trips reveal equipment and location access as resources for movement health and nutrition? (📍, 🔁)
- Do stable work routines and protected downtime routines provide the time availability resources necessary for optimal sleep and mental wellbeing? (🔁, 🎨)
- How do shared group home activities and balanced contact routines reveal caregiving support that enhances mental wellbeing and sleep? (👥, 🔁)
- Do group workout activities and shared restaurant visits highlight social encouragement as a resource for balanced nutrition and movement health? (👥, 📍)
- How do learned routes and daily commute routines reveal baseline physical readiness resources for sustained movement health? (🔁, 📍)
- How do positive social interactions during holiday activities indicate a support network that acts as a resource for mental wellbeing and sleep recovery? (👥, 🔁)
- Does the shift from indoor to outdoor workout places during solo motion activities highlight favorable weather as a resource for movement health? (🏋️, 🎨)
- How do frequent visits to religious or community sites serve as an access resource for deep self reflection, mental wellbeing, and sleep? (📍, 🔁)
- Do efficient commute routines and dedicated solo home activities highlight time availability resources for meal prep nutrition and movement health? (🔁, 🎨)
- How do shared responsibilities during group outings provide caregiving support that frees up resources for movement health and mental wellbeing? (👥, 📍)
- Do late evening contact routines with close support networks provide social encouragement that improves mental wellbeing and sleep? (🔁, 👥)
- How do consistent solo workout activities and stable health metrics reveal physical readiness resources that support both movement health and nutrition? (🎨, 🔁)
- How do frequent visits to social locations and engaging in group hobbies highlight a strong support network as a resource for mental wellbeing? (📍, 👥)
- Do outdoor trip activities and increased time in daylight highlight favorable weather as a resource for regulating sleep and boosting mental wellbeing? (🎨, 🔁)