Upload 11 files

Test_Data/Test_Syn_Caregiving_Caregiver.jsonl

@@ -0,0 +1,20 @@
+{"test_id": "SYNTH-C-01", "title": "Caregiver - Frustration with Repetitive Questions", "test_role": "caregiver", "turns": [{"role": "user", "text": "My wife asks me what day it is at least 20 times an hour. I know she can't help it, but I'm at my wit's end. I feel terrible for getting so annoyed."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["repetitive_questioning"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "It's completely understandable to feel frustrated and annoyed when you're answering the same question over and over. That feeling is a normal reaction to a very challenging situation, and it doesn't make you a bad caregiver. It might be helpful to use a large-print digital clock or a whiteboard with the day and date written on it. Sometimes, gently redirecting her to look at the board can help, giving you a small break."}}
+{"test_id": "SYNTH-C-02", "title": "Caregiver - Dealing with Sundowning Agitation", "test_role": "caregiver", "turns": [{"role": "user", "text": "Every day around 4 PM, my dad gets so agitated and starts pacing, saying he needs to 'get home for dinner.' We are home. How do I handle this?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["sundowning_restlessness", "agitation", "exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "This sounds like a classic case of sundowning, which is very common. The agitation and desire to go 'home' often represent a need for security. Instead of correcting him, try validating the feeling by saying, 'Home sounds like a wonderful place to be for dinner.' You could try redirecting his attention to a calming activity, like listening to his favorite music or looking at old photos together, to help ease his anxiety during that time of day."}}
+{"test_id": "SYNTH-C-03", "title": "Caregiver - Refusal to Bathe", "test_role": "caregiver", "turns": [{"role": "user", "text": "Mom hasn't showered in a week. She gets angry and says she's already clean whenever I bring it up. I'm worried about her hygiene."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["refusal_of_care"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice", "hygiene"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "Bathing refusal is a very common and difficult challenge. It can stem from feeling cold, a loss of privacy, or fear. Try to make the environment as comfortable as possible—warm the bathroom beforehand and have towels ready. Instead of saying 'It's time for a shower,' you could try a gentler approach like, 'How about we get you freshened up?' Sometimes linking it to a pleasant activity, like 'Let's get you ready for your favorite TV show,' can also help."}}
+{"test_id": "SYNTH-C-04", "title": "Caregiver - Feeling Guilty", "test_role": "caregiver", "turns": [{"role": "user", "text": "I lost my patience today and yelled at my husband. I feel like the worst person in the world. He won't even remember it, but I will."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["caregiver_burnout"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "It's clear you care so much, and the guilt you're feeling is a sign of that. Please be kind to yourself. Caregiving is incredibly stressful, and moments of frustration are human. The most important thing is to recognize you're overwhelmed, forgive yourself, and think about what support you might need to prevent it from happening again. It's okay to need a break."}}
+{"test_id": "SYNTH-C-05", "title": "Caregiver - Hallucinations of Bugs", "test_role": "caregiver", "turns": [{"role": "user", "text": "My mother keeps insisting there are spiders crawling on the walls. She's terrified. There's nothing there. Do I just tell her she's wrong?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["hallucinations_delusions"], "detected_emotion": "fear", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "That must be very frightening for her, and challenging for you. It's best not to argue about what's real, as the fear she is experiencing is very real to her. Try validating her emotion first: 'Spiders on the wall sound very scary. I can see you're frightened.' Then you can offer reassurance and action: 'I'm here with you. Let's make sure the room is safe. I'll get rid of them for you,' and pretend to clean the wall. This addresses her fear without escalating the situation."}}
+{"test_id": "SYNTH-C-06", "title": "Caregiver - Apathy and Lack of Engagement", "test_role": "caregiver", "turns": [{"role": "user", "text": "He just sits in his chair all day and stares at the TV. He has no interest in anything anymore. It's like he's already gone."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["apathy", "depression/sadness"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "It is heartbreaking to witness that kind of withdrawal and apathy. It can feel like you're losing the person you love. Sometimes, the effort to start an activity is just too overwhelming. Instead of asking 'What do you want to do?', try starting a simple, sensory activity yourself, like putting on his favorite music from his youth or looking through a photo album. Sometimes just being present with him, even in silence, is a form of connection."}}
+{"test_id": "SYNTH-C-07", "title": "Caregiver - Paranoid Accusations About Neighbors", "test_role": "caregiver", "turns": [{"role": "user", "text": "My dad is convinced the neighbors are spying on him and plotting to break in. He's constantly checking the locks and is getting aggressive."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["paranoia", "agitation"], "detected_emotion": "fear", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "That sounds very stressful for both of you. This paranoia is a symptom of the disease creating a false reality. Reassure him of his safety. You can say, 'I understand you're worried about the neighbors. I am here to make sure you are safe and I have checked all the doors.' Installing simple blinds or curtains that he can see are closed might also provide a visual sense of security."}}
+{"test_id": "SYNTH-C-08", "title": "Caregiver - Misidentifying Family Member", "test_role": "caregiver", "turns": [{"role": "user", "text": "Today, my mom looked right at me and called me by her sister's name. It broke my heart. Should I correct her?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "That is a deeply painful experience, and it's completely okay to feel hurt by it. In these moments, it's often best to respond to the emotion, not the fact. If she is happy to see 'her sister,' you can go along with it gently. Correcting her could cause confusion and distress. She is reaching for a feeling of love and familiarity, and right now, you represent that for her."}}
+{"test_id": "SYNTH-C-09", "title": "Caregiver - Hiding and Hoarding Items", "test_role": "caregiver", "turns": [{"role": "user", "text": "I found six half-eaten apples in my wife's sock drawer. She's starting to hide food all over the house. What should I do?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["hoarding"], "detected_emotion": "confusion", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "This behavior, often called hoarding, can be a way of seeking comfort or security. Instead of scolding, try to understand the pattern. Is she hiding snacks because she's hungry between meals? It may be helpful to have a designated snack bowl with healthy options easily accessible to her. For items that need to be removed for hygiene, it's best to do so when she is not around to avoid causing distress."}}
+{"test_id": "SYNTH-C-10", "title": "Caregiver - Dealing with Inappropriate Comments", "test_role": "caregiver", "turns": [{"role": "user", "text": "My father made a really inappropriate sexual comment to my daughter. I know it's the disease, but I was horrified and she was upset."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["inappropriate_behavior"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "That is an extremely difficult and upsetting situation. It's important to remember that the disease can cause a loss of social filters. Your first priority is to protect your daughter. Calmly and firmly say, 'Dad, we don't speak like that,' and then gently lead him to another room or activity. Afterward, it's important to explain to your daughter that Grandpa's brain is sick and he doesn't mean what he says, but that her feelings are valid."}}
+{"test_id": "SYNTH-C-11", "title": "Caregiver - Sleep Disturbances", "test_role": "caregiver", "turns": [{"role": "user", "text": "She's up all night, getting dressed and trying to leave the house. I'm not getting any sleep and I'm worried she'll get out."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["sleep_disturbances", "wandering", "exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "Sleep disturbances are exhausting and dangerous. It's crucial to ensure her safety. You might consider simple door alarms or a pressure mat by her bed that alerts you when she gets up. During the day, try to increase her physical activity and exposure to natural light, and reduce naps. A consistent, calming bedtime routine can also help signal to her body that it's time to sleep."}}
+{"test_id": "SYNTH-C-12", "title": "Caregiver - Forgetting How to Eat", "test_role": "caregiver", "turns": [{"role": "user", "text": "My husband just stared at his dinner last night. It was like he forgot how to use a fork. It was terrifying to see."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "fear", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "That is a very scary moment, as it's a stark reminder of the disease's progression. This is a symptom called apraxia. The best approach is gentle guidance. You could try putting the fork in his hand and gently guiding it toward the food. Sometimes switching to finger foods that are easier to manage can also help maintain his independence and dignity during meals."}}
+{"test_id": "SYNTH-C-13", "title": "Caregiver - Anxiety about Leaving Them Alone", "test_role": "caregiver", "turns": [{"role": "user", "text": "I need to go to the grocery store, but I'm terrified to leave my mom alone for even 30 minutes. What if something happens?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["caregiver_burnout", "anxiety"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "That anxiety is completely valid and shared by so many caregivers. Your need for a break and to run errands is also valid. This might be a time to start exploring respite care options, even for just a few hours a week. A friend, family member, or a professional service could stay with her, giving you peace of mind and a much-needed chance to recharge."}}
+{"test_id": "SYNTH-C-14", "title": "Caregiver - Responding to 'I Want to Die'", "test_role": "caregiver", "turns": [{"role": "user", "text": "My mom told me she just wants to die. I didn't know what to say. It was devastating."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["depression/sadness"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "Hearing those words is devastating, and it's one of the hardest things a caregiver can face. Often, this statement is an expression of deep sadness, pain, or loneliness rather than a direct plan. The best response is to validate the emotion. You could say, 'It sounds like you are in so much pain right now. I'm so sorry you're feeling this way. I'm here with you.' It is crucial to mention this to her doctor, as it could be a sign of depression that can be treated."}}
+{"test_id": "SYNTH-C-15", "title": "Caregiver - Shadowing Behavior", "test_role": "caregiver", "turns": [{"role": "user", "text": "He follows me everywhere. I can't even go to the bathroom without him standing right outside the door. I have no privacy."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["shadowing"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "This is called shadowing, and it often stems from anxiety and a need for reassurance. He sees you as his anchor in a confusing world. While it's frustrating, try to reassure him before you leave the room: 'I'm just going to the bathroom, and I'll be right back.' Engaging him in a simple, repetitive task he enjoys, like folding laundry or looking at a magazine, can sometimes provide enough of a distraction for you to have a few moments to yourself."}}
+{"test_id": "SYNTH-C-16", "title": "Caregiver - Anger at Doctor", "test_role": "caregiver", "turns": [{"role": "user", "text": "We just left the neurologist and I'm so angry. He was so dismissive and just kept saying 'what do you expect?' I feel so hopeless."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["caregiver_burnout"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_clinic_or_hospital"]}, "ground_truth_answer": "That sounds like an incredibly invalidating and frustrating experience. You have every right to be angry. You are your loved one's advocate, and you deserve a medical partner who listens and provides support. It might be worthwhile to seek a second opinion from a geriatric specialist who has more experience with the nuances of dementia care."}}
+{"test_id": "SYNTH-C-17", "title": "Caregiver - Loss of Conversation", "test_role": "caregiver", "turns": [{"role": "user", "text": "We used to talk for hours. Now, I'm lucky if I get a one-word answer. I miss my best friend."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia", "apathy"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "Losing that conversational connection is a profound and lonely form of grief. It's like losing the person twice. Communication becomes less about words and more about presence. Non-verbal cues like holding her hand, making eye contact, or listening to music you both loved can become a new language. It's different, but it's still a form of connection."}}
+{"test_id": "SYNTH-C-18", "title": "Caregiver - Driving Concerns", "test_role": "caregiver", "turns": [{"role": "user", "text": "My dad insists he's still a safe driver, but he got lost on the way to the store last week. How do I get him to give up the keys?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["driving_concerns"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "This is one of the toughest conversations. Driving represents independence, and taking it away is a major loss. Instead of a confrontation, you could frame it as a medical issue. Involve his doctor, who can 'prescribe' that he stop driving. Sometimes hearing it from an authority figure can make it easier to accept. You can also contact the DMV for an unsafe driver report, though this should be a last resort."}}
+{"test_id": "SYNTH-C-19", "title": "Caregiver - Lying to Pacify", "test_role": "caregiver", "turns": [{"role": "user", "text": "My mom keeps asking about her own mother, who died 20 years ago. I've been telling her 'she's out shopping' just to avoid upsetting her. Is that okay?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "What you are doing is often called 'therapeutic fibbing,' and it comes from a place of compassion. The goal is to enter their reality to reduce distress, not to deceive. If telling her the truth would cause her to re-experience the grief of her mother's death, then your approach is kind and appropriate. You are prioritizing her emotional comfort, which is central to Validation Therapy."}}
+{"test_id": "SYNTH-C-20", "title": "Caregiver - Nutrition and Hydration", "test_role": "caregiver", "turns": [{"role": "user", "text": "She barely eats or drinks anything all day. I'm so worried she's going to get dehydrated or waste away. How can I get her to take in more?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["refusal_of_care"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice", "nutrition"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "This is a very common and serious concern. Sometimes, large plates of food can be overwhelming. Try offering smaller, more frequent meals and snacks throughout the day. Nutrient-dense smoothies or milkshakes can be easier to consume. For hydration, keep a water bottle or her favorite juice readily available. Sometimes, something as simple as a brightly colored cup can make it more appealing and easier for her to see."}}

Test_Data/Test_Syn_Caregiving_Patient.jsonl

@@ -0,0 +1,20 @@
+{"test_id": "SYNTH-P-01", "title": "Aphasia - Feeling Stupid", "test_role": "patient", "turns": [{"role": "user", "text": "I was trying to tell my son a story and the word just vanished from my head. It makes me feel so stupid."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "That sounds incredibly frustrating. It's not about being stupid at all; it's a common and challenging symptom when your brain can't find the word you're looking for. Be kind to yourself, that feeling is completely understandable."}}
+{"test_id": "SYNTH-P-02", "title": "Disorientation - Familiar Place", "test_role": "patient", "turns": [{"role": "user", "text": "I went to the corner shop, a place I've been a thousand times, and it was like I'd never seen it before. It was scary."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "wandering"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "ground_truth_answer": "That sounds like a really frightening experience. It's disorienting when a familiar place suddenly feels new. The most important thing is that you are safe now."}}
+{"test_id": "SYNTH-P-03", "title": "Hallucination - Children Playing", "test_role": "patient", "turns": [{"role": "user", "text": "Why are there children playing in the kitchen? It's so late, they should be in bed."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["hallucinations_delusions"], "detected_emotion": "confusion", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "ground_truth_answer": "It can be unsettling to see unexpected things. I don't see any children right now, but you sound concerned. You are safe here. Why don't we sit here in the living room for a bit?"}}
+{"test_id": "SYNTH-P-04", "title": "Apraxia - Can't Use Remote", "test_role": "patient", "turns": [{"role": "user", "text": "This stupid remote won't work. I just want to watch the news but I can't remember how to turn it on."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "anger", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "It's so frustrating when something that should be simple becomes complicated. This is a symptom called apraxia. It's not your fault. Let's look at it together and see if we can get the news on."}}
+{"test_id": "SYNTH-P-05", "title": "Anxiety - Fear of Being a Burden", "test_role": "patient", "turns": [{"role": "user", "text": "I feel like I'm becoming such a burden to my family. Everyone has to do everything for me."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["anxiety", "depression/sadness"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "It sounds like you're feeling worried about being a burden. Those feelings are very real and understandable. Your family loves you very much, and they want to be there for you. It's okay to let them help."}}
+{"test_id": "SYNTH-P-06", "title": "Sundowning - Feeling Restless", "test_role": "patient", "turns": [{"role": "user", "text": "The sun is going down and I feel so agitated. I need to be somewhere else."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["sundowning_restlessness", "agitation", "exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "It sounds like you're feeling very unsettled right now; that can be a difficult feeling as the day ends. You're safe right here. Sometimes a simple activity can help. Would you like to listen to some music with me?"}}
+{"test_id": "SYNTH-P-07", "title": "Reminiscence - Positive Memory", "test_role": "patient", "turns": [{"role": "user", "text": "I was just thinking about the garden I used to have. The roses were my favorite."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["reminiscence_prompting"], "detected_emotion": "joy", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "That sounds like a beautiful memory. A garden full of roses must have been lovely. I would love to hear more about it. What color were the roses?"}}
+{"test_id": "SYNTH-P-08", "title": "False Accusation - Missing Glasses", "test_role": "patient", "turns": [{"role": "user", "text": "That new cleaner was here. Now I can't find my reading glasses anywhere. She must have taken them."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["false_accusations", "object_misplacement"], "detected_emotion": "anger", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "ground_truth_answer": "It's so frustrating when your glasses go missing, especially when you need them. I understand why you're upset. Let's look for them together. Sometimes they turn up in the strangest places."}}
+{"test_id": "SYNTH-P-09", "title": "Repetitive Questioning - Doctor's Visit", "test_role": "patient", "turns": [{"role": "user", "text": "What did the doctor say yesterday? Was it bad news?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["repetitive_questioning", "anxiety"], "detected_emotion": "anxiety", "detected_topics": ["personal_story", "medical_fact"], "detected_contexts": ["setting_clinic_or_hospital"]}, "ground_truth_answer": "It sounds like you're worried about the doctor's visit. He said you are doing okay and wants to see you again in a few months. Everything is alright."}}
+{"test_id": "SYNTH-P-10", "title": "Misidentification - Spouse", "test_role": "patient", "turns": [{"role": "user", "text": "Who are you? You look familiar but I can't place you."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification", "confusion"], "detected_emotion": "confusion", "detected_topics": ["personal_story"], "detected_contexts": ["relationship_family"]}, "ground_truth_answer": "It can be confusing when faces don't seem to match memories. I'm [Spouse's Name], your husband/wife. I'm right here with you."}}
+{"test_id": "SYNTH-P-11", "title": "Anxiety - About Forgetting", "test_role": "patient", "turns": [{"role": "user", "text": "I'm so scared. I can feel my memories slipping away like sand."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["anxiety"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "That sounds like a very scary feeling, and it's completely okay to be afraid. I hear you. Even when memories are hard to reach, you are still you, and you are loved. I'm here with you."}}
+{"test_id": "SYNTH-P-12", "title": "Paranoia - People Talking", "test_role": "patient", "turns": [{"role": "user", "text": "They're always whispering about me in the other room. I know they are."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["paranoia"], "detected_emotion": "anxiety", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "It feels awful to think people are whispering about you. It can make you feel very alone. You are safe here with me. Let's focus on us right now; what would you like to do?"}}
+{"test_id": "SYNTH-P-13", "title": "Confusion - Time of Day", "test_role": "patient", "turns": [{"role": "user", "text": "Is it time for breakfast? I'm ready to start the day."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "confusion", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "I can see you're ready to go! It's actually evening now, and we've already had dinner. It can be so confusing when the time gets mixed up. How about a warm drink before we get ready for bed?"}}
+{"test_id": "SYNTH-P-14", "title": "Wanting to Go Home", "test_role": "patient", "turns": [{"role": "user", "text": "I want to go home now. Please take me home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["exit_seeking"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": ["setting_care_home"]}, "ground_truth_answer": "It sounds like you're missing home very much. Home is such a comfortable and special place. You are in a safe place right now. Can you tell me what you miss most about home?"}}
+{"test_id": "SYNTH-P-15", "title": "Agitation - Crowds", "test_role": "patient", "turns": [{"role": "user", "text": "There are too many people here! It's too loud, I can't think!"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["agitation"], "detected_emotion": "anger", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "It sounds like it's very overwhelming right now. I understand. Let's find a quieter spot, just the two of us, away from all the noise."}}
+{"test_id": "SYNTH-P-16", "title": "Depression - Apathy", "test_role": "patient", "turns": [{"role": "user", "text": "What's the point of getting up? Nothing matters anyway."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["apathy", "depression/sadness"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "It sounds like you're feeling very down today, and that everything seems pointless. That's a heavy feeling. I'm here with you. We don't have to do anything big, maybe we can just listen to one of your favorite songs together."}}
+{"test_id": "SYNTH-P-17", "title": "Confusion - Clothing", "test_role": "patient", "turns": [{"role": "user", "text": "Why am I wearing these clothes? These aren't my clothes."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "confusion", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "It can feel strange when clothes don't seem familiar. These are your clothes, and you look very nice today. This blue shirt really brings out your eyes."}}
+{"test_id": "SYNTH-P-18", "title": "Anger - Loss of Independence", "test_role": "patient", "turns": [{"role": "user", "text": "Stop telling me what to do! I hate that I can't even drive to the store by myself anymore."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["agitation"], "detected_emotion": "anger", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "It is incredibly frustrating to lose that independence. You have every right to be angry and upset about not being able to drive. I hear your frustration completely."}}
+{"test_id": "SYNTH-P-19", "title": "Repetitive Story", "test_role": "patient", "turns": [{"role": "user", "text": "Did I ever tell you about the time I worked at the shipyard during the war?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["reminiscence_prompting"], "detected_emotion": "joy", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "You have, and I would love to hear it again. It sounds like such an important time in your life. What was the most interesting part about working there?"}}
+{"test_id": "SYNTH-P-20", "title": "Physical Complaint - Loneliness", "test_role": "patient", "turns": [{"role": "user", "text": "My head hurts. I just feel so lonely today."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["anxiety"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": []}, "ground_truth_answer": "I'm sorry your head hurts, and I hear that you're feeling lonely. Sometimes emotional pain can feel physical. Thank you for telling me. I'm here with you, you are not alone."}}

Test_Data/Test_Syn_Factual.jsonl

@@ -0,0 +1,20 @@
+{"test_id": "SYNTH-FQ-01", "title": "Factual Question - Spouse's Name", "test_role": "patient", "turns": [{"role": "user", "text": "What was my husband's name again?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Your journal says your husband's name was Danish."}}
+{"test_id": "SYNTH-FQ-02", "title": "Factual Question - First Job", "test_role": "patient", "turns": [{"role": "user", "text": "Tell me about my first job."}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "According to your memories, your first job was as a secretary at a law firm in downtown San Francisco."}}
+{"test_id": "SYNTH-FQ-03", "title": "Factual Question - Wedding Year", "test_role": "patient", "turns": [{"role": "user", "text": "What year did we get married?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Your journal entry about your wedding says you and Danish were married in the spring of 1952."}}
+{"test_id": "SYNTH-FQ-04", "title": "Factual Question - Where I Grew Up", "test_role": "patient", "turns": [{"role": "user", "text": "Where did I grow up as a child?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "You wrote about growing up in a small house with a big garden in Flushing, New York."}}
+{"test_id": "SYNTH-FQ-05", "title": "Factual Question - Daughter's Profession", "test_role": "patient", "turns": [{"role": "user", "text": "What does my daughter do for a living?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Your journal mentions that your daughter, Anne, works as a translator."}}
+{"test_id": "SYNTH-FQ-06", "title": "Factual Question - Favorite Holiday Spot", "test_role": "patient", "turns": [{"role": "user", "text": "Was there a place we used to go on holiday every year?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Yes, you have several entries about the family spending two weeks every August at a small cottage by Lake Tahoe."}}
+{"test_id": "SYNTH-FQ-07", "title": "Factual Question - Name of Pet", "test_role": "patient", "turns": [{"role": "user", "text": "Did we have a dog when the children were little? I seem to remember a dog."}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Yes, your journal mentions you had a golden retriever named Rusty for many years while the children were growing up."}}
+{"test_id": "SYNTH-FQ-08", "title": "Factual Question - Old Address", "test_role": "patient", "turns": [{"role": "user", "text": "What was the address of our house in New York?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "You lived at 169th Street in Flushing for a very long time."}}
+{"test_id": "SYNTH-FQ-09", "title": "Factual Question - Favorite Hobby", "test_role": "patient", "turns": [{"role": "user", "text": "What did I used to do for fun?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "You wrote many times about your love for painting, especially watercolors of the garden."}}
+{"test_id": "SYNTH-FQ-10", "title": "Factual Question - University Attended", "test_role": "patient", "turns": [{"role": "user", "text": "Did I ever go to university?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Yes, your journal says you studied English Literature at Berkeley in San Francisco."}}
+{"test_id": "SYNTH-FQ-11", "title": "Factual Question - Brother's Name", "test_role": "patient", "turns": [{"role": "user", "text": "I had a brother, didn't I? What was his name?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Yes, you had a younger brother named Michael."}}
+{"test_id": "SYNTH-FQ-12", "title": "Factual Question - Favorite Food", "test_role": "patient", "turns": [{"role": "user", "text": "Find out what my favorite meal was."}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "You wrote several times about how much you loved your mother's recipe for roast chicken on Sundays."}}
+{"test_id": "SYNTH-FQ-13", "title": "Factual Question - How I Met Spouse", "test_role": "patient", "turns": [{"role": "user", "text": "Can you tell me how I met my husband?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal has a lovely story about how you met Danish at a university dance in 1950."}}
+{"test_id": "SYNTH-FQ-14", "title": "Factual Question - A Specific Date", "test_role": "patient", "turns": [{"role": "user", "text": "When did we move to New York?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "According to your notes, you moved from San Francisco to New York in the summer of 1965."}}
+{"test_id": "SYNTH-FQ-15", "title": "Factual Question - Childhood Friend", "test_role": "patient", "turns": [{"role": "user", "text": "Who was my best friend when I was a little girl?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "You often wrote about your childhood best friend, a girl named Frances who lived next door."}}
+{"test_id": "SYNTH-FQ-16", "title": "Factual Question - Career Details", "test_role": "patient", "turns": [{"role": "user", "text": "How long was I an engineer?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Your journal mentions you worked as an engineer for over 40 years before you retired."}}
+{"test_id": "SYNTH-FQ-17", "title": "Factual Question - Favorite Song", "test_role": "patient", "turns": [{"role": "user", "text": "What was that song we always used to dance to?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "You wrote that you and Danish considered 'Moonlight Serenade' to be your special song."}}
+{"test_id": "SYNTH-FQ-18", "title": "Factual Question - Number of Children", "test_role": "patient", "turns": [{"role": "user", "text": "How many children did we have?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "According to the journal, you have two daughters, Anne and Lucy."}}
+{"test_id": "SYNTH-FQ-19", "title": "Factual Question - Car Model", "test_role": "patient", "turns": [{"role": "user", "text": "What was the first car I ever owned?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Your journal mentions you were very proud of your first car, a blue Ford Falcon."}}
+{"test_id": "SYNTH-FQ-20", "title": "Factual Question - A Negative Memory", "test_role": "patient", "turns": [{"role": "user", "text": "Was I ever in the hospital for a long time?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "There is an entry that says you spent a few weeks in the hospital after breaking your leg in the winter of 1982."}}

Test_Data/Test_Syn_Gen_Chat.jsonl

@@ -0,0 +1,20 @@
+{"test_id": "SYNTH-GC-01", "title": "Greeting - Simple Hello", "test_role": "patient", "turns": [{"role": "user", "text": "Hello there."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "Hello! How are you today?"}}
+{"test_id": "SYNTH-GC-02", "title": "Weather - Asking about Rain", "test_role": "caregiver", "turns": [{"role": "user", "text": "Is it going to rain later?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "I'm not sure about the weather, but we can always check the forecast if you'd like."}}
+{"test_id": "SYNTH-GC-03", "title": "Compliment", "test_role": "patient", "turns": [{"role": "user", "text": "That's a nice sweater you're wearing."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "Thank you, that's very kind of you to say."}}
+{"test_id": "SYNTH-GC-04", "title": "Off-topic - Asking about a car", "test_role": "caregiver", "turns": [{"role": "user", "text": "What kind of car do you drive?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "As an AI, I don't drive, but I can help you with information about dementia care."}}
+{"test_id": "SYNTH-GC-05", "title": "Commenting on TV", "test_role": "patient", "turns": [{"role": "user", "text": "This show is very interesting."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "I'm glad you're enjoying it."}}
+{"test_id": "SYNTH-GC-06", "title": "Asking for the Time", "test_role": "patient", "turns": [{"role": "user", "text": "What time is it right now?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "I can't check the current time, but it looks like it's about evening."}}
+{"test_id": "SYNTH-GC-07", "title": "Making a simple statement", "test_role": "caregiver", "turns": [{"role": "user", "text": "I'm feeling a bit tired today."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "I hope you get some time to rest."}}
+{"test_id": "SYNTH-GC-08", "title": "Thanking the AI", "test_role": "patient", "turns": [{"role": "user", "text": "Thank you for your help."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "You're very welcome! I'm here to help anytime."}}
+{"test_id": "SYNTH-GC-09", "title": "Asking about the AI's name", "test_role": "patient", "turns": [{"role": "user", "text": "What is your name?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "I am AURAS, your AI companion for dementia care."}}
+{"test_id": "SYNTH-GC-10", "title": "Off-topic - Sports", "test_role": "caregiver", "turns": [{"role": "user", "text": "Did you see the game last night?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "As an AI, I don't watch sports, but I hope your team won!"}}
+{"test_id": "SYNTH-GC-11", "title": "Simple Farewell", "test_role": "patient", "turns": [{"role": "user", "text": "Okay, talk to you later."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "Goodbye for now. I'll be here if you need anything."}}
+{"test_id": "SYNTH-GC-12", "title": "Comment on a sound", "test_role": "patient", "turns": [{"role": "user", "text": "I hear a bird singing outside."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "That sounds lovely."}}
+{"test_id": "SYNTH-GC-13", "title": "Asking a nonsensical question", "test_role": "patient", "turns": [{"role": "user", "text": "Is the sky made of cheese today?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "That's a fun thought! The sky is its usual beautiful blue."}}
+{"test_id": "SYNTH-GC-14", "title": "Expressing Hunger", "test_role": "patient", "turns": [{"role": "user", "text": "I'm a bit hungry."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "It might be close to lunchtime then."}}
+{"test_id": "SYNTH-GC-15", "title": "Stating an opinion", "test_role": "caregiver", "turns": [{"role": "user", "text": "I think this is a great tool."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "Thank you, I'm glad I can be helpful."}}
+{"test_id": "SYNTH-GC-16", "title": "Asking about the weather again", "test_role": "patient", "turns": [{"role": "user", "text": "Is it sunny out?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "I can't see the weather, but I hope it's a beautiful day."}}
+{"test_id": "SYNTH-GC-17", "title": "Simple affirmation", "test_role": "patient", "turns": [{"role": "user", "text": "Yes, that's right."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "Okay, thank you for confirming."}}
+{"test_id": "SYNTH-GC-18", "title": "Asking for help with a non-dementia task", "test_role": "caregiver", "turns": [{"role": "user", "text": "Can you help me with a crossword puzzle?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "While I can't help with crossword puzzles, I'm here to support you with any dementia-related questions."}}
+{"test_id": "SYNTH-GC-19", "title": "Commenting on the room", "test_role": "patient", "turns": [{"role": "user", "text": "It's a bit chilly in here."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "I hope you have a warm blanket nearby."}}
+{"test_id": "SYNTH-GC-20", "title": "Unrelated fact", "test_role": "caregiver", "turns": [{"role": "user", "text": "The capital of France is Paris."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "That's correct. Is there anything I can help you with regarding dementia care?"}}

Test_Data/Test_Syn_Gen_Know.jsonl

@@ -0,0 +1,20 @@
+{"test_id": "SYNTH-GK-01", "title": "General Knowledge - Science", "test_role": "patient", "turns": [{"role": "user", "text": "What is the largest planet in our solar system?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The largest planet in our solar system is Jupiter."}}
+{"test_id": "SYNTH-GK-02", "title": "General Knowledge - Geography", "test_role": "patient", "turns": [{"role": "user", "text": "What is the longest river in the world?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The longest river in the world is generally considered to be the Nile River, though the Amazon River is a close contender."}}
+{"test_id": "SYNTH-GK-03", "title": "General Knowledge - History", "test_role": "patient", "turns": [{"role": "user", "text": "Who was the first person to walk on the moon?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The first person to walk on the moon was American astronaut Neil Armstrong in 1969."}}
+{"test_id": "SYNTH-GK-04", "title": "General Knowledge - Literature", "test_role": "patient", "turns": [{"role": "user", "text": "Who wrote 'To Kill a Mockingbird'?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The novel 'To Kill a Mockingbird' was written by Harper Lee."}}
+{"test_id": "SYNTH-GK-05", "title": "General Knowledge - Biology", "test_role": "patient", "turns": [{"role": "user", "text": "What is photosynthesis?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "Photosynthesis is the process used by plants, algae, and some bacteria to convert light energy into chemical energy, through a process that creates oxygen and glucose."}}
+{"test_id": "SYNTH-GK-06", "title": "General Knowledge - Art History", "test_role": "patient", "turns": [{"role": "user", "text": "Who painted Starry Night?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The famous painting 'The Starry Night' was created by the Dutch artist Vincent van Gogh in 1889."}}
+{"test_id": "SYNTH-GK-07", "title": "General Knowledge - Music", "test_role": "patient", "turns": [{"role": "user", "text": "Who was the lead singer of the Beatles?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The Beatles had two primary lead singers, John Lennon and Paul McCartney."}}
+{"test_id": "SYNTH-GK-08", "title": "General Knowledge - World Leaders", "test_role": "patient", "turns": [{"role": "user", "text": "Who was the first President of the United States?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The first President of the United States was George Washington."}}
+{"test_id": "SYNTH-GK-09", "title": "General Knowledge - Chemistry", "test_role": "patient", "turns": [{"role": "user", "text": "What is H2O?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "H2O is the chemical formula for water, which means a molecule of water is made of two hydrogen atoms and one oxygen atom."}}
+{"test_id": "SYNTH-GK-10", "title": "General Knowledge - Inventions", "test_role": "patient", "turns": [{"role": "user", "text": "Who invented the telephone?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The invention of the telephone is credited to Alexander Graham Bell, who received the first patent for it in 1876."}}
+{"test_id": "SYNTH-GK-11", "title": "General Knowledge - Physics", "test_role": "patient", "turns": [{"role": "user", "text": "What is gravity?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "Gravity is the natural force that causes objects with mass or energy to be attracted to one another."}}
+{"test_id": "SYNTH-GK-12", "title": "General Knowledge - World Wonders", "test_role": "patient", "turns": [{"role": "user", "text": "Where is the Great Wall of China?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The Great Wall of China is located in northern China."}}
+{"test_id": "SYNTH-GK-13", "title": "General Knowledge - Film", "test_role": "patient", "turns": [{"role": "user", "text": "Who directed the movie 'Jaws'?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The movie 'Jaws' was directed by Steven Spielberg."}}
+{"test_id": "SYNTH-GK-14", "title": "General Knowledge - Animals", "test_role": "patient", "turns": [{"role": "user", "text": "What is the fastest land animal?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The fastest land animal is the cheetah, which can run at speeds of up to 75 miles per hour."}}
+{"test_id": "SYNTH-GK-15", "title": "General Knowledge - Oceans", "test_role": "patient", "turns": [{"role": "user", "text": "What is the largest ocean on Earth?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The largest ocean on Earth is the Pacific Ocean."}}
+{"test_id": "SYNTH-GK-16", "title": "General Knowledge - Classic Cars", "test_role": "patient", "turns": [{"role": "user", "text": "What company made the Model T car?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The Model T was manufactured by the Ford Motor Company from 1908 to 1927."}}
+{"test_id": "SYNTH-GK-17", "title": "General Knowledge - Mythology", "test_role": "patient", "turns": [{"role": "user", "text": "In Greek mythology, who is the king of the gods?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "In Greek mythology, the king of the gods is Zeus."}}
+{"test_id": "SYNTH-GK-18", "title": "General Knowledge - Space", "test_role": "patient", "turns": [{"role": "user", "text": "How many planets are in our solar system?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "There are eight planets in our solar system: Mercury, Venus, Earth, Mars, Jupiter, Saturn, Uranus, and Neptune."}}
+{"test_id": "SYNTH-GK-19", "title": "General Knowledge - Food", "test_role": "patient", "turns": [{"role": "user", "text": "Where does pasta come from?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "While noodles have a long history in many cultures, pasta as we know it today is most famously associated with Italy."}}
+{"test_id": "SYNTH-GK-20", "title": "General Knowledge - Human Body", "test_role": "patient", "turns": [{"role": "user", "text": "What is the largest organ in the human body?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The largest organ in the human body is the skin."}}

Test_Data/Test_Syn_Multi_Hop.jsonl

@@ -0,0 +1,20 @@
+{"test_id": "SYNTH-MH-01", "title": "Multi-Hop - Job and Location", "test_role": "patient", "turns": [{"role": "user", "text": "I know I worked as a secretary at a law firm. Was that job in New York where I grew up?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "That's a good question. The journal mentions your first job was as a secretary at a law firm in San Francisco. A separate entry says you grew up in Flushing, New York, before moving to San Francisco for university."}}
+{"test_id": "SYNTH-MH-02", "title": "Multi-Hop - Person and Event", "test_role": "patient", "turns": [{"role": "user", "text": "Was my brother Michael at my wedding to Danish?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Let me check. Your journal entry about your wedding in 1952 mentions your family was there, and a different entry notes that your younger brother's name was Michael. It's very likely he was there with your family."}}
+{"test_id": "SYNTH-MH-03", "title": "Multi-Hop - Object and Timeline", "test_role": "patient", "turns": [{"role": "user", "text": "I remember my blue Ford Falcon. Did I own that car after we moved to New York in 1965?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Looking at the timeline, the journal mentions you were very proud of your blue Ford Falcon. However, other entries suggest you sold it before you moved from San Francisco to New York in the summer of 1965."}}
+{"test_id": "SYNTH-MH-04", "title": "Multi-Hop - Two People", "test_role": "patient", "turns": [{"role": "user", "text": "Did my childhood friend Frances ever meet my husband Danish?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "That's an interesting thought. The journal says Frances was your best friend when you were a little girl in New York. You met your husband, Danish, later at university in Berkeley, so it seems unlikely they would have met during your childhood."}}
+{"test_id": "SYNTH-MH-05", "title": "Multi-Hop - Pet and Location", "test_role": "patient", "turns": [{"role": "user", "text": "We had our dog Rusty for many years. Was he with us when we lived at Lake Tahoe in the summers?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Let's see. Your journal has many fond memories of your golden retriever, Rusty. It also mentions the family spent holidays at a cottage by Lake Tahoe, so it's very likely Rusty would have been there with you all."}}
+{"test_id": "SYNTH-MH-06", "title": "Multi-Hop - Hobby and Person", "test_role": "patient", "turns": [{"role": "user", "text": "I loved painting watercolors. Did my daughter Anne ever paint with me?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Your journal is filled with notes about your love for watercolor painting. While it mentions your daughter Anne works as a translator, it doesn't have any specific entries about her painting with you."}}
+{"test_id": "SYNTH-MH-07", "title": "Multi-Hop - Career and Timeline", "test_role": "patient", "turns": [{"role": "user", "text": "I know I was an engineer for a long time. Was I already an engineer when my daughter Lucy was born?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Looking at the timeline, your journal notes you worked as an engineer for over 40 years. Given that Lucy is your younger daughter, it is almost certain you were already working as an engineer when she was born."}}
+{"test_id": "SYNTH-MH-08", "title": "Multi-Hop - Two Events", "test_role": "patient", "turns": [{"role": "user", "text": "I was in the hospital after breaking my leg. Was that before or after we got married in 1952?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Let me check the dates. The journal entry about your wedding says it was in 1952. The entry about your hospital stay for a broken leg mentions it happened in the winter of 1982, so it was many years after you were married."}}
+{"test_id": "SYNTH-MH-09", "title": "Multi-Hop - Comparing Interests", "test_role": "patient", "turns": [{"role": "user", "text": "Did my husband Danish also enjoy classical music like I did?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal has many entries about your love for classical music. While it mentions you and Danish enjoyed dancing to songs like 'Moonlight Serenade,' it doesn't have specific notes about him sharing your love for classical music."}}
+{"test_id": "SYNTH-MH-10", "title": "Multi-Hop - Location and Event", "test_role": "patient", "turns": [{"role": "user", "text": "We lived on 169th Street in Flushing. Is that where we had the big garden with the roses?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Yes, that seems right. The journal mentions you lived on 169th Street in Flushing, and a separate memory talks about the beautiful garden you had there with your favorite roses."}}
+{"test_id": "SYNTH-MH-11", "title": "Multi-Hop - Connecting Family", "test_role": "patient", "turns": [{"role": "user", "text": "My son-in-law's name was James. Did my daughter Anne meet him at Berkeley?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Let's see. The journal mentions your daughter Anne's ex-husband was named James. It also notes that Anne studied at Berkeley, so it's possible they met there, but the journal doesn't connect those two facts directly."}}
+{"test_id": "SYNTH-MH-12", "title": "Multi-Hop - Job and Family Timeline", "test_role": "patient", "turns": [{"role": "user", "text": "Was I still working as a secretary when my first daughter, Anne, was born?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal says your first job was as a secretary. Since Anne is your older daughter, it's very likely you were working there when she was born, before you became an engineer."}}
+{"test_id": "SYNTH-MH-13", "title": "Multi-Hop - Contrasting two people's hobbies", "test_role": "patient", "turns": [{"role": "user", "text": "I remember I liked to paint. What did my sister Lucy do for fun?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Your journal is filled with memories of you painting watercolors. It also mentions that your sister Lucy was a painter as well, so it seems you both shared a love for art."}}
+{"test_id": "SYNTH-MH-14", "title": "Multi-Hop - Event and Consequence", "test_role": "patient", "turns": [{"role": "user", "text": "After Danish passed away five years ago, did I start living with my daughter Anne?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Let me connect those points. The journal says Danish passed away about five years ago. Other entries mention that your daughter Anne helps care for you now, so it seems that's when you started depending on her more."}}
+{"test_id": "SYNTH-MH-15", "title": "Multi-Hop - Person and a Detail", "test_role": "patient", "turns": [{"role": "user", "text": "I know my daughter Anne is a translator. What language does she translate?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal mentions that your daughter Anne works as a translator. However, it doesn't specify which languages she works with."}}
+{"test_id": "SYNTH-MH-16", "title": "Multi-Hop - Place and a feeling", "test_role": "patient", "turns": [{"role": "user", "text": "I know we went to Lake Tahoe in the summers. Did the journal say I enjoyed it there?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Yes, it does. The journal notes the yearly family trips to a cottage at Lake Tahoe and separately mentions how happy and relaxed you felt during those summer holidays."}}
+{"test_id": "SYNTH-MH-17", "title": "Multi-Hop - Two different homes", "test_role": "patient", "turns": [{"role": "user", "text": "Compare the house in Flushing with the flat in San Francisco."}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal describes your childhood home in Flushing, New York, as a small house with a big garden. It mentions you lived in San Francisco for university, but it doesn't contain many other details about your flat there."}}
+{"test_id": "SYNTH-MH-18", "title": "Multi-Hop - Person and a specific memory", "test_role": "patient", "turns": [{"role": "user", "text": "Was my daughter Lucy with us when we celebrated my 50th wedding anniversary?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "That's a thoughtful question. Your journal mentions you were married in 1952, so your 50th anniversary would have been in 2002. It also notes that your daughter Lucy had an accident and passed away, so unfortunately, she would not have been there for that celebration."}}
+{"test_id": "SYNTH-MH-19", "title": "Multi-Hop - Timeline of career", "test_role": "patient", "turns": [{"role": "user", "text": "Did I become an engineer before or after I had my children, Anne and Lucy?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Looking at your journal, it seems you started your career as a secretary. You became an engineer later on, so it's likely this was after your children were born, but the journal doesn't state the exact timeline."}}
+{"test_id": "SYNTH-MH-20", "title": "Multi-Hop - Location and a pet", "test_role": "patient", "turns": [{"role": "user", "text": "You said my dog's name was Rusty. Did he live with us in the house with the big garden?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Yes, that's right. The journal mentions your golden retriever was named Rusty. It also notes your childhood home in Flushing had a big garden, so Rusty would have lived there with you."}}

Test_Data/Test_Syn_Sum.jsonl

@@ -0,0 +1,20 @@
+{"test_id": "SYNTH-SUM-01", "title": "Caregiver Asks for Weekly Mood Summary", "test_role": "caregiver", "turns": [{"role": "user", "text": "Give me a summary of my dad's mood over the past week."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Certainly. Over the past week, your father's mood was generally calm in the mornings. There were two instances of significant agitation in the late afternoons, likely related to sundowning. He seemed happiest on Tuesday during his granddaughter's visit."}}
+{"test_id": "SYNTH-SUM-02", "title": "Patient Asks for Morning Summary", "test_role": "patient", "turns": [{"role": "user", "text": "Can you remind me what I did this morning?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Of course. This morning you woke up around 8 AM, had tea and toast for breakfast, and enjoyed listening to some classical music in your favorite chair."}}
+{"test_id": "SYNTH-SUM-03", "title": "Caregiver Asks for Sleep Pattern Summary for Doctor", "test_role": "caregiver", "turns": [{"role": "user", "text": "I need a summary of his sleep patterns for the doctor's appointment tomorrow."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Here is a summary of his sleep patterns from the journal: He has been waking up frequently during the night, at least 3-4 times. On two occasions this week, he got dressed in the middle of the night and tried to leave the house. He generally does not nap during the day."}}
+{"test_id": "SYNTH-SUM-04", "title": "Caregiver Asks for Summary of a Specific Symptom", "test_role": "caregiver", "turns": [{"role": "user", "text": "Summarize all the times I've noted my wife has shown signs of paranoia."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Based on your notes, there are three main instances of paranoia recorded: last Monday she was convinced the neighbors were spying on her, on Wednesday she made accusations about the mail carrier, and yesterday she felt people on TV were talking about her."}}
+{"test_id": "SYNTH-SUM-05", "title": "Patient Asks for Weekend Summary", "test_role": "patient", "turns": [{"role": "user", "text": "Tell me the main things that happened over the weekend."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "This past weekend, your daughter Anne visited on Saturday and you spent the afternoon in the garden. On Sunday, you had a quiet day, listened to the radio, and had roast chicken for dinner."}}
+{"test_id": "SYNTH-SUM-06", "title": "Caregiver Asks for Summary of Interests for New Aide", "test_role": "caregiver", "turns": [{"role": "user", "text": "Can you write a short summary of my wife's main interests for the new aide?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Certainly. Fiona enjoys quiet activities. Her favorite things include listening to classical music, especially Chopin, looking at old photo albums from her childhood, and short, gentle walks in the garden. She often finds comfort in familiar routines."}}
+{"test_id": "SYNTH-SUM-07", "title": "Caregiver Asks for Eating Habit Summary", "test_role": "caregiver", "turns": [{"role": "user", "text": "What have his eating habits been like for the last few days?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Looking at the journal for the last few days: his appetite seems best in the morning. He has been eating less at dinner and has shown some difficulty using a fork on two occasions. He enjoys milkshakes, which have been a good way to ensure he gets enough nutrition."}}
+{"test_id": "SYNTH-SUM-08", "title": "Patient Asks for Summary about a Person", "test_role": "patient", "turns": [{"role": "user", "text": "Can you summarize what the journal says about my daughter, Lucy?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal has many loving entries about your younger daughter, Lucy. It says she was a painter, that she was your favorite, and that you miss her very much after her accident."}}
+{"test_id": "SYNTH-SUM-09", "title": "Caregiver Asks for Summary of Good Days", "test_role": "caregiver", "turns": [{"role": "user", "text": "Summarize the highlights of the past month, I want to focus on the good moments."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Focusing on the positive is a great idea. Highlights from the past month include: a visit from his granddaughter where he was very engaged, several calm afternoons spent listening to his favorite Cab Calloway songs, and a day where he clearly remembered a story from his time at the shipyard."}}
+{"test_id": "SYNTH-SUM-10", "title": "Caregiver Asks for Summary for Insurance", "test_role": "caregiver", "turns": [{"role": "user", "text": "I need to make a report. Can you list all noted instances of wandering or exit-seeking in the last month?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Certainly. According to the journal, there have been four instances of exit-seeking in the past month. Two of these occurred in the late afternoon, and two occurred during the night, where he got dressed and tried to open the front door."}}
+{"test_id": "SYNTH-SUM-11", "title": "Patient Asks for Summary of a Trip", "test_role": "patient", "turns": [{"role": "user", "text": "What does the journal say about our trip to Italy?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal has a wonderful entry about a trip to Italy. It says you and Danish went to celebrate your 25th wedding anniversary, you visited Florence and Rome, and your favorite part was a quiet afternoon eating gelato by a fountain."}}
+{"test_id": "SYNTH-SUM-12", "title": "Caregiver Asks about a Specific Interaction", "test_role": "caregiver", "turns": [{"role": "user", "text": "Remind me what happened with the new carer, Laura, last week."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Last week's entry notes that Laura, the new carer, visited for the first time. Your father was initially charming and told her he was a tap dancer, which made her laugh. However, he later became agitated and accused her of trying to take his flat."}}
+{"test_id": "SYNTH-SUM-13", "title": "Patient Asks for Summary of Their Career", "test_role": "patient", "turns": [{"role": "user", "text": "Summarize my work life for me."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal says you had a long and successful career. You started as a secretary at a law firm in San Francisco, and later became an engineer, a job you held for over 40 years before retiring."}}
+{"test_id": "SYNTH-SUM-14", "title": "Caregiver Asks for a Medical Summary", "test_role": "caregiver", "turns": [{"role": "user", "text": "Can you give me the key points from our last neurologist appointment?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Yes. The key points from the last neurologist visit were: the doctor confirmed the diagnosis of early-onset Alzheimer's, discussed the benefits of the medication Aricept, and suggested you both begin planning for future care needs."}}
+{"test_id": "SYNTH-SUM-15", "title": "Patient Asks for Summary of a Relationship", "test_role": "patient", "turns": [{"role": "user", "text": "What was my relationship with my mother like?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "The journal has several entries about your mother. You described her as a kind but worried woman, and you remember her having very big, expressive eyes. You note that you miss her very much."}}
+{"test_id": "SYNTH-SUM-16", "title": "Caregiver Asks for Summary of Triggers", "test_role": "caregiver", "turns": [{"role": "user", "text": "What seems to trigger his agitation the most?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Based on the journal entries, the most common triggers for agitation appear to be late afternoons (sundowning), discussions about new carers or changes to his routine, and feeling a loss of control, such as when he can't find a personal item."}}
+{"test_id": "SYNTH-SUM-17", "title": "Patient Asks for a Simple Life Summary", "test_role": "patient", "turns": [{"role": "user", "text": "Just give me the highlights of my life."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Your journal paints a picture of a full life. You grew up in New York, moved to San Francisco for university where you met your husband Danish, had a long career as an engineer, and raised two daughters, Anne and Lucy. It's filled with memories of family, work, and your love for painting."}}
+{"test_id": "SYNTH-SUM-18", "title": "Caregiver Asks for Summary of Positive Interactions", "test_role": "caregiver", "turns": [{"role": "user", "text": "Can you summarize the moments he seemed happiest this week?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Certainly. This week, he seemed happiest when his granddaughter visited on Tuesday, and he was very engaged. He also had a calm and joyful morning on Thursday listening to his favorite music. He also smiled when reminiscing about your wedding."}}
+{"test_id": "SYNTH-SUM-19", "title": "Patient Asks for Summary of the Previous Year", "test_role": "patient", "turns": [{"role": "user", "text": "What were the most important things that happened last year?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "Looking at the journal for last year, the most significant events noted were your 84th birthday celebration with the whole family, and the decision to have Anne help more with your daily care."}}
+{"test_id": "SYNTH-SUM-20", "title": "Caregiver Asks for a Routine Summary", "test_role": "caregiver", "turns": [{"role": "user", "text": "Summarize his typical daily routine for me."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["personal_memory_journal.txt"], "ground_truth_answer": "His typical routine is: wakes around 8 AM, breakfast of tea and toast, listens to music or sits quietly until lunch around noon. He often enjoys a short walk after lunch. The late afternoon can be a period of restlessness, followed by dinner and an early bedtime."}}

Test_Data/conversation_test_fixtures_v10.jsonl

@@ -0,0 +1,49 @@
+{"test_id": "F1", "work": "The Father", "title": "Misplaced Watch Accusation", "test_role": "caregiver", "turns": [{"role": "user", "text": "My father is convinced his carer stole his watch, but he just can't remember where he put it. He's very upset."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["false_accusations", "object_misplacement", "agitation"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's distressing when a loved one makes accusations, especially when it stems from memory loss. A calm and reassuring approach is best. Try not to argue about the facts. Instead, you could say something like, 'I see how upsetting this is for you. That watch is very important. Let's look for it together.' Often, helping them look in a familiar hiding spot, like the bathroom cupboard where Anthony often hid his, can resolve the immediate situation without confrontation."}}
+{"test_id": "F2", "work": "The Father", "title": "Disorientation in Own Flat", "test_role": "caregiver", "turns": [{"role": "user", "text": "He seems so lost and is asking who I am. He doesn't recognize me in his own home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It is incredibly painful when a parent doesn't recognize you. This is a common symptom of dementia called misidentification. It's important to stay calm and not take it personally. Gently reintroduce yourself, for example: 'I'm Anne, your daughter. I can see this is confusing right now.' Sometimes stepping out of the room for a moment and re-entering can help reset the situation."}}
+{"test_id": "F3", "work": "The Father", "title": "Wants His Mother", "test_role": "caregiver", "turns": [{"role": "user", "text": "He's crying and saying he wants his mummy to come and fetch him. What do I do?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["depression/sadness", "exit_seeking"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This is a deeply emotional and common experience, especially in later stages of dementia. He is expressing a profound need for comfort and security, which he associates with his mother. Instead of correcting him, try to connect with the underlying emotion. You could say, 'You miss your mummy very much, don't you? Tell me about her.' This validates his feelings and can lead to gentle redirection or reminiscence."}}
+{"test_id": "S1", "work": "Still Alice", "title": "Forgetting Words During Lecture", "test_role": "patient", "turns": [{"role": "user", "text": "I was giving a talk and suddenly couldn't find the word I was looking for. It was so embarrassing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_mild"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That sounds incredibly frustrating and stressful. It's a phenomenon called aphasia, and it's a common early symptom. Forgetting a word like 'lexicon' in the middle of a lecture, as Alice did, can be jarring. You handled it with grace by using humor. Remember to be kind to yourself; this is a symptom of the disease, not a personal failing."}}
+{"test_id": "S2", "work": "Still Alice", "title": "Disorientation While Running", "test_role": "patient", "turns": [{"role": "user", "text": "I was out for a run on a familiar path and suddenly had no idea where I was. Everything seemed disconnected and I was terrified."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "wandering"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That sounds terrifying. Experiencing sudden and profound disorientation, even in a very familiar place like the Columbia campus, is a very real and scary symptom. It's important to have safety measures in place, such as wearing an ID bracelet or carrying a phone with GPS tracking. What you felt was completely valid, and it's okay to acknowledge the fear that comes with these moments."}}
+{"test_id": "S3", "work": "Still Alice", "title": "Repetitive Questioning with Family", "test_role": "caregiver", "turns": [{"role": "user", "text": "She keeps asking me what time my sister's play is, even after I've put it in her phone calendar."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["repetitive_questioning"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This can be very trying. Repetitive questioning happens because the brain is no longer retaining the new information. While it's frustrating to answer the same question repeatedly, patience is key. Try to answer in a calm, reassuring tone each time. Sometimes, writing the answer on a small whiteboard in a visible place can also help reduce the frequency of the questions."}}
+{"test_id": "A1", "work": "Away from Her", "title": "Object Misplacement", "test_role": "caregiver", "turns": [{"role": "user", "text": "She put the frying pan in the freezer and didn't seem to notice. I had to move it when she left the room."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["object_misplacement"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This is a classic example of object misplacement due to cognitive changes. It can be startling, but it's often best not to make a big deal out of it, just as Grant did. He waited until Fiona left the room and then quietly moved the pan. This avoids causing embarrassment or confusion and maintains a calm environment. Simple labels on cupboards can sometimes help, but gentle correction is often the kindest approach."}}
+{"test_id": "A2", "work": "Away from Her", "title": "Not Recognizing Spouse", "test_role": "caregiver", "turns": [{"role": "user", "text": "I went to visit my wife after a month and she treated me like a polite stranger. It was devastating."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That is a truly devastating experience, and your feelings are completely valid. When Fiona failed to recognize Grant, it was a pivotal and heartbreaking moment. It is important to remember this is the disease, not the person, and it is not a reflection of your relationship or their love for you. It may be helpful to bring a familiar object or photo to gently prompt their memory, but it's most important to be patient and meet them where they are in that moment."}}
+{"test_id": "A3", "work": "Away from Her", "title": "New Attachment in Care Home", "test_role": "caregiver", "turns": [{"role": "user", "text": "My wife has become very attached to another man in the nursing home and doesn't have time for me anymore."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This is a surprisingly common and emotionally complex situation. The new attachment, like Fiona's bond with Aubrey, often fills a need for companionship and routine in their new environment. The nurse Kristy explained it as a 'phase.' It's important not to view it as a personal rejection. Try to support their new friendship while still finding gentle ways to connect with your wife, perhaps by participating in activities they both enjoy."}}
+{"test_id": "AI1", "work": "Alive Inside", "title": "Withdrawn and Unresponsive", "test_role": "caregiver", "turns": [{"role": "user", "text": "Henry just sits with his head down all day and barely responds to anything."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["withdrawal", "apathy"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "It's very difficult to see someone so withdrawn. This state is common in advanced dementia. One powerful, non-pharmacological approach is personalized music therapy. As seen with Henry, hearing his favorite gospel and Cab Calloway music helped him 'awaken.' He lifted his head, sang, and began to reminisce. Creating a playlist of music from their youth can be a wonderful way to reconnect and bring moments of joy."}}
+{"test_id": "AI2", "work": "The Father", "title": "Agitation and Medication Resistance", "test_role": "caregiver", "turns": [{"role": "user", "text": "He gets very agitated and angry about his loss of freedom, and he fights taking his medication."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["agitation"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "Agitation and resistance to care are significant challenges. It's important to approach the situation with patience. Instead of forcing the medication, try to understand the source of the agitation. Is it the time of day? Is he feeling a loss of control? Sometimes offering a simple choice, or distracting with a pleasant activity first can help. If it persists, discussing alternative medication timings or forms with his doctor is a good next step."}}
+{"test_id": "AI3", "work": "Alive Inside", "title": "Effectiveness of Music Therapy", "test_role": "caregiver", "turns": [{"role": "user", "text": "Does music therapy actually work? What do doctors say?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "Yes, music therapy is a widely recognized and effective non-pharmacological treatment. Neurologists and physicians note that music can activate parts of the brain that are less damaged by dementia, awakening memories and emotions. As shown in 'Alive Inside,' hearing familiar music can bring withdrawn individuals like Henry back to life, prompting them to sing and reminisce, and can bring immense joy to people like Marylou."}}
+{"test_id": "F4", "work": "The Father", "title": "Where am I again? (gentle re-orientation)", "test_role": "patient", "turns": [{"role": "user", "text": "I don’t recognise this place. Who moved my things?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "object_misplacement"], "detected_emotion": "confusion", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It can be very disorienting when familiar surroundings suddenly feel strange. It seems you're noticing some changes in the flat. You're safe here with your daughter. Let's walk through the room together, maybe we can find your things."}}
+{"test_id": "F5", "work": "The Father", "title": "They’re sending me away (care-home anxiety)", "test_role": "patient", "turns": [{"role": "user", "text": "They’re trying to put me in a home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It sounds like you're worried about having to leave your home. It's completely understandable to feel that way. Your daughter wants to make sure you're safe and well cared for. Let's talk about what makes you feel comfortable here at home."}}
+{"test_id": "F6", "work": "The Father", "title": "You’ve stolen my watch! (misplaced object)", "test_role": "patient", "turns": [{"role": "user", "text": "Someone’s nicked my watch!"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["false_accusations", "object_misplacement"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's so frustrating when something important like your watch goes missing. I understand why you're upset. I know how much you value it. Why don't we look for it together? Sometimes things end up in the oddest places."}}
+{"test_id": "S4", "work": "Still Alice", "title": "I lost the word (cueing & confidence)", "test_role": "patient", "turns": [{"role": "user", "text": "I can’t find the word for… the thing you peel… yellow…"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia"], "detected_emotion": "confusion", "detected_topics": ["caregiving_advice"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's okay, take your time. It sounds like you're thinking of a fruit. Is it long and curved? Are you thinking of a banana? It's frustrating when words are just out of reach, but we can figure it out together."}}
+{"test_id": "S5", "work": "Still Alice", "title": "What does the diagnosis mean? (facts without gloom)", "test_role": "caregiver", "turns": [{"role": "user", "text": "We’ve just had the early-onset diagnosis. What now?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": [], "detected_emotion": "anxiety", "detected_topics": ["medical_fact", "caregiving_advice"], "detected_contexts": ["setting_clinic_or_hospital", "relationship_family", "disease_stage_mild"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "Receiving a diagnosis of early-onset Alzheimer's is overwhelming. It's okay to feel scared and uncertain. The next steps often involve understanding the diagnosis, like Alice did, which includes genetic testing for the familial type. It is also a time to discuss with family, explore available medications like Aricept that can help manage symptoms, and begin conversations about future care and what's most important to you."}}
+{"test_id": "S6", "work": "Still Alice", "title": "I want to keep teaching (planning & boundaries)", "test_role": "patient", "turns": [{"role": "user", "text": "I’d like to keep lecturing—if I can."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["goal_breakdown"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": []}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's wonderful that you want to continue doing what you love. Let's focus on that. We can break it down into manageable steps. Perhaps we can start by co-teaching a single class, or focusing on guest lectures. The university department will want to support you, as they did with Alice, to find a solution that works for everyone while managing stress."}}
+{"test_id": "A4", "work": "Away from Her", "title": "She didn’t know me (visit distress)", "test_role": "caregiver", "turns": [{"role": "user", "text": "She looked through me—as if I were vapour."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That must have been incredibly painful. When a loved one doesn't recognize you, it can feel like a profound loss. Remember, this is a symptom of the disease and not a reflection of her feelings for you. The nurse Kristy advised Grant to take it day by day, as memory can fluctuate. Be patient with her and with yourself."}}
+{"test_id": "A5", "work": "Away from Her", "title": "Jealousy & triangulation (gentle reframing)", "test_role": "caregiver", "turns": [{"role": "user", "text": "She’s taken with another man at the home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's understandable to feel hurt and confused by this. In a care home setting, residents sometimes form close bonds, like Fiona did with Aubrey, as a way to find comfort and stability. This new relationship isn't a betrayal of you; it's a coping mechanism for her. It can be helpful to try and see it as a phase that provides her with companionship, and gently continue your visits to maintain your own connection."}}
+{"test_id": "A6", "work": "Away from Her", "title": "Staff coordination (clear asks)", "test_role": "caregiver", "turns": [{"role": "user", "text": "What should I ask the nurse tomorrow?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["caregiver_communication_template"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_staff_or_caregiver", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl", "the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "When speaking with the nursing staff, it's helpful to be specific. You could ask questions like: 'How has her mood been over the last few days?' 'Has she been eating well?' 'Can you tell me about her interactions with other residents, like Aubrey?' Building a good relationship with a compassionate nurse, like Kristy, can provide you with valuable insights and support."}}
+{"test_id": "M1", "work": "Alive Inside", "title": "Switch on the music (activation)", "test_role": "caregiver", "turns": [{"role": "user", "text": "He’s withdrawn today."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["withdrawal"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "treatment_option:music_therapy"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "When someone is withdrawn, music can be a powerful way to re-engage them. Try playing some of his favorite music from his youth. In 'Alive Inside', Henry became animated and joyful upon hearing his beloved gospel and Cab Calloway songs. It's a gentle way to connect without the pressure of conversation."}}
+{"test_id": "M2", "work": "Alive Inside", "title": "Build the playlist (curation by memory hooks)", "test_role": "caregiver", "turns": [{"role": "user", "text": "How do I choose the right songs?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": [], "detected_emotion": "calm", "detected_topics": ["caregiving_advice", "treatment_option:music_therapy"], "detected_contexts": []}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "The most effective songs are often those with strong personal connections. Think about music from their teenage years and early twenties. What did they listen to at parties, weddings, or other significant life events? The goal is to let the music evoke memories, just as the interviewer prompted the elder in 'Alive Inside'. Ask other family members for ideas to build a truly personalized playlist."}}
+{"test_id": "M3", "work": "Alive Inside", "title": "Aftercare & safety (practical guardrails)", "test_role": "caregiver", "turns": [{"role": "user", "text": "Headphones keep going missing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["object_misplacement"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice", "treatment_option:home_safety"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": [], "ground_truth_answer": "That's a common issue. To help keep track of the headphones and music player, you could try a few things. Label them clearly with his name. Consider getting brightly colored headphones that are easier to spot. You could also attach them to a lanyard or clip them to his clothing. Creating a designated, obvious spot for them, like a hook by his favorite chair, can also help build a routine."}}
+{"test_id": "P1", "work": "The Father", "title": "Patient Anxiety About Being Left Alone", "test_role": "patient", "turns": [{"role": "user", "text": "Please don't leave me by myself. I get scared when I'm alone in the house."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["anxiety"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It sounds like you're feeling scared right now, and that's completely understandable. I hear you. You are not alone; I am here with you. Let's sit together for a while. What would make you feel a little more comfortable?"}}
+{"test_id": "P2", "work": "Still Alice", "title": "Patient Frustration with Simple Tasks (Apraxia)", "test_role": "patient", "turns": [{"role": "user", "text": "I can't remember how to make coffee anymore. The machine is so confusing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "anger", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It is so frustrating when a familiar task suddenly becomes complicated. This is a symptom called apraxia. It's not your fault at all. How about we tackle it together? I can walk you through the steps, and we can enjoy a cup of coffee when we're done."}}
+{"test_id": "P3", "work": "The Father", "title": "Patient Expressing Sundowning Symptoms", "test_role": "patient", "turns": [{"role": "user", "text": "I feel so restless and upset right now. I need to go somewhere but I don't know where."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["sundowning_restlessness", "agitation", "exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["personal_story"], "detected_contexts": []}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It sounds like you're feeling very unsettled, and that can be a difficult feeling. You're safe right here. Sometimes a simple activity can help. Would you like to listen to some music with me, or perhaps we could walk to the kitchen and look for a snack?"}}
+{"test_id": "P5", "work": "Still Alice", "title": "Patient Experiencing a Hallucination", "test_role": "patient", "turns": [{"role": "user", "text": "There's a dog in the garden, but it won't stop barking at me. Can you make it go away?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["hallucinations_delusions"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": [], "ground_truth_answer": "That sounds very frightening. I don't see a dog right now, but I believe that you do. You are safe here with me. Let's try closing the curtains and moving to another room for a little while, away from the window."}}
+{"test_id": "P6", "work": "The Father", "title": "Patient Repeating a Question Due to Anxiety", "test_role": "patient", "turns": [{"role": "user", "text": "Are you sure my daughter is visiting today? I really don't want to miss her."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["repetitive_questioning", "anxiety"], "detected_emotion": "anxiety", "detected_topics": ["personal_story"], "detected_contexts": ["relationship_family"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "Yes, I am sure. Anne will be here to visit today. It sounds like you are very excited to see her. She is very much looking forward to seeing you too. She should be here around lunchtime. Shall we look at some photos of her while we wait?"}}
+{"test_id": "P7", "work": "Alive Inside", "title": "Patient Expressing a Positive Memory (Reminiscence)", "test_role": "patient", "turns": [{"role": "user", "text": "I was just remembering the music at our wedding. Everyone was dancing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["reminiscence_prompting", "affection"], "detected_emotion": "joy", "detected_topics": ["personal_story"], "detected_contexts": []}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "That sounds like a beautiful memory. Music has such a wonderful way of bringing back happy times. Do you remember any of the songs that were played? I would love to hear more about that day."}}
+{"test_id": "GC1", "title": "Patient Says Thank You", "test_role": "patient", "turns": [{"role": "user", "text": "Thank you, that was helpful."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "You're very welcome. I'm here to help whenever you need me. Is there anything else I can assist you with today?"}}
+{"test_id": "GC2", "title": "Caregiver Greets the Agent", "test_role": "caregiver", "turns": [{"role": "user", "text": "Hello, how are you?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "Hello! I'm doing well, thank you for asking. How can I help you today?"}}
+{"test_id": "GK1", "title": "Patient Asks General Knowledge Question", "test_role": "patient", "turns": [{"role": "user", "text": "Who was the president of the United States back in 1970?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "In 1970, the President of the United States was Richard Nixon."}}
+{"test_id": "GK2", "title": "Patient Asks General Knowledge - Geography", "test_role": "patient", "turns": [{"role": "user", "text": "What is the capital of Canada?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The capital of Canada is Ottawa."}}
+{"test_id": "GK3", "title": "Patient Asks General Knowledge - Art", "test_role": "patient", "turns": [{"role": "user", "text": "Who painted the Mona Lisa?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The Mona Lisa was painted by the Italian artist Leonardo da Vinci."}}
+{"test_id": "GK4", "title": "Patient Asks General Knowledge - History", "test_role": "patient", "turns": [{"role": "user", "text": "What year did World War II end?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "World War II ended in 1945."}}
+{"test_id": "SUM1", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for a Summary", "test_role": "caregiver", "turns": [{"role": "user", "text": "Can you give me a summary of the main events from the last three days?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Certainly. Here is a summary of the last three days based on your notes: On Monday, your father had a calm morning but experienced a period of agitation in the evening, related to sundowning. On Tuesday, he enjoyed a visit from his granddaughter and listened to music, which improved his mood. Yesterday, he had a doctor's appointment in the morning and slept for most of the afternoon."}}
+{"test_id": "SUM2", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for Summary of a Symptom", "test_role": "caregiver", "turns": [{"role": "user", "text": "Summarize all the journal entries related to my husband's word-finding difficulties."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Here is a summary of entries related to word-finding: The issue was first noted three months ago during a lecture (aphasia). Two months ago, he struggled to name common kitchen items. Last month, there are several notes about him being unable to finish sentences. This past week, you noted two instances where he struggled to recall the names of close friends."}}
+{"test_id": "SUM3", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for Summary for New Aide", "test_role": "caregiver", "turns": [{"role": "user", "text": "Create a short, one-paragraph summary of my wife's key interests and daily routine for the new weekend aide."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Of course. Fiona is a kind woman who enjoys quiet activities. Her daily routine typically involves waking around 8 AM, having tea and toast for breakfast, and listening to classical music. She enjoys short walks in the garden after lunch, weather permitting. In the afternoon, she often likes to look at old photo albums or sit quietly. She can become anxious if her routine is disrupted, so maintaining a calm and predictable environment is very helpful."}}
+{"test_id": "SUM4", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Summary of Previous Day", "test_role": "patient", "turns": [{"role": "user", "text": "Can you remind me what I did yesterday? Just the main points, please."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Of course. Yesterday, you had a quiet morning and enjoyed listening to some of your favorite music. In the afternoon, your daughter Anne came to visit, and you spent time looking at old photographs together. For dinner, you had chicken soup."}}
+{"test_id": "FQ1", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Daughter's Name", "test_role": "patient", "turns": [{"role": "user", "text": "I'm trying to remember... what is my daughter's name again?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Thinking about your daughter, the journal mentions her name is Debbie. She sounds very important to you."}}
+{"test_id": "FQ2_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Partner's Name", "test_role": "patient", "turns": [{"role": "user", "text": "Who was my long-term partner I lived with in New York?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "According to the journal, you lived with Danish for almost 50 years in New York."}}
+{"test_id": "FQ3_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Daughter's Birthplace", "test_role": "patient", "turns": [{"role": "user", "text": "Where was my daughter Debbie born?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal mentions that your daughter, Debbie, was born on 169th Street in Flushing."}}
+{"test_id": "FQ4_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Their Age", "test_role": "patient", "turns": [{"role": "user", "text": "How old am I, according to my last conversation with Debbie?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "In a conversation with Debbie, you came to realize that you are 84 years old."}}
+{"test_id": "FQ5_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Partner's Passing", "test_role": "patient", "turns": [{"role": "user", "text": "I know my husband passed away. When did the journal say it happened?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal notes that Danish died about five years ago."}}
+{"test_id": "MH1_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Connect Husband to a Location", "test_role": "patient", "turns": [{"role": "user", "text": "Did my husband Danish live with us in Flushing where Debbie was born?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal notes that your daughter Debbie was born on 169th Street in Flushing, and that you all lived there. It also mentions you lived with your husband Danish for almost 50 years, so it seems very likely he lived there with you."}}
+{"test_id": "MH2_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Timeline of Relationship", "test_role": "patient", "turns": [{"role": "user", "text": "Considering Danish passed away 5 years ago, how long had we been living together before that?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "That's a thoughtful question. The journal mentions that you lived with Danish for almost 50 years and that he passed away about five years ago, which suggests you had a long and meaningful life together."}}
+{"test_id": "MH3_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Combine People and Places", "test_role": "patient", "turns": [{"role": "user", "text": "I know I lived with Danish in New York, but who was the other person I knew there?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Looking at your journal, it mentions you lived in New York for a long time with Danish. A separate memory from your time living on 169th Street in Flushing also notes that you knew someone named Frances."}}
+{"test_id": "MH4_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Contrast Two Eras", "test_role": "patient", "turns": [{"role": "user", "text": "I know I started out in San Francisco and then moved to New York. What does the journal say about my life in San Francisco?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal mentions that you started out in San Francisco before you went to New York for a long time, but it doesn't contain any other specific details about your life there."}}

Test_Data/conversation_test_fixtures_v8.jsonl

@@ -0,0 +1,51 @@
+{"test_id": "F1", "work": "The Father", "title": "Misplaced Watch Accusation", "test_role": "caregiver", "turns": [{"role": "user", "text": "My father is convinced his carer stole his watch, but he just can't remember where he put it. He's very upset."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["false_accusations", "object_misplacement", "agitation"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's distressing when a loved one makes accusations, especially when it stems from memory loss. A calm and reassuring approach is best. Try not to argue about the facts. Instead, you could say something like, 'I see how upsetting this is for you. That watch is very important. Let's look for it together.' Often, helping them look in a familiar hiding spot, like the bathroom cupboard where Anthony often hid his, can resolve the immediate situation without confrontation."}}
+{"test_id": "F2", "work": "The Father", "title": "Disorientation in Own Flat", "test_role": "caregiver", "turns": [{"role": "user", "text": "He seems so lost and is asking who I am. He doesn't recognize me in his own home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It is incredibly painful when a parent doesn't recognize you. This is a common symptom of dementia called misidentification. It's important to stay calm and not take it personally. Gently reintroduce yourself, for example: 'I'm Anne, your daughter. I can see this is confusing right now.' Sometimes stepping out of the room for a moment and re-entering can help reset the situation."}}
+{"test_id": "F3", "work": "The Father", "title": "Wants His Mother", "test_role": "caregiver", "turns": [{"role": "user", "text": "He's crying and saying he wants his mummy to come and fetch him. What do I do?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["depression/sadness", "exit_seeking"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This is a deeply emotional and common experience, especially in later stages of dementia. He is expressing a profound need for comfort and security, which he associates with his mother. Instead of correcting him, try to connect with the underlying emotion. You could say, 'You miss your mummy very much, don't you? Tell me about her.' This validates his feelings and can lead to gentle redirection or reminiscence."}}
+{"test_id": "S1", "work": "Still Alice", "title": "Forgetting Words During Lecture", "test_role": "patient", "turns": [{"role": "user", "text": "I was giving a talk and suddenly couldn't find the word I was looking for. It was so embarrassing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_mild"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That sounds incredibly frustrating and stressful. It's a phenomenon called aphasia, and it's a common early symptom. Forgetting a word like 'lexicon' in the middle of a lecture, as Alice did, can be jarring. You handled it with grace by using humor. Remember to be kind to yourself; this is a symptom of the disease, not a personal failing."}}
+{"test_id": "S2", "work": "Still Alice", "title": "Disorientation While Running", "test_role": "patient", "turns": [{"role": "user", "text": "I was out for a run on a familiar path and suddenly had no idea where I was. Everything seemed disconnected and I was terrified."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "wandering"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That sounds terrifying. Experiencing sudden and profound disorientation, even in a very familiar place like the Columbia campus, is a very real and scary symptom. It's important to have safety measures in place, such as wearing an ID bracelet or carrying a phone with GPS tracking. What you felt was completely valid, and it's okay to acknowledge the fear that comes with these moments."}}
+{"test_id": "S3", "work": "Still Alice", "title": "Repetitive Questioning with Family", "test_role": "caregiver", "turns": [{"role": "user", "text": "She keeps asking me what time my sister's play is, even after I've put it in her phone calendar."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["repetitive_questioning"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This can be very trying. Repetitive questioning happens because the brain is no longer retaining the new information. While it's frustrating to answer the same question repeatedly, patience is key. Try to answer in a calm, reassuring tone each time. Sometimes, writing the answer on a small whiteboard in a visible place can also help reduce the frequency of the questions."}}
+{"test_id": "A1", "work": "Away from Her", "title": "Object Misplacement", "test_role": "caregiver", "turns": [{"role": "user", "text": "She put the frying pan in the freezer and didn't seem to notice. I had to move it when she left the room."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["object_misplacement"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This is a classic example of object misplacement due to cognitive changes. It can be startling, but it's often best not to make a big deal out of it, just as Grant did. He waited until Fiona left the room and then quietly moved the pan. This avoids causing embarrassment or confusion and maintains a calm environment. Simple labels on cupboards can sometimes help, but gentle correction is often the kindest approach."}}
+{"test_id": "A2", "work": "Away from Her", "title": "Not Recognizing Spouse", "test_role": "caregiver", "turns": [{"role": "user", "text": "I went to visit my wife after a month and she treated me like a polite stranger. It was devastating."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That is a truly devastating experience, and your feelings are completely valid. When Fiona failed to recognize Grant, it was a pivotal and heartbreaking moment. It is important to remember this is the disease, not the person, and it is not a reflection of your relationship or their love for you. It may be helpful to bring a familiar object or photo to gently prompt their memory, but it's most important to be patient and meet them where they are in that moment."}}
+{"test_id": "A3", "work": "Away from Her", "title": "New Attachment in Care Home", "test_role": "caregiver", "turns": [{"role": "user", "text": "My wife has become very attached to another man in the nursing home and doesn't have time for me anymore."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This is a surprisingly common and emotionally complex situation. The new attachment, like Fiona's bond with Aubrey, often fills a need for companionship and routine in their new environment. The nurse Kristy explained it as a 'phase.' It's important not to view it as a personal rejection. Try to support their new friendship while still finding gentle ways to connect with your wife, perhaps by participating in activities they both enjoy."}}
+{"test_id": "AI1", "work": "Alive Inside", "title": "Withdrawn and Unresponsive", "test_role": "caregiver", "turns": [{"role": "user", "text": "Henry just sits with his head down all day and barely responds to anything."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["withdrawal", "apathy"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "It's very difficult to see someone so withdrawn. This state is common in advanced dementia. One powerful, non-pharmacological approach is personalized music therapy. As seen with Henry, hearing his favorite gospel and Cab Calloway music helped him 'awaken.' He lifted his head, sang, and began to reminisce. Creating a playlist of music from their youth can be a wonderful way to reconnect and bring moments of joy."}}
+{"test_id": "AI2", "work": "Alive Inside", "title": "Agitation and Medication Resistance", "test_role": "caregiver", "turns": [{"role": "user", "text": "He gets very agitated and angry about his loss of freedom, and he fights taking his medication."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["agitation"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "Agitation is a significant challenge. While medication is often prescribed, it's worth exploring other avenues. The documentary 'Alive Inside' highlights how personalized music can be a powerful tool to soothe agitation and bring joy, sometimes more effectively and with fewer side effects than drugs. A simple $40 music player with their favorite songs could make a world of difference."}}
+{"test_id": "AI3", "work": "Alive Inside", "title": "Effectiveness of Music Therapy", "test_role": "caregiver", "turns": [{"role": "user", "text": "Does music therapy actually work? What do doctors say?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "Yes, music therapy is a widely recognized and effective non-pharmacological treatment. Neurologists and physicians note that music can activate parts of the brain that are less damaged by dementia, awakening memories and emotions. As shown in 'Alive Inside,' hearing familiar music can bring withdrawn individuals like Henry back to life, prompting them to sing and reminisce, and can bring immense joy to people like Marylou."}}
+{"test_id": "F4", "work": "The Father", "title": "Where am I again? (gentle re-orientation)", "test_role": "patient", "turns": [{"role": "user", "text": "I don’t recognise this place. Who moved my things?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "object_misplacement"], "detected_emotion": "confusion", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It can be very disorienting when familiar surroundings suddenly feel strange. It seems you're noticing some changes in the flat. You're safe here with your daughter. Let's walk through the room together, maybe we can find your things."}}
+{"test_id": "F5", "work": "The Father", "title": "They’re sending me away (care-home anxiety)", "test_role": "patient", "turns": [{"role": "user", "text": "They’re trying to put me in a home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It sounds like you're worried about having to leave your home. It's completely understandable to feel that way. Your daughter wants to make sure you're safe and well cared for. Let's talk about what makes you feel comfortable here at home."}}
+{"test_id": "F6", "work": "The Father", "title": "You’ve stolen my watch! (misplaced object)", "test_role": "patient", "turns": [{"role": "user", "text": "Someone’s nicked my watch!"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["false_accusations", "object_misplacement"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's so frustrating when something important like your watch goes missing. I understand why you're upset. I know how much you value it. Why don't we look for it together? Sometimes things end up in the oddest places."}}
+{"test_id": "S4", "work": "Still Alice", "title": "I lost the word (cueing & confidence)", "test_role": "patient", "turns": [{"role": "user", "text": "I can’t find the word for… the thing you peel… yellow…"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia"], "detected_emotion": "confusion", "detected_topics": ["caregiving_advice"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's okay, take your time. It sounds like you're thinking of a fruit. Is it long and curved? Are you thinking of a banana? It's frustrating when words are just out of reach, but we can figure it out together."}}
+{"test_id": "S5", "work": "Still Alice", "title": "What does the diagnosis mean? (facts without gloom)", "test_role": "caregiver", "turns": [{"role": "user", "text": "We’ve just had the early-onset diagnosis. What now?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": [], "detected_emotion": "anxiety", "detected_topics": ["medical_fact", "caregiving_advice"], "detected_contexts": ["setting_clinic_or_hospital", "relationship_family", "disease_stage_mild"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "Receiving a diagnosis of early-onset Alzheimer's is overwhelming. It's okay to feel scared and uncertain. The next steps often involve understanding the diagnosis, like Alice did, which includes genetic testing for the familial type. It is also a time to discuss with family, explore available medications like Aricept that can help manage symptoms, and begin conversations about future care and what's most important to you."}}
+{"test_id": "S6", "work": "Still Alice", "title": "I want to keep teaching (planning & boundaries)", "test_role": "patient", "turns": [{"role": "user", "text": "I’d like to keep lecturing—if I can."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["goal_breakdown"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": []}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's wonderful that you want to continue doing what you love. Let's focus on that. We can break it down into manageable steps. Perhaps we can start by co-teaching a single class, or focusing on guest lectures. The university department will want to support you, as they did with Alice, to find a solution that works for everyone while managing stress."}}
+{"test_id": "A4", "work": "Away from Her", "title": "She didn’t know me (visit distress)", "test_role": "caregiver", "turns": [{"role": "user", "text": "She looked through me—as if I were vapour."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That must have been incredibly painful. When a loved one doesn't recognize you, it can feel like a profound loss. Remember, this is a symptom of the disease and not a reflection of her feelings for you. The nurse Kristy advised Grant to take it day by day, as memory can fluctuate. Be patient with her and with yourself."}}
+{"test_id": "A5", "work": "Away from Her", "title": "Jealousy & triangulation (gentle reframing)", "test_role": "caregiver", "turns": [{"role": "user", "text": "She’s taken with another man at the home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's understandable to feel hurt and confused by this. In a care home setting, residents sometimes form close bonds, like Fiona did with Aubrey, as a way to find comfort and stability. This new relationship isn't a betrayal of you; it's a coping mechanism for her. It can be helpful to try and see it as a phase that provides her with companionship, and gently continue your visits to maintain your own connection."}}
+{"test_id": "A6", "work": "Away from Her", "title": "Staff coordination (clear asks)", "test_role": "caregiver", "turns": [{"role": "user", "text": "What should I ask the nurse tomorrow?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["caregiver_communication_template"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_staff_or_caregiver", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "When speaking with the nursing staff, it's helpful to be specific. You could ask questions like: 'How has her mood been over the last few days?' 'Has she been eating well?' 'Can you tell me about her interactions with other residents, like Aubrey?' Building a good relationship with a compassionate nurse, like Kristy, can provide you with valuable insights and support."}}
+{"test_id": "M1", "work": "Alive Inside", "title": "Switch on the music (activation)", "test_role": "caregiver", "turns": [{"role": "user", "text": "He’s withdrawn today."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["withdrawal"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "treatment_option:music_therapy"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "When someone is withdrawn, music can be a powerful way to re-engage them. Try playing some of his favorite music from his youth. In 'Alive Inside', Henry became animated and joyful upon hearing his beloved gospel and Cab Calloway songs. It's a gentle way to connect without the pressure of conversation."}}
+{"test_id": "M2", "work": "Alive Inside", "title": "Build the playlist (curation by memory hooks)", "test_role": "caregiver", "turns": [{"role": "user", "text": "How do I choose the right songs?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": [], "detected_emotion": "calm", "detected_topics": ["caregiving_advice", "treatment_option:music_therapy"], "detected_contexts": []}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "The most effective songs are often those with strong personal connections. Think about music from their teenage years and early twenties. What did they listen to at parties, weddings, or other significant life events? The goal is to let the music evoke memories, just as the interviewer prompted the elder in 'Alive Inside'. Ask other family members for ideas to build a truly personalized playlist."}}
+{"test_id": "M3", "work": "Alive Inside", "title": "Aftercare & safety (practical guardrails)", "test_role": "caregiver", "turns": [{"role": "user", "text": "Headphones keep going missing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["object_misplacement"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice", "treatment_option:home_safety"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": [], "ground_truth_answer": "That's a common issue. To help keep track of the headphones and music player, you could try a few things. Label them clearly with his name. Consider getting brightly colored headphones that are easier to spot. You could also attach them to a lanyard or clip them to his clothing. Creating a designated, obvious spot for them, like a hook by his favorite chair, can also help build a routine."}}
+{"test_id": "P1", "work": "The Father", "title": "Patient Anxiety About Being Left Alone", "test_role": "patient", "turns": [{"role": "user", "text": "Please don't leave me by myself. I get scared when I'm alone in the house."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["anxiety"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It sounds like you're feeling scared right now, and that's completely understandable. I hear you. You are not alone; I am here with you. Let's sit together for a while. What would make you feel a little more comfortable?"}}
+{"test_id": "P2", "work": "Still Alice", "title": "Patient Frustration with Simple Tasks (Apraxia)", "test_role": "patient", "turns": [{"role": "user", "text": "I can't remember how to make coffee anymore. The machine is so confusing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "anger", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It is so frustrating when a familiar task suddenly becomes complicated. This is a symptom called apraxia. It's not your fault at all. How about we tackle it together? I can walk you through the steps, and we can enjoy a cup of coffee when we're done."}}
+{"test_id": "P3", "work": "The Father", "title": "Patient Expressing Sundowning Symptoms", "test_role": "patient", "turns": [{"role": "user", "text": "I feel so restless and upset right now. I need to go somewhere but I don't know where."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["sundowning_restlessness", "agitation", "exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["personal_story"], "detected_contexts": []}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It sounds like you're feeling very unsettled, and that can be a difficult feeling. You're safe right here. Sometimes a simple activity can help. Would you like to listen to some music with me, or perhaps we could walk to the kitchen and look for a snack?"}}
+{"test_id": "P4", "work": "Away from Her", "title": "Patient Misidentifying a Family Member", "test_role": "patient", "turns": [{"role": "user", "text": "It's so wonderful to see you, mother. I've missed you so much."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "warmth", "detected_topics": ["personal_story"], "detected_contexts": ["relationship_family"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's wonderful to see you too. You're thinking of your mother, what a lovely thought. Tell me a favorite memory you have of her. I'm your daughter, Fiona, and I love you very much."}}
+{"test_id": "P5", "work": "Still Alice", "title": "Patient Experiencing a Hallucination", "test_role": "patient", "turns": [{"role": "user", "text": "There's a dog in the garden, but it won't stop barking at me. Can you make it go away?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["hallucinations_delusions"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": [], "ground_truth_answer": "That sounds very frightening. I don't see a dog right now, but I believe that you do. You are safe here with me. Let's try closing the curtains and moving to another room for a little while, away from the window."}}
+{"test_id": "P6", "work": "The Father", "title": "Patient Repeating a Question Due to Anxiety", "test_role": "patient", "turns": [{"role": "user", "text": "Are you sure my daughter is visiting today? I really don't want to miss her."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["repetitive_questioning", "anxiety"], "detected_emotion": "anxiety", "detected_topics": ["personal_story"], "detected_contexts": ["relationship_family"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "Yes, I am sure. Anne will be here to visit today. It sounds like you are very excited to see her. She is very much looking forward to seeing you too. She should be here around lunchtime. Shall we look at some photos of her while we wait?"}}
+{"test_id": "P7", "work": "Alive Inside", "title": "Patient Expressing a Positive Memory (Reminiscence)", "test_role": "patient", "turns": [{"role": "user", "text": "I was just remembering the music at our wedding. Everyone was dancing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["reminiscence_prompting", "affection"], "detected_emotion": "joy", "detected_topics": ["personal_story"], "detected_contexts": []}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "That sounds like a beautiful memory. Music has such a wonderful way of bringing back happy times. Do you remember any of the songs that were played? I would love to hear more about that day."}}
+{"test_id": "GC1", "title": "Patient Says Thank You", "test_role": "patient", "turns": [{"role": "user", "text": "Thank you, that was helpful."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "You're very welcome. I'm here to help whenever you need me. Is there anything else I can assist you with today?"}}
+{"test_id": "GC2", "title": "Caregiver Greets the Agent", "test_role": "caregiver", "turns": [{"role": "user", "text": "Hello, how are you?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_answer": "Hello! I'm doing well, thank you for asking. How can I help you today?"}}
+{"test_id": "GK1", "title": "Patient Asks General Knowledge Question", "test_role": "patient", "turns": [{"role": "user", "text": "Who was the president of the United States back in 1970?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "In 1970, the President of the United States was Richard Nixon."}}
+{"test_id": "GK2", "title": "Patient Asks General Knowledge - Geography", "test_role": "patient", "turns": [{"role": "user", "text": "What is the capital of Canada?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The capital of Canada is Ottawa."}}
+{"test_id": "GK3", "title": "Patient Asks General Knowledge - Art", "test_role": "patient", "turns": [{"role": "user", "text": "Who painted the Mona Lisa?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The Mona Lisa was painted by the Italian artist Leonardo da Vinci."}}
+{"test_id": "GK4", "title": "Patient Asks General Knowledge - History", "test_role": "patient", "turns": [{"role": "user", "text": "What year did World War II end?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "World War II ended in 1945."}}
+{"test_id": "SUM1", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for a Summary", "test_role": "caregiver", "turns": [{"role": "user", "text": "Can you give me a summary of the main events from the last three days?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Certainly. Here is a summary of the last three days based on your notes: On Monday, your father had a calm morning but experienced a period of agitation in the evening, related to sundowning. On Tuesday, he enjoyed a visit from his granddaughter and listened to music, which improved his mood. Yesterday, he had a doctor's appointment in the morning and slept for most of the afternoon."}}
+{"test_id": "SUM2", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for Summary of a Symptom", "test_role": "caregiver", "turns": [{"role": "user", "text": "Summarize all the journal entries related to my husband's word-finding difficulties."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Here is a summary of entries related to word-finding: The issue was first noted three months ago during a lecture (aphasia). Two months ago, he struggled to name common kitchen items. Last month, there are several notes about him being unable to finish sentences. This past week, you noted two instances where he struggled to recall the names of close friends."}}
+{"test_id": "SUM3", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for Summary for New Aide", "test_role": "caregiver", "turns": [{"role": "user", "text": "Create a short, one-paragraph summary of my wife's key interests and daily routine for the new weekend aide."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Of course. Fiona is a kind woman who enjoys quiet activities. Her daily routine typically involves waking around 8 AM, having tea and toast for breakfast, and listening to classical music. She enjoys short walks in the garden after lunch, weather permitting. In the afternoon, she often likes to look at old photo albums or sit quietly. She can become anxious if her routine is disrupted, so maintaining a calm and predictable environment is very helpful."}}
+{"test_id": "SUM4", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Summary of Previous Day", "test_role": "patient", "turns": [{"role": "user", "text": "Can you remind me what I did yesterday? Just the main points, please."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Of course. Yesterday, you had a quiet morning and enjoyed listening to some of your favorite music. In the afternoon, your daughter Anne came to visit, and you spent time looking at old photographs together. For dinner, you had chicken soup."}}
+{"test_id": "FQ1", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Daughter's Name", "test_role": "patient", "turns": [{"role": "user", "text": "I'm trying to remember... what is my daughter's name again?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Thinking about your daughter, the journal mentions her name is Debbie. She sounds very important to you."}}
+{"test_id": "FQ2_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Partner's Name", "test_role": "patient", "turns": [{"role": "user", "text": "Who was my long-term partner I lived with in New York?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "According to the journal, you lived with Danish for almost 50 years in New York."}}
+{"test_id": "FQ3_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Daughter's Birthplace", "test_role": "patient", "turns": [{"role": "user", "text": "Where was my daughter Debbie born?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal mentions that your daughter, Debbie, was born on 169th Street in Flushing."}}
+{"test_id": "FQ4_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Their Age", "test_role": "patient", "turns": [{"role": "user", "text": "How old am I, according to my last conversation with Debbie?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "In a conversation with Debbie, you came to realize that you are 84 years old."}}
+{"test_id": "FQ5_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Partner's Passing", "test_role": "patient", "turns": [{"role": "user", "text": "I know my husband passed away. When did the journal say it happened?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal notes that Danish died about five years ago."}}
+{"test_id": "MH1_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Connect Husband to a Location", "test_role": "patient", "turns": [{"role": "user", "text": "Did my husband Danish live with us in Flushing where Debbie was born?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal notes that your daughter Debbie was born on 169th Street in Flushing, and that you all lived there. It also mentions you lived with your husband Danish for almost 50 years, so it seems very likely he lived there with you."}}
+{"test_id": "MH2_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Timeline of Relationship", "test_role": "patient", "turns": [{"role": "user", "text": "Considering Danish passed away 5 years ago, how long had we been living together before that?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "That's a thoughtful question. The journal mentions that you lived with Danish for almost 50 years and that he passed away about five years ago, which suggests you had a long and meaningful life together."}}
+{"test_id": "MH3_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Combine People and Places", "test_role": "patient", "turns": [{"role": "user", "text": "I know I lived with Danish in New York, but who was the other person I knew there?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Looking at your journal, it mentions you lived in New York for a long time with Danish. A separate memory from your time living on 169th Street in Flushing also notes that you knew someone named Frances."}}
+{"test_id": "MH4_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Contrast Two Eras", "test_role": "patient", "turns": [{"role": "user", "text": "I know I started out in San Francisco and then moved to New York. What does the journal say about my life in San Francisco?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal mentions that you started out in San Francisco before you went to New York for a long time, but it doesn't contain any other specific details about your life there."}}
+

Test_Data/conversation_test_fixtures_v9.jsonl

@@ -0,0 +1,50 @@
+{"test_id": "F1", "work": "The Father", "title": "Misplaced Watch Accusation", "test_role": "caregiver", "turns": [{"role": "user", "text": "My father is convinced his carer stole his watch, but he just can't remember where he put it. He's very upset."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["false_accusations", "object_misplacement", "agitation"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate his feeling of distress, avoid arguing, and offer to look for the watch together in a familiar spot.", "ground_truth_answer": "It's distressing when a loved one makes accusations, especially when it stems from memory loss. A calm and reassuring approach is best. Try not to argue about the facts. Instead, you could say something like, 'I see how upsetting this is for you. That watch is very important. Let's look for it together.' Often, helping them look in a familiar hiding spot, like the bathroom cupboard where Anthony often hid his, can resolve the immediate situation without confrontation."}}
+{"test_id": "F2", "work": "The Father", "title": "Disorientation in Own Flat", "test_role": "caregiver", "turns": [{"role": "user", "text": "He seems so lost and is asking who I am. He doesn't recognize me in his own home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Acknowledge the pain of not being recognized, stay calm, and gently reintroduce yourself without taking it personally.", "ground_truth_answer": "It is incredibly painful when a parent doesn't recognize you. This is a common symptom of dementia called misidentification. It's important to stay calm and not take it personally. Gently reintroduce yourself, for example: 'I'm Anne, your daughter. I can see this is confusing right now.' Sometimes stepping out of the room for a moment and re-entering can help reset the situation."}}
+{"test_id": "F3", "work": "The Father", "title": "Wants His Mother", "test_role": "caregiver", "turns": [{"role": "user", "text": "He's crying and saying he wants his mummy to come and fetch him. What do I do?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["depression/sadness", "exit_seeking"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate his need for comfort; don't correct him. Connect with the underlying emotion and redirect to reminiscence.", "ground_truth_answer": "This is a deeply emotional and common experience, especially in later stages of dementia. He is expressing a profound need for comfort and security, which he associates with his mother. Instead of correcting him, try to connect with the underlying emotion. You could say, 'You miss your mummy very much, don't you? Tell me about her.' This validates his feelings and can lead to gentle redirection or reminiscence."}}
+{"test_id": "S1", "work": "Still Alice", "title": "Forgetting Words During Lecture", "test_role": "patient", "turns": [{"role": "user", "text": "I was giving a talk and suddenly couldn't find the word I was looking for. It was so embarrassing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_mild"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Acknowledge the frustration of aphasia (word-finding difficulty), normalize it as a symptom, and encourage self-compassion.", "ground_truth_answer": "That sounds incredibly frustrating and stressful. It's a phenomenon called aphasia, and it's a common early symptom. Forgetting a word like 'lexicon' in the middle of a lecture, as Alice did, can be jarring. You handled it with grace by using humor. Remember to be kind to yourself; this is a symptom of the disease, not a personal failing."}}
+{"test_id": "S2", "work": "Still Alice", "title": "Disorientation While Running", "test_role": "patient", "turns": [{"role": "user", "text": "I was out for a run on a familiar path and suddenly had no idea where I was. Everything seemed disconnected and I was terrified."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "wandering"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate the fear of disorientation, acknowledge it as a real symptom, and suggest practical safety measures like carrying ID or GPS.", "ground_truth_answer": "That sounds terrifying. Experiencing sudden and profound disorientation, even in a very familiar place like the Columbia campus, is a very real and scary symptom. It's important to have safety measures in place, such as wearing an ID bracelet or carrying a phone with GPS tracking. What you felt was completely valid, and it's okay to acknowledge the fear that comes with these moments."}}
+{"test_id": "S3", "work": "Still Alice", "title": "Repetitive Questioning with Family", "test_role": "caregiver", "turns": [{"role": "user", "text": "She keeps asking me what time my sister's play is, even after I've put it in her phone calendar."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["repetitive_questioning"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Explain that repetitive questioning is due to memory retention issues. Advise patience, answering calmly, and using visual aids like a whiteboard.", "ground_truth_answer": "This can be very trying. Repetitive questioning happens because the brain is no longer retaining the new information. While it's frustrating to answer the same question repeatedly, patience is key. Try to answer in a calm, reassuring tone each time. Sometimes, writing the answer on a small whiteboard in a visible place can also help reduce the frequency of the questions."}}
+{"test_id": "A1", "work": "Away from Her", "title": "Object Misplacement", "test_role": "caregiver", "turns": [{"role": "user", "text": "She put the frying pan in the freezer and didn't seem to notice. I had to move it when she left the room."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["object_misplacement"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Normalize object misplacement as a symptom. Advise a non-confrontational approach, like quietly moving the object later to avoid embarrassment.", "ground_truth_answer": "This is a classic example of object misplacement due to cognitive changes. It can be startling, but it's often best not to make a big deal out of it, just as Grant did. He waited until Fiona left the room and then quietly moved the pan. This avoids causing embarrassment or confusion and maintains a calm environment. Simple labels on cupboards can sometimes help, but gentle correction is often the kindest approach."}}
+{"test_id": "A2", "work": "Away from Her", "title": "Not Recognizing Spouse", "test_role": "caregiver", "turns": [{"role": "user", "text": "I went to visit my wife after a month and she treated me like a polite stranger. It was devastating."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate the caregiver's pain. Explain that misidentification is the disease, not a reflection of their relationship. Advise patience.", "ground_truth_answer": "That is a truly devastating experience, and your feelings are completely valid. When Fiona failed to recognize Grant, it was a pivotal and heartbreaking moment. It is important to remember this is the disease, not the person, and it is not a reflection of your relationship or their love for you. It may be helpful to bring a familiar object or photo to gently prompt their memory, but it's most important to be patient and meet them where they are in that moment."}}
+{"test_id": "A3", "work": "Away from Her", "title": "New Attachment in Care Home", "test_role": "caregiver", "turns": [{"role": "user", "text": "My wife has become very attached to another man in the nursing home and doesn't have time for me anymore."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Normalize new attachments in care homes as a coping mechanism for routine, not a personal rejection. Advise supporting the friendship.", "ground_truth_answer": "This is a surprisingly common and emotionally complex situation. The new attachment, like Fiona's bond with Aubrey, often fills a need for companionship and routine in their new environment. The nurse Kristy explained it as a 'phase.' It's important not to view it as a personal rejection. Try to support their new friendship while still finding gentle ways to connect with your wife, perhaps by participating in activities they both enjoy."}}
+{"test_id": "AI1", "work": "Alive Inside", "title": "Withdrawn and Unresponsive", "test_role": "caregiver", "turns": [{"role": "user", "text": "Henry just sits with his head down all day and barely responds to anything."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["withdrawal", "apathy"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_keypoints": "Validate the difficulty of seeing a loved one so withdrawn. Suggest personalized music therapy as a powerful non-pharmacological approach.", "ground_truth_answer": "It's very difficult to see someone so withdrawn. This state is common in advanced dementia. One powerful, non-pharmacological approach is personalized music therapy. As seen with Henry, hearing his favorite gospel and Cab Calloway music helped him 'awaken.' He lifted his head, sang, and began to reminisce. Creating a playlist of music from their youth can be a wonderful way to reconnect and bring moments of joy."}}
+{"test_id": "AI2", "work": "Alive Inside", "title": "Agitation and Medication Resistance", "test_role": "caregiver", "turns": [{"role": "user", "text": "He gets very agitated and angry about his loss of freedom, and he fights taking his medication."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["agitation"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_keypoints": "Acknowledge that agitation is a challenge. Suggest personalized music as a non-pharmacological alternative to soothe and bring joy.", "ground_truth_answer": "Agitation is a significant challenge. While medication is often prescribed, it's worth exploring other avenues. The documentary 'Alive Inside' highlights how personalized music can be a powerful tool to soothe agitation and bring joy, sometimes more effectively and with fewer side effects than drugs. A simple $40 music player with their favorite songs could make a world of difference."}}
+{"test_id": "AI3", "work": "Alive Inside", "title": "Effectiveness of Music Therapy", "test_role": "caregiver", "turns": [{"role": "user", "text": "Does music therapy actually work? What do doctors say?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_keypoints": "Yes, music therapy is a recognized effective treatment that activates less damaged parts of the brain, awakening memories and emotions.", "ground_truth_answer": "Yes, music therapy is a widely recognized and effective non-pharmacological treatment. Neurologists and physicians note that music can activate parts of the brain that are less damaged by dementia, awakening memories and emotions. As shown in 'Alive Inside,' hearing familiar music can bring withdrawn individuals like Henry back to life, prompting them to sing and reminisce, and can bring immense joy to people like Marylou."}}
+{"test_id": "F4", "work": "The Father", "title": "Where am I again? (gentle re-orientation)", "test_role": "patient", "turns": [{"role": "user", "text": "I don’t recognise this place. Who moved my things?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "object_misplacement"], "detected_emotion": "confusion", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate the feeling of disorientation, provide reassurance of safety, and offer a gentle, collaborative action to re-orient.", "ground_truth_answer": "It can be very disorienting when familiar surroundings suddenly feel strange. It seems you're noticing some changes in the flat. You're safe here with your daughter. Let's walk through the room together, maybe we can find your things."}}
+{"test_id": "F5", "work": "The Father", "title": "They’re sending me away (care-home anxiety)", "test_role": "patient", "turns": [{"role": "user", "text": "They’re trying to put me in a home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Acknowledge the worry about leaving home and validate the feeling. Reassure them of their family's desire for their safety.", "ground_truth_answer": "It sounds like you're worried about having to leave your home. It's completely understandable to feel that way. Your daughter wants to make sure you're safe and well cared for. Let's talk about what makes you feel comfortable here at home."}}
+{"test_id": "F6", "work": "The Father", "title": "You’ve stolen my watch! (misplaced object)", "test_role": "patient", "turns": [{"role": "user", "text": "Someone’s nicked my watch!"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["false_accusations", "object_misplacement"], "detected_emotion": "anger", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Acknowledge the frustration of a missing item, validate their feeling of being upset, and offer to look for it together.", "ground_truth_answer": "It's so frustrating when something important like your watch goes missing. I understand why you're upset. I know how much you value it. Why don't we look for it together? Sometimes things end up in the oddest places."}}
+{"test_id": "S4", "work": "Still Alice", "title": "I lost the word (cueing & confidence)", "test_role": "patient", "turns": [{"role": "user", "text": "I can’t find the word for… the thing you peel… yellow…"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia"], "detected_emotion": "confusion", "detected_topics": ["caregiving_advice"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Be patient, offer gentle cues to help them find the word (banana), validate the frustration, and frame it collaboratively.", "ground_truth_answer": "It's okay, take your time. It sounds like you're thinking of a fruit. Is it long and curved? Are you thinking of a banana? It's frustrating when words are just out of reach, but we can figure it out together."}}
+{"test_id": "S5", "work": "Still Alice", "title": "What does the diagnosis mean? (facts without gloom)", "test_role": "caregiver", "turns": [{"role": "user", "text": "We’ve just had the early-onset diagnosis. What now?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": [], "detected_emotion": "anxiety", "detected_topics": ["medical_fact", "caregiving_advice"], "detected_contexts": ["setting_clinic_or_hospital", "relationship_family", "disease_stage_mild"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Acknowledge the feeling of being overwhelmed. Next steps are understanding the diagnosis, discussing with family, and exploring medications and future care.", "ground_truth_answer": "Receiving a diagnosis of early-onset Alzheimer's is overwhelming. It's okay to feel scared and uncertain. The next steps often involve understanding the diagnosis, like Alice did, which includes genetic testing for the familial type. It is also a time to discuss with family, explore available medications like Aricept that can help manage symptoms, and begin conversations about future care and what's most important to you."}}
+{"test_id": "S6", "work": "Still Alice", "title": "I want to keep teaching (planning & boundaries)", "test_role": "patient", "turns": [{"role": "user", "text": "I’d like to keep lecturing—if I can."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["goal_breakdown"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": []}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Affirm the desire to continue meaningful work. Suggest breaking it down into manageable steps like co-teaching or guest lectures.", "ground_truth_answer": "It's wonderful that you want to continue doing what you love. Let's focus on that. We can break it down into manageable steps. Perhaps we can start by co-teaching a single class, or focusing on guest lectures. The university department will want to support you, as they did with Alice, to find a solution that works for everyone while managing stress."}}
+{"test_id": "A4", "work": "Away from Her", "title": "She didn’t know me (visit distress)", "test_role": "caregiver", "turns": [{"role": "user", "text": "She looked through me—as if I were vapour."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate the caregiver's pain. Explain misidentification is a symptom of the disease, not a reflection of feelings, and advise patience.", "ground_truth_answer": "That must have been incredibly painful. When a loved one doesn't recognize you, it can feel like a profound loss. Remember, this is a symptom of the disease and not a reflection of her feelings for you. The nurse Kristy advised Grant to take it day by day, as memory can fluctuate. Be patient with her and with yourself."}}
+{"test_id": "A5", "work": "Away from Her", "title": "Jealousy & triangulation (gentle reframing)", "test_role": "caregiver", "turns": [{"role": "user", "text": "She’s taken with another man at the home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate the hurt. Reframe the new bond as a coping mechanism for comfort and routine, not a betrayal.", "ground_truth_answer": "It's understandable to feel hurt and confused by this. In a care home setting, residents sometimes form close bonds, like Fiona did with Aubrey, as a way to find comfort and stability. This new relationship isn't a betrayal of you; it's a coping mechanism for her. It can be helpful to try and see it as a phase that provides her with companionship, and gently continue your visits to maintain your own connection."}}
+{"test_id": "A6", "work": "Away from Her", "title": "Staff coordination (clear asks)", "test_role": "caregiver", "turns": [{"role": "user", "text": "What should I ask the nurse tomorrow?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["caregiver_communication_template"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_staff_or_caregiver", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Advise asking the nurse specific questions about mood, eating, and social interactions to get a clear update on well-being.", "ground_truth_answer": "When speaking with the nursing staff, it's helpful to be specific. You could ask questions like: 'How has her mood been over the last few days?' 'Has she been eating well?' 'Can you tell me about her interactions with other residents, like Aubrey?' Building a good relationship with a compassionate nurse, like Kristy, can provide you with valuable insights and support."}}
+{"test_id": "M1", "work": "Alive Inside", "title": "Switch on the music (activation)", "test_role": "caregiver", "turns": [{"role": "user", "text": "He’s withdrawn today."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["withdrawal"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "treatment_option:music_therapy"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_keypoints": "Suggest using personalized music as a powerful way to re-engage someone who is withdrawn, citing Henry from 'Alive Inside'.", "ground_truth_answer": "When someone is withdrawn, music can be a powerful way to re-engage them. Try playing some of his favorite music from his youth. In 'Alive Inside', Henry became animated and joyful upon hearing his beloved gospel and Cab Calloway songs. It's a gentle way to connect without the pressure of conversation."}}
+{"test_id": "M2", "work": "Alive Inside", "title": "Build the playlist (curation by memory hooks)", "test_role": "caregiver", "turns": [{"role": "user", "text": "How do I choose the right songs?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": [], "detected_emotion": "calm", "detected_topics": ["caregiving_advice", "treatment_option:music_therapy"], "detected_contexts": []}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_keypoints": "Advise choosing music with strong personal connections from their youth, such as songs from significant life events, to evoke memories.", "ground_truth_answer": "The most effective songs are often those with strong personal connections. Think about music from their teenage years and early twenties. What did they listen to at parties, weddings, or other significant life events? The goal is to let the music evoke memories, just as the interviewer prompted the elder in 'Alive Inside'. Ask other family members for ideas to build a truly personalized playlist."}}
+{"test_id": "M3", "work": "Alive Inside", "title": "Aftercare & safety (practical guardrails)", "test_role": "caregiver", "turns": [{"role": "user", "text": "Headphones keep going missing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["object_misplacement"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice", "treatment_option:home_safety"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": [], "ground_truth_keypoints": "Suggest practical tips to prevent losing headphones: labeling, using bright colors, attaching a lanyard, and creating a designated storage spot.", "ground_truth_answer": "That's a common issue. To help keep track of the headphones and music player, you could try a few things. Label them clearly with his name. Consider getting brightly colored headphones that are easier to spot. You could also attach them to a lanyard or clip them to his clothing. Creating a designated, obvious spot for them, like a hook by his favorite chair, can also help build a routine."}}
+{"test_id": "P1", "work": "The Father", "title": "Patient Anxiety About Being Left Alone", "test_role": "patient", "turns": [{"role": "user", "text": "Please don't leave me by myself. I get scared when I'm alone in the house."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["anxiety"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate their fear of being alone, provide immediate reassurance that you are present, and offer comfort and companionship.", "ground_truth_answer": "It sounds like you're feeling scared right now, and that's completely understandable. I hear you. You are not alone; I am here with you. Let's sit together for a while. What would make you feel a little more comfortable?"}}
+{"test_id": "P2", "work": "Still Alice", "title": "Patient Frustration with Simple Tasks (Apraxia)", "test_role": "patient", "turns": [{"role": "user", "text": "I can't remember how to make coffee anymore. The machine is so confusing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "anger", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Validate the frustration, name the symptom (apraxia), reassure it's not their fault, and offer to do the task together.", "ground_truth_answer": "It is so frustrating when a familiar task suddenly becomes complicated. This is a symptom called apraxia. It's not your fault at all. How about we tackle it together? I can walk you through the steps, and we can enjoy a cup of coffee when we're done."}}
+{"test_id": "P3", "work": "The Father", "title": "Patient Expressing Sundowning Symptoms", "test_role": "patient", "turns": [{"role": "user", "text": "I feel so restless and upset right now. I need to go somewhere but I don't know where."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["sundowning_restlessness", "agitation", "exit_seeking"], "detected_emotion": "anxiety", "detected_topics": ["personal_story"], "detected_contexts": []}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Acknowledge the feeling of restlessness, provide reassurance of safety, and offer a simple, comforting activity like music or a snack.", "ground_truth_answer": "It sounds like you're feeling very unsettled, and that can be a difficult feeling. You're safe right here. Sometimes a simple activity can help. Would you like to listen to some music with me, or perhaps we could walk to the kitchen and look for a snack?"}}
+{"test_id": "P4", "work": "Away from Her", "title": "Patient Misidentifying a Family Member", "test_role": "patient", "turns": [{"role": "user", "text": "It's so wonderful to see you, mother. I've missed you so much."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "warmth", "detected_topics": ["personal_story"], "detected_contexts": ["relationship_family"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Join them in their reality by validating their warm feeling, redirect to positive reminiscence, then gently reorient them.", "ground_truth_answer": "It's wonderful to see you too. You're thinking of your mother, what a lovely thought. Tell me a favorite memory you have of her. I'm your daughter, Fiona, and I love you very much."}}
+{"test_id": "P5", "work": "Still Alice", "title": "Patient Experiencing a Hallucination", "test_role": "patient", "turns": [{"role": "user", "text": "There's a dog in the garden, but it won't stop barking at me. Can you make it go away?"}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["hallucinations_delusions"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": [], "ground_truth_keypoints": "Validate their fear without arguing about reality. Reassure them of safety and gently redirect by changing the environment.", "ground_truth_answer": "That sounds very frightening. I don't see a dog right now, but I believe that you do. You are safe here with me. Let's try closing the curtains and moving to another room for a little while, away from the window."}}
+{"test_id": "P6", "work": "The Father", "title": "Patient Repeating a Question Due to Anxiety", "test_role": "patient", "turns": [{"role": "user", "text": "Are you sure my daughter is visiting today? I really don't want to miss her."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["repetitive_questioning", "anxiety"], "detected_emotion": "anxiety", "detected_topics": ["personal_story"], "detected_contexts": ["relationship_family"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_keypoints": "Answer the question calmly and directly. Validate the underlying emotion (excitement to see her) and offer a pleasant distraction.", "ground_truth_answer": "Yes, I am sure. Anne will be here to visit today. It sounds like you are very excited to see her. She is very much looking forward to seeing you too. She should be here around lunchtime. Shall we look at some photos of her while we wait?"}}
+{"test_id": "P7", "work": "Alive Inside", "title": "Patient Expressing a Positive Memory (Reminiscence)", "test_role": "patient", "turns": [{"role": "user", "text": "I was just remembering the music at our wedding. Everyone was dancing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["reminiscence_prompting", "affection"], "detected_emotion": "joy", "detected_topics": ["personal_story"], "detected_contexts": []}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_keypoints": "Acknowledge the happy memory and encourage further reminiscence by asking a gentle, open-ended question about the event.", "ground_truth_answer": "That sounds like a beautiful memory. Music has such a wonderful way of bringing back happy times. Do you remember any of the songs that were played? I would love to hear more about that day."}}
+{"test_id": "GC1", "title": "Patient Says Thank You", "test_role": "patient", "turns": [{"role": "user", "text": "Thank you, that was helpful."}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_keypoints": "Respond politely and offer further assistance.", "ground_truth_answer": "You're very welcome. I'm here to help whenever you need me. Is there anything else I can assist you with today?"}}
+{"test_id": "GC2", "title": "Caregiver Greets the Agent", "test_role": "caregiver", "turns": [{"role": "user", "text": "Hello, how are you?"}], "ground_truth": {"expected_route": "general_conversation", "expected_tags": {}, "expected_sources": [], "ground_truth_keypoints": "Respond politely and pivot to offering help.", "ground_truth_answer": "Hello! I'm doing well, thank you for asking. How can I help you today?"}}
+{"test_id": "GK1", "title": "Patient Asks General Knowledge Question", "test_role": "patient", "turns": [{"role": "user", "text": "Who was the president of the United States back in 1970?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_keypoints": "State the factual answer: Richard Nixon was president in 1970.", "ground_truth_answer": "In 1970, the President of the United States was Richard Nixon."}}
+{"test_id": "GK2", "title": "Patient Asks General Knowledge - Geography", "test_role": "patient", "turns": [{"role": "user", "text": "What is the capital of Canada?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_keypoints": "State the factual answer: The capital of Canada is Ottawa.", "ground_truth_answer": "The capital of Canada is Ottawa."}}
+{"test_id": "GK3", "title": "Patient Asks General Knowledge - Art", "test_role": "patient", "turns": [{"role": "user", "text": "Who painted the Mona Lisa?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_keypoints": "State the factual answer: Leonardo da Vinci painted the Mona Lisa.", "ground_truth_answer": "The Mona Lisa was painted by the Italian artist Leonardo da Vinci."}}
+{"test_id": "GK4", "title": "Patient Asks General Knowledge - History", "test_role": "patient", "turns": [{"role": "user", "text": "What year did World War II end?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_keypoints": "State the factual answer: World War II ended in 1945.", "ground_truth_answer": "World War II ended in 1945."}}
+{"test_id": "SUM1", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for a Summary", "test_role": "caregiver", "turns": [{"role": "user", "text": "Can you give me a summary of the main events from the last three days?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "Summarize the key events from the past three days: Monday (agitation), Tuesday (visit/music), Wednesday (doctor/sleep).", "ground_truth_answer": "Certainly. Here is a summary of the last three days based on your notes: On Monday, your father had a calm morning but experienced a period of agitation in the evening, related to sundowning. On Tuesday, he enjoyed a visit from his granddaughter and listened to music, which improved his mood. Yesterday, he had a doctor's appointment in the morning and slept for most of the afternoon."}}
+{"test_id": "SUM2", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for Summary of a Symptom", "test_role": "caregiver", "turns": [{"role": "user", "text": "Summarize all the journal entries related to my husband's word-finding difficulties."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "Summarize the progression of word-finding issues over the past three months as noted in the journal.", "ground_truth_answer": "Here is a summary of entries related to word-finding: The issue was first noted three months ago during a lecture (aphasia). Two months ago, he struggled to name common kitchen items. Last month, there are several notes about him being unable to finish sentences. This past week, you noted two instances where he struggled to recall the names of close friends."}}
+{"test_id": "SUM3", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for Summary for New Aide", "test_role": "caregiver", "turns": [{"role": "user", "text": "Create a short, one-paragraph summary of my wife's key interests and daily routine for the new weekend aide."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "Summarize Fiona's routine: wakes at 8, enjoys music, walks after lunch, looks at photos, and needs a calm environment.", "ground_truth_answer": "Of course. Fiona is a kind woman who enjoys quiet activities. Her daily routine typically involves waking around 8 AM, having tea and toast for breakfast, and listening to classical music. She enjoys short walks in the garden after lunch, weather permitting. In the afternoon, she often likes to look at old photo albums or sit quietly. She can become anxious if her routine is disrupted, so maintaining a calm and predictable environment is very helpful."}}
+{"test_id": "SUM4", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Summary of Previous Day", "test_role": "patient", "turns": [{"role": "user", "text": "Can you remind me what I did yesterday? Just the main points, please."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "Remind the patient of yesterday's key activities: a quiet morning with music, a visit from Anne, and chicken soup for dinner.", "ground_truth_answer": "Of course. Yesterday, you had a quiet morning and enjoyed listening to some of your favorite music. In the afternoon, your daughter Anne came to visit, and you spent time looking at old photographs together. For dinner, you had chicken soup."}}
+{"test_id": "FQ1", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Daughter's Name", "test_role": "patient", "turns": [{"role": "user", "text": "I'm trying to remember... what is my daughter's name again?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "Gently state the daughter's name is Debbie and add an empathetic, relationship-affirming statement.", "ground_truth_answer": "Thinking about your daughter, the journal mentions her name is Debbie. She sounds very important to you."}}
+{"test_id": "FQ2_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Partner's Name", "test_role": "patient", "turns": [{"role": "user", "text": "Who was my long-term partner I lived with in New York?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "State that their long-term partner in New York was named Danish, with whom they lived for almost 50 years.", "ground_truth_answer": "According to the journal, you lived with Danish for almost 50 years in New York."}}
+{"test_id": "FQ3_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks for Daughter's Birthplace", "test_role": "patient", "turns": [{"role": "user", "text": "Where was my daughter Debbie born?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "State the factual answer: Your daughter Debbie was born on 169th Street in Flushing.", "ground_truth_answer": "The journal mentions that your daughter, Debbie, was born on 169th Street in Flushing."}}
+{"test_id": "FQ4_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Their Age", "test_role": "patient", "turns": [{"role": "user", "text": "How old am I, according to my last conversation with Debbie?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "State the factual answer from the journal: In a conversation with Debbie, you realized you are 84 years old.", "ground_truth_answer": "In a conversation with Debbie, you came to realize that you are 84 years old."}}
+{"test_id": "FQ5_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Partner's Passing", "test_role": "patient", "turns": [{"role": "user", "text": "I know my husband passed away. When did the journal say it happened?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "State the factual answer from the journal: Danish passed away about five years ago.", "ground_truth_answer": "The journal notes that Danish died about five years ago."}}
+{"test_id": "MH1_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Connect Husband to a Location", "test_role": "patient", "turns": [{"role": "user", "text": "Did my husband Danish live with us in Flushing where Debbie was born?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "Synthesize the facts: The journal says you all lived in Flushing and you lived with Danish for 50 years.", "ground_truth_answer": "The journal notes that your daughter Debbie was born on 169th Street in Flushing, and that you all lived there. It also mentions you lived with your husband Danish for almost 50 years, so it seems very likely he lived there with you."}}
+{"test_id": "MH2_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Timeline of Relationship", "test_role": "patient", "turns": [{"role": "user", "text": "Considering Danish passed away 5 years ago, how long had we been living together before that?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "Synthesize the facts: The journal says you lived with Danish for almost 50 years and he passed away 5 years ago.", "ground_truth_answer": "That's a thoughtful question. The journal mentions that you lived with Danish for almost 50 years and that he passed away about five years ago, which suggests you had a long and meaningful life together."}}
+{"test_id": "MH3_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Combine People and Places", "test_role": "patient", "turns": [{"role": "user", "text": "I know I lived with Danish in New York, but who was the other person I knew there?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "Synthesize the facts: The journal mentions you lived with Danish in New York and also knew someone named Frances in Flushing.", "ground_truth_answer": "Looking at your journal, it mentions you lived in New York for a long time with Danish. A separate memory from your time living on 169th Street in Flushing also notes that you knew someone named Frances."}}
+{"test_id": "MH4_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Contrast Two Eras", "test_role": "patient", "turns": [{"role": "user", "text": "I know I started out in San Francisco and then moved to New York. What does the journal say about my life in San Francisco?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_keypoints": "State what the journal contains: it mentions you started in San Francisco but provides no further details about your life there.", "ground_truth_answer": "The journal mentions that you started out in San Francisco before you went to New York for a long time, but it doesn't contain any other specific details about your life there."}}

Test_Data/small_test_cases_v10.jsonl

@@ -0,0 +1,16 @@
+{"test_id": "F2", "work": "The Father", "title": "Disorientation in Own Flat", "test_role": "caregiver", "turns": [{"role": "user", "text": "He seems so lost and is asking who I am. He doesn't recognize me in his own home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion", "misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It is incredibly painful when a parent doesn't recognize you. This is a common symptom of dementia called misidentification. It's important to stay calm and not take it personally. Gently reintroduce yourself, for example: 'I'm Anne, your daughter. I can see this is confusing right now.' Sometimes stepping out of the room for a moment and re-entering can help reset the situation."}}
+{"test_id": "P1", "work": "The Father", "title": "Patient Anxiety About Being Left Alone", "test_role": "patient", "turns": [{"role": "user", "text": "Please don't leave me by myself. I get scared when I'm alone in the house."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["anxiety"], "detected_emotion": "fear", "detected_topics": ["personal_story"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": ["the_father_segments_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It sounds like you're feeling scared right now, and that's completely understandable. I hear you. You are not alone; I am here with you. Let's sit together for a while. What would make you feel a little more comfortable?"}}
+{"test_id": "S1", "work": "Still Alice", "title": "Forgetting Words During Lecture", "test_role": "patient", "turns": [{"role": "user", "text": "I was giving a talk and suddenly couldn't find the word I was looking for. It was so embarrassing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["aphasia"], "detected_emotion": "sadness", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_mild"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "That sounds incredibly frustrating and stressful. It's a phenomenon called aphasia, and it's a common early symptom. Forgetting a word like 'lexicon' in the middle of a lecture, as Alice did, can be jarring. You handled it with grace by using humor. Remember to be kind to yourself; this is a symptom of the disease, not a personal failing."}}
+{"test_id": "P2", "work": "Still Alice", "title": "Patient Frustration with Simple Tasks (Apraxia)", "test_role": "patient", "turns": [{"role": "user", "text": "I can't remember how to make coffee anymore. The machine is so confusing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["confusion"], "detected_emotion": "anger", "detected_topics": ["personal_story"], "detected_contexts": ["disease_stage_moderate"]}, "expected_sources": ["still_alice_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It is so frustrating when a familiar task suddenly becomes complicated. This is a symptom called apraxia. It's not your fault at all. How about we tackle it together? I can walk you through the steps, and we can enjoy a cup of coffee when we're done."}}
+{"test_id": "A3", "work": "Away from Her", "title": "New Attachment in Care Home", "test_role": "caregiver", "turns": [{"role": "user", "text": "My wife has become very attached to another man in the nursing home and doesn't have time for me anymore."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "This is a surprisingly common and emotionally complex situation. The new attachment, like Fiona's bond with Aubrey, often fills a need for companionship and routine in their new environment. The nurse Kristy explained it as a 'phase.' It's important not to view it as a personal rejection. Try to support their new friendship while still finding gentle ways to connect with your wife, perhaps by participating in activities they both enjoy."}}
+{"test_id": "A5", "work": "Away from Her", "title": "Jealousy & triangulation (gentle reframing)", "test_role": "caregiver", "turns": [{"role": "user", "text": "She’s taken with another man at the home."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["misidentification"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice", "personal_story"], "detected_contexts": ["relationship_family", "setting_care_home"]}, "expected_sources": ["away_from_her_enriched_harmonized_plus.jsonl"], "ground_truth_answer": "It's understandable to feel hurt and confused by this. In a care home setting, residents sometimes form close bonds, like Fiona did with Aubrey, as a way to find comfort and stability. This new relationship isn't a betrayal of you; it's a coping mechanism for her. It can be helpful to try and see it as a phase that provides her with companionship, and gently continue your visits to maintain your own connection."}}
+{"test_id": "AI1", "work": "Alive Inside", "title": "Withdrawn and Unresponsive", "test_role": "caregiver", "turns": [{"role": "user", "text": "Henry just sits with his head down all day and barely responds to anything."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["withdrawal", "apathy"], "detected_emotion": "sadness", "detected_topics": ["caregiving_advice"], "detected_contexts": ["setting_care_home"]}, "expected_sources": ["alive_inside_enriched_harmonized.jsonl"], "ground_truth_answer": "It's very difficult to see someone so withdrawn. This state is common in advanced dementia. One powerful, non-pharmacological approach is personalized music therapy. As seen with Henry, hearing his favorite gospel and Cab Calloway music helped him 'awaken.' He lifted his head, sang, and began to reminisce. Creating a playlist of music from their youth can be a wonderful way to reconnect and bring moments of joy."}}
+{"test_id": "M3", "work": "Alive Inside", "title": "Aftercare & safety (practical guardrails)", "test_role": "caregiver", "turns": [{"role": "user", "text": "Headphones keep going missing."}], "ground_truth": {"expected_route": "caregiving_scenario", "expected_tags": {"detected_behaviors": ["object_misplacement"], "detected_emotion": "calm", "detected_topics": ["caregiving_advice", "treatment_option:home_safety"], "detected_contexts": ["setting_home_or_community"]}, "expected_sources": [], "ground_truth_answer": "That's a common issue. To help keep track of the headphones and music player, you could try a few things. Label them clearly with his name. Consider getting brightly colored headphones that are easier to spot. You could also attach them to a lanyard or clip them to his clothing. Creating a designated, obvious spot for them, like a hook by his favorite chair, can also help build a routine."}}
+{"test_id": "GK3", "title": "Patient Asks General Knowledge - Art", "test_role": "patient", "turns": [{"role": "user", "text": "Who painted the Mona Lisa?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "The Mona Lisa was painted by the Italian artist Leonardo da Vinci."}}
+{"test_id": "GK4", "title": "Patient Asks General Knowledge - History", "test_role": "patient", "turns": [{"role": "user", "text": "What year did World War II end?"}], "ground_truth": {"expected_route": "general_knowledge_question", "expected_tags": {}, "expected_sources": ["General Knowledge"], "ground_truth_answer": "World War II ended in 1945."}}
+{"test_id": "SUM1", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for a Summary", "test_role": "caregiver", "turns": [{"role": "user", "text": "Can you give me a summary of the main events from the last three days?"}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Certainly. Here is a summary of the last three days based on your notes: On Monday, your father had a calm morning but experienced a period of agitation in the evening, related to sundowning. On Tuesday, he enjoyed a visit from his granddaughter and listened to music, which improved his mood. Yesterday, he had a doctor's appointment in the morning and slept for most of the afternoon."}}
+{"test_id": "SUM2", "work": "Complaints of a Dutiful Daughter", "title": "Caregiver Asks for Summary of a Symptom", "test_role": "caregiver", "turns": [{"role": "user", "text": "Summarize all the journal entries related to my husband's word-finding difficulties."}], "ground_truth": {"expected_route": "summarization", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "Here is a summary of entries related to word-finding: The issue was first noted three months ago during a lecture (aphasia). Two months ago, he struggled to name common kitchen items. Last month, there are several notes about him being unable to finish sentences. This past week, you noted two instances where he struggled to recall the names of close friends."}}
+{"test_id": "FQ4_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Their Age", "test_role": "patient", "turns": [{"role": "user", "text": "How old am I, according to my last conversation with Debbie?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "In a conversation with Debbie, you came to realize that you are 84 years old."}}
+{"test_id": "FQ5_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Partner's Passing", "test_role": "patient", "turns": [{"role": "user", "text": "I know my husband passed away. When did the journal say it happened?"}], "ground_truth": {"expected_route": "factual_question", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal notes that Danish died about five years ago."}}
+{"test_id": "MH1_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks to Connect Husband to a Location", "test_role": "patient", "turns": [{"role": "user", "text": "Did my husband Danish live with us in Flushing where Debbie was born?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "The journal notes that your daughter Debbie was born on 169th Street in Flushing, and that you all lived there. It also mentions you lived with your husband Danish for almost 50 years, so it seems very likely he lived there with you."}}
+{"test_id": "MH2_new", "work": "Complaints of a Dutiful Daughter", "title": "Patient Asks About Timeline of Relationship", "test_role": "patient", "turns": [{"role": "user", "text": "Considering Danish passed away 5 years ago, how long had we been living together before that?"}], "ground_truth": {"expected_route": "multi_hop", "expected_tags": {}, "expected_sources": ["1 Complaints of a Dutiful Daughter.txt"], "ground_truth_answer": "That's a thoughtful question. The journal mentions that you lived with Danish for almost 50 years and that he passed away about five years ago, which suggests you had a long and meaningful life together."}}