LongMemEval-S
500 questionsAnswered by gpt-6-luna. Graded by gpt-6.1-sol with LongMemEval's grading prompts.
Each question comes with about 50 past chats with an assistant, around 115,000 tokens. Ormem has to find the right ones itself.
459 of 500 right. Ormem sends about 6,200 tokens of memory per question.