Try it: every question we asked

XERJ and agentmemory, question by question

QuestionAnswerXERJ BM25XERJ hybridagentmemory
Does Dana prefer pnpm or npm?pnpm111
What is the main database for Lark?PostgreSQL111
What is Dana allergic to?peanuts111
Which region does the staging cluster run in?eu-west-3111
What is Lark's frontend written in?Svelte111
Where does error tracking for Lark go?Sentry111
What is Dana's cat named?Biscuit111
How fast must the test suite finish?12 minutes111
What does the billing service use for card payments?Stripe111
What is the Lark mobile app built with?Flutter111
What is the Lark design system called?Pebble111
Where are Lark's public docs hosted?Mintlify111
What is the analytics warehouse?ClickHouse111
What is the support inbox address?help@lark.example111
Which day does Dana's daughter Mia have swim practice?Wednesdays111
What is the load balancer in front of Lark?HAProxy111
What do background jobs run on?Sidekiq111
What is Dana's GitHub handle?dana-codes111
What is the Redis cache TTL?300 seconds111
What is the Slack channel for incidents?lark-fire111
Where are secrets stored?Vault111
What is transactional email sent through?Postmark111
What is the monorepo built with?Turborepo111
When do database backups run?02:00111
What is Lark's mascot?Hugo111
Which package manager should I use for JS work?pnpmmiss24
Does she have any food intolerance I should know about before ordering lunch?peanutsmiss1miss
Who is the boss Dana answers to?Tomas3missmiss
Which UI framework powers the web client?Sveltemissmissmiss
Where do crash reports and exceptions end up?Sentrymiss1miss
What is the name of her pet?Biscuitmiss13
How does Dana take her coffee?oat milkmiss3miss
Which company handles credit card charges?Stripe112
What computer does she use at the office?ThinkPadmiss5miss
Which toolkit was used for the iOS and Android client?Fluttermiss2miss
What style should git log entries follow?imperativemiss5miss
Which language does Dana like coding in most?Rust111
Is there a legal rule about where user records may be kept?inside the EUmiss1miss
What sport does Dana's kid do midweek?swimmiss2miss
How long should a call with Dana be?25 minutesmiss5miss
Does Dana eat meat?vegetarian112
Which human languages does the product UI support?Portuguesemiss5miss
Where do we keep passwords and API tokens?Vaultmiss2miss
What exercise does she do at the weekend?10kmiss4miss
Which tool maps the JavaScript backends to SQL tables?Prismamissmissmiss
How quickly should a pull request get feedback?same daymissmissmiss
What bird represents the brand?heronmiss3miss
Which city is home to Dana's sibling?Portomiss3miss
How slow may search get for the slowest one in twenty requests?200 ms111
Under which open source terms is the code published?MPL-2.0111
What port does the Lark API listen on in production?94432, old first2, old first2, old first
Which day does Dana's team deploy to production?Tuesdays111
Who is Dana's manager?Tomasmissmissmiss
What code editor does Dana use?Zed2, old first2, old first2, old first
Where does the Lark CI pipeline run?GitHub Actions2, old first2, old first2, old first
What is Lark's search feature backed by?Typesense2, old first2, old first2, old first
Where are feature flags managed?Unleash2, old first2, old first2, old first
How long are application logs retained?90 days4, old first3, old first3, old first
What timezone does Dana work on?Berlin3, old first2, old first2, old first
When do auth JWTs expire?60 minutes111
What do Lark's Python services use for dependency management?uv2, old first2, old first2, old first
When is the Lark 2.0 launch?April 22, old first2, old first2, old first
Which floor is Dana's desk on?3rd floor2, old first2, old first2, old first
What is the Lark API rate limit per key?12002, old first2, old first2, old first
Which Kubernetes version runs in production?1.332, old first2, old first2, old first
What is the staging database for Lark?MySQL111
Which package manager does Dana's brother prefer?yarn221
What port does the internal admin API listen on?7001111
Which day does the marketing website deploy?Fridays111
What is Priya's cat named?Pixel111
How long are search query logs retained?7 days111
What is the mobile app's rate limit?100 requests111
What does the data team use for local analysis?DuckDB111
What was Dana's old personal laptop?MacBook111
Which street is Mia's school on?Rua das Flores111
Runs in your browser and sends nothing. Each cell is the rank of the first returned memory that holds the answer, or miss if none of the top 5 does. "old first" means the old value of a changed fact ranked above the new one. From out/per_question.csv in benchmarks/agent-memory.