Try it: every question we asked

XERJ and ReMe, question by question

QuestionAnswerXERJ BM25XERJ hybridReMe defaultReMe hybrid
Does Dana prefer pnpm or npm?pnpm1111
What is the main database for Lark?PostgreSQL1111
What is Dana allergic to?peanuts1111
Which region does the staging cluster run in?eu-west-31111
What is Lark's frontend written in?Svelte1111
Where does error tracking for Lark go?Sentry1111
What is Dana's cat named?Biscuit1111
How fast must the test suite finish?12 minutes1111
What does the billing service use for card payments?Stripe1111
What is the Lark mobile app built with?Flutter1111
What is the Lark design system called?Pebble1111
Where are Lark's public docs hosted?Mintlify1111
What is the analytics warehouse?ClickHouse1111
What is the support inbox address?help@lark.example1111
Which day does Dana's daughter Mia have swim practice?Wednesdays1111
What is the load balancer in front of Lark?HAProxy1111
What do background jobs run on?Sidekiq1111
What is Dana's GitHub handle?dana-codes1111
What is the Redis cache TTL?300 seconds1111
What is the Slack channel for incidents?lark-fire1111
Where are secrets stored?Vault1111
What is transactional email sent through?Postmark1111
What is the monorepo built with?Turborepo1111
When do database backups run?02:001111
What is Lark's mascot?Hugo1111
Which package manager should I use for JS work?pnpmmiss2miss2
Does she have any food intolerance I should know about before ordering lunch?peanutsmiss1miss1
Who is the boss Dana answers to?Tomas3missmiss5
Which UI framework powers the web client?Sveltemissmissmissmiss
Where do crash reports and exceptions end up?Sentrymiss1miss1
What is the name of her pet?Biscuitmiss1miss2
How does Dana take her coffee?oat milkmiss3missmiss
Which company handles credit card charges?Stripe1111
What computer does she use at the office?ThinkPadmiss5miss2
Which toolkit was used for the iOS and Android client?Fluttermiss2miss1
What style should git log entries follow?imperativemiss5miss5
Which language does Dana like coding in most?Rust1111
Is there a legal rule about where user records may be kept?inside the EUmiss1miss1
What sport does Dana's kid do midweek?swimmiss2missmiss
How long should a call with Dana be?25 minutesmiss5miss3
Does Dana eat meat?vegetarian1121
Which human languages does the product UI support?Portuguesemiss5miss3
Where do we keep passwords and API tokens?Vaultmiss2miss4
What exercise does she do at the weekend?10kmiss4miss2
Which tool maps the JavaScript backends to SQL tables?Prismamissmissmissmiss
How quickly should a pull request get feedback?same daymissmissmissmiss
What bird represents the brand?heronmiss3miss1
Which city is home to Dana's sibling?Portomiss3miss1
How slow may search get for the slowest one in twenty requests?200 ms1152
Under which open source terms is the code published?MPL-2.01111
What port does the Lark API listen on in production?94432, old first2, old first2, old first2, old first
Which day does Dana's team deploy to production?Tuesdays1111
Who is Dana's manager?Tomasmissmissmiss4, old first
What code editor does Dana use?Zed2, old first2, old first2, old first2, old first
Where does the Lark CI pipeline run?GitHub Actions2, old first2, old first2, old first2, old first
What is Lark's search feature backed by?Typesense2, old first2, old first2, old first2, old first
Where are feature flags managed?Unleash2, old first2, old first2, old first2, old first
How long are application logs retained?90 days4, old first3, old first4, old first2, old first
What timezone does Dana work on?Berlin3, old first2, old firstmiss2, old first
When do auth JWTs expire?60 minutes1111
What do Lark's Python services use for dependency management?uv2, old first2, old first2, old first2, old first
When is the Lark 2.0 launch?April 22, old first2, old first12, old first
Which floor is Dana's desk on?3rd floor2, old first2, old first2, old first2, old first
What is the Lark API rate limit per key?12002, old first2, old first2, old first2, old first
Which Kubernetes version runs in production?1.332, old first2, old first2, old first2, old first
What is the staging database for Lark?MySQL1111
Which package manager does Dana's brother prefer?yarn2224
What port does the internal admin API listen on?70011111
Which day does the marketing website deploy?Fridays1111
What is Priya's cat named?Pixel1111
How long are search query logs retained?7 days1111
What is the mobile app's rate limit?100 requests1111
What does the data team use for local analysis?DuckDB1111
What was Dana's old personal laptop?MacBook1111
Which street is Mia's school on?Rua das Flores1111
Runs in your browser and sends nothing. Each cell is the rank of the first returned memory that holds the answer, or miss if none of the top 5 does. "old first" means the old value of a changed fact ranked above the new one. From out/per_question.csv in benchmarks/agent-memory.