How a Sort Key Redesign Cut Sponsored Campaign API Latency by 10x
p99 latency before and after the sort key redesign.
The Problem The Sponsored Campaign API serves boost scores for sponsored partners on a food delivery marketplace. Every time a consumer searches for restaurants on the app, the API is called with a list of partner IDs from the search results page (SERP) and needs to return which of those partners are running a sponsored campaign and what their boost score is. This needs to happen in single-digit milliseconds at high throughput across multiple markets.
...