In this presentation, we will cover the basics of LinkedIn’s Search Engine indexing pipeline, focusing on how we leverage Kafka and Samza to ingest over 10K events per second of real time updates. Furthermore, we will examine how we made the system both flexible and horizontally scalable; our pipeline accepts different input system streams and supports both full and partial document updates, but remains agnostic to the type of document (e.g. member profile, job posting or company page).