Engineering Manager, Search Storage

<div class="content-intro"><div class="c-message_kit__blocks c-message_kit__blocks--rich_text"> <div class="c-message__message_blocks c-message__message_blocks--rich_text" data-qa="message-text"> <div class="p-block_kit_renderer" data-qa="block-kit-renderer"> <div class="p-block_kit_renderer__block_wrapper p-block_kit_renderer__block_wrapper--first"> <div class="p-rich_text_block"> <div class="p-rich_text_section">Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 126 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit <a class="c-link" href="http://www.redditinc.com/" target="_blank" data-stringify-link="http://redditinc.com" data-sk="tooltip_parent">www.redditinc.com</a>.</div> </div> </div> </div> </div> </div></div><p>Search Infrastructure builds and operates the foundational components for platform teams at Reddit to build atop. Our systems satisfy needs ranging from classical ranking/search (<a href="https://en.wikipedia.org/wiki/Okapi_BM25">BM25</a>) to more modern and novel spaces involving <a href="https://en.wikipedia.org/wiki/Vector_database">vector embeddings</a>. We are a team of software and machine learning engineers who build platforms around and evolve technologies including:</p> <ul> <li>Milvus</li> <li>Vespa</li> <li>Solr</li> <li>Kubernetes</li> </ul> <p>Our platform strives to balance reliability, performance, efficiency, and developer productivity, in that order. We offer abstractions that enable our customers to express their needs and transparently map those into underlying infrastructure resources (CPU, memory, architecture, etc). Software engineering is the core of our DNA. We scale the team through automation, self healing, and orchestration.</p> <p>As Reddit’s usage of AI and embedding models grows, conventional databases don’t fit the needs of our scale. This is an opportunity to sit at the cutting edge of this space and help establish the future of Reddit’s search capabilities while maturing a (relatively) newer ecosystem of technologies. These capabilities will post everything from <a href="http://reddit.com">Reddit.com</a>’s search, to Ads Platforms, and many other ranking/relevance use cases.</p> <p>Some Of Our Present And Future Challenges Include:</p> <ul> <li>Scaling search primitives, namely databases, to be secure, highly available, and geo-distributed.</li> <li>Contributing to ecosystems (OSS) involving codebases including Go, Rust, C++, and Java.</li> <li>Managing the full lifecycle of our systems including provisioning, scaling, self healing, and decommissioning via software engineering. </li> </ul> <p><em>Our interfaces are APIs and our operators are code, not humans.</em></p> <ul> <li>Working with and abstracting systems like Milvus, Vespa, and Solr to support key use cases, such as lexical search, semantic search, and relevance/ranking.</li> <li>Running these systems with high-efficiency without sacrificing reliability.</li> </ul> <p><strong>What You’ll Do</strong></p> <ul> <li>Steer: Work with the team to select, scope, and drive high leverage projects that align with Reddit’s goals.</li> <li>Build: Build out your team to execute on a strategy and create more efficient, more reliable Storage systems.</li> <li>Amplify: Mentor your ICs and be a leader for the team.</li> <li>Collaborate: Work together with a variety of teams across Reddit Engineering.</li> <li>Evolve: Learn and improve your own technical and non-technical abilities.</li> </ul> <p><strong>You Have:</strong></p> <ul> <li>3+ years experience in people management of high performing engineering teams.</li> <li>7+ years experience on backend infrastructure with a focus on storage systems. <ul> <li>5+ years of this experience spent in high-scale environments is key. <ul> <li>Reddit’s challenges go beyond building/adopting new tech and often into how we scale them as one of the largest use cases.</li> </ul> </li> <li>Experience in storage systems pertaining to full-text s