Battle for Fast Real-time Document Grouping Using Solr Search Engine - Andrzej Wisłowski, Allegro.pl
Allegro uses Solr as our main search engine. Due to their search engine traffic and index size, they needed to develop custom optimizations. In offer listings, they were supposed to group together offers representing different variants of the same product so that they would be displayed as a single item. Allegro started with configuring built in solr collapsing query parser, but it was not competitive enough so they developed a custom filter and compared its implementations with sorted indexes and priority queue. After a few months they needed to choose the best offer in a group by one sort expression, then finally re-sort the results by the second sort expression. They tried a few approaches, starting with our custom collapser with a defined size priority queue, then grouping a long type field. Finally, we changed built-in Solr collapser plugin, which in their case allowed to decrease query time by 40%. Our improvement was merged into Solr 8.1.
Speaker: Andrzej Wisłowski, Software Engineer, Allegro.pl
ACTIVATE Conference: http://www.activate-conf.com
Lucidworks: http://www.lucidworks.com