Solr benchmark – first blood

This is a quick impression about the freshly installed Solr 3.5 server.

Enviroment

The base system is a Amazon Microinstance equivalent virtual machine running on a HP Microserver. The VM has 600MB ram and 8GB HDD.

System info & benchmarks

Solr performance

Full index

The data backend was a Percona MySQL 5.5 server. The indexed database was a webshop with 42k+ items . The full reindex took in average 20-25 secs.

Quick Search

All of the searches finished under 50ms. As a matter of fact 90% of searches was under 30ms. This result was quite impressive. I knew Solr (Lucene) is quick but theoretically it should be slower on a fewer processor with one client. The true strength of Solr is multithreading and parallel processing even under heavy load with more concurrent clients.

Load test

Sawing that results I became curious. If simple query were so quick what would happen under a serious load. So I turned to ab (Apache Benchmark).

Simple query for two keyword. 30 results from 42k set. Apache benchmark results depending on concurrency level.

Concurrency Request Time taken (sec) Request/sec 95% (ms)
5 500 1,176 425,31 25
10 500 1,338 373,83 36
20 500 1,589 314,67 183
40 500 1,543 324,09 143
50 500 1,355 369,07 175
100 500 1,398 357,72 319

Conlcusion: even with 100 concurrent threads the 95% of request was served within 319 microseconds which is a very good result for searches even in big clustered systems. The 300+ requests/sec was amazing because this amount of traffic assumes at least 1M unique visitors and above 10M page impressions / day. If a site would be this popular the owner certainly would have the money for more than a micro instance on Amazon Web Services. But it’s good to know that this would be enough.

You might like these too

Framework comparison (PHP, PERL, Python) My first "program" was a BASIC script on Commode 64. It was able to print some text on the screen twenty times. The text was "Hello world". I copied i...
PERL / Catalyst test and benchmark Initializing First of all I have created the environment for the test. On the previously cloned machine the database has been imported and started. T...
Framework comparison summary To be able to size up an objective summing image I started to build an e-commerce website in all frameworks on the same model. These are my experience...

About charlesnagy

I'm out of many things mostly automation expert, database specialist, system engineer and software architect with passion towards data, searching it, analyze it, learn from it. I learn by experimenting and this blog is a result of these experiments and some other random thought I have time to time.
Bookmark the permalink.