Dataimport handler for Sunburnt Solr python library

Dataimport handler

I had to trigger the dataimporter delta-import command from the code so I added support for this function.

Example:

from sunburnt import SolrInterface
SOLR_URL = 'http://some.url:8983/solr/'
_s = SolrInterface(SOLR_URL)
_s.dataimport('delta-import')
_response = _s.dataimport('status')
print _response.import_status
print _response.import_status.time_taken

from sunburnt import SolrInterface

SOLR_URL = 'http://some.url:8983/solr/'

_s = SolrInterface(SOLR_URL)

_s.dataimport('delta-import')

_response = _s.dataimport('status')

print _response.import_status

print _response.import_status.time_taken

Following properties are available in the SolrImportStatus (_response.import_status) object:

    markers = [
        ('Total Requests made to DataSource', 'requests'),
        ('Total Rows Fetched', 'rows_fetched'),
        ('Total Documents Skipped', 'docs_skipped'),
        ('Full Dump Started', 'full_started'),
        ('Delta Dump started', 'delta_started'),
        ('Committed', 'committed'),
        ('Optimized', 'optimized'),
        ('Total Changed Documents', 'docs_changed'),
        ('Total Documents Processed', 'docs_processed'),
        ('Time taken ', 'time_taken'),
    ]

markers = [

('Total Requests made to DataSource', 'requests'),

('Total Rows Fetched', 'rows_fetched'),

('Total Documents Skipped', 'docs_skipped'),

('Full Dump Started', 'full_started'),

('Delta Dump started', 'delta_started'),

('Committed', 'committed'),

('Optimized', 'optimized'),

('Total Changed Documents', 'docs_changed'),

('Total Documents Processed', 'docs_processed'),

('Time taken ', 'time_taken'),

]

Source code can be found on my github page: https://github.com/charlesnagy/sunburnt

You might like these too

Sunburnt Solr spatial filter support I've added spatial filtering to the sunburnt library. The feature is now available with filter_spatial function. Example usage Currently this will...

Python MySQLdb vs mysql-connector query performanc... There are a lot of python driver available for MySQL and two stand out the most. The one, traditionally everybody's choice, sort of industrial standar...

Priority queue in Redis aka ZPOP Redis list is great to use it as a processing queue. So great that it sort of became the standard and many people using that instead of dedicated queu...

Dataimport handler for Sunburnt Solr python library