Dataimport handler for Sunburnt Solr python library

Dataimport handler

I had to trigger the dataimporter delta-import command from the code so I added support for this function.

Example:

from sunburnt import SolrInterface
SOLR_URL = 'http://some.url:8983/solr/'
_s = SolrInterface(SOLR_URL)
_s.dataimport('delta-import')
_response = _s.dataimport('status')
print _response.import_status
print _response.import_status.time_taken

from sunburnt import SolrInterface

SOLR_URL = 'http://some.url:8983/solr/'

_s = SolrInterface(SOLR_URL)

_s.dataimport('delta-import')

_response = _s.dataimport('status')

print _response.import_status

print _response.import_status.time_taken

Following properties are available in the SolrImportStatus (_response.import_status) object:

    markers = [
        ('Total Requests made to DataSource', 'requests'),
        ('Total Rows Fetched', 'rows_fetched'),
        ('Total Documents Skipped', 'docs_skipped'),
        ('Full Dump Started', 'full_started'),
        ('Delta Dump started', 'delta_started'),
        ('Committed', 'committed'),
        ('Optimized', 'optimized'),
        ('Total Changed Documents', 'docs_changed'),
        ('Total Documents Processed', 'docs_processed'),
        ('Time taken ', 'time_taken'),
    ]

markers = [

('Total Requests made to DataSource', 'requests'),

('Total Rows Fetched', 'rows_fetched'),

('Total Documents Skipped', 'docs_skipped'),

('Full Dump Started', 'full_started'),

('Delta Dump started', 'delta_started'),

('Committed', 'committed'),

('Optimized', 'optimized'),

('Total Changed Documents', 'docs_changed'),

('Total Documents Processed', 'docs_processed'),

('Time taken ', 'time_taken'),

]

Source code can be found on my github page: https://github.com/charlesnagy/sunburnt

You might like these too

Stream cypher (encrypt) with digital envelope in P... Generating. storing and keeping inventory of hundreds of terabyte large database backups is a challenge by itself which we do on daily basis. It's eve...

Sunburnt Solr spatial filter support I've added spatial filtering to the sunburnt library. The feature is now available with filter_spatial function. Example usage Currently this will...

BitTornado library forked by me on GitHub I just forked and committed some patches to the BitTornado library on GitHub. https://github.com/charlesnagy/BitTornado Right now I only committ...

Dataimport handler for Sunburnt Solr python library