Dataimport handler for Sunburnt Solr python library

Dataimport handler

I had to trigger the dataimporter delta-import command from the code so I added support for this function.

Example:

from sunburnt import SolrInterface
SOLR_URL = 'http://some.url:8983/solr/'
_s = SolrInterface(SOLR_URL)
_s.dataimport('delta-import')
_response = _s.dataimport('status')
print _response.import_status
print _response.import_status.time_taken

from sunburnt import SolrInterface

SOLR_URL = 'http://some.url:8983/solr/'

_s = SolrInterface(SOLR_URL)

_s.dataimport('delta-import')

_response = _s.dataimport('status')

print _response.import_status

print _response.import_status.time_taken

Following properties are available in the SolrImportStatus (_response.import_status) object:

    markers = [
        ('Total Requests made to DataSource', 'requests'),
        ('Total Rows Fetched', 'rows_fetched'),
        ('Total Documents Skipped', 'docs_skipped'),
        ('Full Dump Started', 'full_started'),
        ('Delta Dump started', 'delta_started'),
        ('Committed', 'committed'),
        ('Optimized', 'optimized'),
        ('Total Changed Documents', 'docs_changed'),
        ('Total Documents Processed', 'docs_processed'),
        ('Time taken ', 'time_taken'),
    ]

markers = [

('Total Requests made to DataSource', 'requests'),

('Total Rows Fetched', 'rows_fetched'),

('Total Documents Skipped', 'docs_skipped'),

('Full Dump Started', 'full_started'),

('Delta Dump started', 'delta_started'),

('Committed', 'committed'),

('Optimized', 'optimized'),

('Total Changed Documents', 'docs_changed'),

('Total Documents Processed', 'docs_processed'),

('Time taken ', 'time_taken'),

]

Source code can be found on my github page: https://github.com/charlesnagy/sunburnt

You might like these too

Python MySQLdb vs mysql-connector query performanc... There are a lot of python driver available for MySQL and two stand out the most. The one, traditionally everybody's choice, sort of industrial standar...

Priority queue in Redis aka ZPOP Redis list is great to use it as a processing queue. So great that it sort of became the standard and many people using that instead of dedicated queu...

Stop using await in a Python forloop Disclaimer: This might sound to be a rant but stay with me and you will see this will be a very good practical advise to speed up your async python c...

Dataimport handler for Sunburnt Solr python library