Dataimport handler for Sunburnt Solr python library

Dataimport handler

I had to trigger the dataimporter delta-import command from the code so I added support for this function.

Example:

from sunburnt import SolrInterface
SOLR_URL = 'http://some.url:8983/solr/'
_s = SolrInterface(SOLR_URL)
_s.dataimport('delta-import')
_response = _s.dataimport('status')
print _response.import_status
print _response.import_status.time_taken

from sunburnt import SolrInterface

SOLR_URL = 'http://some.url:8983/solr/'

_s = SolrInterface(SOLR_URL)

_s.dataimport('delta-import')

_response = _s.dataimport('status')

print _response.import_status

print _response.import_status.time_taken

Following properties are available in the SolrImportStatus (_response.import_status) object:

    markers = [
        ('Total Requests made to DataSource', 'requests'),
        ('Total Rows Fetched', 'rows_fetched'),
        ('Total Documents Skipped', 'docs_skipped'),
        ('Full Dump Started', 'full_started'),
        ('Delta Dump started', 'delta_started'),
        ('Committed', 'committed'),
        ('Optimized', 'optimized'),
        ('Total Changed Documents', 'docs_changed'),
        ('Total Documents Processed', 'docs_processed'),
        ('Time taken ', 'time_taken'),
    ]

markers = [

('Total Requests made to DataSource', 'requests'),

('Total Rows Fetched', 'rows_fetched'),

('Total Documents Skipped', 'docs_skipped'),

('Full Dump Started', 'full_started'),

('Delta Dump started', 'delta_started'),

('Committed', 'committed'),

('Optimized', 'optimized'),

('Total Changed Documents', 'docs_changed'),

('Total Documents Processed', 'docs_processed'),

('Time taken ', 'time_taken'),

]

Source code can be found on my github page: https://github.com/charlesnagy/sunburnt

You might like these too

Python MySQLdb vs mysql-connector query performanc... There are a lot of python driver available for MySQL and two stand out the most. The one, traditionally everybody's choice, sort of industrial standar...

Stream cypher (encrypt) with digital envelope in P... Generating. storing and keeping inventory of hundreds of terabyte large database backups is a challenge by itself which we do on daily basis. It's eve...

Python error: AttributeError: __exit__ I just had a 30 minutes worth of debugging on a stupid mistake I made. I wanted to check the free space on the target server before I actually start t...

Dataimport handler for Sunburnt Solr python library