Deep page or export part of all of a Solr index efficiently. Requires Solr >= v4.7. For more information, check this blog post.
npm install deep-page
Modify solr_options
and query_options
as needed
sorting_fields
: are fields used to sort the result-set. These fields must include the tie-breaker (see next parameter)
unique_key_breaker
: a unique key field used to tie-break documents that have equal sorting field(s) value(s)
$ deep-page rows total_rows skip output_file
Where:
rows
: number of documents to fetch in each request
total_rows
: total number of documents to fetch
skip
: skip first n documents
output_file
: the file to output the whole result-set
Copyright (c) 2015 BADR Ltd.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.