Bureaucrats, editor, reviewer, Administrators
13,554
edits
Changes
Jump to navigation
Jump to search
→Indexes
the compiler a second chance and try different rewritings of the same query.
==IndexesOptions==
To support a wide variety of scenarios, the available full-text index can handle different
combinations of the match options defined in the XQuery Full Text Recommendation.
The following indexing options are available:
* '''Language''': language-specific parsers wil be used; this option affects tokenization and stemming (if enabled). BaseX comes with built-in support for English and German. Additionally, other languages can be supported using stemmers from [http://lucene.apache.org/java/docs/index.html Lucene[#Languages|see below] or [http://snowball.tartarus.org Snowball]. If the corresponding JARs or classes are in the Java class-path, BaseX will automatically make use of them for more details (<code>SET LANGUAGE DEEN</code>)
* '''Support Wildcards''': a trie-based index can be applied to support wildcard searches (<code>SET WILDCARDS ON</code>)
* '''Stemming''': tokens are stemmed with the Porter Stemmer before being indexed (<code>SET STEMMING ON</code>)
//*[text() contains text 'inform']
</pre>
==Languages==
The chosen language determines how the input text is tokenized and stemmed. The basic code base and <code>jar</code> file of BaseX comes with built-in support for English and German. More languages will be supported if the following libraries are found in the classpath (<font color='orangered'>Version 6.8</font>):
* [http://files.basex.org/maven/org/apache/lucene-stemmers/3.4.0/lucene-stemmers-3.4.0.jar lucene-stemmers-3.4.0.jar]: includes Snowball and Lucene stemmers and extends language support to the following languages: Arabic, Bulgarian, Catalan, Czech, Danish, Dutch, Finnish, French, Hindi, Hungarian, Italian, Latvian, Lithuanian, Norwegian, Portuguese, Romanian, Russian, Spanish, Swedish, Turkish.
* [http://en.sourceforge.jp/projects/igo/releases/ igo-0.4.3.jar]: includes a tokenizer for Japanese texts. In addition to the library, the file [http://files.basex.org/etc/ipadic.zip ipadic.zip] must either be unzipped in the current directory, or in the project’s [[Configuration#Home Directory|Home Directory]. Thank you [http://blog.infinite.jp Toshio HIRAI] for integrating the lexer into BaseX!
The JAR files can also be found in the <code>zip</code> and <code>exe</code> distribution files of BaseX.
==Scoring==
