]> git.mjollnir.org Git - moodle.git/commit
First cut of the tokeniser library. Modified from drupal search.module
authorstronk7 <stronk7>
Tue, 12 Jun 2007 18:15:55 +0000 (18:15 +0000)
committerstronk7 <stronk7>
Tue, 12 Jun 2007 18:15:55 +0000 (18:15 +0000)
commit7bb11c76d19d5f3fa70a502bb5bee9259c064d70
tree5437e78b5074a9ee35753f63fee4d4dceacd7192
parentb4892fa2a0c82def298a682f050420082305aaf5
First cut of the tokeniser library. Modified from drupal search.module
code (see copyrights). The library converts any text/html into an array
of tokens with their score (weight). Supports stop_words, cjk basic
tokeniser (for indexers) and different modes of handling numbers.

Merged from MOODLE_18_STABLE
lib/tokeniserlib.php [new file with mode: 0644]