function SearchTokenizerTest::testNoTokenizer

Verifies that strings of non-CJK characters are not tokenized.

This is just a sanity check - it verifies that strings of letters are not tokenized.

File

drupal/core/modules/search/lib/Drupal/search/Tests/SearchTokenizerTest.php, line 118

Definition of Drupal\search\Tests\SearchTokenizerTest.

Class

SearchTokenizerTest

Test the CJK tokenizer.

Namespace

Code

function testNoTokenizer() {

  // Set the minimum word size to 1 (to split all CJK characters) and make
  // sure CJK tokenizing is turned on.
  config('search.settings')
    ->set('minimum_word_size', 1)
    ->set('overlap_cjk', TRUE)
    ->save();
  $this
    ->refreshVariables();
  $letters = 'abcdefghijklmnopqrstuvwxyz';
  $out = trim(search_simplify($letters));
  $this
    ->assertEqual($letters, $out, 'Letters are not CJK tokenized');
}