function SearchTokenizerTest::testNoTokenizer

Verifies that strings of non-CJK characters are not tokenized.

This is just a sanity check - it verifies that strings of letters are not tokenized.

File

core/modules/search/tests/src/Kernel/SearchTokenizerTest.php, line 125

Class

SearchTokenizerTest

Tests that CJK tokenizer works as intended.

Namespace

Code

public function testNoTokenizer() : void {
  // Set the minimum word size to 1 (to split all CJK characters) and make
  // sure CJK tokenizing is turned on.
  $this->config('search.settings')
    ->set('index.minimum_word_size', 1)
    ->set('index.overlap_cjk', TRUE)
    ->save();
  $letters = 'abcdefghijklmnopqrstuvwxyz';
  $text_processor = \Drupal::service('search.text_processor');
  assert($text_processor instanceof SearchTextProcessorInterface);
  $out = trim($text_processor->analyze($letters));
  $this->assertEquals($letters, $out, 'Letters are not CJK tokenized');
}