Search for tokenize

  1. Other projects
Name Type Location Description
SearchTokenizerTest class drupal/core/modules/search/lib/Drupal/search/Tests/SearchTokenizerTest.php Test the CJK tokenizer.
Twig_Lexer::tokenize function drupal/core/vendor/twig/twig/lib/Twig/Lexer.php Tokenizes a source code.
SearchTokenizerTest.php file drupal/core/modules/search/lib/Drupal/search/Tests/SearchTokenizerTest.php Definition of Drupal\search\Tests\SearchTokenizerTest.
PoHeader::tokenizeFormula function drupal/core/lib/Drupal/Component/Gettext/PoHeader.php Tokenize the formula.
Twig_Environment::tokenize function drupal/core/vendor/twig/twig/lib/Twig/Environment.php Tokenizes a source code.
SearchTokenizerTest::getInfo function drupal/core/modules/search/lib/Drupal/search/Tests/SearchTokenizerTest.php
Twig_LexerInterface::tokenize function drupal/core/vendor/twig/twig/lib/Twig/LexerInterface.php Tokenizes a source code.
SearchTokenizerTest::code2utf function drupal/core/modules/search/lib/Drupal/search/Tests/SearchTokenizerTest.php Like PHP chr() function, but for unicode characters.
StylePluginBase::tokenize_value function drupal/core/modules/views/lib/Drupal/views/Plugin/views/style/StylePluginBase.php Take a value and apply token replacement logic to it.
FieldPluginBase::tokenize_value function drupal/core/modules/views/lib/Drupal/views/Plugin/views/field/FieldPluginBase.php Replace a value with tokens from the last field.
SearchTokenizerTest::testTokenizer function drupal/core/modules/search/lib/Drupal/search/Tests/SearchTokenizerTest.php Verifies that strings of CJK characters are tokenized.
AbstractMessage::getTokenizedHeader function drupal/core/vendor/guzzle/http/Guzzle/Http/Message/AbstractMessage.php Get a tokenized header as a Collection
AbstractMessage::setTokenizedHeader function drupal/core/vendor/guzzle/http/Guzzle/Http/Message/AbstractMessage.php Set a tokenized header on the request that implodes a Collection of data into a string separated by a token.
MessageInterface::getTokenizedHeader function drupal/core/vendor/guzzle/http/Guzzle/Http/Message/MessageInterface.php Get a tokenized header as a Collection
MessageInterface::setTokenizedHeader function drupal/core/vendor/guzzle/http/Guzzle/Http/Message/MessageInterface.php Set a tokenized header on the request that implodes a Collection of data into a string separated by a token.
SearchTokenizerTest::testNoTokenizer function drupal/core/modules/search/lib/Drupal/search/Tests/SearchTokenizerTest.php Verifies that strings of non-CJK characters are not tokenized.
DocLexerTest::testScannerTokenizesDocBlockWhitConstants function drupal/core/vendor/doctrine/common/tests/Doctrine/Tests/Common/Annotations/DocLexerTest.php
DocLexerTest::testScannerTokenizesDocBlockWhitInvalidIdentifier function drupal/core/vendor/doctrine/common/tests/Doctrine/Tests/Common/Annotations/DocLexerTest.php