Index: third_party/sqlite/src/ext/fts3/README.tokenizers |
diff --git a/third_party/sqlite/src/ext/fts3/README.tokenizers b/third_party/sqlite/src/ext/fts3/README.tokenizers |
index e06803acc0599d5636cb062b29e36dc04823daf1..7f2345a81fd0e708fc5c78dfbecc0170a4944f72 100644 |
--- a/third_party/sqlite/src/ext/fts3/README.tokenizers |
+++ b/third_party/sqlite/src/ext/fts3/README.tokenizers |
@@ -11,7 +11,7 @@ |
); |
The built-in tokenizers (valid values to pass as <tokenizer name>) are |
- "simple" and "porter". |
+ "simple", "porter" and "unicode". |
<tokenizer-args> should consist of zero or more white-space separated |
arguments to pass to the selected tokenizer implementation. The |