Skip to content

Commit

Permalink
Apply suggestions from code review
Browse files Browse the repository at this point in the history
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
  • Loading branch information
kolchfa-aws and natebower authored Dec 9, 2024
1 parent 70c122b commit 2508dde
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion _analyzers/tokenizers/thai.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ nav_order: 140

# Thai tokenizer

The `thai` tokenizer is designed for tokenizing Thai language text. Because words in Thai language are not separated by spaces, the tokenizer must identify word boundaries based on language-specific rules.
The `thai` tokenizer tokenizes Thai language text. Because words in Thai language are not separated by spaces, the tokenizer must identify word boundaries based on language-specific rules.

## Example usage

Expand Down

0 comments on commit 2508dde

Please sign in to comment.