Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use character classes as word boundaries #34

Open
bentley opened this issue Jun 23, 2015 · 1 comment
Open

Use character classes as word boundaries #34

bentley opened this issue Jun 23, 2015 · 1 comment

Comments

@bentley
Copy link
Collaborator

bentley commented Jun 23, 2015

In current nvi, ‘w’ is not that useful in Japanese text, because it considers a long sentence written without spaces as a single word.

In the old nvi-m17n, ‘w’ moved along katakana/hiragana/kanji boundaries (so, for instance, “本日は晴天なり” would be treated as words “本日” “は” “晴天” “なり”). This is also how Xterm handles word selection; see Xterm’s charclass.c. I’ve been told by a Japanese nvi user that this is behavior he misses from nvi-m17n.

It would be useful to break along character class boundaries like this.

@lichray
Copy link
Owner

lichray commented Jun 23, 2015

Yes. And by relying on the Unicode information, we can also eliminate the platform differences on locale. Currently we have some code to get the Unicode codepoint

int uc = -1;
, but only used to display Unicode escape sequences.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants