New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use SIMD for UTF-8 to UTF-32 conversion #20

Open

christianparpart opened this issue Jul 6, 2021 · 1 comment

Labels

enhancement help wanted

Member

christianparpart commented Jul 6, 2021 •

edited

Loading

And maybe also u8-to-u16.

Get inspired by https://github.com/BobSteagall/utf_utils/blob/master/src/utf_utils.cpp#L1126 to see how he has been doing that.

Non-supported platforms should automatically fall back to the classical algorithm.

Then test if (and if: then how much) the performance gain will be on contour throughout benchmarks.

christianparpart added the enhancement label

Contributor

data-man commented Jul 7, 2021

Just for a record: benchmarks are in my ToDos (using very nice https://github.com/martinus/nanobench).

christianparpart mentioned this issue

Refactor UTF-8 decoding to enable use of SIMD. #23

Closed

9 tasks

christianparpart added the help wanted label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment