Skip to content

Conversation

@Boshen
Copy link
Owner

@Boshen Boshen commented Dec 9, 2025

No description provided.

Add a utility function that uses simdutf8 for UTF-8 validation, which is faster than std::str::from_utf8 used by fs::read_to_string. Replace all existing fs::read_to_string calls with the new util::read_to_string function.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Sonnet 4.5 <[email protected]>
@Boshen Boshen changed the title Use simdutf8 for faster file reading perf: Use simdutf8 for faster file reading Dec 9, 2025
@Boshen Boshen merged commit 7d940b0 into main Dec 9, 2025
1 check passed
@Boshen Boshen deleted the simdutf8-perf branch December 9, 2025 03:08
@Boshen Boshen mentioned this pull request Dec 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants