Repository navigation
Conversation
|
This looks good to me. I just want to add that |
|
Here's a list of te reo Māori words which contain tohutō, if you'd like to expand coverage for detecting each of these characters. Macrons are commonly used in other languages also (some examples on Wikipedia).
This covers all five vowels with tohutō (macrons). These are the names of birds of Aotearoa from https://teara.govt.nz/en/nga-manu-birds/print |
|
I have a some worry about, now mb_detect_encoding behavior is different of manual https://www.php.net/manual/en/function.mb-detect-encoding.php .
ex below: $ sapi/cli/php -r 'var_dump(mb_detect_encoding("Total Māori,31.5,33.3,31.8,33,36.4,33.2,33.2", ["Windows-1251", "ISO-8859-1", "UTF-8"]));'
string(12) "Windows-1251"
$ sapi/cli/php -r 'var_dump(mb_detect_encoding("Total Māori,31.5,33.3,31.8,33,36.4,33.2,33.2", ["ISO-8859-1", "UTF-8", "Windows-1251"]));'
string(5) "UTF-8"If these characters consider to binaries, all However, I think that it is good as GH-11908 to me. |
…acrons Among other world languages, the Māori language commonly uses vowels with macrons.
|
I have just adjusted this PR to include detection of text with all lowercase vowels with macron. |
|
Looks like there are no more comments. I'm merging this. |
Closes GH-11908.
Anyone want to review? @kamil-tekiela @iluuu1994 @youkidearitai