[MDEV-11777] REGEXP_REPLACE converts utf8mb4 supplementary characters to '?' - Jira

XML

Word

Printable

Details

Type: Bug
Status: Closed (View Workflow)
Priority: Major
Resolution: Fixed
Affects Version/s: 10.1(EOL), 10.2(EOL), 10.3(EOL), 10.4(EOL), 10.5, 10.6
Fix Version/s: 10.6.17, 10.11.7, 11.0.5, 11.1.4, 11.2.3
Component/s: Character Sets
Labels:
None

Description

The REGEXP_REPLACE function converts supplementary characters (4 byte utf8 encoding) into "?" when the charset is utf8mb4.

Due to JIRA not allowing supplementary utf8 characters in the issue description, I have used the CAST/UNHEX of the smiley character, but the actual value should be _utf8mb4'<emoji>'.

SELECT REGEXP_REPLACE(CAST(UNHEX('F09F9881') AS CHAR CHARACTER SET 'utf8mb4'), _utf8mb4'a', _utf8mb4'b') AS Text;

Expected output: "<emoji>"
Actual output: "?"

Attachments

Issue Links

relates to

MDEV-32904 smiley emoji (F09F9883) valid in utf8 but not utf8mb4

Closed

MDEV-34012 Regular expression queries containing 4-byte multicharacters result in an error.

Closed

Activity

People

Assignee:: Sergei Golubchik

Reporter:: Pim Broekhof

Votes:: 3 Vote for this issue

Watchers:: 10 Start watching this issue

Dates

Created:: 2017-01-11 10:59

Updated:: 2024-04-27 10:36

Resolved:: 2024-01-09 20:15

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.