MySQL 5.6 implemented Unicode support in command line client (mysql.exe).
Earlier mysql.exe versions support only OEM (DOS) locale character set
(e.g. cp850 on a Western machine), which is old fashioned:
it does not support neither Euro sign nor modern punctuation characters.
Isn't the mysql.exe the same? I thought it starts a cmd.exe with unicode support and then calls mysql.exe with default-character-set=utf8 (or mysql.exe detects the unicode support of the cmd.exe and switches automatically).
Please try to use utf8mb4 instead of utf8 when implementing this feature.
There could be more things needed for Unicode support on Windows. With powershell this won't work:
mysqldump.exe -A > dump.sql
mysql.exe < dump.sql
This is because the stream will be converted to utf16 by powershell and mysql.exe can't handle utf16.... https://bugs.mysql.com/bug.php?id=73481 https://bugs.mysql.com/bug.php?id=73672
Daniël van Eeden
added a comment - Isn't the mysql.exe the same? I thought it starts a cmd.exe with unicode support and then calls mysql.exe with default-character-set=utf8 (or mysql.exe detects the unicode support of the cmd.exe and switches automatically).
Please try to use utf8mb4 instead of utf8 when implementing this feature.
There could be more things needed for Unicode support on Windows. With powershell this won't work:
mysqldump.exe -A > dump.sql
mysql.exe < dump.sql
This is because the stream will be converted to utf16 by powershell and mysql.exe can't handle utf16....
https://bugs.mysql.com/bug.php?id=73481
https://bugs.mysql.com/bug.php?id=73672
dveeden, there are various workarounds for powershell to reading the raw input/output redirections, by favorite being prepending command line with "cmd /c "
Vladislav Vaintroub
added a comment - - edited Already solved in MDEV-26713 .
dveeden , there are various workarounds for powershell to reading the raw input/output redirections, by favorite being prepending command line with "cmd /c "
People
Unassigned
Alexander Barkov
Votes:
2Vote for this issue
Watchers:
4Start watching this issue
Dates
Created:
Updated:
Resolved:
Git Integration
Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.
{"report":{"fcp":787.5,"ttfb":240.39999997615814,"pageVisibility":"visible","entityId":22756,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"56b7919e-ebbb-45d4-afa9-876a908ac22f","navigationType":0,"readyForUser":883.6999999284744,"redirectCount":0,"resourceLoadedEnd":525.8999999761581,"resourceLoadedStart":244.60000002384186,"resourceTiming":[{"duration":8.199999928474426,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":244.60000002384186,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":244.60000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":252.79999995231628,"responseStart":0,"secureConnectionStart":0},{"duration":5.699999928474426,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":248.60000002384186,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":248.60000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":254.29999995231628,"responseStart":0,"secureConnectionStart":0},{"duration":165,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":248.79999995231628,"connectEnd":248.79999995231628,"connectStart":248.79999995231628,"domainLookupEnd":248.79999995231628,"domainLookupStart":248.79999995231628,"fetchStart":248.79999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":258.10000002384186,"responseEnd":413.7999999523163,"responseStart":283.60000002384186,"secureConnectionStart":248.79999995231628},{"duration":276.7999999523163,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":249.10000002384186,"connectEnd":249.10000002384186,"connectStart":249.10000002384186,"domainLookupEnd":249.10000002384186,"domainLookupStart":249.10000002384186,"fetchStart":249.10000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":258.39999997615814,"responseEnd":525.8999999761581,"responseStart":315.89999997615814,"secureConnectionStart":249.10000002384186},{"duration":43.200000047683716,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":249.19999992847443,"connectEnd":249.19999992847443,"connectStart":249.19999992847443,"domainLookupEnd":249.19999992847443,"domainLookupStart":249.19999992847443,"fetchStart":249.19999992847443,"redirectEnd":0,"redirectStart":0,"requestStart":258.60000002384186,"responseEnd":292.39999997615814,"responseStart":288.39999997615814,"secureConnectionStart":249.19999992847443},{"duration":43.10000002384186,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":249.39999997615814,"connectEnd":249.39999997615814,"connectStart":249.39999997615814,"domainLookupEnd":249.39999997615814,"domainLookupStart":249.39999997615814,"fetchStart":249.39999997615814,"redirectEnd":0,"redirectStart":0,"requestStart":259,"responseEnd":292.5,"responseStart":289,"secureConnectionStart":249.39999997615814},{"duration":44.10000002384186,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":249.39999997615814,"connectEnd":249.39999997615814,"connectStart":249.39999997615814,"domainLookupEnd":249.39999997615814,"domainLookupStart":249.39999997615814,"fetchStart":249.39999997615814,"redirectEnd":0,"redirectStart":0,"requestStart":263.60000002384186,"responseEnd":293.5,"responseStart":292.7999999523163,"secureConnectionStart":249.39999997615814},{"duration":9.199999928474426,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":249.60000002384186,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":249.60000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":258.7999999523163,"responseStart":0,"secureConnectionStart":0},{"duration":49.5,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":249.60000002384186,"connectEnd":249.60000002384186,"connectStart":249.60000002384186,"domainLookupEnd":249.60000002384186,"domainLookupStart":249.60000002384186,"fetchStart":249.60000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":265.2999999523163,"responseEnd":299.10000002384186,"responseStart":296,"secureConnectionStart":249.60000002384186},{"duration":10.900000095367432,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":249.69999992847443,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":249.69999992847443,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":260.60000002384186,"responseStart":0,"secureConnectionStart":0},{"duration":65.80000007152557,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":249.79999995231628,"connectEnd":249.79999995231628,"connectStart":249.79999995231628,"domainLookupEnd":249.79999995231628,"domainLookupStart":249.79999995231628,"fetchStart":249.79999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":265.60000002384186,"responseEnd":315.60000002384186,"responseStart":299.60000002384186,"secureConnectionStart":249.79999995231628},{"duration":230.60000002384186,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":253.79999995231628,"connectEnd":253.79999995231628,"connectStart":253.79999995231628,"domainLookupEnd":253.79999995231628,"domainLookupStart":253.79999995231628,"fetchStart":253.79999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":282.39999997615814,"responseEnd":484.39999997615814,"responseStart":480.5,"secureConnectionStart":253.79999995231628},{"duration":230.89999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":254,"connectEnd":254,"connectStart":254,"domainLookupEnd":254,"domainLookupStart":254,"fetchStart":254,"redirectEnd":0,"redirectStart":0,"requestStart":285.1999999284744,"responseEnd":484.89999997615814,"responseStart":481.60000002384186,"secureConnectionStart":254},{"duration":72.29999995231628,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":557.6000000238419,"connectEnd":557.6000000238419,"connectStart":557.6000000238419,"domainLookupEnd":557.6000000238419,"domainLookupStart":557.6000000238419,"fetchStart":557.6000000238419,"redirectEnd":0,"redirectStart":0,"requestStart":592.3999999761581,"responseEnd":629.8999999761581,"responseStart":629.1000000238419,"secureConnectionStart":557.6000000238419},{"duration":145.19999992847443,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":781.6000000238419,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":781.6000000238419,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":926.7999999523163,"responseStart":0,"secureConnectionStart":0},{"duration":180.5,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":787.7999999523163,"connectEnd":787.7999999523163,"connectStart":787.7999999523163,"domainLookupEnd":787.7999999523163,"domainLookupStart":787.7999999523163,"fetchStart":787.7999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":930.8999999761581,"responseEnd":968.2999999523163,"responseStart":966.5,"secureConnectionStart":787.7999999523163}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":44,"responseStart":241,"responseEnd":254,"domLoading":244,"domInteractive":930,"domContentLoadedEventStart":930,"domContentLoadedEventEnd":971,"domComplete":1337,"loadEventStart":1337,"loadEventEnd":1338,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":912.3999999761581},{"name":"bigPipe.sidebar-id.end","time":913.1000000238419},{"name":"bigPipe.activity-panel-pipe-id.start","time":913.2999999523163},{"name":"bigPipe.activity-panel-pipe-id.end","time":914.3999999761581},{"name":"activityTabFullyLoaded","time":986.1999999284744}],"measures":[],"correlationId":"b69447239ac9a7","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":103,"dbReadsTimeInMs":11,"dbConnsTimeInMs":18,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Isn't the mysql.exe the same? I thought it starts a cmd.exe with unicode support and then calls mysql.exe with default-character-set=utf8 (or mysql.exe detects the unicode support of the cmd.exe and switches automatically).
Please try to use utf8mb4 instead of utf8 when implementing this feature.
There could be more things needed for Unicode support on Windows. With powershell this won't work:
mysqldump.exe -A > dump.sql
mysql.exe < dump.sql
This is because the stream will be converted to utf16 by powershell and mysql.exe can't handle utf16....
https://bugs.mysql.com/bug.php?id=73481
https://bugs.mysql.com/bug.php?id=73672