[MDEV-21260] MariadDB on Windows (datadir as network resource) - Jira

Kai Klueber created issue - 2019-12-09 16:02

Kai Klueber made changes - 2019-12-09 16:03

Field	Original Value	New Value
Description	We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path) Our configuration: --------------------------------------------------------------------- [mysqld] datadir = //STA-WS001/MariaDBData/Data port = 3306 innodb_buffer_pool_size = 2033M character-set-server = utf8 [client] port = 3306 plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin --------------------------------------------------------------------- The mariadb-error-log shows the following entries as soon a new table is created ("CREATE TABLE ..."): 2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified. 2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203. 2019-12-09 15:32:39 36 [ERROR] InnoDB: Table `mysql`.`innodb_table_stats` not found. If we set "innodb_file_per_table = OFF" the problem is not showing up.	We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path) Our configuration: --------------------------------------------------------------------- [mysqld] datadir = //STA-WS001/MariaDBData/Data port = 3306 innodb_buffer_pool_size = 2033M character-set-server = utf8 [client] port = 3306 plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin --------------------------------------------------------------------- The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."): 2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified. 2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203. 2019-12-09 15:32:39 36 [ERROR] InnoDB: Table `mysql`.`innodb_table_stats` not found. If we set "innodb_file_per_table = OFF" the problem is not showing up.

Kai Klueber made changes - 2019-12-09 16:17

Description

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------

The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):

2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.
2019-12-09 15:32:39 36 [ERROR] InnoDB: Table `mysql`.`innodb_table_stats` not found.

If we set "innodb_file_per_table = OFF" the problem is not showing up.

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------

The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):

2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.

If we set "innodb_file_per_table = OFF" the problem is not showing up.

Kai Klueber made changes - 2019-12-09 16:19

Description

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------

The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):

2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.

If we set "innodb_file_per_table = OFF" the problem is not showing up.

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------

The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):

2019-12-09 16:20:30 36 [ERROR] InnoDB: Operating system error number 3 in a file operation.
2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.

If we set "innodb_file_per_table = OFF" the problem is not showing up.

Kai Klueber made changes - 2019-12-09 16:21

Description

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------

The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):

2019-12-09 16:20:30 36 [ERROR] InnoDB: Operating system error number 3 in a file operation.
2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.

If we set "innodb_file_per_table = OFF" the problem is not showing up.

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------

The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):

2019-12-09 16:20:30 36 [ERROR] InnoDB: Operating system error number 3 in a file operation.
2019-12-09 16:20:30 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 16:20:30 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.

If we set "innodb_file_per_table = OFF" the problem is not showing up.

Anel Husakovic made changes - 2019-12-09 16:22

Description

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------

The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):

2019-12-09 16:20:30 36 [ERROR] InnoDB: Operating system error number 3 in a file operation.
2019-12-09 16:20:30 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 16:20:30 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.

If we set "innodb_file_per_table = OFF" the problem is not showing up.

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
{code: noformat}
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------
{code}
The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):
{code:noformat}
2019-12-09 16:20:30 36 [ERROR] InnoDB: Operating system error number 3 in a file operation.
2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.
{code}
If we set "innodb_file_per_table = OFF" the problem is not showing up.

Kai Klueber made changes - 2019-12-09 17:01

Description

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
{code: noformat}
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------
{code}
The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):
{code:noformat}
2019-12-09 16:20:30 36 [ERROR] InnoDB: Operating system error number 3 in a file operation.
2019-12-09 15:32:39 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 15:32:39 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.
{code}
If we set "innodb_file_per_table = OFF" the problem is not showing up.

We run MariaDB 10.4.8 with the parameter datadir as network resource (UNC-Path)

Our configuration:
{code: noformat}
---------------------------------------------------------------------
[mysqld]
datadir = //STA-WS001/MariaDBData/Data
port = 3306
innodb_buffer_pool_size = 2033M
character-set-server = utf8
[client]
port = 3306
plugin-dir = C:/Program Files/MariaDB 10.4/lib/plugin
---------------------------------------------------------------------
{code}
The mariadb-error-log shows the following entries as soon a new InnoDB-table is created ("CREATE TABLE ..."):
{code:noformat}
2019-12-09 16:20:30 36 [ERROR] InnoDB: Operating system error number 3 in a file operation.
2019-12-09 16:20:30 36 [ERROR] InnoDB: The error means the system cannot find the path specified.
2019-12-09 16:20:30 36 [ERROR] InnoDB: File \\.\\\STA-WS001\MariaDBData: 'CreateFile()' returned OS error 203.
{code}
If we set "innodb_file_per_table = OFF" the problem is not showing up.

Vladislav Vaintroub added a comment - 2019-12-10 21:13 - edited

An easy workaround seem to be to create a symbolic link (with mklink) pointing to the UNC path, and use it as datadir.

Can you attach the full error log , please? Just for my curiosity, why would you use remote SMB pathfor the database? That seems a lot of network and SMB overhead, for every IO

Vladislav Vaintroub added a comment - 2019-12-10 21:13 - edited An easy workaround seem to be to create a symbolic link (with mklink) pointing to the UNC path, and use it as datadir. Can you attach the full error log , please? Just for my curiosity, why would you use remote SMB pathfor the database? That seems a lot of network and SMB overhead, for every IO

Vladislav Vaintroub made changes - 2019-12-11 23:46

Priority

Blocker [ 1 ]

Major [ 3 ]

Vladislav Vaintroub added a comment - 2019-12-11 23:54

I'm able to actually start database, if I put files on (local) share.
Yes there is a couple of ERRORs that should be better WARNINGs, but it starts ok, and I'm able to create tables, insert data, etc.
kaiklue, why do you think it deserved a "Blocker" status? Do I miss anything, something else does not work, apart from extra messages?
I downgraded its prio for the time being, until there is an explanation

This is what I got.

2019-12-12  0:44:29 0 [Note] Plugin 'FEEDBACK' is disabled.

2019-12-12  0:44:29 0 [Note] InnoDB: Loading buffer pool(s) from \\workpc\work\10.4\xxx\sql\data\ib_buffer_pool

2019-12-12  0:44:29 0 [ERROR] InnoDB: Operating system error number 3 in a file operation.

2019-12-12  0:44:29 0 [ERROR] InnoDB: The error means the system cannot find the path specified.

2019-12-12  0:44:29 0 [Note] Server socket created on IP: '::'.

2019-12-12  0:44:29 0 [ERROR] InnoDB: File \\.\\\workpc\work: 'CreateFile()' returned OS error 203.

2019-12-12  0:44:29 0 [ERROR] InnoDB: Operating system error number 3 in a file operation.

2019-12-12  0:44:29 0 [ERROR] InnoDB: The error means the system cannot find the path specified.

2019-12-12  0:44:29 0 [ERROR] InnoDB: File \\.\\\workpc\work: 'CreateFile()' returned OS error 203.

2019-12-12  0:44:29 0 [Note] InnoDB: Buffer pool(s) load completed at 191212  0:44:29

2019-12-12  0:44:29 0 [Note] Reading of all Master_info entries succeeded

2019-12-12  0:44:29 0 [Note] Added new Master_info '' to hash table

2019-12-12  0:44:29 0 [Note] mysqld: ready for connections.

Version: '10.4.11-MariaDB-debug'  socket: ''  port: 3306  Source distribution

Vladislav Vaintroub added a comment - 2019-12-11 23:54 I'm able to actually start database, if I put files on (local) share. Yes there is a couple of ERRORs that should be better WARNINGs, but it starts ok, and I'm able to create tables, insert data, etc. kaiklue , why do you think it deserved a "Blocker" status? Do I miss anything, something else does not work, apart from extra messages? I downgraded its prio for the time being, until there is an explanation This is what I got. 2019-12-12 0:44:29 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-12 0:44:29 0 [Note] InnoDB: Loading buffer pool(s) from \\workpc\work\10.4\xxx\sql\data\ib_buffer_pool 2019-12-12 0:44:29 0 [ERROR] InnoDB: Operating system error number 3 in a file operation. 2019-12-12 0:44:29 0 [ERROR] InnoDB: The error means the system cannot find the path specified. 2019-12-12 0:44:29 0 [Note] Server socket created on IP: '::'. 2019-12-12 0:44:29 0 [ERROR] InnoDB: File \\.\\\workpc\work: 'CreateFile()' returned OS error 203. 2019-12-12 0:44:29 0 [ERROR] InnoDB: Operating system error number 3 in a file operation. 2019-12-12 0:44:29 0 [ERROR] InnoDB: The error means the system cannot find the path specified. 2019-12-12 0:44:29 0 [ERROR] InnoDB: File \\.\\\workpc\work: 'CreateFile()' returned OS error 203. 2019-12-12 0:44:29 0 [Note] InnoDB: Buffer pool(s) load completed at 191212 0:44:29 2019-12-12 0:44:29 0 [Note] Reading of all Master_info entries succeeded 2019-12-12 0:44:29 0 [Note] Added new Master_info '' to hash table 2019-12-12 0:44:29 0 [Note] mysqld: ready for connections. Version: '10.4.11-MariaDB-debug' socket: '' port: 3306 Source distribution

Vladislav Vaintroub made changes - 2019-12-12 10:52

Assignee

Vladislav Vaintroub [ wlad ]

Vladislav Vaintroub made changes - 2019-12-12 10:52

Component/s	Data Definition - Create Table [ 14503 ]
Fix Version/s		10.4.12 [ 24019 ]
Resolution		Fixed [ 1 ]
Status	Open [ 1 ]	Closed [ 6 ]

Vladislav Vaintroub made changes - 2019-12-12 10:53

Priority

Major [ 3 ]

Minor [ 4 ]

Kai Klueber made changes - 2019-12-12 12:04

Attachment

errorlog.txt [ 49656 ]

Kai Klueber made changes - 2019-12-12 12:06

Attachment

errorlog.txt [ 49656 ]

Kai Klueber made changes - 2019-12-12 12:06

Attachment

errorlog.txt [ 49657 ]

Kai Klueber added a comment - 2019-12-12 12:21

Thanks for the feedback.

I attached the errorlog.

Yes, the database is starting. Removing the status "blocker" is ok.

Can you tell me more about the error and why this error is not cirtical. What is the cause of the error-message?

I noticed that the ticket is now in the status "closed" and that there will be an fix on 10.4.12. Can you tell me more about the fix?

errorlog.txt

Kai Klueber added a comment - 2019-12-12 12:21 Thanks for the feedback. I attached the errorlog. Yes, the database is starting. Removing the status "blocker" is ok. Can you tell me more about the error and why this error is not cirtical. What is the cause of the error-message? I noticed that the ticket is now in the status "closed" and that there will be an fix on 10.4.12. Can you tell me more about the fix? errorlog.txt

Vladislav Vaintroub added a comment - 2019-12-12 12:38 - edited

The Innodb tries to find out what is the sector size on the disk, and whether it is on SSD.
(It is used for optimization, e.g if your disk sectors size and innodb_page_size are both 4K, then doublewrite buffer is not used for writes, because the writes are atomic).

To achieve that, Innodb tries to open the volume where file is on (which would be like, C:\ for datadir on local disk). But for the UNC, it can't, thus the error message.

But there is no big tragedy, if it can't find out about sector size or SSD, then it falls back to defaults.
I just suppressed the error message, for the UNC, because it does not make much sense to present it, error should only be written for real problems, which is here not the case.

Vladislav Vaintroub added a comment - 2019-12-12 12:38 - edited The Innodb tries to find out what is the sector size on the disk, and whether it is on SSD. (It is used for optimization, e.g if your disk sectors size and innodb_page_size are both 4K, then doublewrite buffer is not used for writes, because the writes are atomic). To achieve that, Innodb tries to open the volume where file is on (which would be like, C:\ for datadir on local disk). But for the UNC, it can't, thus the error message. But there is no big tragedy, if it can't find out about sector size or SSD, then it falls back to defaults. I just suppressed the error message, for the UNC, because it does not make much sense to present it, error should only be written for real problems, which is here not the case.

Kai Klueber added a comment - 2019-12-12 13:04

Thanks for the detailed explanation

Kai Klueber added a comment - 2019-12-12 13:04 Thanks for the detailed explanation

Sergei Golubchik made changes - 2021-12-06 21:50

Workflow

MariaDB v3 [ 101744 ]

MariaDB v4 [ 157074 ]

MariaDB Server

MariadDB on Windows (datadir as network resource)

Details

Description

Attachments

Attachments

Activity

People

Dates

Git Integration