[MDEV-12142] server goes down when creating CONNECT table - Jira

Details

Type: Bug
Status: Closed (View Workflow)
Priority: Critical
Resolution: Fixed
Affects Version/s: 10.1.17, 10.1(EOL)
Fix Version/s: 10.1.22, 10.2.5, 10.0.31
Component/s: Storage Engine - Connect
Labels:
None
Environment:
Amazon Linux AMI release 2016.03

Description

I tried to make a CONNECT table to a local CSV file.
The command fails and server goes down every time.
I will attach the csv for reproduction test.

I wanted to set the primary key to the row "zip_code", so the column def was needed beforehand or the command would error.
The CONNECT table works properly only when no column definition is set or all existing columns are defined.
I want to request that PK can be set even where not all columns are known.

MariaDB [(none)]> SET SESSION connect_xtrace=1;

Query OK, 0 rows affected (0.00 sec)

MariaDB [(none)]> show variables like 'connect_xtrace';

+----------------+-------+

| Variable_name  | Value |

+----------------+-------+

| connect_xtrace | 1     |

+----------------+-------+

1 row in set (0.00 sec)

MariaDB [(none)]> use test;

Reading table information for completion of table and column names

You can turn off this feature to get a quicker startup with -A

Database changed

MariaDB [test]> CREATE OR REPLACE TABLE M_Zip (zip_code char(7) character set ascii collate ascii_bin NOT NULL, PRIMARY KEY(zip_code)) ENGINE=CONNECT TABLE_TYPE=CSV FILE_NAME='M_Zip.csv' HEADER=1 SEP_CHAR=',' QUOTED=3;

ERROR 2013 (HY000): Lost connection to MySQL server during query

MariaDB [test]> SHOW CREATE TABLE M_Zip;

ERROR 2006 (HY000): MySQL server has gone away

No connection. Trying to reconnect...

Connection id:    2

Current database: test

+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

| Table | Create Table                                                                                                                                                                                                                               |

+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

| M_Zip | CREATE TABLE `M_Zip` (

  `zip_code` char(7) CHARACTER SET ascii COLLATE ascii_bin NOT NULL,

  PRIMARY KEY (`zip_code`)

) ENGINE=CONNECT DEFAULT CHARSET=utf8 `TABLE_TYPE`=CSV `FILE_NAME`='M_Zip.csv' `HEADER`=1 `SEP_CHAR`=',' `QUOTED`=3 |

+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

1 row in set (0.01 sec)

The report of my.err is below.

New CONNECT 0x7fb0e1add820, table: M_Zip

create: this=0x7fb0e1add820 thd=0x7fb0e3a6e008 xp=0x7fb0e1a7d080 g=0x7fb0e1a69000 sqlcom=1 name=M_Zip

xchk=(nil) createas=0

Getting created index 1 info

XTAB: making new TABLE M_Zip (null)

Getting created index 1 info

GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43

File length=19028

GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43

File length=19028

Estimating lines len=19028 ending=1/nEstimatedLength: Fields=0 Columns=(nil)

avglen=1 MaxSize19028

ColDB: am=34 colname=zip_code tabname=M_Zip num=0

cdp(1).Name=zip_code cp=(nil)

 making new CSVCOL C1 zip_code at 0x7fb047800590

colp=0x7fb047800590

DOS OpenDB: tdbp=0x7fb047800478 tdb=R1 use=2 mode=10

PlugOpenFile: fname=/data/mysql/./test/M_Zip.csv ftype=rb

dbuserp=0x7fb0e182b020

 fop=0x7fb0e182ee80

 fp=0x7fb0478006b0

 returning fop=0x7fb0e182ee80

File /data/mysql/./test/M_Zip.csv open Stream=0x7fb0e182ee80 mode=rb

SubAllocating a buffer of 16 bytes

OpenDos: R1 mode=10 To_Line=0x7fb047800718

File length=19028

ColDB: am=34 colname=zip_code tabname=M_Zip num=0

cdp(1).Name=zip_code cp=0x7fb047800590

colp=0x7fb047800590

File length=19028

Estimating lines len=19028 ending=1/nEstimatedLength: Fields=1 Columns=0x7fb047800590

avglen=1 MaxSize19028

XINDEX Make: n=19028

KCOL(0x7fb047813210) Init: col=zip_code n=19028 type=1 sm=1

AVB: mp=0x7fb047813350 type=1 nval=19028 len=7 check=1 blank=1

170227 19:45:22 mysqld_safe Number of processes running now: 0

170227 19:45:22 mysqld_safe mysqld restarted

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

M_Zip.csv
19 kB
2017-02-27 11:04

Activity

Ascending order - Click to sort in descending order

Takuya Aoki (Inactive) created issue - 2017-02-27 11:05

Takuya Aoki (Inactive) made changes - 2017-02-28 01:18

Field	Original Value	New Value
Description	I tried to make a CONNECT table to a local CSV file. The command fails and server goes down every time. I will attach the csv for reproduction test. {noformat} MariaDB [(none)]> SET SESSION connect_xtrace=1; Query OK, 0 rows affected (0.00 sec) MariaDB [(none)]> show variables like 'connect_xtrace'; +----------------+-------+ \| Variable_name \| Value \| +----------------+-------+ \| connect_xtrace \| 1 \| +----------------+-------+ 1 row in set (0.00 sec) MariaDB [(none)]> use test; Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Database changed MariaDB [test]> CREATE OR REPLACE TABLE M_Zip (zip_code char(7) character set ascii collate ascii_bin NOT NULL, PRIMARY KEY(zip_code)) ENGINE=CONNECT TABLE_TYPE=CSV FILE_NAME='M_Zip.csv' HEADER=1 SEP_CHAR=',' QUOTED=3; ERROR 2013 (HY000): Lost connection to MySQL server during query MariaDB [test]> SHOW CREATE TABLE M_Zip; ERROR 2006 (HY000): MySQL server has gone away No connection. Trying to reconnect... Connection id: 2 Current database: test +-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ \| Table \| Create Table \| +-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ \| M_Zip \| CREATE TABLE `M_Zip` ( `zip_code` char(7) CHARACTER SET ascii COLLATE ascii_bin NOT NULL, PRIMARY KEY (`zip_code`) ) ENGINE=CONNECT DEFAULT CHARSET=utf8 `TABLE_TYPE`=CSV `FILE_NAME`='M_Zip.csv' `HEADER`=1 `SEP_CHAR`=',' `QUOTED`=3 \| +-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 1 row in set (0.01 sec) {noformat} The report of my.err is below. {noformat} New CONNECT 0x7fb0e1add820, table: M_Zip create: this=0x7fb0e1add820 thd=0x7fb0e3a6e008 xp=0x7fb0e1a7d080 g=0x7fb0e1a69000 sqlcom=1 name=M_Zip xchk=(nil) createas=0 Getting created index 1 info XTAB: making new TABLE M_Zip (null) Getting created index 1 info GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43 File length=19028 GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43 File length=19028 Estimating lines len=19028 ending=1/nEstimatedLength: Fields=0 Columns=(nil) avglen=1 MaxSize19028 ColDB: am=34 colname=zip_code tabname=M_Zip num=0 cdp(1).Name=zip_code cp=(nil) making new CSVCOL C1 zip_code at 0x7fb047800590 colp=0x7fb047800590 DOS OpenDB: tdbp=0x7fb047800478 tdb=R1 use=2 mode=10 PlugOpenFile: fname=/data/mysql/./test/M_Zip.csv ftype=rb dbuserp=0x7fb0e182b020 fop=0x7fb0e182ee80 fp=0x7fb0478006b0 returning fop=0x7fb0e182ee80 File /data/mysql/./test/M_Zip.csv open Stream=0x7fb0e182ee80 mode=rb SubAllocating a buffer of 16 bytes OpenDos: R1 mode=10 To_Line=0x7fb047800718 File length=19028 ColDB: am=34 colname=zip_code tabname=M_Zip num=0 cdp(1).Name=zip_code cp=0x7fb047800590 colp=0x7fb047800590 File length=19028 Estimating lines len=19028 ending=1/nEstimatedLength: Fields=1 Columns=0x7fb047800590 avglen=1 MaxSize19028 XINDEX Make: n=19028 KCOL(0x7fb047813210) Init: col=zip_code n=19028 type=1 sm=1 AVB: mp=0x7fb047813350 type=1 nval=19028 len=7 check=1 blank=1 170227 19:45:22 mysqld_safe Number of processes running now: 0 170227 19:45:22 mysqld_safe mysqld restarted {noformat}	I tried to make a CONNECT table to a local CSV file. The command fails and server goes down every time. I will attach the csv for reproduction test. I wanted to set the primary key to the row "zip_code", so the column def was needed beforehand or the command would error. The CONNECT table works properly only when no column definition is made or all columns are defined. {noformat} MariaDB [(none)]> SET SESSION connect_xtrace=1; Query OK, 0 rows affected (0.00 sec) MariaDB [(none)]> show variables like 'connect_xtrace'; +----------------+-------+ \| Variable_name \| Value \| +----------------+-------+ \| connect_xtrace \| 1 \| +----------------+-------+ 1 row in set (0.00 sec) MariaDB [(none)]> use test; Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Database changed MariaDB [test]> CREATE OR REPLACE TABLE M_Zip (zip_code char(7) character set ascii collate ascii_bin NOT NULL, PRIMARY KEY(zip_code)) ENGINE=CONNECT TABLE_TYPE=CSV FILE_NAME='M_Zip.csv' HEADER=1 SEP_CHAR=',' QUOTED=3; ERROR 2013 (HY000): Lost connection to MySQL server during query MariaDB [test]> SHOW CREATE TABLE M_Zip; ERROR 2006 (HY000): MySQL server has gone away No connection. Trying to reconnect... Connection id: 2 Current database: test +-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ \| Table \| Create Table \| +-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ \| M_Zip \| CREATE TABLE `M_Zip` ( `zip_code` char(7) CHARACTER SET ascii COLLATE ascii_bin NOT NULL, PRIMARY KEY (`zip_code`) ) ENGINE=CONNECT DEFAULT CHARSET=utf8 `TABLE_TYPE`=CSV `FILE_NAME`='M_Zip.csv' `HEADER`=1 `SEP_CHAR`=',' `QUOTED`=3 \| +-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 1 row in set (0.01 sec) {noformat} The report of my.err is below. {noformat} New CONNECT 0x7fb0e1add820, table: M_Zip create: this=0x7fb0e1add820 thd=0x7fb0e3a6e008 xp=0x7fb0e1a7d080 g=0x7fb0e1a69000 sqlcom=1 name=M_Zip xchk=(nil) createas=0 Getting created index 1 info XTAB: making new TABLE M_Zip (null) Getting created index 1 info GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43 File length=19028 GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43 File length=19028 Estimating lines len=19028 ending=1/nEstimatedLength: Fields=0 Columns=(nil) avglen=1 MaxSize19028 ColDB: am=34 colname=zip_code tabname=M_Zip num=0 cdp(1).Name=zip_code cp=(nil) making new CSVCOL C1 zip_code at 0x7fb047800590 colp=0x7fb047800590 DOS OpenDB: tdbp=0x7fb047800478 tdb=R1 use=2 mode=10 PlugOpenFile: fname=/data/mysql/./test/M_Zip.csv ftype=rb dbuserp=0x7fb0e182b020 fop=0x7fb0e182ee80 fp=0x7fb0478006b0 returning fop=0x7fb0e182ee80 File /data/mysql/./test/M_Zip.csv open Stream=0x7fb0e182ee80 mode=rb SubAllocating a buffer of 16 bytes OpenDos: R1 mode=10 To_Line=0x7fb047800718 File length=19028 ColDB: am=34 colname=zip_code tabname=M_Zip num=0 cdp(1).Name=zip_code cp=0x7fb047800590 colp=0x7fb047800590 File length=19028 Estimating lines len=19028 ending=1/nEstimatedLength: Fields=1 Columns=0x7fb047800590 avglen=1 MaxSize19028 XINDEX Make: n=19028 KCOL(0x7fb047813210) Init: col=zip_code n=19028 type=1 sm=1 AVB: mp=0x7fb047813350 type=1 nval=19028 len=7 check=1 blank=1 170227 19:45:22 mysqld_safe Number of processes running now: 0 170227 19:45:22 mysqld_safe mysqld restarted {noformat}

Takuya Aoki (Inactive) made changes - 2017-02-28 01:20

Description

I tried to make a CONNECT table to a local CSV file.
The command fails and server goes down every time.
I will attach the csv for reproduction test.

I wanted to set the primary key to the row "zip_code", so the column def was needed beforehand or the command would error.
The CONNECT table works properly only when no column definition is made or all columns are defined.

{noformat}
MariaDB [(none)]> SET SESSION connect_xtrace=1;
Query OK, 0 rows affected (0.00 sec)

MariaDB [(none)]> show variables like 'connect_xtrace';
+----------------+-------+
| Variable_name | Value |
+----------------+-------+
| connect_xtrace | 1 |
+----------------+-------+
1 row in set (0.00 sec)

MariaDB [(none)]> use test;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
MariaDB [test]> CREATE OR REPLACE TABLE M_Zip (zip_code char(7) character set ascii collate ascii_bin NOT NULL, PRIMARY KEY(zip_code)) ENGINE=CONNECT TABLE_TYPE=CSV FILE_NAME='M_Zip.csv' HEADER=1 SEP_CHAR=',' QUOTED=3;
ERROR 2013 (HY000): Lost connection to MySQL server during query
MariaDB [test]> SHOW CREATE TABLE M_Zip;
ERROR 2006 (HY000): MySQL server has gone away
No connection. Trying to reconnect...
Connection id: 2
Current database: test

+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Table | Create Table |
+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| M_Zip | CREATE TABLE `M_Zip` (
`zip_code` char(7) CHARACTER SET ascii COLLATE ascii_bin NOT NULL,
PRIMARY KEY (`zip_code`)
) ENGINE=CONNECT DEFAULT CHARSET=utf8 `TABLE_TYPE`=CSV `FILE_NAME`='M_Zip.csv' `HEADER`=1 `SEP_CHAR`=',' `QUOTED`=3 |
+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.01 sec)
{noformat}

The report of my.err is below.

{noformat}
New CONNECT 0x7fb0e1add820, table: M_Zip
create: this=0x7fb0e1add820 thd=0x7fb0e3a6e008 xp=0x7fb0e1a7d080 g=0x7fb0e1a69000 sqlcom=1 name=M_Zip
xchk=(nil) createas=0
Getting created index 1 info
XTAB: making new TABLE M_Zip (null)
Getting created index 1 info
GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43
File length=19028
GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43
File length=19028
Estimating lines len=19028 ending=1/nEstimatedLength: Fields=0 Columns=(nil)
avglen=1 MaxSize19028
ColDB: am=34 colname=zip_code tabname=M_Zip num=0
cdp(1).Name=zip_code cp=(nil)
making new CSVCOL C1 zip_code at 0x7fb047800590
colp=0x7fb047800590
DOS OpenDB: tdbp=0x7fb047800478 tdb=R1 use=2 mode=10
PlugOpenFile: fname=/data/mysql/./test/M_Zip.csv ftype=rb
dbuserp=0x7fb0e182b020
fop=0x7fb0e182ee80
fp=0x7fb0478006b0
returning fop=0x7fb0e182ee80
File /data/mysql/./test/M_Zip.csv open Stream=0x7fb0e182ee80 mode=rb
SubAllocating a buffer of 16 bytes
OpenDos: R1 mode=10 To_Line=0x7fb047800718
File length=19028
ColDB: am=34 colname=zip_code tabname=M_Zip num=0
cdp(1).Name=zip_code cp=0x7fb047800590
colp=0x7fb047800590
File length=19028
Estimating lines len=19028 ending=1/nEstimatedLength: Fields=1 Columns=0x7fb047800590
avglen=1 MaxSize19028
XINDEX Make: n=19028
KCOL(0x7fb047813210) Init: col=zip_code n=19028 type=1 sm=1
AVB: mp=0x7fb047813350 type=1 nval=19028 len=7 check=1 blank=1
170227 19:45:22 mysqld_safe Number of processes running now: 0
170227 19:45:22 mysqld_safe mysqld restarted
{noformat}

I tried to make a CONNECT table to a local CSV file.
The command fails and server goes down every time.
I will attach the csv for reproduction test.

I wanted to set the primary key to the row "zip_code", so the column def was needed beforehand or the command would error.
The CONNECT table works properly only when no column definition is set or all existing columns are defined.
I want to request that PK can be set even where not all columns are known.

{noformat}
MariaDB [(none)]> SET SESSION connect_xtrace=1;
Query OK, 0 rows affected (0.00 sec)

MariaDB [(none)]> show variables like 'connect_xtrace';
+----------------+-------+
| Variable_name | Value |
+----------------+-------+
| connect_xtrace | 1 |
+----------------+-------+
1 row in set (0.00 sec)

MariaDB [(none)]> use test;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
MariaDB [test]> CREATE OR REPLACE TABLE M_Zip (zip_code char(7) character set ascii collate ascii_bin NOT NULL, PRIMARY KEY(zip_code)) ENGINE=CONNECT TABLE_TYPE=CSV FILE_NAME='M_Zip.csv' HEADER=1 SEP_CHAR=',' QUOTED=3;
ERROR 2013 (HY000): Lost connection to MySQL server during query
MariaDB [test]> SHOW CREATE TABLE M_Zip;
ERROR 2006 (HY000): MySQL server has gone away
No connection. Trying to reconnect...
Connection id: 2
Current database: test

+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Table | Create Table |
+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| M_Zip | CREATE TABLE `M_Zip` (
`zip_code` char(7) CHARACTER SET ascii COLLATE ascii_bin NOT NULL,
PRIMARY KEY (`zip_code`)
) ENGINE=CONNECT DEFAULT CHARSET=utf8 `TABLE_TYPE`=CSV `FILE_NAME`='M_Zip.csv' `HEADER`=1 `SEP_CHAR`=',' `QUOTED`=3 |
+-------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.01 sec)
{noformat}

The report of my.err is below.

{noformat}
New CONNECT 0x7fb0e1add820, table: M_Zip
create: this=0x7fb0e1add820 thd=0x7fb0e3a6e008 xp=0x7fb0e1a7d080 g=0x7fb0e1a69000 sqlcom=1 name=M_Zip
xchk=(nil) createas=0
Getting created index 1 info
XTAB: making new TABLE M_Zip (null)
Getting created index 1 info
GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43
File length=19028
GetFileLength: fn=/data/mysql/./test/M_Zip.csv h=43
File length=19028
Estimating lines len=19028 ending=1/nEstimatedLength: Fields=0 Columns=(nil)
avglen=1 MaxSize19028
ColDB: am=34 colname=zip_code tabname=M_Zip num=0
cdp(1).Name=zip_code cp=(nil)
making new CSVCOL C1 zip_code at 0x7fb047800590
colp=0x7fb047800590
DOS OpenDB: tdbp=0x7fb047800478 tdb=R1 use=2 mode=10
PlugOpenFile: fname=/data/mysql/./test/M_Zip.csv ftype=rb
dbuserp=0x7fb0e182b020
fop=0x7fb0e182ee80
fp=0x7fb0478006b0
returning fop=0x7fb0e182ee80
File /data/mysql/./test/M_Zip.csv open Stream=0x7fb0e182ee80 mode=rb
SubAllocating a buffer of 16 bytes
OpenDos: R1 mode=10 To_Line=0x7fb047800718
File length=19028
ColDB: am=34 colname=zip_code tabname=M_Zip num=0
cdp(1).Name=zip_code cp=0x7fb047800590
colp=0x7fb047800590
File length=19028
Estimating lines len=19028 ending=1/nEstimatedLength: Fields=1 Columns=0x7fb047800590
avglen=1 MaxSize19028
XINDEX Make: n=19028
KCOL(0x7fb047813210) Init: col=zip_code n=19028 type=1 sm=1
AVB: mp=0x7fb047813350 type=1 nval=19028 len=7 check=1 blank=1
170227 19:45:22 mysqld_safe Number of processes running now: 0
170227 19:45:22 mysqld_safe mysqld restarted
{noformat}

Elena Stepanova made changes - 2017-03-03 00:26

Status

Open [ 1 ]

Confirmed [ 10101 ]

Elena Stepanova made changes - 2017-03-03 00:27

Fix Version/s		10.1 [ 16100 ]
Affects Version/s		10.1 [ 16100 ]
Assignee		Olivier Bertrand [ bertrandop ]

Olivier Bertrand made changes - 2017-03-03 23:36

Status

Confirmed [ 10101 ]

In Progress [ 3 ]

Olivier Bertrand made changes - 2017-03-11 22:16

issue.field.resolutiondate

2017-03-11 22:16:54.0

2017-03-11 22:16:54.699

Olivier Bertrand made changes - 2017-03-11 22:16

Fix Version/s		10.0.31 [ 22501 ]
Fix Version/s		10.1.22 [ 22502 ]
Fix Version/s		10.2.5 [ 22117 ]
Fix Version/s	10.1 [ 16100 ]
Resolution		Fixed [ 1 ]
Status	In Progress [ 3 ]	Closed [ 6 ]

Sergei Golubchik made changes - 2021-12-06 21:44

Workflow

MariaDB v3 [ 79767 ]

MariaDB v4 [ 151756 ]

People

Assignee:: Olivier Bertrand

Reporter:: Takuya Aoki (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 2017-02-27 11:05

Updated:: 2017-03-11 22:16

Resolved:: 2017-03-11 22:16

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server

Details

Description

Attachments

Attachments

Activity

People

Dates

Git Integration