[MDEV-20553] Large File Import fails with WSREP: transaction size limit exceeded Created: 2019-09-10 Updated: 2019-12-12 Resolved: 2019-12-12 |
|
| Status: | Closed |
| Project: | MariaDB Server |
| Component/s: | Galera, wsrep |
| Affects Version/s: | 10.4.7 |
| Fix Version/s: | N/A |
| Type: | Bug | Priority: | Major |
| Reporter: | Justin M | Assignee: | Jan Lindström (Inactive) |
| Resolution: | Not a Bug | Votes: | 0 |
| Labels: | None | ||
| Environment: |
Ubuntu 18.04 running Mariadb 10.4.7 Galera Cluster |
||
| Issue Links: |
|
||||||||
| Description |
|
Loading a delimited text file fails in mysql LOAD DATA INFILE query or using the mysqlimport program. Test file is 17 million rows and 4.7GiB. Error thrown is [Warning] WSREP: transaction size limit (2147483647) exceeded: 2147483648 I can fix it by setting the wsrep_load_data_splitting='ON' variable, but the documentation says this was deprecated in 10.4.3 because of a new continuous replication change. I'm on 10.4.7 and having this set to off does not work. Not sure if I have a setting in my config breaking this feature, or if it is not yet running fully. My mariadb.cnf: [galera]
performance_schema = ON |
| Comments |
| Comment by Justin M [ 2019-09-11 ] |
|
Not sure if related directly, but I also get "Got error 5 input/output error during COMMIT" on a query of this same table once imported. There are no errors thrown in /var/log/mysql/error.log SET @cnt = 0; |
| Comment by Jan Lindström (Inactive) [ 2019-12-12 ] |
|
If your transaction size limit is reached you should use streaming replication with correct configuration. |