[MXS-1575] maxscale crashed with Avro conversion service Created: 2017-12-10 Updated: 2018-02-02 Resolved: 2018-02-02 |
|
| Status: | Closed |
| Project: | MariaDB MaxScale |
| Component/s: | avrorouter, binlogrouter |
| Affects Version/s: | 2.1.11, 2.1.12 |
| Fix Version/s: | 2.1.14 |
| Type: | Bug | Priority: | Major |
| Reporter: | Jiafu Wang | Assignee: | markus makela |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Environment: |
maxscale:maxscale-2.1.11-1.x86_64 |
||
| Attachments: |
|
| Sprint: | 2017-49, MXS-SPRINT-50, MXS-SPRINT-51 |
| Description |
|
I have confiured the maxscale 2.1.11 with binlogrouter and avrorouter. |
| Comments |
| Comment by markus makela [ 2017-12-11 ] | |
|
Please try if the pre-release candidate packages for 2.1.12 fix the problem: http://max-tst-01.mariadb.com/ci-repository/maxscale-2.1.12-release/mariadb-maxscale/ | |
| Comment by Jiafu Wang [ 2017-12-11 ] | |
|
@markus makela thanks for reply,maxscale-2.1.12 was also crashed. | |
| Comment by markus makela [ 2017-12-11 ] | |
|
OK, thanks for verifying this. Also, the archive file is empty. If possible, please upload the MaxScale log file first so that we can see where it crashed. Only upload the binary log files and the core dump if it contains no confidential data. | |
| Comment by Jiafu Wang [ 2017-12-11 ] | |
|
sorry,it's my fault.I have uploaded the relative files. | |
| Comment by Jiafu Wang [ 2017-12-13 ] | |
|
Hi markus,I haved upload the files.What about the progress of this issue? | |
| Comment by markus makela [ 2018-01-02 ] | |
|
If possible, please try out this debug build of MaxScale. It contains a very minor fix (that could prevent the crash but still cause problems) and some added debug assertions to catch the real reason of the crash: http://max-tst-01.mariadb.com/ci-repository/2.1-markusjm-jan2/ | |
| Comment by Jiafu Wang [ 2018-01-05 ] | |
|
The MaxScale 2.1.13 from http://max-tst-01.mariadb.com/ci-repository/2.1-markusjm-jan2/ was crashed again. | |
| Comment by markus makela [ 2018-01-05 ] | |
|
I think the crash could be caused by the comments in the CREATE TABLE statements. I think that the way the avrorouter parses the statements is not compatible with the character set that is used for the comments. Edit: This was a false alarm, it was a simple mistake in the CREATE TABLE processing that failed to identify the explicit database name used in the CREATE statement. | |
| Comment by markus makela [ 2018-01-06 ] | |
|
We have added a small fix that should fix the problems with the CREATE TABLE processing as well as built packages for testing the fix. You can find the packages here: http://max-tst-01.mariadb.com/ci-repository/2.1-markusjm-jan6/mariadb-maxscale/ If you can reproduce the crash, we'd appreciate it if you can try and see what sort of output you get with these packages. | |
| Comment by Jiafu Wang [ 2018-01-09 ] | |
|
The recent core file was uploaded to the ftp://ftp.mariadb.com/uploads/.The filename is crash20170109.zip. | |
| Comment by markus makela [ 2018-01-09 ] | |
|
Would it be possible for you to upload the binary log file that was being converted when the crash happened? This would be the fastest way to resolve this issue. You can upload the binary logs to the same place where you uploaded the core file. | |
| Comment by Jiafu Wang [ 2018-01-10 ] | |
|
I have uploaded the binlog file.The filename is binlog.zip. [avro-conversion] | |
| Comment by markus makela [ 2018-01-10 ] | |
|
Thank you, I'll start testing with the binlog you provided and report back once I have some results. | |
| Comment by markus makela [ 2018-01-11 ] | |
|
Managed to reproduce the debug assertion with the uploaded binlog. Now it's just a matter of finding and fixing the bug. | |
| Comment by markus makela [ 2018-01-11 ] | |
|
The avrorouter appeared to be having problems with large DECIMAL fields. This has now been fixed along with a few minor bugs that were found. wjf870128 I have built new packages for testing, you can find them here: http://max-tst-01.mariadb.com/ci-repository/2.1-markusjm-jan11/mariadb-maxscale/ With the new package, I was able to fully convert the binary log file. | |
| Comment by markus makela [ 2018-01-16 ] | |
|
wjf870128 Have you tried the new custom version? | |
| Comment by Jiafu Wang [ 2018-01-18 ] | |
|
Thanks,it was looked better. [avro-conversion] | |
| Comment by markus makela [ 2018-01-18 ] | |
|
Thanks for the reply, we'll look into the binary log to see what is going on. I suspect that some of the data types used in your setup are not very common and they are the ones causing problems. I'll let you know once we've built another package for you to test. A big thank you for doing all this testing! | |
| Comment by markus makela [ 2018-01-20 ] | |
|
This time it seems to be a problem with
causing problems. This appears to be a simple oversight in the ALTER TABLE processing that the avrorouter does. | |
| Comment by markus makela [ 2018-01-29 ] | |
|
The ALTER TABLE handling revealed a few bugs in other parts of the code. With these packages, I was able to fully convert both binlog files. wjf870128 If possible, please try them out. | |
| Comment by Jiafu Wang [ 2018-02-02 ] | |
|
Hi makela,I have tested the packages from http://max-tst-01.mariadb.com/ci-repository/2.1-markusjm-jan29/mariadb-maxscale/centos/7/x86_64/ | |
| Comment by markus makela [ 2018-02-02 ] | |
|
OK, that is very good news. I'll close this issue and the fix should get into the next 2.1 release. |