[MXS-1106] Failed to initialize avrofile, fatal signal 11 Created: 2017-01-25 Updated: 2017-02-01 Resolved: 2017-02-01 |
|
| Status: | Closed |
| Project: | MariaDB MaxScale |
| Component/s: | avrorouter |
| Affects Version/s: | 2.0.3 |
| Fix Version/s: | 2.0.4 |
| Type: | Bug | Priority: | Major |
| Reporter: | Frédérick Pop | Assignee: | markus makela |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Environment: |
Centos 6.7 |
||
| Attachments: |
|
| Sprint: | 2017-27 |
| Description |
|
Hi, I'm having an issue while starting maxscale when I set up avrorouter service : error : Failed to initialize avrofile. Context : 1) I setup a binlogrouter service and replicate binlogs from my master mariadb node, binlog started at index 32 Here is my configuration :
[replication-service]
[avro-service] |
| Comments |
| Comment by markus makela [ 2017-01-26 ] | |||||||||||||
|
Can you upload the .avsc files that were generated? One possible cause for this might be a malformed schema definition. | |||||||||||||
| Comment by Frédérick Pop [ 2017-01-26 ] | |||||||||||||
|
Is there a way to anonymize tables definitions into avsc files ? I'm doing this setup with a production like database and I work in a financial company so unfortunately I won't have authorization to upload those informations. | |||||||||||||
| Comment by markus makela [ 2017-01-26 ] | |||||||||||||
|
Ah, I think validating the JSON in the .avsc files would be enough. The actual values aren't relevant as long as they conform to the Avro specification. You can use something like jq to validate it. You can also enable the info log level to get some extra information about the binlog conversion process. If you spot a certain spot in the binlogs that causes this, it would be good to take a look at the binlogs at that point with mysqlbinlog. Since it crashes on startup, I'd assume it's the first binlog that is causing the problems. You can also try and see what happens if you create a similar table, insert some data and start MaxScale without the generated .avsc files. This way MaxScale itself will generate the .avsc files from the CREATE TABLE statements in the binlogs and we can see if the problem is with the generated .avsc files or something else. We've also made a few minor fixes for the next 2.0 release that could fix this bug. If you have the possibility of building MaxScale from the source, I'd recommend you try out the 2.0 branch on GitHub and see if this still happens. | |||||||||||||
| Comment by Frédérick Pop [ 2017-01-26 ] | |||||||||||||
|
JSON structure seems good for every .avsc files, I tried to open the first binlog but I get this message : " mysqlbinlog: unknown variable 'default-character-set=utf8' " It seems to be caused by the 'default-character-set=utf8' statement in my.cnf configuration, which is deprecated. | |||||||||||||
| Comment by markus makela [ 2017-01-26 ] | |||||||||||||
|
I don't think that should prevent the binlogs from being processed. Does the error log have any errors apart from the one that's already shown? | |||||||||||||
| Comment by Frédérick Pop [ 2017-01-26 ] | |||||||||||||
|
maxscale203_startup.log | |||||||||||||
| Comment by Frédérick Pop [ 2017-01-26 ] | |||||||||||||
|
I opened the first binlog with these options " mysqlbinlog --no-defaults --base64-output=DECODE-ROWS mariadb-bin.000032 " and what we can see at pos 526 is :
| |||||||||||||
| Comment by Frédérick Pop [ 2017-01-30 ] | |||||||||||||
|
I tried to build from source in order to test fixes from 2.0.4 but it fail during 'make test' command on the last test (binlogrouter). | |||||||||||||
| Comment by markus makela [ 2017-01-30 ] | |||||||||||||
|
We've pushed a fix to the test failure in the 2.0 branch on GitHub. The test should pass now as it was a simple configuration error in the test declaration. | |||||||||||||
| Comment by Frédérick Pop [ 2017-02-01 ] | |||||||||||||
|
I tried with version 2.0.4 and still can't start Maxscale, I have the same log : 2017-02-01 11:53:01 error : Failed to initialize avrofile. | |||||||||||||
| Comment by Frédérick Pop [ 2017-02-01 ] | |||||||||||||
|
I tried with an other binlog start index, I always have this error. |