[MDEV-15148] Protocol regression testing for the server Created: 2018-01-31  Updated: 2023-07-19

Status: Open
Project: MariaDB Server
Component/s: Tests
Fix Version/s: None

Type: Task Priority: Major
Reporter: Vladislav Vaintroub Assignee: Daniel Black
Resolution: Unresolved Votes: 1
Labels: None

Issue Links:
Relates
relates to MDEV-16347 Integer literal is typed as MYSQL_TYP... Closed
relates to MDEV-24121 Recent MariaDB update appears to have... Closed
relates to MDEV-24134 10.4.16 update breaks python Closed
relates to MDEV-31746 Problems with tx_isolation after MDEV... Closed
relates to MDEV-24146 latest update (10.5.7) breaks communi... Closed

 Description   

Problem :

We keep telling people that the client/server protocol that we use is the same as MySQL's.
We do not test it at all, the only testing that is regularly done for the server is implemented with C/C client that is also owned by us. C/C can have bugs, that can be compensated on the server site.

To fix this problem, we need to implement testing for protocol features. The probably single way to do that is to test server with more than just C/C. Perhaps, ideally we can run unit tests suites of the connectors that are not owned by us on buildbot.

There are several alternatives for choosing the connectors to test server against.

C/J by MariaDB is a viable alternative, not ideal (since it is aware of mariadb features), but still it does run against MySQL server by Oracle regularly, and is not as tied to the server as C/C

Now, to the test suites

We can also do "program minimum" rather than run "program maximum" (full connector test suites), which is
connect/query with result set or update, same with prepared statement/disconnect.



 Comments   
Comment by Daniel Black [ 2018-02-01 ]

wlad great idea.

On other clients implementations with active communities:

Lots of these have travis tests already against mariadb to ensure their compatibility with released mariadb in the same way that this MDEV proposed to do the same in reverse.
Some communities above are missing tests against mariadb and and getting them to develop against released mariadb would help their mutual compatibility by release time too. Probably should notify these communities about MariaDB's protocol enhancements too.

Comment by Daniel Black [ 2020-11-09 ]

fyi, working on a plan/implementation with some urgency.

Generated at Thu Feb 08 08:19:02 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.