Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-27245

Import TenDBCluster-TSpider bug fixes

    XMLWordPrintable

Details

    Description

      Check all the TenDBCluster-TSpider-specific patches and import useful bug fix patches.

      TODO:

      • List useful patches
      • Ask Tencent to contribute under MCA or BSD

      Patches (tspider3.7) : unchecked, undecided already fixed, need import, no need to import

      • afae7913ab7 jamxia Mon Nov 29 03:27:27 2021 +0000 Merge branch 'fix_kill_query_issue29' into 'tspider3.7' (merge request !76)
      • c02a9dc8143 danielye Fri Nov 26 14:57:56 2021 +0800 Propagate KILLs on Spider queries to corresponding backend connections
      • 63d1de84891 jamxia Fri Nov 26 10:26:29 2021 +0000 Merge branch 'bugfix_udf_in_where_issue46' into 'tspider3.7' (merge request !73)
      • e3c4598f696 jamxia Fri Nov 26 09:54:04 2021 +0000 Merge branch 'tspider3.7' into 'tspider3.7' (merge request !74)
      • eb04bb3c79d jamxia Fri Nov 26 09:54:01 2021 +0000 Merge branch 'fix_insert_ignore_errlog_issue50' into 'tspider3.7' (merge request !75)
      • 742048ef950 jamxia Fri Nov 26 09:19:49 2021 +0000 Merge branch 'opt_select_max_problem' into 'tspider3.7' (merge request !72)
      • 30b6f2fbdba danielye Mon Nov 22 19:22:38 2021 +0800 Disable unnecessary errlog output for INSERT IGNORE queries
      • 224dafdc0fa danielye Thu Sep 16 16:11:01 2021 +0800 [mysql-test] Add testcase for UDF conds fix
      • 5506b2e0f80 danielye Thu Sep 16 14:25:27 2021 +0800 [bugfix] Fix updated rows count for non-direct updates
      • 9006fc76620 danielye Tue Sep 14 15:23:39 2021 +0800 [bugfix] Fix UDFs & Stored Functions in where conds
      • 96790753acc danielye Tue Oct 12 16:33:12 2021 +0800 [bugfix] Fix SELECT COUNT DISTINCT + LIMIT when spider_parallel_limit=1
      • caaaa5ce80a danielye Mon Sep 13 20:27:48 2021 +0800 [mysql-test] Fix Spider tests
      • 38d2879f9ae danielye Mon Sep 13 15:57:11 2021 +0800 Get MIN val of non-group-by fields for direct aggregate
      • 7ad57d4f241 vinchen Thu Sep 2 02:02:34 2021 +0000 Merge branch 'mr_error' into 'tspider3.7' (merge request !71)
      • e9ac1befa81 vinchen Wed Sep 1 12:44:33 2021 +0000 Merge branch 'dev-tspider-3.7' into 'tspider3.7' (merge request !68)
      • a4e39fbcd16 vinchen Wed Sep 1 12:43:36 2021 +0000 Merge branch 'fix_conn_null_pointer_checks' into 'tspider3.7' (merge request !66)
      • bc2eb192f51 vinchen Wed Sep 1 12:29:40 2021 +0000 Merge branch 'opt_parallel_selects_issue43' into 'tspider3.7' (merge request !69)
      • c7514e6d060 danielye Tue Aug 31 20:08:25 2021 +0800 [optimization] Disable bgs_mode when a SELECT fetches the whole table
      • 507e04c4b03 jamxia Wed Sep 1 09:36:57 2021 +0000 Merge branch 'fix_assertion_error_when_backend_switches_issue41' into 'tspider3.7' (merge request !70)
      • ea86720e2d3 jamxia Wed Sep 1 17:13:58 2021 +0800 optimization spider log format to support skip log
      • 42227e9d68d danielye Wed Sep 1 16:39:53 2021 +0800 [bugfix] Fix mysqld (debug ver.) crash when Spider switches remotes
      • d36b1d942dc jamxia Fri Aug 27 16:01:02 2021 +0800 fix a spider core bug while select with partiton(N) syntax
      • 35b742bd955 danielye Tue Aug 24 15:06:02 2021 +0800 [bugfix] Fix potential NULL pointer access in get_bg_result()
      • 47d647b7ef2 vinchen Fri Aug 27 03:54:09 2021 +0000 Merge branch 'fix_prepare_execute_issue40' into 'tspider3.7' (merge request !67)
      • 51fbe79b0b7 vinchen Fri Aug 27 02:53:39 2021 +0000 Merge branch 'fix_item_cache_print' into 'tspider3.7' (merge request !65)
      • 9424d6f94fa danielye Thu Aug 19 15:56:03 2021 +0800 [bugfix] Fix user var in queries Spider send to remote DBs
      • 1ca5b88a417 yongxinxu Wed Aug 11 15:45:27 2021 +0800 MDEV-25808 PREPARE/EXECUTE makes signed integer out of unsigned
      • b8331d1e617 yongxinxu Mon Jul 26 07:02:45 2021 +0000 Merge branch 'tspider3.7' into 'tspider3.7' (merge request !64)
      • 12c5b908b4b willhan Fri Jun 25 15:37:30 2021 +0800 set extra connection to 10 for use by accounts that have the SUPER privilege
      • 837283d6e67 willhan Mon May 24 12:39:42 2021 +0000 Merge branch 'overflow_fix' into 'tspider3.6' (merge request !60)
      • 207e0432778 yongxinxu Mon May 24 17:00:15 2021 +0800 [bugfix] unsigned overflow when using PREPARE/EXECUTE
      • b6d4f0adafc willhan Fri May 21 08:24:32 2021 +0000 Merge branch 'optimize-conn' into 'tspider3.6' (merge request !59)
      • 7448895e065 yongxinxu Sat May 8 11:59:12 2021 +0800 [code-review] revision for spider connection pool
      • 25934f211b5 yongxinxu Fri May 7 15:18:20 2021 +0800 [optimization] use rwlock in spider_conn_meta_mutex and spider_ipport_conn
      • 1521f834164 yongxinxu Wed Apr 14 14:52:38 2021 +0800 use atomic_add to replace mutex for spider_conn_id
      • 759bcd595c7 yongxinxu Wed Mar 17 10:37:07 2021 +0800 [optimization] Use RWLock Hash with Mutex Queue in connection pool
      • 9c62b291225 willhan Mon Apr 19 13:18:50 2021 +0000 Merge branch 'auto-increment-fix' into 'tspider3.6' (merge request !58)
      • 770121659c6 yongxinxu Mon Apr 19 20:33:55 2021 +0800 [bugfix] auto-increment with information_schema.tables, and hide the spider_auto_increment_mode variable
      • 3fa05cbd25c willhan Fri Apr 16 08:36:24 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.6' (merge request !57)
      • 300ad0c9caf yongxinxu Fri Apr 16 16:20:39 2021 +0800 [mysql-test] mysql-test fix for update with primary key and auto-increment
      • afb96ebfaa5 willhan Fri Apr 16 08:08:22 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.6' (merge request !56)
      • ee64f808bdf yongxinxu Fri Apr 16 15:52:08 2021 +0800 [mysql-test] mysql-test for auto-increment with show table status and show create table
      • 601f00653fc willhan Fri Apr 16 07:11:49 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.6' (merge request !55)
      • 78e0d32da5b yongxinxu Thu Apr 15 22:23:49 2021 +0800 [feature] New Global Variable `spider_log_ignore_err_numbers`
      • 40ffd0755fe yongxinxu Thu Apr 15 20:19:13 2021 +0800 [bugfix] show table status with auto-increment
      • 3211d793e5f willhan Mon Mar 29 02:18:39 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.6' (merge request !54)
      • cfda05afc57 willhan Sat Mar 27 17:59:58 2021 +0800 bug fix when query "select + limit" is parallel dispatched, the result_list->finish_flg can't be true
      • ed259642b6a willhan Thu Mar 25 04:14:10 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.6' (merge request !53)
      • 1d51dcf91a5 willhan Thu Mar 25 12:07:49 2021 +0800 1. add global variables spider_parallel_limit with default value "FALSE". when spider_parallel_limit is true, spider will parallel dispatch "select + limit" query 2. free conns when close spider table
      • b3f1936caf8 willhan Wed Mar 17 09:38:28 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.6' (merge request !52)
      • 3bc071e2bde yongxinxu Wed Mar 17 17:33:51 2021 +0800 [bugfix] auto_increment do not reset next_auto_inc_val when failed
      • d9a64b36881 willhan Tue Mar 9 13:15:51 2021 +0000 Merge branch 'update_with_float' into 'tspider3.6' (merge request !51)
      • 6bcd3950e4d yongxinxu Tue Mar 9 20:56:00 2021 +0800 [code-review] check table_has_unique_key in append_update_where
      • 8883f3e3eea yongxinxu Tue Mar 9 19:46:30 2021 +0800 [mysql-test] mysql-test for updated join with float fields
      • 8ae99aa8d69 yongxinxu Mon Mar 1 17:51:51 2021 +0800 [bugfix] No match row founded when SET float fields in UPDATE
      • 185502fd1bb willhan Sat Mar 6 11:42:08 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.6' (merge request !50)
      • e3e5bb7e9cf willhan Sat Mar 6 19:38:51 2021 +0800 fix bug for spider auto_increment insert into table with aotu_increment, may cause "empty string" .
      • 968bc0601f7 willhan Fri Feb 26 06:34:58 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.6' (merge request !48)
      • fb2031d3982 yongxinxu Mon Feb 8 16:41:51 2021 +0800 [mysql-test] mysql-test for updated rows on spider
      • cd7c0f16f0b yongxinxu Mon Feb 8 15:08:26 2021 +0800 [bugfix] The count of updated rows wrong on Spider
      • 93405b93422 yongxinxu Sun Feb 7 15:53:51 2021 +0800 [bugfix] Fix auto_increment duplicate bug
      • 7c007f791c0 willhan Tue Feb 2 01:54:22 2021 +0000 Merge branch 'tspider3.6' into 'tspider3.5' (merge request !47)
      • 061c2c5af4a yongxinxu Fri Jan 29 15:48:06 2021 +0800 [version] change spider_default_version to 3.6.1
      • 34978805bd5 yongxinxu Fri Jan 29 15:47:56 2021 +0800 [mysql-test] mysql-test for print_bool_as_literal
      • 6b9267d47f9 yongxinxu Fri Jan 29 15:35:42 2021 +0800 [optimization] New global variable 'print_bool_as_literal'
      • 6bf5778f587 willhan Fri Jan 29 02:06:55 2021 +0000 Merge branch 'ha_list' into 'tspider3.5' (merge request !46)
      • 4118f65d9ff yongxinxu Thu Jan 28 16:05:41 2021 +0800 [bugfix] ha_list dead loop fix
      • 8c5e77cb815 willhan Wed Jan 27 03:37:13 2021 +0000 Merge branch 'yongxin_dev' into 'tspider3.5' (merge request !44)
      • b1cafea3773 yongxinxu Tue Jan 26 20:01:59 2021 +0800 [bugfix] the dangling pointer of spider_get_time
      • 845d3bb1ec4 yongxinxu Tue Jan 26 19:51:58 2021 +0800 [compile] -Werror=uninitialized compiling fix
      • 59b5bb07245 yongxinxu Tue Jan 26 18:33:49 2021 +0800 [optimization] default spider_max_connections is set to 500
      • 48e8887e521 willhan Tue Jan 26 06:56:46 2021 +0000 Merge branch 'complex_sql_fix' into 'tspider3.5' (merge request !43)
      • e1736d81ae0 yongxinxu Mon Jan 25 20:25:49 2021 +0800 [optimization] rewrite Item_sum::reset_field()
      • 6859650307e yongxinxu Mon Jan 25 11:27:51 2021 +0800 [mysql-test] make spider tests consistent at debug and release version
      • c371dd10d2f yongxinxu Mon Jan 25 10:21:58 2021 +0800 [mysql-test] test for complex select sqls on spider
      • 315ce4b0b80 yongxinxu Sun Jan 24 15:46:55 2021 +0800 [mysql-test] test for spider_distinct_limit_bug
      • e0a1c6ed9d5 yongxinxu Fri Jan 22 16:28:54 2021 +0800 [mysql-test] some of group_by on spider
      • 01c278b6b1b yongxinxu Wed Jan 20 20:06:53 2021 +0800 [bugfix] group aggr with sql_big_result returns wrong result
      • 4d618b065d3 yongxinxu Wed Jan 20 15:06:25 2021 +0800 [bugfix] better way to fix group by + max/min bug
      • d22ddd1dd65 yongxinxu Sat Jan 23 06:42:25 2021 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !40)
      • 57b2a1f9988 willhan Fri Jan 22 21:40:25 2021 +0800 fix bug for select + distinct + order by(shard_key) + limit
      • 1c8f81d79ee willhan Thu Jan 14 13:52:50 2021 +0000 Merge branch 'group_fix' into 'tspider3.5' (merge request !39)
      • 381316e4184 yongxinxu Thu Jan 14 17:57:02 2021 +0800 [bugfix] spider select with group by and max()/min() returns error result
      • 6272f1ddb46 yongxinxu Thu Jan 14 14:33:19 2021 +0800 [mysql-test] Add create table helper for spider mysql-test
      • 762044e8f0f willhan Thu Jan 14 01:38:57 2021 +0000 Merge branch 'json_extract_fix' into 'tspider3.5' (merge request !38)
      • b3084cf5437 yongxinxu Wed Dec 30 15:02:16 2020 +0800 [bugfix] Two JSON_OBJECT() with same key but in different order is not equal
      • 89656f0e668 yongxinxu Thu Dec 24 17:25:03 2020 +0800 [bugfix] Select with JSON boolean value true returns empty set
      • 229092c4c64 yongxinxu Thu Dec 24 10:45:33 2020 +0800 [bugfix] Update using JSON_REPLACE makes the server crash
      • 2b696a082fb yongxinxu Tue Dec 22 15:01:26 2020 +0800 [bugfix] SELECT with JSON_EXTRACT condition failed on Spider SE
      • 9bb1f01641a willhan Tue Dec 22 07:15:52 2020 +0000 Merge branch 'json_test' into 'tspider3.5' (merge request !37)
      • 25a6ee47b11 yongxinxu Fri Dec 18 16:35:00 2020 +0800 [mysql-test] JSON functions on TSpider
      • d7fafeec81c willhan Sat Dec 5 14:46:58 2020 +0800 Merge pull request #4 from yongxin-xu/tspider3.5
      • 992520d4dd5 willhan Thu Dec 3 14:07:34 2020 +0000 Merge branch 'better_perf' into 'tspider3.5' (merge request !36)
      • 1c05cd0fd94 yongxinxu Wed Dec 2 16:41:45 2020 +0800 [mysql-test] Remove wsrep_auto_increment_control display
      • 4c103885903 yongxinxu Fri Nov 13 15:39:19 2020 +0800 [Optimization] Remove redundant pages allocations and frees
      • 58e27514c3f yongxinxu Fri Nov 13 14:51:01 2020 +0800 [Optimization] Using index read in Spider SE for const join types
      • 8706e9f692e yongxinxu Wed Dec 2 18:27:16 2020 +0800 [Comment] Add comments and todos
      • 769650b46de willhan Mon Nov 30 11:38:37 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !34)
      • 744e4244c8b yongxinxu Fri Nov 27 18:44:55 2020 +0800 [Feature]Add shard_count, shard_func, shard_type support for TDBCTL
      • 5499a0d5c61 willhan Wed Nov 18 04:04:45 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !33)
      • 426c88b2b87 yongxinxu Wed Nov 18 11:27:03 2020 +0800 [mysql-test] Fix spider_direct_insert_ignore cases
      • 8b36f5b10f1 yongxinxu Mon Nov 16 13:45:17 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !32)
      • 57409582657 yongxinxu Mon Nov 16 21:00:14 2020 +0800 [Optimization] Allow bulk_insert for `replace` and `duplicate key update` when `spider_direct_insert_ignore=0`
      • af4bc919d5a willhan Sat Nov 14 03:31:43 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !30)
      • 36a049cc011 willhan Sat Nov 14 11:25:12 2020 +0800 add session variables spider_direct_insert_ignore, defaults values is 0. For query "insert ignore into", when spider_direct_insert_ignore=0: tspider dispatch "insert " to data node, and process duplicate key on local server. when spider_direct_insert_ignore=1: tspider dispatch "insert ignore" to data node directly
      • fb9b73fa024 yongxinxu Wed Nov 11 17:38:56 2020 +0800 [mysql-test] Fix mysql-test cases for spider
      • ba99049e1b6 willhan Wed Oct 28 02:25:53 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !28)
      • eff8c0a722e yongxinxu Wed Oct 28 09:56:16 2020 +0800 [Bugfix] Spider quick multi-range read (mrr) fix
      • 8969a563e00 willhan Fri Oct 16 06:32:42 2020 +0000 Merge branch 'sport_crash' into 'tspider3.5' (merge request !27)
      • b2b7d0d08ff yongxinxu Fri Oct 16 12:00:46 2020 +0800 [Bugfix] Avoid crash when use 'create server'
      • 44304f9ec43 willhan Sat Oct 10 03:01:16 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !26)
      • b767a7b0402 yongxinxu Wed Sep 23 18:34:51 2020 +0800 [Optimization] Make the code compatible with some environments
      • fa058cc2ac2 willhan Mon Sep 21 03:15:51 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !25)
      • cc29dda9f53 willhan Mon Sep 21 11:12:25 2020 +0800 sleep 2 seconds when mysqld shutdown, waiting for thd::free_connection (just like mysql-5.7) otherwise, may crash
      • a0cf789adb2 willhan Fri Sep 4 14:18:39 2020 +0800 Update README.md Update README-cn.md
      • 3348c95331d willhan Thu Sep 3 07:28:47 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !24)
      • 4a9752c6956 yongxinxu Fri Aug 28 11:29:14 2020 +0800 Bugfix: sport Null Pointer Crash
      • 58352f849aa willhan Thu Aug 27 07:56:47 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !23)
      • 34376b7268c yongxinxu Wed Aug 26 11:15:29 2020 +0800 Bugfix: Trim() with remove_str Fails when Using the Spider Storage Engine
      • f94b7716cee willhan Mon Aug 10 01:50:35 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !22)
      • cd0fee0ef50 willhan Thu Aug 6 17:36:10 2020 +0800 fix bug for direct_limit
      • 2e375a0b059 willhan Fri Jul 17 10:22:16 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !21)
      • 290bb15bd07 willhan Fri Jul 17 18:15:32 2020 +0800 fix crash because of trx is null.
      • abec3dc5781 willhan Sun Jun 28 01:55:30 2020 +0000 Merge branch 'alex_new1' into 'tspider3.5' (merge request !20)
      • 3d0777a210a alexxing Fri Jun 19 19:57:37 2020 +0800 WL#12571 Support fully qualified hostnames longer than 60 characters
      • 9ee9b52c2c3 alexxing Fri Jun 19 19:13:37 2020 +0800 decrease username length to 32 characters
      • ddc69f26e33 willhan Fri Jun 19 10:25:36 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !19)
      • 4c70f4c32a3 willhan Fri Jun 19 18:17:25 2020 +0800 fix a bug of using tdbctl_is_ddl_by_ctl, and reduce the frequency calls of this function other, clang-format some code
      • 1e3cb412cc9 willhan Wed Jun 17 09:51:41 2020 +0800 1. remove some unuse code 2. clang-format some code 3. update Documentation
      • af1986d962b willhan Tue Jun 9 09:57:13 2020 +0000 Merge branch 'clang_format' into 'tspider3.5' (merge request !17)
      • 549c536f3ea danielye(叶绍崇) Tue Jun 9 17:35:47 2020 +0800 clang format src files under storage/spider
      • 3a62f4f526f willhan Wed Jun 3 04:00:47 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !14)
      • 79470cf3559 willhan Wed Jun 3 11:43:03 2020 +0800 Simply remove tokudb/rocksdb/mariabackup to reduce media size
      • 49d6e167625 willhan Wed Jun 3 11:31:33 2020 +0800 modify README.md and make mysqld shutdown fast
      • dad5faf9831 willhan Thu May 28 16:18:01 2020 +0800 update tendb cluster Documentation
      • c2e1882f601 willhan Sat May 23 03:52:25 2020 +0000 Merge branch 'tspider3.5_alex' into 'tspider3.5' (merge request !12)
      • c2e13c88782 willhan Sat May 23 03:52:15 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !13)
      • fe39984effe alexxing Fri May 22 16:46:39 2020 +0800 fix bug for mysql.servers cache when alter server
      • d67e5bb78a0 willhan Thu May 21 15:32:10 2020 +0800 add spider test suite from mariadb/spider
      • b22701941ad alexxing Fri May 22 16:15:33 2020 +0800 add session/global parameter:spider_not_show_partition 1. default 0 2. if spider_not_show_partition=1 ,means show create table without partition information
      • a5654125279 willhan Wed May 20 09:07:42 2020 +0000 Merge branch 'tspider3.5' into 'tspider3.5' (merge request !11)
      • bf2091bf1cf willhan Wed May 20 17:05:22 2020 +0800 fix a bug, when do "kill thread" + transaction + auto_incrment may cause a crash
      • 46987565808 willhan Wed May 20 17:04:52 2020 +0800 add TenDBCuster-License
      • 8e3090a01ef willhan Tue May 19 09:47:56 2020 +0800 set spider_idle_conn_recycle_interval default as 300
      • bd15cd2e425 willhan Thu May 7 20:31:46 2020 +0800 fix bug, when first get spider_auto_incement, spider would dispatch "select max(id)" to each data node; as a result, spider would do reset for each ha_spider
      • 4389a653139 willhan Wed May 6 18:33:08 2020 +0800 update Documentation
      • 537aa8a4c5e willhan Wed May 6 18:19:44 2020 +0800 remove some chinese character
      • 07f11190c5a willhan Wed May 6 17:54:50 2020 +0800 Fix "out of sync" issue at using quick_mode = 1 or 2
      • 7b06895e201 willhan Wed May 6 16:59:49 2020 +0800 fix bug for auto increment + transaction there may cause dead lock because of get max id by using "select max(id) for update"
      • adc4830cf69 willhan Wed May 6 15:30:16 2020 +0800 add cmake.sh for compile
      • a38ce2a59bf willhan Wed May 6 14:36:48 2020 +0800 set libmariadb as a main directory, but not a submodule
      • 35af09226d8 willhan Wed May 6 11:38:33 2020 +0800 fix bug, may cause crash when using transaction + auto_increment checkout the commit: 082ab1119303ffe4b711c23db23ea911d9c9cc83
      • 3e57de351d7 willhan(韩全安) Wed Apr 22 18:09:23 2020 +0800 add # Acknowledgents
      • 128a4cd1866 willhan(韩全安) Mon Apr 20 20:57:27 2020 +0800 fix doc
      • 8c64a7fd3c1 willhan(韩全安) Mon Apr 20 20:29:06 2020 +0800 fix documentation
      • cbe006efe8d willhan(韩全安) Mon Apr 20 19:16:08 2020 +0800 add tendb cluster documentation
      • f0860e2b7d0 willhan Tue Apr 7 21:53:50 2020 +0800 features and bug fix: 1. when mysql.server changed, free the old version spider_conn if set spider_error_when_flush_server=true (global variables), the query involed old version spider_conn would report ERROR 12701 2. fix bug for thread_count(may be negative number and caused crash) 3. fix bug for spider_dry_access, may cause crash ; spider will return ERROR 12730 when set spider_dry_access
      • d46d9d9ab83 willhan Thu Apr 2 16:06:45 2020 +0800 give the same execution plan as mysql when explain
      • b36a769c2c1 willhan Thu Apr 2 14:46:59 2020 +0800 set some insignificant parameters to be invisible to reduce the complexity of use
      • 0c48cb312e7 willhan Wed Apr 1 11:00:34 2020 +0800 main alter spider_tables as myisam, an non-transactional storage engine
      • 0b18d6e56e5 willhan Tue Mar 17 14:35:21 2020 +0800 fix bug, conn->semi_trx_chk is always FALSE, remove it
      • 8204309f22b willhan Tue Feb 25 15:56:08 2020 +0800 support for left join/right join/outer join, but the left table must have only one shard when left join and the right table must have only one shard when right join
      • da6d18aa7af willhan Mon Feb 24 14:26:07 2020 +0800 fix some bugs for direct_join: 1. get the partition information correctly, change the check scan partition from part_spec to part_info-> read_partitions; some modify in spider_create_group_by_handler; 2. print "field->table->const_table" when using spider_db_open_item_ident/spider_db_open_item_field 3. fix crash when "the SELECT with the INNER JOIN is executed with one of the two tables being optimized as a constant table", some modify in "spider_mysql_handler::append_list_item_select" 4. fix a problem by preventing spider from pushing down queries that include a field that is not a member of a table included in the optimized query
      • ec4f5b2dfc5 willhan Wed Jan 15 18:56:11 2020 +0800 modify log to logs; xa commit xid one phase with log ==> xa commit xid one phase with logs
      • a0f0e5e8233 willhan Tue Jan 14 10:20:48 2020 +0800 use [ERROR SPIDER RESULT] instead of [WARN SPIDER RESULT] for connection error
      • 06c876176e9 willhan Tue Jan 14 10:19:08 2020 +0800 remove unuse code to improve development efficiency
      • df853454276 willhan Fri Dec 20 15:48:08 2019 +0800 fix bug for mysqld_safe logging into err.log
      • b4b5c811706 willhan Tue Dec 17 15:17:41 2019 +0800 1. when spider_internal_xa is true, simple update/delete/insert/replace query involving multiply partition( include query not direct_update) would do xa transaction to data node; 2. thd->sql_use_partition_count++ when not direct_update/direct_delete 3. spider dispatch commit xid one phase /*!99302 with log */ to data node
      • 3e419402665 willhan Fri Dec 6 10:25:51 2019 +0800 do more Semantic check for mysql_alter_table, support for alter spider_t1 drop primary key, add primary key(c1,c2) ## c1 is the old primary key
      • 596d26dd3f8 willhan Fri Nov 1 16:09:59 2019 +0800 1. fix crash when spider bulk update; mysqld may be crashed if the thd is freed by close connection 2. set log_warnings default to 1, the same with mysql-5.5
      • 4ff537c178f willhan Mon Oct 21 15:04:53 2019 +0800 set spider system table as innodb; myisam would be easy damaged and need repair
      • ce3d4018d23 willhan Fri Oct 18 21:12:33 2019 +0800 1. fix bug when mysql install db by set ddl_execute_by_ctl 2. fix bug when shutdown (thread_count may grant than 0 because of spider bg action) 3. fix bug, tspider support insert/update mysql.servers when flush table with read lock 4. remove thr_lock in spider engine (some dead lock found when query insert/select in spider) 5. add read only variables tdbctl_skip_ddl_convert_db, default "performance_schema,information_schema,mysql,test,db_infobase", the list of database will ignore ddl_execute_by_ctl
      • 68963bf51fd willhan Mon Sep 16 10:03:07 2019 +0800 add READ_ONLY GLOBAL_VAR tdbctl_wrapper_name, default if "TDBCT", the wrapper name of tdbctl server
      • 3d132e4d7a9 willhan Fri Sep 6 10:59:20 2019 +0800 remove redefine variables
      • 082ab111930 willhan Fri Sep 6 10:56:13 2019 +0800 fix a crash because of spider_conns[0] do not set be NULL after reset
      • 472b8f83e62 alexxing Wed Sep 4 20:16:10 2019 +0800 fix bug for multi_dml 1.reset sql for multi update delete 2.use explicit_limit to control bg mode 3.add fun to get whther spider is in multi
      • 59423a5a4b5 willhan Mon Jul 22 15:03:22 2019 +0800 1. when flush table with read lock , we still can modify mysql.servers 2. add function get_server_by_wrapper, used for get ctl info
      • 373b5757f1b willhan Tue May 14 09:58:18 2019 +0800 fix bug for mroonga (not use)
      • 505c752a650 willhan Mon May 13 21:12:02 2019 +0800 move from spider storage, install spider table when mysql_install_db
      • f13d1527a4c willhan Mon May 13 19:08:55 2019 +0800 fix file path
      • 35e158089bc willhan Mon May 13 17:35:17 2019 +0800 rm unuse code
      • b4f7230d31f willhan Mon May 13 17:31:57 2019 +0800 add help
      • 89c5838d870 willhan Mon May 13 17:27:14 2019 +0800 modify mysql-test for tcadmin if you need to run "perl mysql-test-run.pl --suite=tcadmin --force", you must have a tdbctl instance and port is 27000, config just like this
      • b0f084d74f2 willhan Mon May 13 15:33:30 2019 +0800 fix crash for create procedure/function
      • 49201292b55 willhan Wed May 8 11:42:48 2019 +0800 tcadmin test suite init (suite from innodb)
      • f8d73ebbdc3 willhan Wed May 8 11:25:59 2019 +0800 add install_spider.sql to mysql_install_db
      • cb9840c6e55 willhan Wed May 8 10:54:41 2019 +0800 fix bug for alter table rename xx to yy
      • 0dc3ea69904 willhan Mon Apr 29 17:34:52 2019 +0800 fix bug, some query don't need to append use db
      • 0fcf2f75749 willhan Mon Apr 29 17:04:13 2019 +0800 1. retry connect when real_connect failed; retry times: connect_retry_count = 3; retry interval: connect_retry_interval = 1000(ms) 2. support for SQLCOM_ALTER_DB 3. for query "create/drop if (not) exist“ , push down to tdbctl whatever table (not) exists 4. forbid next sql type in spider: case SQLCOM_ALTER_SEQUENCE: case SQLCOM_ALTER_TABLESPACE: case SQLCOM_CREATE_PACKAGE: case SQLCOM_CREATE_PACKAGE_BODY: case SQLCOM_CREATE_SEQUENCE: case SQLCOM_DROP_PACKAGE: case SQLCOM_DROP_PACKAGE_BODY: case SQLCOM_DROP_SEQUENCE: case SQLCOM_GRANT_ROLE: case SQLCOM_RENAME_USER: case SQLCOM_REVOKE_ALL: case SQLCOM_REVOKE_ROLE: case SQLCOM_XA_COMMIT: case SQLCOM_XA_END: case SQLCOM_XA_PREPARE: case SQLCOM_XA_RECOVER: case SQLCOM_XA_ROLLBACK: case SQLCOM_XA_START:
      • dd7ecb05994 willhan Fri Apr 19 15:33:42 2019 +0800 1. fix some bugs 2. limit create/alter partition when set ddl_execute_by_ctl =1 3. add 2 error num: ER_BEFORE_EXEC_DDL_IN_CTL, ER_EXECUTE_DDL_FAILED_IN_CTL
      • faafb7cb89a willhan Fri Apr 12 19:33:13 2019 +0800 tspider ddl by ctl, 1. get tdbctl through mysql.servers, and tdbctl's Wrapper name must be "TDBCTL" 2. set ddl_exeucte_by_ctl=1; ddl query would dispatch to tdbctl; currently supported ddl: SQLCOM_CREATE_USER, SQLCOM_DROP_USER, SQLCOM_ALTER_USER, SQLCOM_RENAME_USER, SQLCOM_REVOKE_ALL, SQLCOM_REVOKE, SQLCOM_GRANT, SQLCOM_CREATE_EVENT, SQLCOM_ALTER_EVENT, SQLCOM_DROP_EVENT, SQLCOM_CREATE_PROCEDURE, SQLCOM_CREATE_SPFUNCTION, SQLCOM_ALTER_PROCEDURE, SQLCOM_DROP_PROCEDURE, SQLCOM_CREATE_FUNCTION, SQLCOM_ALTER_FUNCTION, SQLCOM_DROP_FUNCTION, SQLCOM_CREATE_TRIGGER, SQLCOM_DROP_TRIGGER, SQLCOM_CREATE_VIEW, SQLCOM_DROP_VIEW, SQLCOM_CREATE_TABLE, SQLCOM_DROP_TABLE, SQLCOM_ALTER_TABLE, SQLCOM_RENAME_TABLE, SQLCOM_CREATE_INDEX, SQLCOM_DROP_INDEX, SQLCOM_CREATE_DB, SQLCOM_DROP_DB
      • 20b447b3a20 willhan Mon Apr 29 17:34:52 2019 +0800 fix bug, some query don't need to append use db
      • 5e26abd6080 willhan Mon Apr 29 17:04:13 2019 +0800 1. retry connect when real_connect failed; retry times: connect_retry_count = 3; retry interval: connect_retry_interval = 1000(ms) 2. support for SQLCOM_ALTER_DB 3. for query "create/drop if (not) exist“ , push down to tdbctl whatever table (not) exists 4. forbid next sql type in spider: case SQLCOM_ALTER_SEQUENCE: case SQLCOM_ALTER_TABLESPACE: case SQLCOM_CREATE_PACKAGE: case SQLCOM_CREATE_PACKAGE_BODY: case SQLCOM_CREATE_SEQUENCE: case SQLCOM_DROP_PACKAGE: case SQLCOM_DROP_PACKAGE_BODY: case SQLCOM_DROP_SEQUENCE: case SQLCOM_GRANT_ROLE: case SQLCOM_RENAME_USER: case SQLCOM_REVOKE_ALL: case SQLCOM_REVOKE_ROLE: case SQLCOM_XA_COMMIT: case SQLCOM_XA_END: case SQLCOM_XA_PREPARE: case SQLCOM_XA_RECOVER: case SQLCOM_XA_ROLLBACK: case SQLCOM_XA_START:
      • 19530a4f0a2 willhan Fri Apr 19 15:33:42 2019 +0800 1. fix some bugs 2. limit create/alter partition when set ddl_execute_by_ctl =1 3. add 2 error num: ER_BEFORE_EXEC_DDL_IN_CTL, ER_EXECUTE_DDL_FAILED_IN_CTL
      • 9fed6b21d29 willhan Fri Apr 12 19:33:13 2019 +0800 tspider ddl by ctl, 1. get tdbctl through mysql.servers, and tdbctl's Wrapper name must be "TDBCTL" 2. set ddl_exeucte_by_ctl=1; ddl query would dispatch to tdbctl; currently supported ddl: SQLCOM_CREATE_USER, SQLCOM_DROP_USER, SQLCOM_ALTER_USER, SQLCOM_RENAME_USER, SQLCOM_REVOKE_ALL, SQLCOM_REVOKE, SQLCOM_GRANT, SQLCOM_CREATE_EVENT, SQLCOM_ALTER_EVENT, SQLCOM_DROP_EVENT, SQLCOM_CREATE_PROCEDURE, SQLCOM_CREATE_SPFUNCTION, SQLCOM_ALTER_PROCEDURE, SQLCOM_DROP_PROCEDURE, SQLCOM_CREATE_FUNCTION, SQLCOM_ALTER_FUNCTION, SQLCOM_DROP_FUNCTION, SQLCOM_CREATE_TRIGGER, SQLCOM_DROP_TRIGGER, SQLCOM_CREATE_VIEW, SQLCOM_DROP_VIEW, SQLCOM_CREATE_TABLE, SQLCOM_DROP_TABLE, SQLCOM_ALTER_TABLE, SQLCOM_RENAME_TABLE, SQLCOM_CREATE_INDEX, SQLCOM_DROP_INDEX, SQLCOM_CREATE_DB, SQLCOM_DROP_DB
      • 389e453e639 willhan Fri Sep 21 19:04:10 2018 +0800 实现三种kill threads的方式: 1. kill thread_id safe(kill 9 safe) 与直接kill thread_id不同的是,只有当该thread id是sleep状态且非事务中,才会被kill, 否则报错: ER_THREAD_IN_USING_OR_TRANSACTION , "thread %lu is in using or in transaction, can't be killed safe" 2. kill threads all 用来安全的kill当前threads。 sleep状态且非事务中的threads会被kill掉,其它thread则等待当前query执行完成或者事务结束才被kill 3. kill threads all force 用来kill当前所有运行的thread
      • e4f311c40ba willhan Tue Sep 25 19:26:03 2018 +0800 增加read only global 参数spider_group_by_handler,默认为fase, 表示禁止掉spider的direct join行为(存在bug)
      • b6b632d4ce7 willhan Wed Sep 4 10:07:17 2019 +0800 Merge branch 'tspider_3.3.3_multi_dev_1' into 'tspider3.3.3'
      • b6d7dcc39a1 alexxing Fri Aug 16 10:41:29 2019 +0800 Merge branch 'tspider3.3.3' of http://code.gcs.ied.com/tendb/TendbCluster3 into tspider_3.3.3_multi_dev
      • 276fc04a169 alexxing Wed Aug 7 20:05:16 2019 +0800 allow more than 10 error files for test_suite
      • eea7c921da2 alexxing Wed Aug 7 09:53:43 2019 +0800 add log for unkown error
      • 8165e28ac2f alexxing Mon Aug 5 22:15:18 2019 +0800 add ms for err log
      • 9288c036221 alexxing Mon Aug 5 10:05:59 2019 +0800 add port for general_log
      • 2e8022dba43 alexxing Fri Aug 2 15:16:50 2019 +0800 fix bug for multi_insert 1.crash caused by thread recycle 2.ignore HA_ERR_END_OF_FILE 3.bulk insert for one record
      • 546911610f9 willhan Fri Jul 19 20:07:45 2019 +0800 Merge branch 'tspider3.3.3_dev' into 'tspider3.3.3'
      • 3943bff0af2 alexxing Thu Jul 18 22:21:49 2019 +0800 support regexp for spider
      • a73176ef175 alexxing Thu Jul 18 22:03:19 2019 +0800 fix bug for spider select union with prefix index
      • 50193c35131 alexxing Thu Jul 18 17:52:38 2019 +0800 fix bug when open binlog,for 2 pc commit
      • d18ca4061a4 alexxing Wed Jul 17 18:15:07 2019 +0800 multi thread for direct_delete 1. handler->ha_get_bg_result: means wait for the background thread in handler API 2. spider_set_conn_bg_param_for_dml: check whether it can insert parallel mode. Maybe it should decided by a new spider parameter 3. spider_db_direct_delete: main logic for parallel update 4. spider_bg_conn_action: reuse the most logic 5. make sure spider_bgs_mode=1 spider_bg_dml=1 and sql must without limit x and only one table included
      • c6140975397 alexxing Mon Jul 15 17:07:03 2019 +0800 multi thread for direct_update 1. handler->ha_get_bg_result: means wait for the background thread in handler API 2. spider_set_conn_bg_param_for_dml: check whether it can insert parallel mode. Maybe it should decided by a new spider parameter 3. spider_db_direct_update: main logic for parallel update 4. spider_bg_conn_action: reuse the most logic 5. make sure spider_bgs_mode=1 spider_bg_dml=1 and sql must without limit x and only one table included
      • 031baa61bd0 alexxing Thu Jul 11 16:38:19 2019 +0800 multi thread for bulk insert
      • 41ef071849b alexxing Wed Jun 26 21:50:08 2019 +0800 fix test-suite:vp_fixes.test
      • 6ec9c7333dd willhan Wed Jun 26 20:16:18 2019 +0800 fix bug
      • 092cf809cb1 willhan Wed Jun 26 17:16:13 2019 +0800 fix bug for wrong result 1. select * from t1 where 1=2 cause crash (because of without my_ok(thd)) 2. select count from t1 where 1=2 would return like this mysql> select count from t1 where 1=2; --------- | count | -------- | 0 | ---------
      • 868fb387cff alexxing Tue Jun 25 09:45:15 2019 +0800 fix for spider xa start
      • 090d9faddac alexxing Mon Jun 24 23:40:56 2019 +0800 add test-suite for spider create table
      • 4aab59e9ed5 alexxing Mon Jun 24 23:08:24 2019 +0800 fix test-suite:modify create spider table by server_name
      • 94c2ba6ec0c alexxing Mon Jun 3 16:59:17 2019 +0800 fix bug 1.add mdl for lock table and get_lock 2.prohibit lock in the period of ftwwl 3.prohibit get_lock in the period of ftwwl, add switch_s for ddl 4.add explicit switch_s for handler
      • 3489acf1b9c alexxing Tue May 28 22:01:27 2019 +0800 flush table with write lock 1.this feature makes for spider xa switch 2.add explict user_lock MDL_X for flush table with write lock 3.add transaction user_lock MDL_S when start transaction and spider_internal_xa=ON 4.add statement user_lock MDL_S when autocommit=1 and without transaction and spider_internal_xa=ON 5.add explict user_lock MDL_S for flush table with read lock to prohibit MDL_X in case of dead lock 6.move session-variable:spider_internal_xa to global-read-only 7.fix bug for make package and delete some unuse code
      • 7207c7cfe24 alexxing Fri May 24 20:08:36 2019 +0800 flush table with write lock 1.this feature makes for spider xa switch 2.add global MDL_X for flush table with write lock 3.add global MDL_S when start transaction and spider_internal_xa=ON 4.move session-variable:spider_internal_xa to global-read-only
      • 356c0558b1c alexxing Wed May 8 11:21:39 2019 +0800 add sql: flush table with write lock 1. add global-transaction-MDL_EXCLUSIVE for flush table with write lock 2. move spider_internal_xa to server 3. add scope_lock:MDL_INTENTION_SHARED for select ,when spider_internal_xa=ON 4. when spider_internal_xa=ON , dml add scope_lock for transaction not statement
      • d599b9fe98a alexxing Tue Apr 30 15:03:41 2019 +0800 spider obtains the connection information and establishes the connection by using the server name in mysql.servers in the share as conn_key. fix bug :1.when server_name is null ,spider may be crash;2.when thd->is_error,free conn directly
      • 11aa959a481 alexxing Fri Mar 29 17:18:33 2019 +0800 1.merge xa_end and xa_prepare 2.split spider_xid_cache with sever_xid_cache 3.add ER_SPIDER_XA_MAY_PARTIAL_COMMIT_NUM for partital commit 4.add spider_ignore_xa_log 5.modify xid create rule 6.support commit one phase:if xa-trasaction concerns only one shard,then exe commit on phase 7.add spider_trans_rollback for xa
      • 4cefbcc641d alexxing Wed Jun 19 14:37:01 2019 +0800 [fix test-suite] : optimize for spider_query_one_shard.test
      • 8dc685e7837 alexxing Wed Jun 19 10:09:32 2019 +0800 fix test-suite:optimize for spider_kill_thread.test
      • 4cdbcc49764 alexxing Fri Jun 14 17:09:44 2019 +0800 modify mysql-test/mysql-test-run.pl 1. install spider for mysql-test 2. fix mysql-test:it is doomed to failure when run test without result file
      • f56c684d1cb alexxing Thu Jun 13 17:59:48 2019 +0800 fix for install
      • c1504b69c55 alexxing Thu Jun 13 16:59:06 2019 +0800 make for mysql-test
      • 1ab86682dc9 alexxing Thu Jun 13 15:43:50 2019 +0800 fix memory bug for TIMESTAMPDIFF
      • 64d4d8f0d30 alexxing Thu May 16 17:27:48 2019 +0800 fix some bug from environment
      • 676becc60db alexxing Tue Mar 19 11:54:25 2019 +0800 reset for insert_crash_fix
      • 459478db24a alexxing Tue Mar 19 11:33:52 2019 +0800 modify fix_sysdate_bug insert_crash_fix spider_set_autocommit and add test-suite for spider_ignore_autocommit
      • 11cf8c40b68 alexxing Wed Mar 13 20:25:53 2019 +0800 make comment for test-suite
      • f9aa9d894b4 alexxing Wed Mar 13 15:52:39 2019 +0800 make test-suite for spider
      • de6199df856 alexxing Tue Jun 18 11:44:09 2019 +0800 fix bug for spider_xa_lock
      • 48f82ae9c21 alexxing Mon Jun 3 16:59:17 2019 +0800 fix bug 1.add mdl for lock table and get_lock 2.prohibit lock in the period of ftwwl 3.prohibit get_lock in the period of ftwwl, add switch_s for ddl 4.add explicit switch_s for handler
      • 005abac2abb alexxing Fri May 31 11:27:06 2019 +0800 rename for README.md
      • d75e831fe16 alexxing Tue May 28 22:01:27 2019 +0800 flush table with write lock 1.this feature makes for spider xa switch 2.add explict user_lock MDL_X for flush table with write lock 3.add transaction user_lock MDL_S when start transaction and spider_internal_xa=ON 4.add statement user_lock MDL_S when autocommit=1 and without transaction and spider_internal_xa=ON 5.add explict user_lock MDL_S for flush table with read lock to prohibit MDL_X in case of dead lock 6.move session-variable:spider_internal_xa to global-read-only 7.fix bug for make package and delete some unuse code
      • 6352a118b8d alexxing Fri May 24 20:08:36 2019 +0800 flush table with write lock 1.this feature makes for spider xa switch 2.add global MDL_X for flush table with write lock 3.add global MDL_S when start transaction and spider_internal_xa=ON 4.move session-variable:spider_internal_xa to global-read-only
      • ac64586d48f willhan Mon May 27 11:01:26 2019 +0800 modify README for tendbcluster
      • 093c3f97569 alexxing Wed May 8 11:21:39 2019 +0800 add sql: flush table with write lock 1. add global-transaction-MDL_EXCLUSIVE for flush table with write lock 2. move spider_internal_xa to server 3. add scope_lock:MDL_INTENTION_SHARED for select ,when spider_internal_xa=ON 4. when spider_internal_xa=ON , dml add scope_lock for transaction not statement
      • 8f2a8208f5d alexxing Tue Apr 30 15:03:41 2019 +0800 spider obtains the connection information and establishes the connection by using the server name in mysql.servers in the share as conn_key. fix bug :1.when server_name is null ,spider may be crash;2.when thd->is_error,free conn directly
      • 3d41b6be22d alexxing Fri Mar 29 17:18:33 2019 +0800 1.merge xa_end and xa_prepare 2.split spider_xid_cache with sever_xid_cache 3.add ER_SPIDER_XA_MAY_PARTIAL_COMMIT_NUM for partital commit 4.add spider_ignore_xa_log 5.modify xid create rule 6.support commit one phase:if xa-trasaction concerns only one shard,then exe commit on phase 7.add spider_trans_rollback for xa
      • d99ff474623 willhan Mon May 20 16:26:03 2019 +0800 base from tspider-3.2.3 would rebase tspider-3.2.6, tspider-3.3
      • 4814723e203 willhan Thu May 2 10:00:30 2019 +0800 fix bog for spider auto increment; Mixed use spider auto increment occus error
      • a7aa9365cc7 willhan Tue Apr 30 17:18:51 2019 +0800 fix bug for x'' as hex data;
      • 6c145573e41 willhan Fri Sep 21 19:04:10 2018 +0800 实现三种kill threads的方式: 1. kill thread_id safe(kill 9 safe) 与直接kill thread_id不同的是,只有当该thread id是sleep状态且非事务中,才会被kill, 否则报错: ER_THREAD_IN_USING_OR_TRANSACTION , "thread %lu is in using or in transaction, can't be killed safe" 2. kill threads all 用来安全的kill当前threads。 sleep状态且非事务中的threads会被kill掉,其它thread则等待当前query执行完成或者事务结束才被kill 3. kill threads all force 用来kill当前所有运行的thread
      • 4ee0f06df8c willhan Fri May 10 15:37:34 2019 +0800 fix bug
      • 8f20ff552bf willhan Tue Dec 11 11:01:25 2018 +0800 修复的tspider-3.x shutdown可能卡死的问题。 shutdown失败的原因: mariadb对thd的线程处理与mysql略有不同, 初始化一个后台线程时会让一个全局变量threads_count++; shutdown时会判断这个值是否为0,否则等待; tspider通过handler接口析构也有异常,没把cond wait的后台线程析构掉, 从而threads_count就没有--; 主线程shutdown判断theads_count时,不为0就cond wait就卡死了;
      • da9bc5f9077 willhan Tue Nov 27 18:16:49 2018 +0800 remote spider_ping, may cause crash
      • 1aaafe70272 willhan Thu Nov 22 15:17:18 2018 +0800 修复select * from tb where id in (xxx) 中的(xxx) 值列表值的个数大于1000时碰到的bug。
      • bb8df16f6f0 willhan Mon Oct 15 16:10:45 2018 +0800 修复thd->self_kill在linux下状态可能异常的bug
      • dba77271176 willhan Mon Oct 15 15:19:43 2018 +0800 fix bug from linux connection
      • 151e5e438c9 willhan Mon Oct 15 10:15:56 2018 +0800 fix bug for set sql_mode='oracle'
      • a067668bd0b willhan Tue Sep 25 19:26:03 2018 +0800 增加read only global 参数spider_group_by_handler,默认为fase, 表示禁止掉spider的direct join行为(存在bug)
      • 54a2566fe0f willhan Fri Oct 12 18:49:59 2018 +0800 1. 增加能识别hint为99106的tmysql版本号; 可识别99100到99106间的版本号。 hint为123456表示不支持 2. 修正kill all threads时错错误号的输出方式 (当前也并不完善,但为了不新增额外错误号或者更新错误号定义, 暂且用0表示ER_KILL_DENIED_ERROR错误内容中的 %lu)
      • 87bda135d61 willhan Fri Sep 21 19:04:10 2018 +0800 实现三种kill threads的方式: 1. kill thread_id safe(kill 9 safe) 与直接kill thread_id不同的是,只有当该thread id是sleep状态且非事务中,才会被kill, 否则报错: ER_THREAD_IN_USING_OR_TRANSACTION , "thread %lu is in using or in transaction, can't be killed safe" 2. kill threads all 用来安全的kill当前threads。 sleep状态且非事务中的threads会被kill掉,其它thread则等待当前query执行完成或者事务结束才被kill 3. kill threads all force 用来kill当前所有运行的thread
      • c177ebdcd5b willhan Fri Sep 14 20:00:37 2018 +0800 区分opt_spider_ignore_single_select_index与opt_spider_ignore_single_update_index, 后者对update时索引优化还不彻底,且存在疑问(不确定是否完全无隐患)。 暂且通过这种暴力的方式,先禁用掉一些对update中的索引优化。
      • 156fc0c4230 willhan Fri Sep 14 17:46:08 2018 +0800 优化direct update/delete等逻辑,减少无效cpu开销
      • 294cb4a2e30 willhan Fri Sep 14 11:01:44 2018 +0800 提升spider中update性能: 1. info push,涉及分区才执行 2. cond pop,涉及分区才执行 3. mrr等索引优化,在spider中不执行 4. 正常query中,不拼接explain update需要的信息
      • 43681370a9a willhan Thu Sep 13 16:15:36 2018 +0800 1. 增加read only参数spider_enable_trx_ha,默认为false,禁止掉trx_ha的分配释放及维护,能较明显提升性能 2. 在释放资源的时候,不维护spider_add_conn_meta_info,提升性能
      • 3397077d231 willhan Tue Sep 11 18:00:30 2018 +0800 增加一个read only 参数spider_enable_mem_calc,默认为false,禁止收集spider各个参数分配的内存信息
      • 4222f7d982d willhan Tue Sep 11 16:41:28 2018 +0800 Merge branch 'tspider3' of http://code.gcs.ied.com/willhan/TendbCluster3 into tspider3
      • acefc910471 willhan Tue Sep 11 16:40:34 2018 +0800 优化分区数过多时,无效循环导致的性能问题
      • b53fc9be3de willhan Thu Sep 6 17:04:14 2018 +0800 fix some test suite
      • 4b531456de7 willhan Wed Sep 5 17:03:43 2018 +0800 两个问题: 1. 修复tspider在conditiion push down时,将cond传递给了每个shard的bug,只需要下放给需要的shard。 否则会因为错误下放,而reset的时候却不释放导致crash
      • cb24eafa55e willhan Wed Sep 5 14:55:15 2018 +0800 fix test suite
      • 34a0429f1bb willhan Tue Sep 4 15:12:13 2018 +0800 fix bug , query_cache_store_query may use twice, only do that after lock table
      • c412a40f6dd willhan Thu Aug 30 18:06:31 2018 +0800 fix test suite
      • 7dbd2c40330 willhan Thu Aug 30 17:17:58 2018 +0800 fix some test suite
      • 84aab0982ef willhan Thu Aug 30 17:14:58 2018 +0800 Merge branch 'tspider3' of http://code.gcs.ied.com/willhan/TendbCluster3 into tspider3
      • 154fc2d639d willhan Thu Aug 30 17:08:39 2018 +0800 fix bug 修正测例 create or replace table t1 (a int, b varchar(10) generated always as (sysdate()) virtual); 暴露出的bug
      • 11853b7abc2 willhan Thu Aug 30 10:38:33 2018 +0800 fix for test suite, sql/log_event.h, for modify the binlog head
      • b25339a70fb willhan Thu Aug 30 10:36:59 2018 +0800 Merge branch 'tspider3' of http://code.gcs.ied.com/willhan/TendbCluster3 into tspider3
      • 93a0467653d willhan Thu Aug 30 10:28:47 2018 +0800 修正 ON UPDATE current_timestamp(0)在show create table时, 显示为ON UPDATE CURRENT_TIMESTAMP
      • f648903ac76 willhan Wed Aug 29 10:09:04 2018 +0800 Merge branch 'tspider3' of http://code.gcs.ied.com/willhan/TendbCluster3 into tspider3
      • 187e4884f9e willhan Wed Aug 29 10:08:14 2018 +0800 fix bug for maria
      • e1a59751535 willhan Tue Aug 28 15:51:02 2018 +0800 Merge branch 'tspider3' of http://code.gcs.ied.com/willhan/TendbCluster3 into tspider3
      • daf581f0111 willhan Tue Aug 28 15:49:43 2018 +0800 * let current_timestamp in show create table display as CURRENT_TIMESTAMP
      • 2bf7ad843ad willhan Mon Aug 27 19:57:24 2018 +0800 Merge branch 'tspider3' of http://code.gcs.ied.com/willhan/TendbCluster3 into tspider3
      • 4a2a62d32af willhan Mon Aug 27 19:53:46 2018 +0800 fix for test suite, fix for mysqldump, set no-data-med default is 0, and ignore spider
      • 9c7fa4117fd willhan Mon Aug 27 18:02:22 2018 +0800 Merge branch 'tspider3' of http://code.gcs.ied.com/willhan/TendbCluster3 into tspider3
      • 102b5820d79 willhan Mon Aug 27 17:58:20 2018 +0800 fix for test suite
      • c448cc88dea willhan Mon Aug 27 17:18:03 2018 +0800 fix some test suite
      • 1800d7e8733 willhan Thu Aug 23 14:36:47 2018 +0800 修复下面测例导致的crash
      • 323d887e002 willhan Mon Aug 20 17:33:27 2018 +0800 修正两个bug: 1. open_normal_and_derived_tables的参数传递错误,无需要dt_prepare 2. 修正insert过程中,can prune insert中对虚拟列的处理的BUG。
      • 37dde1d9ef5 willhan Thu Aug 16 15:18:33 2018 +0800 分区性能优化: 通过在lock table前优先执行prune_partition消减分区,提升partition表在多分区下的select/insert/delete/update/replace性能
      • 5dc0485725a willhan Fri Aug 3 10:34:36 2018 +0800 分区性能优化: 临时测试提交
      • c224151c044 willhan Mon Aug 27 17:56:55 2018 +0800 fix for mysqldump set no-data-med default is 0, and ignore spider
      • fc06fedcd19 willhan Mon Aug 27 17:18:03 2018 +0800 fix some test suite
      • 8460b3add58 willhan Thu Aug 23 14:36:47 2018 +0800 修复下面测例导致的crash
      • 46317c1609c willhan Mon Aug 20 17:33:27 2018 +0800 修正两个bug: 1. open_normal_and_derived_tables的参数传递错误,无需要dt_prepare 2. 修正insert过程中,can prune insert中对虚拟列的处理的BUG。
      • e4367aec8e2 willhan Thu Aug 16 15:18:33 2018 +0800 分区性能优化: 通过在lock table前优先执行prune_partition消减分区,提升partition表在多分区下的select/insert/delete/update/replace性能
      • 01047a146cd willhan Fri Aug 3 10:34:36 2018 +0800 分区性能优化: 临时测试提交
      • fe7a117583b willhan Mon Jul 16 16:31:56 2018 +0800 fix some variables
      • 88482c5eea6 willhan Fri Jul 13 10:22:51 2018 +0800 更改compresesed相关的binlog事件序号 修改sql_mode默认值为0,
      • e1a04691e98 willhan Tue Jul 3 14:23:55 2018 +0800 mysql.alter_log记录所有alter table日志 为了方便统计表变更的时间和在线加字段的收益,新增mysql.alter_log表记录所有alter table的日志
      • bff65786713 willhan Fri Jun 22 16:43:53 2018 +0800 reduce shutdown time, from 4 to 2 seconds
      • 1b0c664598c willhan Fri Jun 22 15:02:33 2018 +0800 Merge branch 'tspider-3.0' of http://code.gcs.ied.com/willhan/TendbCluster3 into tspider-3.0
      • dcfe1f27202 willhan Fri Jun 22 14:58:45 2018 +0800 几个值的初始化
      • 0bfde1d2846 willhan Fri Jun 22 14:26:37 2018 +0800 fix mariadb bug net上保存thd变更,可能导致spider的内存溢出,crash。
      • 794c9ea8443 willhan Wed Jun 20 09:43:00 2018 +0800 fix some possible crash
      • 01d50b42f1d willhan Thu Jun 14 18:10:54 2018 +0800 add jemalloc
      • 90bee98de82 willhan Wed Jun 13 15:32:07 2018 +0800 laster libmariadb
      • b072ebc5dca willhan Wed Jun 13 15:28:34 2018 +0800 fix for suite
      • 5ce016d56c5 willhan Tue Jun 12 16:09:42 2018 +0800 fix for test suite
      • 36933bff9f7 willhan Tue Jun 12 15:05:58 2018 +0800 fix crash 使用sql_sequence会出现crash. suite如下: perl mysql-test-run.pl sql_sequence.create 'innodb' perl mysql-test-run.pl sql_sequence.next 'innodb' perl mysql-test-run.pl sql_sequence.default
      • 2ef60bc9bb9 willhan Mon Jun 11 15:50:00 2018 +0800 修正前面的一个提交, set autocommit为0时, 会发磅autocommit=0到remote mysql,后面的事务不需要显示指定start transaction
      • 5f563395449 willhan Mon Jun 11 15:02:55 2018 +0800 两个修正: 1. lock_wait_timeout默认值改为300s 2. 修复在tspider-1.9.x中碰到的,thd->lex->type的值不可靠的异常。使用thd->spider_fetures_type替代。
      • 330e7e88995 willhan Mon Jun 11 14:46:27 2018 +0800 修复两个bug 1. 修复spider_conns中时间显示异常的bug 2. 修复在set autocommit=0时,事务commit后。 后面的事务未发送start transaction到remote mysql实例中
      • 1ef4443befa willhan Fri Jun 1 10:01:27 2018 +0800 事务中,暂且不使用并行逻辑。 (另一个处理方式是, 将事务状态放在conn中,从而保证正确发送begin/commit到remote)
      • c82da22af0b willhan Thu May 31 16:31:33 2018 +0800 fix bug
      • 1e6bc58f166 willhan Thu May 31 11:14:15 2018 +0800 fix compile bug after rebase 10.3
      • d7dc48d03e3 willhan Fri May 25 12:20:47 2018 +0800 fix bug mariadb将not like优化为 ! like, 对innodb没问题 但对于spider引擎, 分发like到remote mysql中查询结果,再匹配 not则不正确
      • 804e85fa277 willhan Thu May 17 14:49:05 2018 +0800 内存泄露, new了一些用于后台收集线程的资源,但实际并未使用后台收集线程。因此资源生成后无法被释放。
      • 3426ec9f704 willhan Fri May 11 19:30:43 2018 +0800 让mysql shutdown更快, 主要是thread释放时间
      • 41d1b2fc8e2 willhan Fri May 11 11:56:35 2018 +0800 修复统计信息线程无thd导致的crash. mysqld server上调用mysql api需要初始化thd
      • 99e32253a3f willhan Wed May 9 10:32:05 2018 +0800 for libmariadb
      • 0946b38c673 willhan Wed May 9 10:26:19 2018 +0800 add cmake.option
      • 8b27ab00dee willhan Fri May 4 17:58:49 2018 +0800 修复计算mdl key hash_value可能错误的bug,可能导致所以有query全部hang的获取share对象中。 原罪: 获取到share对象, 发现share->flushed为true,则再次在tdc_hash中尝试获取,却无法获取成功。retry获取share 在flush前后,统一使用hash_value的方式来获取share对象。
      • d6a74f872c8 willhan Thu May 3 15:29:26 2018 +0800 bug修复 flush table with no block后,可能导致生成重复的自增列值。原因: 自增列信息为table_share拥有,由table_share保证并发控制。flush table with no block则生成一个新版本的table_share,因此自增值生成不能保证并发。 本修复: 在执行flush table no block后,淘汰旧版本的自增列写入。
      • 60bdf8f20d2 willhan Wed May 2 19:50:35 2018 +0800 fix bug, 在执行show create table后,会赋值一个auto_inc状态,影响到后面auto_inc的生成。 导致生成重复的自增列
      • e7cc716c311 willhan Wed May 2 18:19:28 2018 +0800 fix crash。 各个session分别获取自增值,会crash
      • 14093fc869b willhan Tue Apr 24 14:57:53 2018 +0800 修复mysqld无法shutdown的问题。(因线程没有结束) 另外,修复告警。
      • 88f22c3acbf willhan Mon Apr 23 16:32:57 2018 +0800 把install_spider.sql放在scripts目录下
      • 3578b2641fb willhan Fri Apr 20 15:36:00 2018 +0800 fix somo test suite
      • ca178c67c20 willhan Wed Apr 18 17:13:00 2018 +0800 set opt_no_data_med default to 0
      • 19e542025d7 willhan Wed Apr 18 16:40:04 2018 +0800 shutdown时关掉线程,否则影响shutdown

      Bug fix:

      • 814793073d9 willhan Wed Apr 18 16:03:34 2018 +0800 修复sql_mode为oracle时语法报错的bug
      • fe0179f8de2 willhan Wed Apr 18 11:38:25 2018 +0800 修复一些代码bug。 另外,修复sql_safe_updates启用中, 对主键的delete显示unsafe的bug。 index_range功能,可以被opt_spider_ignore_single_select_index替换,可以去掉
      • 6591e81185c willhan Tue Apr 17 15:21:59 2018 +0800 修复bug 二进制用十六进制方式作为条件时,截取长度不对 select hex(id),hex(name) from t_blob where name=0x15101408BFF8380088000C458048000C0000。
      • a49e1e02db4 willhan Fri Apr 13 16:48:47 2018 +0800 修复把二进制字段作为where 条件时的bug。 当field为binary时,对field的条件判断不需要对value进行字符集转换。 但作为condition时,无法感知到field的字符集。
      • 52c5cf14647 willhan Mon Apr 2 17:24:10 2018 +0800 fix bug, 对于存在全文索引的表, 不支持单表情况下走全表扫描
      • f188d79885a willhan Thu Mar 22 17:42:01 2018 +0800 修复select a, count from t group by a order by 2 desc limit n;执行时的bug 上述query在spider分发时,会分发group by order by limit 到remote,最终得到错误结果。 修复,对gropu by + limit 的query,不分发limit 到remote中
      • 328f079ace4 willhan Thu Mar 22 16:41:36 2018 +0800 修复load data local infile xxx replace into table t这种用法下的bug。 上述query在tspider中分发的逻辑中insert into ignore; 修正后,这种load data分发replace后remote中
      • ee2cc8c1bf9 willhan Mon Mar 12 17:21:07 2018 +0800 fix spider crash
      • 983f9023c6e willhan Fri Mar 9 11:57:54 2018 +0800 修复cache计算的bug 如下sql select uin, svr_id from DBPlayerInfo where level < 16 and date(now()) - date(logout_time) > 14; 会分发date(now())的结果, 再与date(logout_time)比较。是不对的
      • 02fb7778bef willhan Tue Mar 6 16:32:57 2018 +0800 修复truncate后,当前连接无法回收的bug。 可能导致连接使用混乱,事务无法提交。
      • 4f3c71de82c willhan Mon Mar 5 17:52:19 2018 +0800 修复可能无法获取到conn,conn为null的bug
      • dfcd12d264e willhan Mon Mar 5 12:05:43 2018 +0800 修复一些修版本中的bug,但当前版本并没有复现出来 1. 非direct_update时部分列没有正确select到,导致更新失败的问题 对应旧版本的git log: SHA-1: 324b66a2011605686842060a02dac1bab256a0c7 2. 修复index_range=off但index_merge_intersection=on,导致crash的问题 对应旧版本的git log: SHA-1: 248d413090544aa3677e592db77850380bb6eb73
      • 1eb3dc3b7b8 willhan Fri Mar 2 17:27:10 2018 +0800 修复对表中timestamp字段有更新bug
      • 3b8b2faf321 willhan Wed Feb 28 17:03:42 2018 +0800 修复跨分区性能视图中, 将跨分区操作后的command计入跨分区操作的bug
      • [feature + bug fix] 89e95b3da2f willhan Wed Feb 28 16:37:01 2018 +0800 几个优化: 1. 当指定SQL_NO_CACHE(mysqldump)时,禁用pre_scan优化,避免最后的分区获取结果超时 2. direct_update/direct_delete支持指定limit,如: delete * from t1 where id > 100 limit 100; update t1 set d1 = 1 where id > 100 limit 100; 3. 对于第2点: 如果指定order by,不支持direct_update/direct_delete 4. 如果包含用户变量,不支持direct_update/direct_delete set @i:=@i+1; update test_incr set d2 =(@i:=@i+1) limit 10; 5. 默认启用bulk update/delete
      • 6b149b0b2cf willhan Tue Feb 6 20:16:19 2018 +0800 fix bug
      • 61954f82332 willhan Tue Feb 6 14:57:42 2018 +0800 fix bug
      • 0b0ad28cde0 willhan Tue Feb 6 11:26:29 2018 +0800 fix bug
      • cfbf293c432 willhan Mon Feb 5 15:23:02 2018 +0800 fix bug conn may be null, crash
      • 64dafe88143 willhan Tue Jan 30 12:09:30 2018 +0800 fix bug. when applicate conn using CLIENT_FOUND_ROWS, tspider return matched_rows instead of affected_rows
      • 7619f3a4437 willhan Tue Jan 30 09:59:47 2018 +0800 fix bug. dup_update_sql's charset is wrong
      • bd22def6a3f willhan Mon Jan 29 14:56:56 2018 +0800 * fix bug set share->use_count-- when share->init is always FALSE
      • ebe138e1b7b willhan Fri Jan 26 16:50:32 2018 +0800 fix bug set names charset is different with table charset, must convert charset to table charset
      • 39b80f2432c willhan Wed Jan 24 15:45:06 2018 +0800 fix bug set share->use_count-- when share->init is always FALSE

      feature/enhancement/optimization (out of scope of the issue)

      • 0422705452d willhan Fri Mar 30 19:32:46 2018 +0800 support gcs/gcs_dynamic
      • 04914d04ad8 willhan Wed Mar 28 16:31:02 2018 +0800 通过后台线程spider_get_status_action实现统计信息的收集 说明如下3个参数 1. spider_modify_interval, 全局参数,用于控制spider_table_status的更新频率,默认为8小时 2. spider_sts_interval,会话级参数,用于控制share 对象读取spider_table_status的频率,默认为3小时 3. spider_get_sts_or_crd,全局参数。用于控制是否启用统计信息,当前默认为false。
      • ebe7d6c83ab willhan Thu Mar 22 15:19:34 2018 +0800 阉割tspider上的create table like 1. 在tspider节点上执行create table like时, 忽略每个分区中comment信息。 避免tspider使用create table like后的误操作 2. 上述逻辑受参数opt_spider_ignore_create_like控制,默认打开。 即对一个spider表create table like时忽略每个分区的comment信息
      • f4b279a74ce willhan Thu Mar 22 14:42:15 2018 +0800 仅super权限可以查询mysql.servers表
      • 58a8bb34a96 willhan Thu Mar 22 10:54:03 2018 +0800 增加参数spider_query_one_shard, spider_transaction_one_shard及config_table用法
      • fa2ace7e221 willhan Wed Mar 21 19:41:13 2018 +0800 迁移spider_slow_log功能,未完成 迁移过程中,发现旧版本的spider_slow_log存在bug。 在使用thd获取分发到remote的query时,忽略了在并行模式下(spider_bgs_mode为1), thd是子线程thd。 与主线程的thd并不相同。
      • 2b6aeb0e45e willhan Wed Mar 21 17:55:34 2018 +0800 增加global参数spider_quick_mode_only_select,默认为true。
      • c14ee952748 willhan Wed Mar 21 17:29:19 2018 +0800 实现flush table with no block,无阻塞flush table功能。 执行该命令 1. 直接flush 掉当前空闲的share 2. 对于正在使用的share,则直接略过不等待 3. 新申请的table对象,会生成新的share对象
      • dd67eedabfa willhan Tue Mar 13 15:36:45 2018 +0800 1. add global variables spider_rone_shard_switch, which enabling the SPIDER_RONE_SHARD option effective 2. add SPIDER_RONE_SHARD option, which enabling spider to choose rand one shard to run sql
      • 5c0d5806f04 willhan Tue Mar 13 14:14:03 2018 +0800 * add session variables: sql_slow_log_off, default if true; when set sql_slow_off = 0; mysqld did not log slow query which executing longer than slow query_time.
      • d8ccd9d8418 willhan Tue Mar 13 10:54:51 2018 +0800 support for create table partition like PARTITION BY LIST(cast(substring(c1, 1, 3) as signed))
      • cc1d30f7c14 willhan Fri Mar 9 17:51:10 2018 +0800 remove spider_mta_conn_mutex_lock
      • 98b579155e1 willhan Wed Mar 7 10:42:23 2018 +0800 支持timestampdiff作为where条件下放
      • 1885a1dd119 willhan Tue Mar 6 18:05:24 2018 +0800 增加参数spider_ignore_autocommit 默认是false的,打开会true, 若gs使用的是auto commit=0, 在启用这个参数后,当前事务提交后,再次使用到该连接(spider到remote在), 会设置autocommit=1(不是gs层的0), 后面的都变更自动提交
      • 3876051bcb9 willhan Tue Mar 6 16:10:54 2018 +0800 对一些参数默认值作了调整, 优化bg_search的场景,减少线程切换代价 1. limit x,y 2. 多表关联 3. 非跨分区行为 4. 无pre call的逻辑
      • 341f64dae30 willhan Mon Mar 5 20:07:24 2018 +0800 add some profile info
      • 3e3ee0c15a3 willhan Fri Mar 2 10:55:13 2018 +0800 对spider的索引优化: 1. 参数optimizer_switch增加选项index_range,控制QUICK_RANGE_SELECT,默认spider不需该优化,即关闭。 select * from t1 where id = 1 or id = 2; select * from t1 where id in (1,2,3,4,5); 否则,spider将用union发送到remotedb 2. 默认下index range/merge都关闭 3. 虽然参数opt_spider_ignore_single_select_index已忽略spider上关于索引的优化,但仍抛出并优化上述spider侧执行计划相关的问题。
      • b98a1bb4078 willhan Thu Mar 1 17:21:13 2018 +0800 对于spider,任何单表select都不需要索引,走全表扫描即可
      • 1097adce866 willhan Thu Mar 1 17:08:55 2018 +0800 spider中禁止执行计划 “Using index for group-by”
      • [feature + bug fix] 89e95b3da2f willhan Wed Feb 28 16:37:01 2018 +0800 几个优化: 1. 当指定SQL_NO_CACHE(mysqldump)时,禁用pre_scan优化,避免最后的分区获取结果超时 2. direct_update/direct_delete支持指定limit,如: delete * from t1 where id > 100 limit 100; update t1 set d1 = 1 where id > 100 limit 100; 3. 对于第2点: 如果指定order by,不支持direct_update/direct_delete 4. 如果包含用户变量,不支持direct_update/direct_delete set @i:=@i+1; update test_incr set d2 =(@i:=@i+1) limit 10; 5. 默认启用bulk update/delete
      • d1112329502 willhan Mon Feb 26 15:50:25 2018 +0800 for query_response_time 1. set query_response_time compile with MANDATORY 2. optimize query_response_time: a) recording "since time" b) set query_response_tme_range_base = 2 c) the max time is 65536 3. add P_COUNT, P_TOTAL for query_response_time, P_COUNT, P_TOTAL means queries involving multiply partitions.
      • 2a9977ee659 willhan Sun Feb 11 16:40:33 2018 +0800 json store as longtext and display as longtext; change json format was dispalyed as json chage json charset from utf8mb4 to binary
      • fa7b86d9171 willhan Mon Feb 5 14:51:23 2018 +0800 spider_auto_increment : each spider node maintain their own auto_increment, all the spider in a cluster have the same spider_auto_increment_mode_step and have different spider_auto_increment_mode_value. The entire cluster's auto_increment value is unique, but not incremental, and have gaps add 3 variables : spider_auto_increment_mode_switch: use to control if use the spider_auto_increment_mode, default true spider_auto_increment_mode_value: the auto_increment_value % spider_auto_increment_step is spider_auto_increment_mode_value spider_auto_increment_mode_step: values set spider auto_increment add by spider_auto_increment_step
      • a3b2e363f9c willhan Tue Jan 30 10:02:29 2018 +0800 fix bug use CLIENT_INTERACTIVE option when spider do mysql_real_connect, the CLIENT_INTERACTIVE can make the wait_timeout ineffective
      • 38dd5028f79 willhan Tue Jan 30 14:33:46 2018 +0800 support spceify shard_key in comment for spider
      • 4c46ba9910e willhan Mon Jan 29 18:03:28 2018 +0800 add global variables "log_sql_use_mutil_partition"
      • 213a7835c2e willhan Mon Jan 29 15:44:48 2018 +0800 ignore send <cache> to remote
      • fa9dcd5f090 willhan Mon Jan 29 14:42:27 2018 +0800 add crc32/crc32_ci as partition function
      • 6294a54524c willhan Fri Jan 26 17:57:59 2018 +0800 limit column charset different with table charset in spider engine
      • cdaf094a61c willhan Tue Jan 23 16:40:31 2018 +0800 add plugin information_schema.spider_conns. 1. implement spider connection recycle funtionality that when certain spider connections are keep idle on than 3600 seconds duration, delete them from connection pool and free them then. 2. add one MYSQL_SYSVAR of spider_idle_conn_recycle_interval.
      • 50b57cd6f3f willhan Wed Jan 17 10:38:25 2018 +0800 1. alloc spider_conn when needed, not in spider_get_share. as a result: a) a remote mysql is crash, the other can continue to service b) make fuller use of connection resources
      • 15e412e1261 willhan Tue Jan 9 15:41:02 2018 +0800 1. disable handlersocket int Spider:CMakeLists.txt 2. add session variable "spider_with_begin_commit", default is false, done't send begin/commit to remote when autocommit=1 and without using begin/commit in application

      clean up (out of scope of the issue)

      • 046a5277e7b willhan Wed Jan 10 15:38:28 2018 +0800 Add SPIDER_DISABLE_LINK to disable spider_conn_first_link_idx

      configuration change (out of scope of the issue)

      • 4f16f8acdab willhan Tue Mar 13 10:08:16 2018 +0800 默认delete不带where条件正确返回行数
      • 4f1bec739ec willhan Fri Mar 2 11:28:24 2018 +0800 修改spider_semi_split_read默认值为1,避免limit放大
      • d70912649da willhan Tue Jan 30 14:37:44 2018 +0800 modify spider_idle_conn_recycle_interval' default value: 8
      • 54c8b98fe43 willhan Mon Jan 29 16:19:12 2018 +0800 log both sql when errory for spider
      • 75851e0ce84 willhan Wed Jan 17 15:51:27 2018 +0800 modify some spider variables's default value
      • 3cd7e4eed7d willhan Wed Jan 17 15:10:54 2018 +0800 add spider session variables spider_get_sts_or_crd, default false, don't get_sts/crd

      miscellaneous

      • be43bc44b1f vinchen Wed Apr 18 16:19:11 2018 +0800 fix some test suite
      • 27ab25e4903 vinchen Mon Apr 9 09:54:58 2018 +0800 fix for spider test suite
      • 03ee01ccd58 vinchen Fri Mar 30 19:30:48 2018 +0800 fix for cmake and make package
      • 6210260420c willhan Mon Mar 26 11:26:47 2018 +0800 fix compile error on linux
      • 72b471bdc53 willhan Wed Jan 10 15:27:30 2018 +0800 tmporary forbid collecting sts/crd info
      • be17b499c02 willhan Fri Jan 5 18:01:07 2018 +0800 解决一些编译及运行BUG
      • 16af2d8a045 willhan Fri Jan 5 17:45:17 2018 +0800 静态编译spider引擎
      • 3b541c44478 willhan Thu Jan 4 11:38:19 2018 +0800 fix for make

      Attachments

        Activity

          People

            ycp Yuchen Pei
            nayuta-yanagisawa Nayuta Yanagisawa (Inactive)
            Votes:
            2 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.