Enabled TestGossipInSimulatedCluster to be always executed, it simulates a 48 nodes cluster to test gossip on log shard info. The test is slightly tweaked to check all nodes except one can get expected shard info in a timely manner.

Updated go.mod to use a private fork of memberlist for now as the upstream version has known data race issue.

Approved by: @yingfeng

Add context parameter to TxnStorage

Approved by: @reusee, @lni

* Remove tae types.

One type system for all.

Removed tae types.   Moved encoding into types to reduce a cyclic
dependencies.

Most the changes are like
find . -type f -exec sed -i 's/Type_BOOL/T_bool/g' {} \;

Some mock code in tae types are moved to container types. I don't think
those clock related actually belongs to types, but kept within types so
that the rest of the code refactoring is automatic.

* go fmt.

Approved by: @XuPeng-SH

This case is no longer used, and there may be a timeout, so delete it.

Approved by: @fengttt, @XuPeng-SH

fileservice: add BlockMapper

Approved by: @fengttt

add testtxnengine package

refactor sharding in txnengine

Approved by: @zhangxu19830126

Approved by: @sukki37

Add checksum support for morpc

Approved by: @lni, @reusee

Approved by: @XuPeng-SH

- Implement interface `ClusterWaitState` which is used to wait for some expected state;
- Add more convenient methods within interface `ClusterState`;
- Add unit test, and make all unit tests runnable;

Approved by: @zhangxu19830126, @lni

Approved by: @aressu1985, @ouyuanning, @aunjgr

- Make statement/trace/log/error interrelated by statement_id/span_id.
- store in db, make it can be search by sql cmd.
- error framework provide a unified format to display and optimize error info

Approved by: @fengttt, @daviszhen, @aptend, @yingfeng, @aressu1985

Closing un started dn shard will be blocked

Approved by: @lni

Approved by: @XuPeng-SH

Fix mergeblocks. Record deleteMask for those with primary key.

Approved by: @XuPeng-SH

Rework logical operations with cgo.

Approved by: @daviszhen, @fengttt, @ouyuanning, @nnsgmsone, @aunjgr

fix goroutine leak in test

Approved by: @lni

Previously, all Log Service requests and responses carry possible data fields as not nullable, meaning they are values rather than pointers. This would require full marshal/unmarshal of them even when they are empty. Changed them to pointer types to reduce such marshal and unmarshal overheads.

Approved by: @fengttt

If any Replica exists, a deadlock will occur when DNService starts.

Approved by: @lni

Approved by: @XuPeng-SH, @zhangxu19830126

Approved by: @lni

Approved by: @lni

When the environmental variable GOPATH is not set, get its value from the output of the `go env GOPATH` command otherwise gen.sh will be using incorrect paths.

Approved by: @yingfeng

Log Service's ClientConfig and HAKeeper's HAKeeperClientConfig both have an optional DiscoveryAddress field which is the service address of a reverse proxy provided by k8s. The reverse proxy redirects requests to a random Log Service node and we use this mechanism to query Log Shard info from such random node. As such shard info is broadcasted to all Log Service nodes via gossip over time, this allows eventual discovery of the details of the interested Log Service shard.

This feature is required as replicas of a Log Shard can migrate to a completely different set of nodes over time, a pre determined & fixed address list alone won't be enough to allow clients to connect to the interested Log Shard.

Approved by: @aptend, @fengttt, @nnsgmsone

Approved by: @sukki37, @nnsgmsone, @yingfeng

Approved by: @fengttt

Prepare the structure for the multi-tenant

Approved by: @iamlinjunhong, @yingfeng, @zhangxu19830126

Approved by: @dengn

Approved by: @lni, @zhangxu19830126, @matrix-meow

Approved by: @XuPeng-SH

Move ut_pr.yml to .github/workflow

Approved by: @sukki37

add file `ut_pr.yml` to support pull request additional unit test coverage

Approved by: @sukki37

Approved by: @aressu1985, @nnsgmsone, @aunjgr

Using CGO to reconstruct the comparison operation

Approved by: @daviszhen, @ouyuanning, @fengttt, @nnsgmsone, @aunjgr

* CI: add PR UT coverage (#4371)

Create a new yml file to support detect incremental code coverage

Approved by: @sukki37

* Add union and minus

* Update ut_pr.yml

* Update ut_pr.yml (#4439)

* Delete ut_pr.yml

* Fix sca

* Adding a strategy choice for group by

Co-authored-by: brown <1173781832@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: maomao <77312370+sukki37@users.noreply.github.com>
Co-authored-by: Yingfeng <yingfeng.zhang@gmail.com>

* use constant connection timeout value which is much smaller than the LOG node heartbeat timeout. this ensures we get chance to try most specified HAKeeper nodes.
* during bootstrap, it is possible for the HAKeeper replica to be removed by a KILL command, terminate the local bootstrap procedure when that happens.
* always keep the ticker worker even after the HAKeeper replica is stopped.

Approved by: @reusee

Fix onReplayAppendCmd. Check whether there exists active block before load data.

Approved by: @XuPeng-SH

- Evaluate health of a log shard via its running replicas, not via its expired replica.

Approved by: @lni