This PR is for Summer-2022 Implement the Low Cardinality HashMap project, and the project ID is 22fa00152.
This PR is implementing a low cardinality index, and will use it to optimize JOIN and GROUP BY.

The design documentation has been uploaded to https://github.com/matrixorigin/docs/blob/main/design/low_cardinality_design_doc.md



Co-authored-by: bRong Njam <longran1989@gmail.com>

panic if wait system init timeout

Approved by: @fengttt, @daviszhen, @nnsgmsone, @reusee

Approved by: @nnsgmsone

set timezone info while test timestamp

Approved by: @aressu1985

[Bug]: TPCC Txn can not be executed because the prepared update stmt is hung #6099

Approved by: @ouyuanning, @aressu1985, @aunjgr

The exported snapshot directory is outside of mo-data. So we need to move it.

remove bvt tags

Approved by: @aressu1985

To support loading external files on-the-fly, the file service needs to provide dynamically created S3 instances support.

Approved by: @zhangxu19830126, @nnsgmsone

fix a bug for double value when overflow

Approved by: @daviszhen, @aressu1985

Approved by: @fengttt, @sukki37

Approved by: @zhangxu19830126

* Delete test/distributed/cases/accesscontrol directory

* fix bvt bug in distributed system

1, remove tag 6054
2, fix truncate's privilege
3, add debug info for login blocking on the eks cluster
4, fix datarace

Approved by: @aressu1985

Approved by: @aressu1985

Implemented debug function built-in function `mo_debug` to debug mo. This is a framework to help test and debug MO by registering sub-debug handler functions in the way of commands. Currently a Ping DN subcommand is implemented and used as below:
```sql
mysql> select mo_debug('dn', 'ping','');
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| mo_debug(dn, ping, )                                                                                                                                                   |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| {
"method": "Ping",
"result": [
{
"serviceAddress": "127.0.0.1:22000",
"shardID": 2,
"replicaID": 262146,
"logShardID": 1
}
]
}
|
+-----------------------------------...

Approved by: @aressu1985

* cover: merge.go -> 64%

* cover: merge.go -> 80.1%

Approved by: @aressu1985

Approved by: @aressu1985

Remove bvt tag

Approved by: @fengttt, @daviszhen, @aressu1985, @m-schen, @nnsgmsone

* Update e2e.yml (#5994)

fix post clean bug

* fix bug is auto_incr

Co-authored-by: maomao <77312370+sukki37@users.noreply.github.com>

* [Bug]: Invalid interval range, When I use BETWEEN TIMESAMP AND 'YYYY-MM-DD' #5305

* fix bvt test

* fix bvt test cases

Co-authored-by: fengttt <fengttt@gmail.com>

* add modump

* skip some sca check on modump

* remove useless skip

* skip vet on modump

* add convert test

* fmt

* remove inner table and fix view

* fix error
add make mo-dump

Co-authored-by: fengttt <fengttt@gmail.com>

* fix protocol_binary_resultset issue about time type

Signed-off-by: Wu Qinxuan <wuqinxuan33@gmail.com>

* fix read issue

Signed-off-by: Wu Qinxuan <wuqinxuan33@gmail.com>

Signed-off-by: Wu Qinxuan <wuqinxuan33@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: fengttt <fengttt@gmail.com>

* base: merge register cron task

- check taskRunner nil
- init PathBuilder in startup
- fix ut
- improve: check PathBuilder::SupportMergeSplit in Merge

* adjust CronExpr

* add export::InitCronTask

* modify id with task.TaskCode

* call export.CreateCronTask in service.registerExecutors

* fix yesterday rule

* add note

* config MergeCycle support 1sec -> 5min -> 1hour -> 12hour

* fix review: 1) config mergeCycle as toml.Duration; 2) correct register merge Executor

* fix static-check

* fixut: TestAllocateWithNotExistTask

* Revert "fixut: TestAllocateWithNotExistTask"

This reverts commit 65fb8b0486ea2638b8f35e10fc1f406996385f5c.

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: fengttt <fengttt@gmail.com>

See the github issue page more details.

Co-authored-by: fengttt <fengttt@gmail.com>

Convert different types of partition structures into plan expressions, which are used to split partition table data.
Add: The index table needs to be hidden

Approved by: @zhangxu19830126, @aunjgr, @daviszhen, @ouyuanning, @iamlinjunhong, @nnsgmsone, @aressu1985, @fengttt

correct metric type name of update and delete

Approved by: @aptend

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: fengttt <fengttt@gmail.com>

1, add database system and and system_metrics for the general account.
2, As suggested by @xzxiong,
the database **system** in general account only has the table:
- statement_info

the database **system_metrics** in general account has the tables:
- metric
- views started by **sql_**, **server_**

3, already known problems introduced by pr #5824 @nnsgmsone
the database **system** of general account has the extra views or tables from **sys** account:
- rawlog
- log_info
- error_info
- span_info
- statement_info

the database **system_metrics** of general account has the extra views or tables from **sys** account :
- views started by **process_**, **sys_**

Approved by: @aressu1985

1, remove the replace privilege that is undefined by the product team.
2, export the port in cn.toml.

Approved by: @zhangxu19830126, @iamlinjunhong, @aressu1985

Approved by: @aressu1985

record syntax-parse-failed statement.

Approved by: @reusee, @daviszhen