cnservice: initialize hakeeper client, txn sender, txn client lazily

Approved by: @zhangxu19830126, @nnsgmsone

Co-authored-by: bRong Njam <longran1989@gmail.com>
Co-authored-by: fengttt <fengttt@gmail.com>

This commit replaces `os.Setenv` with `t.Setenv` in tests. The
environment variable is automatically restored to its original value
when the test and all its subtests complete.

Reference: https://pkg.go.dev/testing#T.Setenv


Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>

Support trace context transfer via morpc framework

Approved by: @reusee

cnservice: add memory engine to service.initEngine

txnengine: add ShardToSingleStatic

Approved by: @nnsgmsone

Approved by: @yingfeng

fileservice: add FileService.Name

fileservice: add FileServices; add Get

fileservice: support named path

dnservice: replace store.localFS,s3FS with store.fs,metadataFS

Approved by: @zhangxu19830126, @cnutshell, @nnsgmsone

fix set clause bug: when set uint64 value in sql, but save int64 to session.

Approved by: @daviszhen, @aressu1985

avoid import cycle: trace -> pkg/config -> pkg/txn/client -> pkg/common/morpc -> trace

Approved by: @zhangxu19830126, @fengttt

Approved by: @dengn

Add blob support in MO

Approved by: @nnsgmsone, @fengttt, @zhangxu19830126, @XuPeng-SH

Rename `CNNode`/`DNNode`/`LogNode` to `CNStore`/`DNStore`/`LogStore`.

Add `Shards` field in `DNStore`.

Approved by: @lni, @reusee, @fengttt

txnengine: set Process.SessionInfo.TimeZone

txnstorage: do not remove entry from MemHandler.tables.Map in MemHandler.HandleTruncate

txnengine: do not return SqlError in Tx.Exec

txnengine: refine testBVT; add TestBVT

txnengine: ignore lines with # prefix in bvt files

txnengine: enable optimizer for select, update and delete statement

txnengine: fix testBVT

txnengine: ignore ExplainStmt in Tx.Exec

txnengine: panic on Tx.Exec error

txnengine: add Session

txnengine: fix Execution.DefaultDatabase

txnengine: fix txn client clock

txnengine: set session database to default in Exec

Approved by: @lni

- Implement network partition feature for service test framework
- Maintain `morpc.Client` options within `managedHAKeeperClient`
- Rename `pkg/tests/service/address.go` as `pkg/tests/service/network.go`, the same as its unit test file

Approved by: @zhangxu19830126, @lni

fileservice: implement MutableFileService for LocalETLFS

Approved by: @lni

fix the bug where filter null value in external scan

Approved by: @nnsgmsone, @ouyuanning, @aunjgr

Co-authored-by: tianyahui <tianyahui@tianyahuideMacBook-Pro.local>
Co-authored-by: fengttt <fengttt@gmail.com>

tae supports isolation of db and table by tenantID

1. add access info (tenantID, userID, roleID) to DBEntry, TableEntry and schema
2. add access-related columns to mo_database, mo_tables, mo_columns
3. refactor db iterator and table iterator, add access filter for mo_catalog
4. fix error in `show create table`

Approved by: @daviszhen, @XuPeng-SH, @fengttt

Approved by: @dengn

PR Unit Coverage Test reported an error because there was no Test directory when output Paths were empty.(#4533 #4586 ) This PR fixed this.

Approved by: @sukki37

fix data race in txnstore.getOrSetDB. add dbsMu

Approved by: @XuPeng-SH

cnservice: init hakeeper client

cnservice: init txn sender

cnservice: init txn client

frontend: add wrappedTAETx, wrappedTAEEngine; rename InitDB to InitTAE

frontend: use TxnOperator instead of moengine.Txn

txn: add get txn metadata to txnOperator

replace engine.Snapshot with TxnOperator

Co-authored-by: zhangxu <zhangxu19830126@gmail.com>

solve memory leak in batch alloc

Approved by: @nnsgmsone, @yingfeng

1. cago compiler with link system lib, so  ignore cgo generate files
`/usr/bin/ld` is my local Apple's linker

For example:
```
#16 52.59 # github.com/matrixorigin/matrixone/cmd/db-server
#16 52.59 /usr/local/go/pkg/tool/linux_amd64/link: running gcc failed: exit status 1
#16 52.59 /usr/bin/ld: /tmp/go-link-2126209758/000006.o: in function `_cgo_df8c56550131_Cfunc_Decimal128_Add':
#16 52.59 decimal.cgo2.c:(.text+0x71): undefined reference to `Decimal128_Add'
#16 52.59 /usr/bin/ld: /tmp/go-link-2126209758/000006.o: in function `_cgo_df8c56550131_Cfunc_Decimal128_AddDecimal64':
#16 52.59 decimal.cgo2.c:(.text+0xcd): undefined reference to `Decimal128_AddDecimal64'
#16 52.59 /usr/bin/ld: /tmp/go-link-2126209758/000006.o: in function `_cgo_df8c56550131_Cfunc_Decimal128_AddInt64':
```

2. According to #4535, the `system_vars_config.toml` will be the default config and  `make config` do not generate configuration files. So `system_vars_config.toml` should not be ignored. It's related to [optools/images/Dockerfile](https://github.com/matrixorigin/matrixone/blob/main/optools/images/Dockerfile)

3. Add some other generate files, like `gen_config` and ignore generate data at `store/`.

4. Fix config error

Approved by: @yingfeng

support CMD_STMT_PREPARE/EXECUTE/CLOSE  command for MySQL protocol.

test code see https://github.com/matrixorigin/matrixone/issues/3693  @sukki37 's comment.

Approved by: @daviszhen

Approved by: @yingfeng

- Enable flexible `morpc` option for package `logservice`
- Extend `morpc.WithBackendFilter` in order to support network partition feature

Approved by: @zhangxu19830126, @lni

Approved by: @yingfeng

Approved by: @yingfeng

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: fengttt <fengttt@gmail.com>

txnengine: add Errors and extract errors in doTxnRequest
txnengine: add Errors.As; create default database; fix Execution.Resolve
txnengine: add MemHandler.mheap; fix MemHandler.HandleRead
txnengine: add TestTPCH
txnengine: add Tx.databaseName
txnengine: add file path param to Tx.Exec
txnengine: add typed errors
txnengine: fix Execution.Resolve
txnengine: fix Tx.Exec to execute all statements
txnengine: fix engineAttrToPlanColDef
txnengine: fix plan types gob registeration
txnengine: gob register plan types
txnengine: save database and table name in lowercase; set default schema name in Execution.Resolve
txnengine: set zap logger for NewTxnService
txnengine: trim comment lines in bvt files
txnstorage: add AttributeRow.Order
txnstorage: add hidden __version column
txnstorage: fix BatchIter
txnstorage: fix MemHandler.HandleRead
txnstorage: use req.TableID,DatabaseID in HandleDelTableDef,HandleGetRelations,HandleGetTableDefs,HandleGetTableDefs

Approved by: @lni

1. Connect the cn-service with the frontend and the computation engine.
2. Change the configuraion mechanism to the general method. Remove the auto-generated configuration.

Approved by: @zhangxu19830126, @yingfeng, @fengttt, @aptend, @reusee, @nnsgmsone, @lni

This pr is used to speed up performance-related things like join conditions like r.a = s.b and r.a > s.b, most typically tpch's q21.

Approved by: @yingfeng, @aunjgr