Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog.
2. Trans to insertData.
3. Change dataFields data to Data, dim to Dim4. Add float vector and binary vector.5. Deserialize data and convert to InsertData.6. Move all data into InsertData.7. Add insert buffer and hash string.
8. Add minIOkV in insertBuffer node.
9. Init write node insertBuffer maxSize from writeNode.yaml.
10. Add ddBuffer.
11. Add ddBuffer binLog and minio.
12. Add ddNode unittest.
13. Remove redundant call.
14. Increase test time.
15. Delete ddl const, use request's timestamp instead.
Signed-off-by:
bigsheeper <yihao.dai@zilliz.com>
Showing
- internal/master/client.go 2 additions, 2 deletionsinternal/master/client.go
- internal/master/collection_task_test.go 0 additions, 373 deletionsinternal/master/collection_task_test.go
- internal/master/config_task_test.go 0 additions, 151 deletionsinternal/master/config_task_test.go
- internal/master/grpc_service.go 33 additions, 2 deletionsinternal/master/grpc_service.go
- internal/master/grpc_service_test.go 0 additions, 184 deletionsinternal/master/grpc_service_test.go
- internal/master/index_task.go 95 additions, 0 deletionsinternal/master/index_task.go
- internal/master/master_test.go 998 additions, 166 deletionsinternal/master/master_test.go
- internal/master/meta_table.go 44 additions, 1 deletioninternal/master/meta_table.go
- internal/master/meta_table_test.go 1 addition, 1 deletioninternal/master/meta_table_test.go
- internal/master/partition_task_test.go 0 additions, 339 deletionsinternal/master/partition_task_test.go
- internal/master/segment_manager.go 14 additions, 0 deletionsinternal/master/segment_manager.go
- internal/master/segment_manager_test.go 0 additions, 144 deletionsinternal/master/segment_manager_test.go
- internal/util/flowgraph/message.go 8 additions, 0 deletionsinternal/util/flowgraph/message.go
- internal/writenode/data_sync_service.go 1 addition, 1 deletioninternal/writenode/data_sync_service.go
- internal/writenode/dd_buffer.go 0 additions, 47 deletionsinternal/writenode/dd_buffer.go
- internal/writenode/flow_graph_dd_node.go 209 additions, 21 deletionsinternal/writenode/flow_graph_dd_node.go
- internal/writenode/flow_graph_dd_node_test.go 126 additions, 0 deletionsinternal/writenode/flow_graph_dd_node_test.go
- internal/writenode/write_node_test.go 35 additions, 0 deletionsinternal/writenode/write_node_test.go
Please register or sign in to comment