UNSOLVED Oracle全量同步至StarRocks遇到报错

[wx-ou3Ig6T11NSNUioSvhSfyq0oGciY]

• 源端：Oracle12c

• 目标端：StarRocks2.0 社区版

• 版本：社区版2.2.0.7

• 列表数据问题产生阶段：全量同步，物化视图模式

• 问题描述：1、结构迁移，不支持pk报错。2、全量迁移，出现Failed to flush data to StarRocks报错。

• 源端表结构

CREATE TABLE "XXX"."T_USER_INFO_TEST" 
   (	"USER_ID" VARCHAR2(32) NOT NULL ENABLE, 
	"PHONE_NUM" VARCHAR2(32), 
	"PASSWORD" VARCHAR2(64), 
	"STATUS" CHAR(1), 
	"USER_NAME" VARCHAR2(100), 
	"EMAIL" VARCHAR2(100), 
	"ADDRESS" VARCHAR2(100), 
	"ORIGIN" CHAR(1), 
	"PROVINCE_CODE" VARCHAR2(10), 
	"CITY_CODE" VARCHAR2(10), 
	"USER_TYPE" CHAR(1), 
	"GROUP_USER_ID" VARCHAR2(32), 
	"CREATE_DATE" DATE, 
	"ACCOUNT" VARCHAR2(32), 
	"DATA_SRC" CHAR(1), 
	"MAX_LOGIN_NUM" NUMBER(2,0) DEFAULT 1
   ) SEGMENT CREATION IMMEDIATE 
  PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 
 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1
  BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)
  TABLESPACE "XXX" ;

*目标表结构

CREATE TABLE `t_user_info_test` (
  `USER_ID` varchar(32) NOT NULL COMMENT "用户id",
  `PHONE_NUM` varchar(32) NULL COMMENT "电话号码",
  `PASSWORD` varchar(32) NULL COMMENT "密码",
  `STATUS` char(1) NULL COMMENT "用户状态
1：开户
2：暂停
3：销户",
  `USER_NAME` varchar(32) NULL COMMENT "用户姓名",
  `EMAIL` varchar(100) NULL COMMENT "邮箱",
  `ADDRESS` varchar(100) NULL COMMENT "家庭地址",
  `ORIGIN` char(1) NULL COMMENT "用户来源",
  `PROVINCE_CODE` varchar(10) NULL COMMENT "归属省",
  `CITY_CODE` varchar(10) NULL COMMENT "归属地市",
  `USER_TYPE` char(1) NULL COMMENT "用户类型 1：家庭用户 2：集团用户 3：测试用户,8:0元软终端用户",
  `GROUP_USER_ID` varchar(32) NULL COMMENT "集团用户id",
  `CREATE_DATE` date NULL COMMENT "创建日期",
  `ACCOUNT` varchar(32) NULL COMMENT "用户账号",
  `DATA_SRC` char(1) NULL COMMENT "数据来源",
  `MAX_LOGIN_NUM` int(11) NULL COMMENT "用户订购的基础CP、自购CP及叠加包的数量，即用户允许登录的最大机顶盒数量"
) ENGINE=OLAP 
PRIMARY KEY(`USER_ID`)
COMMENT "OLAP"
DISTRIBUTED BY HASH(`USER_ID`) BUCKETS 10 
PROPERTIES (
"replication_num" = "3",
"in_memory" = "false",
"storage_format" = "DEFAULT"
);

• 源端数据初始化sql

INSERT INTO T_USER_INFO  (USER_ID,PHONE_NUM,PASSWORD,STATUS,USER_NAME,EMAIL,ADDRESS,ORIGIN,PROVINCE_CODE,CITY_CODE,USER_TYPE,GROUP_USER_ID,ACCOUNT)
VALUES ('100000086','138002','abc123','1','name','123@qq.com','shenz','a','3','023','1','0','mac123');

• 发生错误的截图
  1、结构迁移出现报错，在之前的版本未出现过
  

2、全量同步阶段报错
源端表数据有1000万，迁移了12万后出现如下错误：

com.clougence.cloudcanal.base.service.task.exception.runtime.ApplierHandlerException: apply error,msg:RuntimeException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":1,"Message":"close index channel failed, load_id=c64d1aca-9aa8-0c5d-a9d1-06dca30ec3bd","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"6bf6787a-53e2-409a-928c-e19cccc38648","LoadBytes":13836,"StreamLoadPutTimeMs":1,"NumberTotalRows":0,"WriteDataTimeMs":52,"TxnId":33288,"LoadTimeMs":55,"ReadDataTimeMs":0,"NumberLoadedRows":0,"NumberFilteredRows":0}
{}

	at com.clougence.cloudcanal.starrocks.worker.writer.full.StarRocksFullApplyHandler.handle(StarRocksFullApplyHandler.java:62)
	at com.clougence.cloudcanal.starrocks.worker.writer.full.StarRocksFullApplyHandler.handle(StarRocksFullApplyHandler.java:22)
	at com.clougence.cloudcanal.task.applier.full.FullApplyWorkHandler.onEvent(FullApplyWorkHandler.java:70)
	at com.clougence.cloudcanal.task.applier.full.FullApplyWorkHandler.onEvent(FullApplyWorkHandler.java:21)
	at com.lmax.disruptor.WorkProcessor.run(WorkProcessor.java:143)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":1,"Message":"close index channel failed, load_id=c64d1aca-9aa8-0c5d-a9d1-06dca30ec3bd","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"6bf6787a-53e2-409a-928c-e19cccc38648","LoadBytes":13836,"StreamLoadPutTimeMs":1,"NumberTotalRows":0,"WriteDataTimeMs":52,"TxnId":33288,"LoadTimeMs":55,"ReadDataTimeMs":0,"NumberLoadedRows":0,"NumberFilteredRows":0}
{}

	at com.clougence.cloudcanal.starrocks.worker.writer.executor.full.StarRocksFullStreamLoadExecutor.insert(StarRocksFullStreamLoadExecutor.java:108)
	at com.clougence.cloudcanal.starrocks.worker.writer.full.StarRocksFullApplyHandler.handle(StarRocksFullApplyHandler.java:48)
	... 5 common frames omitted

[CloudCanal-万少]

参考https://www.askcug.com/topic/262 调节下参数，写入频率过快会有这样的报错