canal1.1.5同步MySQL到ES7-日期字段踩坑记录
5墨值下载
[environment]
canal 1.1.5-SNAPSHOT
mysql 5.6.49
es 7.6.2
[Issue Description]
mysql5.6.49 表中有日期字段，类型为 timestamp/datetime。
es 创建对应的索引，日期字段也为 date（也试过"format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-
dd||epoch_millis"）。
然后启动 canal-adapter，进行 etl 全量同步：
curl http://127.0.0.1:8081/etl/es7/mytest_article1.yml -X POST
报错：
java.lang.RuntimeException: java.lang.IllegalArgumentException: cannot write
xcontent for unknown value of type class java.sql.Timestamp,
adapter.log 日志详情：
2020-09-08 12:01:47.992 [http-nio-8081-exec-1] ERROR
com.alibaba.otter.canal.client.adapter.support.Util - sqlRs has error, sql:
select a.id as _id, a.title, a.subject, a.author, a.create_time, a.update_time
from article1 a
2020-09-08 12:01:47.994 [http-nio-8081-exec-1] ERROR
c.a.otter.canal.client.adapter.es7x.etl.ESEtlService -
java.lang.RuntimeException: java.lang.IllegalArgumentException: cannot write
xcontent for unknown value of type class java.sql.Timestamp
java.lang.RuntimeException: java.lang.RuntimeException:
java.lang.IllegalArgumentException: cannot write xcontent for unknown value of
type class java.sql.Timestamp
at com.alibaba.otter.canal.client.adapter.support.Util.sqlRS(Util.java:65)
~[client-adapter.common-1.1.5-SNAPSHOT.jar:na]
at
com.alibaba.otter.canal.client.adapter.es7x.etl.ESEtlService.executeSqlImport(ES
EtlService.java:64) [client-adapter.es7x-1.1.5-SNAPSHOT-jar-with-
dependencies.jar:na]
at
com.alibaba.otter.canal.client.adapter.support.AbstractEtlService.importData(Abs
tractEtlService.java:105) [client-adapter.common-1.1.5-SNAPSHOT.jar:na]
at
com.alibaba.otter.canal.client.adapter.es7x.etl.ESEtlService.importData(ESEtlSer
vice.java:56) [client-adapter.es7x-1.1.5-SNAPSHOT-jar-with-dependencies.jar:na]
at
com.alibaba.otter.canal.client.adapter.es7x.ES7xAdapter.etl(ES7xAdapter.java:79)
[client-adapter.es7x-1.1.5-SNAPSHOT-jar-with-dependencies.jar:na]
at
com.alibaba.otter.canal.adapter.launcher.rest.CommonRest.etl(CommonRest.java:100
) [client-adapter.launcher-1.1.5-SNAPSHOT.jar:na]
at
com.alibaba.otter.canal.adapter.launcher.rest.CommonRest.etl(CommonRest.java:123
) [client-adapter.launcher-1.1.5-SNAPSHOT.jar:na]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[na:1.8.0_231]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[na:1.8.0_231]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:43) ~[na:1.8.0_231]
at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_231]
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(Invocable
HandlerMethod.java:209) [spring-web-5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(I
nvocableHandlerMethod.java:136) [spring-web-5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMet
hod.invokeAndHandle(ServletInvocableHandlerMethod.java:102) [spring-webmvc-
5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapt
er.invokeHandlerMethod(RequestMappingHandlerAdapter.java:877) [spring-webmvc-
5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapt
er.handleInternal(RequestMappingHandlerAdapter.java:783) [spring-webmvc-
5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(A
bstractHandlerMethodAdapter.java:87) [spring-webmvc-
5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.j
ava:991) [spring-webmvc-5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.ja
va:925) [spring-webmvc-5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet
.java:974) [spring-webmvc-5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:87
7) [spring-webmvc-5.0.5.RELEASE.jar:5.0.5.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:661) [tomcat-
embed-core-8.5.29.jar:8.5.29]
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:8
51) [spring-webmvc-5.0.5.RELEASE.jar:5.0.5.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742) [tomcat-
embed-core-8.5.29.jar:8.5.29]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt
erChain.java:231) [tomcat-embed-core-8.5.29.jar:8.5.29]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.
java:166) [tomcat-embed-core-8.5.29.jar:8.5.29]
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
[tomcat-embed-websocket-8.5.29.jar:8.5.29]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt
erChain.java:193) [tomcat-embed-core-8.5.29.jar:8.5.29]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.
java:166) [tomcat-embed-core-8.5.29.jar:8.5.29]
at
org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestCont
extFilter.java:99) [spring-web-5.0.5.RELEASE.jar:5.0.5.RELEASE]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilte
r.java:107) [spring-web-5.0.5.RELEASE.jar:5.0.5.RELEASE]
of 8
5墨值下载
【版权声明】本文为墨天轮用户原创内容，转载时必须标注文档的来源（墨天轮），文档链接，文档作者等基本信息，否则作者和墨天轮有权追究责任。如果您发现墨天轮中有涉嫌抄袭或者侵权的内容，欢迎发送邮件至：contact@modb.pro进行举报，并提供相关证据，一经查实，墨天轮将立刻删除相关内容。
下载排行榜
评论