英文:
Error While reading Teradata from Spark. It loaded the Table and Shows Schema But fails to give data set result
问题
scala> val df = spark.sqlContext.load("jdbc", Map("url" -> "jdbc:teradata://tdpw/database=ven68959, TMODE=TERA, user=iv068959, password=xxxxxxx","dbtable" -> "abc_view.vmyk_csat_echat"," driver" -> "com.teradata.jdbc.TeraDriver"))
warning: there was one deprecation warning; re-run with -deprecation for details
df: org.apache.spark.sql.DataFrame = [SRVY_ID: string, SRVY_PRGM_ID: string ... 32 more fields]
scala> df.show(1,false)
20/05/04 10:56:08 WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 4, plsq00642d1.corp.sprint.com, executor 19):
java.sql.SQLException: [Teradata JDBC Driver] [TeraJDBC 15.00.00.20] [Error 804]
[SQLState 08S01] Socket communication failure for Packet receive Mon May 04 10:56:08 CDT 2020
socket orig=tdpw local=0.0.0.0/0.0.0.0:45714
remote=tdpwcop7/144.226.222.186:1025
keepalive=unavailable
nodelay=unavailable
receive=unavailable
send=unavailable
linger=unavailable
traffic=unavailable
concurrent=3 contimeout=10000 conwait=1000 connecttime=1 connecttotaltime=1 connectattempts=1 connectfailures=0 reconnectattempts=0
recoverable=false redrive=false failurecache={} cid=676567f4 sess=5175054
java.io.IOException: Bad response message header with invalid message length of 16773956 bytes
at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF.read(TDNet
英文:
scala> val df = spark.sqlContext.load("jdbc", Map("url" -> "jdbc:teradata://tdpw/database=ven68959, TMODE=TERA, user=iv068959, password=xxxxxxx","dbtable" ->"abc_view.vmyk_csat_echat"," driver" -> "com.teradata.jdbc.TeraDriver"))
warning: there was one deprecation warning; re-run with -deprecation for details
df: org.apache.spark.sql.DataFrame = [SRVY_ID: string, SRVY_PRGM_ID: string ... 32 more fields]
scala> df.show(1,false)
20/05/04 10:56:08 WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 4, plsq00642d1.corp.sprint.com, executor 19):
java.sql.SQLException: [Teradata JDBC Driver] [TeraJDBC 15.00.00.20] [Error 804]
[SQLState 08S01] Socket communication failure for Packet receive Mon May 04 10:56:08 CDT 2020
socket orig=tdpw local=0.0.0.0/0.0.0.0:45714
remote=tdpwcop7/144.226.222.186:1025
keepalive=unavailable
nodelay=unavailable
receive=unavailable
send=unavailable
linger=unavailable
traffic=unavailable
concurrent=3 contimeout=10000 conwait=1000 connecttime=1 connecttotaltime=1 connectattempts=1 connectfailures=0 reconnectattempts=0
recoverable=false redrive=false failurecache={} cid=676567f4 sess=5175054
java.io.IOException: Bad response message header with invalid message length of 16773956 bytes
at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF.read(TDNet
答案1
得分: 0
升级您的Teradata JDBC驱动程序至最新版本，最好是当前的16.20版本。15.0版本的驱动程序与16+版本的数据库不完全兼容。
英文:
Upgrade your Teradata JDBC driver to the latest version, preferably to the current 16.20. Version 15.0 driver is not fully compatible with database version 16+.
专注分享java语言的经验与见解，让所有开发者获益！
评论