Hive数据通过UDF写入neo4j序列化问题KryoException
发布于 5 年前 作者 janezhou 3016 次浏览 来自 问答

问题描述: 通过UDF将Hive表中的数据写入neo4j的数据库中遇到序列化问题, 报错信息如下, 请问有什么解决方法吗?

org.apache.hive.com.esotericsoftware.kryo.KryoException: java.util.ConcurrentModificationException

reducer (org.apache.hadoop.hive.ql.plan.ReduceWork) at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:82) at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:474) at org.apache.hive.com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:538) at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:474) at org.apache.hive.com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:614) at org.apache.hive.com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.write(DefaultArraySerializers.java:337) at org.apache.hive.com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.write(DefaultArraySerializers.java:276) at org.apache.hive.com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:538) at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:474) at org.apache.hive.com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:538) at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)

回到顶部