[SPARK-17536][SQL] Minor performance improvement to JDBC batch inserts
## What changes were proposed in this pull request? Optimize a while loop during batch inserts ## How was this patch tested? Unit tests were done, specifically "mvn test" for sql Author: John Muller <jmuller@us.imshealth.com> Closes #15098 from blue666man/SPARK-17536.
This commit is contained in:
parent
ad79fc0a84
commit
71a65825c5
|
@ -590,12 +590,12 @@ object JdbcUtils extends Logging {
|
|||
val stmt = insertStatement(conn, table, rddSchema, dialect)
|
||||
val setters: Array[JDBCValueSetter] = rddSchema.fields.map(_.dataType)
|
||||
.map(makeSetter(conn, dialect, _)).toArray
|
||||
val numFields = rddSchema.fields.length
|
||||
|
||||
try {
|
||||
var rowCount = 0
|
||||
while (iterator.hasNext) {
|
||||
val row = iterator.next()
|
||||
val numFields = rddSchema.fields.length
|
||||
var i = 0
|
||||
while (i < numFields) {
|
||||
if (row.isNullAt(i)) {
|
||||
|
|
Loading…
Reference in a new issue