我用的导入语句如下:
sqoop import --connect jdbc:mysql://localhost:3306/report --username root --password root --table GOO_GOODS --hive-import -m 1 --hive-overwrite --hive-table report.GOO_GOODS --fields-terminated-by ','数据也导入到hive表中了,可是其实有两行数据被换行了,如下:(小孔空心(出租车专用))
1403101618482510,2014-03-10 16:18:48.0,b310A10008,510085,只,5,控制臂衬套,kzbct,20,11.0,1K0407183A,20,0,2015-09-01 17:23:16.0,1302041111443250,138030000000000,1170,1402171639454103,138030000000000
1403101618482502,2014-03-10 16:18:47.0,b310A10007,510074,只,5,下控制臂胶套,xkzbjt,20,5.0,811407181A,20,0,2015-09-01 17:23:16.0,1302041111443250,138030000000000,1170,1402171639454103,138030000000000
1403101618472494,2014-03-10 16:18:47.0,b310A10006,510080,只,5,控制臂衬套,kzbct,20,4.3,357407182,20,0,2015-09-01 17:23:16.0,1302041111443250,138030000000000,1170,1402171639454103,138030000000000
1403101618472486,2014-03-10 16:18:47.0,b310A10005,510067,只,5,下摆臂胶套\大,xbbjt\d,20,9.3,191407181D ,20,0,2015-09-01 17:15:21.0,1302041111443250,138030000000000,1170,1402171639454103,138030000000000
xkkx(czczy),20,8.8,191407181BG,20,0,2015-09-01 17:23:16.0,1302041111443250,138030000000000,1170,1402171639454103,138030000000000
小孔空心(出租车专用),kzbct
1403101618472478,2014-03-10 16:18:47.0,b310A10004,510232,只,5,控制臂衬套
xksx(czczy),20,8.8,191407181EG,20,0,2015-09-01 17:23:16.0,1302041111443250,138030000000000,1170,1402171639454103,138030000000000
小孔实心(出租车专用),kzbct
1403101618472470,2014-03-10 16:18:47.0,b310A10003,510231,只,5,控制臂衬套
1403101618472462,2014-03-10 16:18:47.0,b310A10002,510066,只,5,下摆臂胶套\大\有边,xbbjt\d\yb,20,8.8,191407181A,20,0,2015-09-01 17:15:21.0,1302041111443250,138030000000000,1170,1402171639454103,138030000000000
1403101618472454,2014-03-10 16:18:46.0,b310810030,730240,个,7,控制臂,kzb,20,156.0,1K0407152M,20,0,2016-01-11 17:08:23.0,1302041111443250,138028000000000,1168,1402171639454103,138028000000000
1403101618462446,2014-03-10 16:18:46.0,b310810029,730239,个,7,控制臂,kzb,20,156.0,1K0407151M,20,0,2016-01-11 17:08:23.0,1302041111443250,138028000000000,1168,1402171639454103,138028000000000

解决方案 »

  1.   

    sudo -u hive sqoop import  --connect jdbc:mysql://${miguanMysqlHost}/${miguanDatabaseName} --username ${miguanMysqlUser} --password ${miguanMysqlPwd} --table applibrary --hive-import --hive-table ${hiveDBName}.applibrary  --hive-drop-import-delims --fields-terminated-by '\001' --lines-terminated-by '\n' --hive-overwrite
    添加了:
     --hive-drop-import-delims --lines-terminated-by '\n'<br><br> --hive-drop-import-delims 的意思是指:delims Drops \n, \r, and \01 from string fields when importing to Hive.
    delims
    Drops \n, \r, and \01 from string fields when importing to Hive.