1 Reply Latest reply on Oct 8, 2013 5:27 AM by pooja khandelwal

    Unable to fetch full data from hive

    pooja khandelwal

      I am trying to import full data from hive. there are two tables with 200+ columns for which tableau is throwing below error after running for some time:

       

      The connection to the data source might have been lost

      could not create extract.

       

      I am able to create extract for all other tables, only for these two tables I am facing dis issue. Just for information. we are running hive in non-strict mode.

        • 1. Re: Unable to fetch full data from hive
          pooja khandelwal

          the log is as follows

          INFO [IPC Server handler 1 on 8012] 2013-10-07 09:40:25,601 JobInProgress.java (line 513) job_201310011613_0884: nMaps=1 nReduces=1 max=-1

          INFO [IPC Server handler 1 on 8012] 2013-10-07 09:40:25,601 JobTracker.java (line 4074) Job job_201310011613_0884 added successfully for user '502226344' to queue 'default'

          INFO [IPC Server handler 1 on 8012] 2013-10-07 09:40:25,601 AuditLogger.java (line 68) USER=502226344  IP=3.47.24.151  OPERATION=SUBMIT_JOB TARGET=job_201310011613_0884    RESULT=SUCCESS

          INFO [pool-9-thread-3] 2013-10-07 09:40:25,602 JobTracker.java (line 4235) Initializing job_201310011613_0884

          INFO [pool-9-thread-3] 2013-10-07 09:40:25,607 JobInProgress.java (line 680) Initializing job_201310011613_0884

          DEBUG [pool-9-thread-3] 2013-10-07 09:40:25,626 CassandraFileSystemThriftStore.java (line 898) Writing inode to: cfs://GIS03620.devcloud.ge.com/tmp/hadoop-root/mapred/system/job_201310011613_0884

          DEBUG [pool-9-thread-3] 2013-10-07 09:40:25,632 CassandraFileSystemThriftStore.java (line 898) Writing inode to: cfs://GIS03620.devcloud.ge.com/tmp/hadoop-root/mapred/system/job_201310011613_0884/jobToken

          INFO [pool-9-thread-3] 2013-10-07 09:40:25,633 JobInProgress.java (line 3544) jobToken generated and stored with users keys in /tmp/hadoop-root/mapred/system/job_201310011613_0884/jobToken

          INFO [pool-9-thread-3] 2013-10-07 09:40:25,637 JobInProgress.java (line 732) Input size for job job_201310011613_0884 = 43353064. Number of splits = 1

          INFO [pool-9-thread-3] 2013-10-07 09:40:25,638 JobInProgress.java (line 587) job_201310011613_0884 LOCALITY_WAIT_FACTOR=1.0

          INFO [pool-9-thread-3] 2013-10-07 09:40:25,638 JobInProgress.java (line 811) Job job_201310011613_0884 initialized successfully with 1 map tasks and 1 reduce tasks.

          INFO [IPC Server handler 2 on 8012] 2013-10-07 09:43:42,387 JobInProgress.java (line 3113) Aborting job job_201310011613_0884

          INFO [IPC Server handler 2 on 8012] 2013-10-07 09:43:42,387 JobInProgress.java (line 2843) Killing job 'job_201310011613_0884'

          INFO [IPC Server handler 9 on 8012] 2013-10-07 09:43:47,397 JobInProgress.java (line 3519) jobId=job_201310011613_0884,submitTime=1381153225587,launchTime=1381153225638,firstMapTaskLaunchTime=1381153231065,firstReduceTaskLaunchTime=1381153245088,firstJobSetupTaskLaunchTime=1381153226047,firstJobCleanupTaskLaunchTime=1381153422387,finishTime=1381153427397,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=502226344,queue=default,status=FAILED,mapSlotSeconds=23,reduceSlotsSeconds=174,clusterMapCapacity=20,clusterReduceCapacity=20,jobName=Flag.isAlarmHDFSToDB

          INFO [pool-11-thread-1] 2013-10-07 09:43:47,397 JobHistory.java (line 305) Moving file:/app/dse-3.0.1/logs/hadoop/history/job_201310011613_0884_1381153225587_502226344_Flag.isAlarmHDFSToDB to file:/app/dse-3.0.1/logs/hadoop/history/done/version-1/GIS03620.devcloud.ge.com_1380658405936_/2013/10/07/000000

          DEBUG [Directory/File cleanup thread] 2013-10-07 09:43:47,399 CassandraFileSystem.java (line 384) Deleting cfs://GIS03620.devcloud.ge.com/tmp/hadoop-root/mapred/system/job_201310011613_0884 true

          INFO [pool-11-thread-1] 2013-10-07 09:43:47,400 JobHistory.java (line 305) Moving file:/app/dse-3.0.1/logs/hadoop/history/job_201310011613_0884_conf.xml to file:/app/dse-3.0.1/logs/hadoop/history/done/version-1/GIS03620.devcloud.ge.com_1380658405936_/2013/10/07/000000

          DEBUG [Directory/File cleanup thread] 2013-10-07 09:43:47,404 CassandraFileSystem.java (line 384) Deleting cfs://GIS03620.devcloud.ge.com/tmp/hadoop-root/mapred/system/job_201310011613_0884/jobToken true