4 Replies Latest reply on Sep 19, 2014 2:27 PM by Ashley Jaschke

    Does anyone have Hive connectivity working on Amazon EMR?

    Jeff Ferris

      Hi All,

       

      I have tried both the MapR and Cloudera drivers with Amazon EMR. Neither of them work. 

      Cloudera gives me this error:

      Column index out of bounds.

      Unable to create extract

       

      MapR (the driver I was told was the most likely to work with EMR) gave me this error:

      [MapR][Support] (50090) Conversion from string to number failed with value: 8636\x1;-

      [MapR][Support] (50090) Conversion from string to number failed with value: 2409\x1;account_customer_summary

      [MapR][Support] (50090) Conversion from string to number failed with value: 2639\x1;account_payment_method

      [MapR][Support] (50090) Conversion from string to number failed with value: 2582\x1;account_shipping

       

      I have no idea why it's trying to convert a string to a number. It should be a string. 

       

      Thanks in advance for advice that anyone can offer. 

       

      Thanks,

      Jeff

        • 1. Re: Does anyone have Hive connectivity working on Amazon EMR?
          Douglas Moore

          "Me Too"

          I get the same sort of error with a MapR cluster and Tableau Desktop 7.0. Sum and other operations on the numeric fields work from Hive QL. The data is derived from twitter data streams and the strings contain many unicode characters.

           

          [MapR][Support] (50090) Conversion from string to number failed with value: 110\x1;therave\x1;1504969

          [MapR][Support] (50090) Conversion from string to number failed with value: 47\x1;é®\x1;1504287

          [MapR][Support] (50090) Conversion from string to number failed with value: 46\x1;k\x1;1504877

          [MapR][Support] (50090) Conversion from string to number failed with value: 41\x1;凪\x1;1504849

          [MapR][Support] (50090) Conversion from string to number failed with value: 40\x1;clubsplash\x1;1504199

          [MapR][Support] (50090) Conversion from string to number failed with value: 39\x1;é®\x1;1504288

          [MapR][Support] (50090) Conversion from string to number failed with value: 39\x1;é®\x1;1504287

          [MapR][Support] (50090) Conversion from string to number failed with value: 38\x1;é®\x1;1504287

          [MapR][Support] (50090) Conversion from string to number failed with value: 38\x1;é®\x1;1504288

          [MapR][Support] (50090) Conversion from string to number failed with value: 36\x1;vcu\x1;1479846

          [MapR][Support] (50090) Conversion from string to number failed with value: 35\x1;가위\x1;1504449

          [MapR][Support] (50090) Conversion from string to number failed with value: 35\x1;cc\x1;1492900

          [MapR][Support] (50090) Conversion from string to number failed with value: 35\x1;輝様\x1;1504193

          [MapR][Support] (50090) Conversion from string to number failed with value: 34\x1;yc\x1;1503942

          [MapR][Support] (50090) Conversion from string to number failed with value: 34\x1;sj\x1;1488624

          [MapR][Support] (50090) Conversion from string to number failed with value: 34\x1;no\x1;1504611

          [MapR][Support] (50090) Conversion from string to number failed with value: 34\x1;no\x1;1504611

          [MapR][Support] (50090) Conversion from string to number failed with value: 32\x1;kc\x1;1504712

          [MapR][Support] (50090) Conversion from string to number failed with value: 32\x1;tc\x1;1503443

          [MapR][Support] (50090) Conversion from string to number failed with value: 32\x1;josefinasiguesubiendo\x1;1478489

          [MapR][Support] (50090) Conversion from string to number failed with value: 31\x1;ly\x1;1504309

          [MapR][Support] (50090) Conversion from string to number failed with value: 31\x1;yc\x1;1503941

          [MapR][Support] (50090) Conversion from string to number failed with value: 31\x1;cm\x1;1504890

          [MapR][Support] (50090) Conversion from string to number failed with value: 31\x1;7d\x1;1504324

          [MapR][Support] (50090) Conversion from string to number failed with value: 31\x1;az\x1;1504272

          [MapR][Support] (50090) Conversion from string to number failed with value: 30\x1;あむ\x1;1504289

          [MapR][Support] (50090) Conversion from string to number failed with value: 30\x1;가위\x1;1503949

          [MapR][Support] (50090) Conversion from string to number failed with value: 30\x1;r\x1;1503944

          [MapR][Support] (50090) Conversion from string to number failed with value: 29\x1;lpshoutout\x1;1504323

          [MapR][Support] (50090) Conversion from string to number failed with value: 29\x1;yc\x1;1503941

          [MapR][Support] (50090) Conversion from string to number failed with value: 29\x1;mb\x1;1479168

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;rdj\x1;1502643

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;a11\x1;1504219

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;gaz\x1;1504504

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;npp\x1;1504050

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;pfg\x1;1504133

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;no\x1;1490859

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;gme\x1;1499059

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;nst\x1;1504429

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;tmt\x1;1503908

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;phe\x1;1504415

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;hoy\x1;1504320

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;sfs\x1;1504795

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;khb\x1;1504436

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;a11\x1;1504308

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;twd\x1;1504337

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;okc\x1;1486100

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;cal\x1;1504317

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;akb\x1;1504940

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;miw\x1;1504519

          [MapR][Support] (50090) Conversion from string to number failed with value: 28\x1;a11\x1;1504308

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;okc\x1;1486245

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;a11\x1;1504311

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;stg\x1;1504746

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;ì² ì»¥\x1;1504412

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;rag\x1;1505025

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;ics\x1;1504025

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;rag\x1;1505021

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;rag\x1;1505025

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;hoi\x1;1491200

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;rt\x1;1495368

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;gol\x1;1504853

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;dgg\x1;1504251

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;rag\x1;1505021

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;rag\x1;1505026

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;rag\x1;1505023

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;ふるかわ性誕ç¥\x1;1504672

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;dwb\x1;1504302

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;twerkfest2k12\x1;1490567

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;rag\x1;1505021

          [MapR][Support] (50090) Conversion from string to number failed with value: 27\x1;bcd\x1;1504676

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;6d\x1;1504227

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;pbb\x1;1497601

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;lsu\x1;1504125

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;wiz\x1;1500844

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;jo\x1;1500456

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;lpshoutout\x1;1504322

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;music\x1;1504650

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;gmb\x1;1504463

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;bsc\x1;1504614

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;ham\x1;1497310

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;a11\x1;1504312

          [MapR][Support] (50090) Conversion from string to number failed with value: 26\x1;ì ˆë§\x1;1505037

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;non\x1;1504866

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;ybc\x1;1504104

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;yo\x1;1504863

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;nfl\x1;1504004

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;pbm\x1;1503464

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;bal\x1;1504221

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;nfl\x1;1503943

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;bdk\x1;1495997

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;nfl\x1;1503941

          [MapR][Support] (50090) Conversion from string to number failed with value: 25\x1;okc\x1;1485809

          [MapR][Support] (50090) Conversion from string to number failed with value: 24\x1;twerkfest2k12\x1;1490567

          [MapR][Support] (50090) Conversion from string to number failed with value: 24\x1;ast\x1;1485615

          [MapR][Support] (50090) Conversion from string to number failed with value: 24\x1;a11\x1;1504310

          [MapR][Support] (50090) Conversion from string to number failed with value: 24\x1;هام\x1;1504693

          [MapR][Support] (50090) Conversion from string to number failed with value: 24\x1;vym\x1;1504035

          [MapR][Support] (50090) Conversion from string to number failed with value: 24\x1;zap\x1;1482123

          [MapR][Support] (50090) Conversion from string to number failed with value: 24\x1;tsn\x1;1485130

           

           

          Unable to create extract

          1 of 1 people found this helpful
          • 2. Re: Does anyone have Hive connectivity working on Amazon EMR?
            Douglas Moore

            I'm using MapR3 and a second table containing just bigints also has parse errors when importing all using the MapR driver.

            1352196000     1353972600     17
            1354077000     1354077000     5
            1353846600     1353846600     6
            1353762000     1353762000     5
            1353949200     1353949200     8
            1353518100     1353525300     14
            1354364100     1354364100     10
            1349100000     1349100000     5
            1340286300     1340286300     20
            1346661900     1346661900     24
            Time taken: 0.337 seconds
            hive> describe counts;
            OK
            mint     bigint     
            maxt     bigint     
            cnt     bigint     
            • 3. Re: Does anyone have Hive connectivity working on Amazon EMR?
              Natey Three

              I can query Hive tables on Amazon's Elastic MapReduce service (using the AWS MapR M3 Distribution) via Tableau 8 using the MapR drivers, but if my Hadoop/Hive cluster on Amazon is the Amazon Distribution Hadoop, I get errors ("Query returned non-zero code: 1").

              Is there a Tableau driver for querying Hive with the Amazon Distribution Hadoop?

              • 4. Re: Does anyone have Hive connectivity working on Amazon EMR?
                Ashley Jaschke

                Tableau now has an EMR connector in beta using Hive or Impala.  If you'd like to participate in the beta, please reach out to me.

                 

                Ashley Jaschke

                Tableau Product Manager