1 Reply Latest reply on Jul 5, 2012 4:57 PM by Tracy Rodgers

    Extract freezing at sort stage

    Peter Gilks

      I am creating extracts from teradata. This previously was working fine, but recently (I think since I got a new laptop!), it freezes during the extraction process, usually but not always at the sort stage.

       

      I am extracting large datasets, typically in the region of 20million rows. But as I say this was working fine before. has anyone got any ideas?

       

       

      Cheers

      Peter

       

       

      here's the last thing the log says before I cancelled. The last line just keeps repeating every second....

       

       

      2012-07-05 16:04:25.819 (1104): UpdateProgress: k = 15328256, lb = 63899068, n = 79873835, ub = 79873835

      2012-07-05 16:04:26.319 (1104): UpdateProgress: k = 41630430, lb = 63899068, n = 95848602, ub = 95848602

      2012-07-05 16:04:26.818 (1104): UpdateProgress: k = 63899068, lb = 63899068, n = 63899068, ub = 63899068

      2012-07-05 16:04:26.818 (1104):    [Time] Running the query took 5.4754 sec.

      2012-07-05 16:04:26.850 (1104): Inserted 15974767 rows in 5558.793 seconds

      2012-07-05 16:04:26.943 (1104): MetadataQuery: (top (table [Extract].[Extract]) () 0)

      2012-07-05 16:04:42.681 (1104): <QUERY protocol='04adbca0'>

      2012-07-05 16:04:42.681 (1104): (sort [Extract].[Extract]

      2012-07-05 16:04:42.681 (1104):   ( ([ACTIVE_CURRENT_ACCOUNT_IND] asc) ([ATM_ACTIVE] asc) ([BAPS_CUSTOMER_IND] asc) ([BFP_CUSTOMER_IND] asc) ([BRANCH_ACTIVE] asc) ([CA_CASHCARD] asc) ([CA_FEE_PAYING] asc) ([CA_OTHER] asc) ([CA_STANDARD] asc) ([CA_STUDENT] asc) ([CA_YOUTH] asc) ([COMPLAINTS_IND] asc) ([CONTACTLESS_USE_IND] asc) ([CREDIT_CARD_IND] asc) ([CURRENT_ACCOUNT_IND] asc) ([CUSTOMER_CHARGED_IND] asc) ([DORMANT_IND] asc) ([EMAIL_MARKETABLE] asc) ([FEE_PAYING_IND] asc) ([GENERAL_INSURANCE_IND] asc) ([HEALTH_INSURANCE_IND] asc) ([HOME_INSURANCE_IND] asc) ([INACTIVE_IND] asc) ([INCOME_INSURANCE_IND] asc) ([INSURANCE_IND] asc) ([INVESTMENTS_IND] asc) ([LIFE_INSURANCE_IND] asc) ([MAIL_MARKETABLE] asc) ([MOBI_IND] asc) ([MORTGAGE_CAPPED] asc) ([MORTGAGE_DISCOUNT] asc) ([MORTGAGE_FIXED] asc) ([MORTGAGE_IND] asc) ([MORTGAGE_OFFSET] asc) ([MORTGAGE_OTHER] asc) ([MORTGAGE_TRACKER] asc) ([MORTGAGE_VARIABLE] asc) ([MOTOR_INSURANCE_IND] asc) ([NEW_TO_BANK_IND] asc) ([ONLINE_ACTIVE] asc) ([PAN_PRODUCT_BORROWER_IND] asc) ([PENSIONS_IND] asc) ([PPI_IND] asc) ([PREMIER_IND] asc) ([PROTECTION_INSURANCE_IND] asc) ([SAVINGS_10KPLUS_IND] asc) ([SAVINGS_500PLUS_IND] asc) ([SAVINGS_FIXED] asc) ([SAVINGS_IND] asc) ([SAVINGS_INSTANT] asc) ([SAVINGS_ISA] asc) ([SAVINGS_NOTICE] asc) ([SAVINGS_OTHER] asc) ([SAVINGS_REGULAR] asc) ([SECURED_LENDING_IND] asc) ([SMS_IND] asc) ([STOCKBROKERS_IND] asc) ([TELEPHONE_ACTIVE] asc) ([TELEPHONE_MARKETABLE] asc) ([TRAVEL_INSURANCE_IND] asc) ([UNSECURED_LOAN_IND] asc) ([ONBOARDING_SCORE] asc) ([PREMIER_SEGMENT] asc) ([XFACTOR_CAT_COUNT] asc) ([CA_STANDING_ORDERS_DR_VOL] asc) ([Insurance_Sales] asc) ([CA_BRANCH_DEBITS_VOL] asc) ([CA_COUNTER_DEBITS_VOL] asc) ([CA_CHEQUE_CREDITS_VOL] asc) ([CA_CARD_USAGE_OVERSEAS_VOL] asc) ([CA_AUTO_CREDITS_VOL] asc) ([CA_COUNTER_CREDITS_VOL] asc) ([CA_CHEQUE_DEBITS_VOL] asc) ([CA_ATM_DEBITS_VOL] asc) ([CA_DAYS_IN_EXCESS_COUNT] asc) ([AGE] asc) ([CA_DIRECT_DEBITS_VOL] asc) ([CA_DAYS_IN_DEBIT_CNT] asc) ([CA_TOTAL_CREDITS_VOL] asc) ([DESCRIPTION] asc) ([NATIONALITY_CODE1] asc) ([NATIONALITY_CODE] asc) ([CA_DAYS_IN_CREDIT_CNT] asc) ([CA_CARD_POS_DEBITS_VOL] asc) ([CA_CARD_DEBITS_VOL] asc) ([CA_TOTAL_DEBITS_VOL] asc) ([MTHS_SINCE_LST_PROD_OPEN] asc) ([Loans_Fee_Inc] asc) ([TENURE_MONTH] asc) ([Insurance_Service] asc) ([Loans_Sales] asc) ([Mortgage_Fee_Inc] asc) ([Savings_Maintain] asc) ([CA_Sales] asc) ([Loans_Service] asc) ([Insurance_Maintain] asc) ([CA_OVERDRAFT_LIMIT] asc) ([Mortgage_Sales] asc) ([Insurance_Fee_Income] asc) ([Savings_Sales] asc) ([Mortgage_Service] asc) ([Loans_Maintain] asc) ([Insurance_Total] asc) ([Mortgage_Maintain] asc) ([CA_AVG_CLEARED_DR_BALANCE] asc) ([POSTAL_SECTOR] asc) ([CA_Maintain] asc) ([Loans_Int_Inc] asc) ([Savings_Service] asc) ([CA_DEBIT_TURNOVER_AMT] asc) ([CA_CREDIT_TURNOVER_AMT] asc) ([CA_AVG_CLEARED_CR_BALANCE] asc) ([CA_AVG_CLEARED_BALANCE] asc) ([CA_Service] asc) ([CUSTOMER_INCOME] asc) ([Loans_Impairment] asc) ([CA_Fee_Inc] asc) ([SAV_AVG_CLEARED_BALANCE] asc) ([Loans_Total] asc) ([CA_Impairment] asc) ([UNSEC_LOAN_AVG_CLEARED_BALANCE] asc) ([MORTGAGE_BALANCE] asc) ([Mortgage_Impairment] asc) ) )

      2012-07-05 16:04:42.681 (1104): </QUERY>

      2012-07-05 16:04:43.930 (1104): UpdateProgress: k = 0, lb = 15974767, n = 4153439420, ub = 4153439420

      2012-07-05 16:04:44.429 (1104): UpdateProgress: k = 0, lb = 15974767, n = 4153439420, ub = 4153439420

      2012-07-05 16:04:44.929 (1104): UpdateProgress: k = 0, lb = 15974767, n = 4153439420, ub = 4153439420

      2012-07-05 16:04:45.429 (1104): UpdateProgress: k = 0, lb = 15974767, n = 4153439420, ub = 4153439420

      2012-07-05 16:04:45.928 (1104): UpdateProgress: k = 0, lb = 15974767, n = 4153439420, ub = 4153439420

      2012-07-05 16:04:46.428 (1104): UpdateProgress: k = 0, lb = 15974767, n = 4153439420, ub = 4153439420