4 Replies Latest reply on Dec 7, 2016 9:06 AM by Eoghan Lyons

    Connecting to Multiple Formats With the Same Headers

    Eoghan Lyons

      Hi all,

       

      I have built up a database of sales for a company over the last 3 years. Each year has quite a large amount of revenue items, in the region of 400,000 transactions a year.

      Therefore, my Excel file has in excess of 1,000,000 lines.

       

      The current format is built in .xls, and also has headers from A to BE. This is the standard number of headers in the reports used to build the database, so I could possibly trim that down.

       

      The file is now in the region of 300 MB in size.

       

      I'm curious regarding the ability to split this file up into different parts, e.g. 2014, 2015, 2016, or even individual months, and still be able to analyse the contents as if combined? For example, can I still observe sales across September 2015 to March 2015 using multiple files and have filters relevant to the entire period?

       

      As an alternative, is there best practice on file formats which might make this a smaller file, using up less memory, while still maintaining data integrity?

       

      Many thanks,

      Eoghan.