Have you tried looking at our Knowledge Base article explaining the differences between our regular connector and the legacy connector? Differences between Legacy and Default Excel and Text File Connections | Tableau Software
This sounds interesting.
Can you, please, explain where do you see this "arbitrary number of rows"?
Is it on the Data Source tab? Or in the viz when you drop "Number of Records" on the shelf?
What do you do to get a different number? F5?
How wide is your csv file (i.e number of columns) and what's the separator? If you could share first 2-3 lines (even anonymized) - that would help me recreate this locally.
The value comes from number of rows, I have tested out a little more and it seems like the number of columns is the issue, there were around 30 in the original file, if I reduce this by around half then I get all the rows. So it seems like it is a combination of rows and columns that hits a limit.
Hm. Never seen that before.
Hard to believe that this would be the case...
In case you get less rows that you actually have - are those rows "correct" ones? I.e. are these top N rows from your file? All columns in those rows are present?
Yes it brings through correct values, it's basically the top N.
2 of 2 people found this helpful
Try EasyMorph | Data transformation and analysis tool to import .csv file, filter and then export directly to tableau's .TDE format.
The free edition allow you up to 30 transformations.
Did you manage to got the correct and complete data set?
if NOT then
//1. try csv odbc driver route - SQLDriverConnect (Text File Driver)
do not forget to prepare a good .ini file!
//2 . play with the csv kit - csvkit 0.9.1 — csvkit 0.9.1 documentation
csvkit is a suite of utilities for converting to and working with CSV, the king of tabular file formats.
Hope this helps.
I was able to get the desired results buy reducing the number of columns first using Alteryx and everything worked as expected.
Have you tried using schema.ini file in order to Microsoft's Jet driver to figure out what's in your file? I wonder if it gets confused and guesses column separators (or even line separators?) wrong.
- Schema.ini File (Text File Driver)
- Resolving Incorrect Data Type Issues Related to Jet | Tableau Software
p.s. would it be possible to get a peek that that file of yours? Dozen of anonymized rows would do. Either here or via support case.
So I have anonymised the data using Alteryx, however when I connect to this file with the legacy connector I get the full number of rows. The original file however still gives me 305,195 out of 992,422
Putting the file through Alteryx requires the fields to be catagorised so I thought this may have been the reason. I attempted to put this data into the schema.ini file, using the link you supplied but this doesn't appear to effect the result.
Doesn't seem to be much point sending the anonymised file as that works fine!
Cheers for your help