I'm evaluating TOS. I created a new project and added a delimited file under Metadata -> File Delimited.
Going thru the wizard I get to step 3 where you define the encoding, file separator, and a few other parameters. This screen reads the file you specified in step 2 and parses it according to the delimiter. In my case it is a CSV file. But the file has double quotes around all the field values and some of those contain commas within them.
Is it possible to tell TOS to ignore commas that are between double quotes? This is a very common situation and is handled by default in spreadsheet programs such as Open Office or Excel.
This seems like very elementary functionality and the reason I started looking for an ETL tool in the first place is because the COPY command in Postgres cannot handle this situation.
My other alternative is to use dbf file downloads of the same data. Is it possible in TOS to define the dbf delimiiter?
The bug in v4.0.2 only affected the New Delimited File dialog and was corrected in v4.0.3 and v4.1.0. An actual job in v4.0.2 reading the file worked fine; see screen-print.
