Data loading from Excel to Database

TC1692777606 — Fri, 15 Nov 2024 21:27:16 GMT

I'm encountering an issue when attempting to load multiple files defined in tFileList using Excel metadata in Talend. It consistently results in a Java "OutOfMemory" error. Surprisingly, this problem doesn't occur when using CSV metadata. Since my task involves loading numerous Excel files into a database table, I'm seeking insights into the root cause and possible solutions. I've already tried adjusting memory configurations, but the problem still persists.

Re: Data loading from Excel to Database

JudyWilliams — Sat, 26 Aug 2023 06:28:57 GMT

HY there i can see your post and i must say

Prepare Your Excel Data:

Ensure your Excel spreadsheet is properly formatted with a clear structure. Each column should have a header, and rows should contain data.

Choose a Database Tool:

Use a database management tool or interface to interact with your database. This could be a command-line interface, a GUI tool, or a programming language with database libraries (e.g., Python with
pandas
- and database connectors).

Export Excel Data:

If your database tool supports it, you can directly import data from Excel. Otherwise, you might need to save your Excel data as a CSV (Comma-Separated Values) file.

Create a Table in the Database:

Make sure you have a corresponding table in your database to accommodate the Excel data. The table structure (columns, data types, etc.) should match the structure of your Excel data.

Thanks and regards

EddieBolt

topic Data loading from Excel to Database in Data Quality

Data loading from Excel to Database

Re: Data loading from Excel to Database