topic Parquet Components in Talend Studio

Parquet Components

lmit — Sat, 16 Nov 2024 08:36:04 GMT

Hi All,

I have requirement where i need to use Parquet Component, but i can see that parquet can be used in Big data batch , is there any way were i can use these components in standard jobs ?

or are there any other components which can replace Parquet components?

Thanks,

lmit

Re: Parquet Components

Anonymous — Tue, 06 Mar 2018 13:10:14 GMT

You can create a hive table with parquet serde on the location that is required and insert data from the hive table of the previous file.

Hive tmp table(any file format) to Hive table (parquet file format) this is one thing i could think of ?

Can you explain your use case ?

Re: Parquet Components

lmit — Tue, 06 Mar 2018 15:36:42 GMT

Thanks rvtj for your reply.

My use case is that we are just using parquet component to store in blob. As parquet files are the most compressed files.

Thanks,
Lmit

Re: Parquet Components

manodwhb — Wed, 07 Mar 2018 04:25:04 GMT

@lmit,Parquet Components only be available if you create a Big Data Batch job in licensed Talend Bigdata.

Re: Parquet Components

Anonymous — Wed, 07 Mar 2018 07:28:05 GMT

Hello,

Please feel free to vote for this new feature jira issue:https://jira.talendforge.org/browse/TBD-4349

Best regards

Sabrina