I see a lot of job postings asking for experience creating, maintaining, and modifying data lakes and pipelines.
I've also heard a LOT about pipelines, and a little bit about lakes (mostly in passing), but I don't think I've ever seen someone actually talk about them in depth. What are they exactly? How do you build them? Do you need something like Spark or Hadoop? What about Azure? Where can you go to learn this power?!
If anyone here works with these concepts, can you shed some light on this topic please? And perhaps drop some resources to study? Please?