Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

>> So basically, a data lake is a fancy word for a file system?

To me, it looks more like an ODS (Operational Data Store) with some data-mart like curation steps before it hits users.



I'm not sure about that, to me an ODS has a schema applied to it to make the data fit into a relational database structure.

A data lake should be storing the data in it's original form, without transformation.


>> ODS has a schema applied to it to make the data fit into a relational database structure.

Yes, I get that. I was probably oversimplifying.

Practically speaking, the BI projects I've been on for small to medium enterprises (<150M in size, non-tech) still have predominantly relational data sources.

In many of those cases, a warehouse is an expensive effort in over-engineering, but a data-lake-like ODS (without transformations in the main data tables) with curated subject-area marts is a more sensible solution.

--edit, added "non-tech" to my qualifier




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: