Hi @dgudkov ,
Hope you are well.
I want to understand how Data Catalog will work in practice for us. Perhaps you might have answered this question elsewhere…
We currently use a software that has inadequate reporting for our needs. There are large volumes of data that are generated by this software and the only way to create custom reports is to export the reports out as csv files.
Being a small business, we don’t have massive databases or a huge team of developers to go and create custom solutions for us. I am contemplating using something like Google Data Studio because it is free and feed the data into there.
From what I understand data catalog is not a database but structured around providing the right dset files to people who are authorised to access them.
If so, I am guessing the workflow would need to be:
- Get data from external system
- Clean it up and load it to data catalog
- Export from data catalog to a source that can be read by a tool such as Data Studio
Google can only read flat files with a size of up to 100mb. Therefore, given your experience, would you say that I would need to have some sort of database eventually holding this information so that we can report on it?
I feel like adding a database is adding a layer of complexity that I am not sure I want…