Wondering if there is any plan to support iceberg (read only from metadata/data files stored in S3).
No plans so far. It's a relatively new format and you're the first person to ask about it. Let's see if more people chime in.
Moving to Feature requests.
1 Like
Lakehouse is the future ....
ICEBERG feature should be considered with Kafka integration as well.
Subscribe to broker's topics as ntfy does, but at scale.
I vote for that
1 Like
I think the best solution for this is to use Postgres to read/write data which you can then connect to from Easymorph. Easiest to use hosted solution I’ve found is from crunchy data and their data analytics solution that has support for a wide variety of data formats. They were recently acquired by snowflake so not sure long term implications but as a proxy for imports of unsupported data formats it’s worth considering. There support is almost as good as Easymorph LOL
It may also be possible to access AWS Iceberg S3 tables from EasyMorph using AWS Glue Iceberg REST endpoints. I'd have to look into it in more detail to be sure.
Another option would be to use the PyIceberg Python library and EasyMorph's new integration of Python in EasyMorph 