Why meldra.ai Bypasses the Databricks & Snowflake Spark Tax
Traditional cloud data warehouses (like Databricks or Snowflake) force teams to spin up heavy virtual machine clusters (Spark nodes) just to handle simple queries or basic ingestion pipelines. This results in thousands of dollars of idle server costs every single month.
meldra.ai completely eliminates this "Spark Tax". By compiling natural language questions directly into optimized DuckDB SQL, our architecture queries S3 Apache Iceberg files locally and serverless on-the-fly. There is no warm cluster compute node kept running, meaning your monthly compute idle cost is exactly $0.
Meldra Data Flow System
ERP Source
SAP / SF JSONmeldra.ai Engine
DuckDB / ServerlessAWS S3
Apache Iceberg1. Databricks Zero-Copy Interoperability Guide
Because meldra.ai writes S3 data files using open-standard Apache Iceberg metadata and Parquet rows, Databricks can read these tables directly from your S3 bucket without requiring you to export, copy, or transfer a single byte of data.
# Spark SQL Catalog configuration for AWS Glue spark.sql.extensions org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions spark.sql.catalog.meldra_catalog org.apache.iceberg.spark.SparkCatalog spark.sql.catalog.meldra_catalog.type hive spark.sql.catalog.meldra_catalog.uri thrift://glue-metastore.eu-west-2.amazonaws.com:9083
2. Snowflake Zero-Copy Interoperability Guide
Configure Snowflake to read the Apache Iceberg tables generated by meldra.ai by setting up an External Volume and an Iceberg Table definition inside your Snowflake worksheet.
CREATE OR REPLACE EXTERNAL VOLUME meldra_ext_vol
STORAGE_LOCATIONS = (
(
STORAGE_PROVIDER = 'S3'
STORAGE_BASE_URL = 's3://your-bucket-name/iceberg-warehouse/'
STORAGE_AWS_ROLE_ARN = 'arn:aws:iam::123456789012:role/snowflake-access-role'
)
);