As a data lake, Databricks’ emphasis is more on use cases such as streaming, machine learning, and data science-based analytics. The platform can be used for raw unprocessed data in large volumes.

Databricks supports a variety of data formats like CSV, Delta Lake, JSON, and Parquet, and connects with major data storage providers such as Amazon S3, Google BigQuery, and Snowflake.

The San Francisco-based startup has released a SQL-based, self-orchestrating data pipeline platform, claiming it will go to go toe-to-toe with Databricks’ Delta Live Tables.

In the run-up to Spark + AI Summit, Databricks is unveiling a new open source project, Delta Lake, which has nothing to do with the bayou or harvesting crawfish.It handles data processed using ...