Field note
What it does
Delta Lake provides ACID transactions, scalable metadata handling, and unified streaming/batch data processing on top of existing data lakes.
Capabilities
Available capabilities
Ignore updates and deletesRate LimitingDelta table as streaming sourceTable deletesTable restoreData partitioningIdempotent writesTime travel queriesTable mergesUpsert using mergeUpdate tableNOT NULL ConstraintChange Data FeedUnified streaming and batchLogStore APIRead protocolDeleteCHECK ConstraintCheckpointsGenerated columnsTable protocol specificationBackward compatibilityWrite protocolData SkippingExactly-once processingSQL ConstraintsProtocol VersioningBatch reads and writesTable featuresMulti-storage configurationDelta table as streaming sinkSchema EvolutionSCD Type 2 operationTable updatesShallow cloneFormat conversionVACUUM commandACID Transactions
Tags
Tags
Ways to use it
Ways to use it
sdk
Python / delta-spark
sdk
SQL / https://docs.delta.io/
sdk
Python / delta-spark
sdk
Python / delta-spark
sdk
SQL / https://docs.delta.io/delta-batch/
sdk
Scala / io.delta
sdk
Python / delta-spark
sdk
Scala / io.delta:delta-core
sdk
Scala / io.delta:delta-spark
sdk
scala / io.delta:delta-spark_2.13
pypi
python / delta-spark