- Backfilling history into a live Lakeflow streaming table with ONCE flows: a checklist for boundaries, CDC targets and full refresh safetyDatabricks on Azure · 13 Nov 2026
- Delta VACUUM takes hours or frees no space on Azure Databricks: LITE mode, inventory-driven vacuum and ADLS soft deleteDatabricks on Azure · 13 Nov 2026
- Event-driven Databricks jobs with table update triggers: debounce settings, ALL vs ANY and incremental processing that survives retriesDatabricks on Azure · 13 Nov 2026
- Databricks materialized view does a full recompute on every refresh - reading planning_information and making it incrementalDatabricks on Azure · 11 Nov 2026
- Letting external engines read Unity Catalog tables on Azure Databricks: Iceberg REST catalog and credential vending checklistDatabricks on Azure · 11 Nov 2026
- Moving Unity Catalog tables and volumes to a new ADLS storage account on Azure DatabricksDatabricks on Azure · 11 Nov 2026
- Surrogate keys on Delta at scale: identity columns, their concurrency limits and hash-key alternatives on Azure DatabricksDatabricks on Azure · 11 Nov 2026
- Convert external Delta tables to Unity Catalog managed tables with SET MANAGED: prechecks, cutover and rollbackDatabricks on Azure · 10 Nov 2026
- Delta queries slow before the first task starts: transaction log bloat, checkpoints and file counts on Azure DatabricksDatabricks on Azure · 9 Nov 2026
- Structured Streaming production checklist for Azure Databricks - checkpoints, rate limits, state, idempotent sinks and monitoringDatabricks on Azure · 9 Nov 2026
- Delta query still scans every file: fix data skipping, the first-32-columns stats limit and filter expressionsDatabricks on Azure · 7 Nov 2026
- Delta stream fails with 'Detected a data update in the source table': skipChangeCommits or Change Data Feed?Databricks on Azure · 7 Nov 2026
- Delta MERGE fails with 'multiple source rows matched': find the duplicate keys and fix the loadData Platform · 6 Nov 2026
- Delta small files from streaming tables: optimized writes, auto compaction and safe OPTIMIZEDatabricks on Azure · 6 Nov 2026
- Delta table inspection cheat sheet: DESCRIBE HISTORY, DETAIL and who changed whatDatabricks on Azure · 6 Nov 2026
- Delta time travel fails for older versions: log retention, file retention and what you can still recoverDatabricks on Azure · 6 Nov 2026
- Spark overwrite wiped the whole table: dynamic partition overwrite, replaceWhere and recoveryData Platform · 6 Nov 2026
- Renaming or dropping a Delta column broke the streaming jobs: column mapping, schema tracking and safe rolloutData Platform · 3 Nov 2026
- Timestamps off by hours in Azure Databricks: session time zones, TIMESTAMP vs TIMESTAMP_NTZ and daily totals that shiftDatabricks on Azure · 3 Nov 2026
- Delta writes failing with CHECK or NOT NULL constraint violated on Azure Databricks: find the bad rows, quarantine them and change constraints safelyDatabricks on Azure · 2 Nov 2026
- Introduction to Microsoft Fabric Lakehouse vs Warehouse: which one to use, and how they share data in OneLakeData Platform · 2 Nov 2026
- Sev1: Delta Lake pipelines failing with ConcurrentAppendException — fixing write conflictsData Platform · 31 Oct 2026
- Sev1: Delta MERGE runs for hours and the daily SLA is missed — pruning, file layout and quick winsDatabricks on Azure · 31 Oct 2026
- Delta change data feed on Databricks: incremental silver-to-gold propagation without full rescansDatabricks on Azure · 29 Oct 2026
- Delta Lake basics: create a table, append, MERGE, and use time travel to undo mistakesData Platform · 29 Oct 2026
- Refreshing test environments with Delta deep and shallow clones on DatabricksDatabricks on Azure · 29 Oct 2026
- Sev1: a dev or test job wrote into production tables. Contain, find the damage and restore with Delta historyDatabricks on Azure · 29 Oct 2026
- Delta table features broke external readers: deletion vectors, column mapping and protocol versions that Synapse, Power BI or older Spark can't readDatabricks on Azure · 28 Oct 2026
- Fabric SQL analytics endpoint shows stale or missing data: Lakehouse metadata sync delays, skipped tables and how to refreshData Platform · 28 Oct 2026
- foreachBatch MERGE in Azure Databricks: duplicates after restarts, 'multiple source rows matched' and merges that get slower every dayDatabricks on Azure · 28 Oct 2026
- Lakeflow AUTO CDC (APPLY CHANGES) gives wrong results: out-of-order events, SCD Type 2 duplicates, deletes that come backDatabricks on Azure · 28 Oct 2026
- Databricks: RESTORE or CLONE that changes table partitioning may now be blocked - what changed on 1 September 2026 and how to work with itDatabricks on Azure · 27 Oct 2026
- Delta \"A schema mismatch detected when writing\" - handling schema evolution safely in appends, overwrites and MERGEDatabricks on Azure · 26 Oct 2026
- Advisory: Delta Lake, Apache Iceberg or Hudi - choosing an open table format and staying interoperableData Platform · 25 Oct 2026
- Optimization: faster Delta MERGE on Azure Databricks - pruning, deletion vectors and source deduplicationDatabricks on Azure · 25 Oct 2026
- Sev1: Delta queries fail with FileNotFoundException after VACUUM or storage cleanupDatabricks on Azure · 25 Oct 2026
- Sev1: duplicate records after a pipeline re-run — clean up and make loads idempotentData Platform · 25 Oct 2026
- Sev1: Unity Catalog table or schema dropped by mistake — UNDROP and RESTOREDatabricks on Azure · 25 Oct 2026
- Sev1: upstream schema change broke the production loads — schema drift triage and recoveryData Platform · 25 Oct 2026
- Transformation: Cloudera/Hortonworks Hadoop to a Databricks lakehouseData Platform · 25 Oct 2026
- Transformation: from hourly batch ETL to streaming with Kafka and Spark Structured StreamingData Platform · 25 Oct 2026
- Transformation: plain Parquet/Hive tables to open table formats (Delta, Iceberg, UniForm)Data Platform · 25 Oct 2026
- A Delta lakehouse blueprint for Azure Databricks: catalogs, medallion layers, loading patterns and data productsDatabricks on Azure · 23 Oct 2026
- Advanced Azure Databricks: encryption keys, hardening, reading query plans and change data captureDatabricks on Azure · 23 Oct 2026
- Delta Lake ConcurrentAppendException and other write conflicts: find the clash and stop itData Platform · 23 Oct 2026
- Delta tables on autopilot: liquid clustering and predictive optimization in DatabricksData Platform · 23 Oct 2026
- Incremental ingestion without the plumbing: an Auto Loader (cloudFiles) pipeline built end to endDatabricks on Azure · 23 Oct 2026
- Moving Delta data between Databricks tenants: storage copy, Delta Sharing or deep cloneData Platform · 23 Oct 2026
- Needle-in-a-haystack lookups on Delta: when Bloom filter indexes pay off on Azure DatabricksDatabricks on Azure · 23 Oct 2026
- Spark Structured Streaming checkpoint recovery runbook: restart, change or reset a stream safelyData Platform · 23 Oct 2026
- Who owns the files? Managed vs external Delta tables, Hive metastore and Unity Catalog on Azure DatabricksDatabricks on Azure · 23 Oct 2026
- Databricks disaster recovery: a second-region workspace, code, data and Unity CatalogData Platform · 22 Oct 2026
- Delta Lake backup and recovery: time travel, RESTORE, deep clone and storage protectionData Platform · 22 Oct 2026
- Delta Lake table maintenance: OPTIMIZE, VACUUM and clusteringData Platform · 22 Oct 2026
- Lakehouse foundation: medallion layers, storage layout and naming that scaleData Platform · 22 Oct 2026
- Reliable Databricks pipelines: retries, zones, instance pools and Delta Live Tables recoveryData Platform · 22 Oct 2026
- The small-files problem in data lakes: detect it and compact itData Platform · 22 Oct 2026