- ANSI mode errors on Databricks Runtime 17+: CAST_INVALID_INPUT, DIVIDE_BY_ZERO and overflow fixes cheat sheetDatabricks on Azure · 12 Nov 2026
- Spark on Kubernetes production checklist: memory overhead, local storage, dynamic allocation and executor decommissioningData Platform · 11 Nov 2026
- Spark Structured Streaming RocksDB state store: slow commits, executor memory blowups and checkpoint storage growthData Platform · 11 Nov 2026
- Apache Iceberg with concurrent writers - a production checklist for catalogs, commit conflicts, isolation and metadata growthData Platform · 9 Nov 2026
- Spark EXPLAIN cheat sheet - reading physical plans, exchanges, join strategies, pushdown and AQE final plansData Platform · 9 Nov 2026
- PySpark first steps: read a CSV, filter, aggregate, join and write ParquetData Platform · 7 Nov 2026
- Spark join returned far more rows than expected: find and fix many-to-many key explosionsData Platform · 7 Nov 2026
- Delta MERGE fails with 'multiple source rows matched': find the duplicate keys and fix the loadData Platform · 6 Nov 2026
- Spark overwrite wiped the whole table: dynamic partition overwrite, replaceWhere and recoveryData Platform · 6 Nov 2026
- spark-submit cheat sheet: memory, cores, deploy mode and the errors you see firstData Platform · 6 Nov 2026
- Renaming or dropping a Delta column broke the streaming jobs: column mapping, schema tracking and safe rolloutData Platform · 3 Nov 2026
- Spark broadcast join failures: 'Could not execute broadcast in 300 secs', driver OOM and the 8 GB limitData Platform · 3 Nov 2026
- Spark fails reading a Parquet folder: column type mismatch, incompatible schemas and unreadable filesData Platform · 3 Nov 2026
- Timestamps off by hours in Azure Databricks: session time zones, TIMESTAMP vs TIMESTAMP_NTZ and daily totals that shiftDatabricks on Azure · 3 Nov 2026
- Introduction to Spark shuffle partitions: what spark.sql.shuffle.partitions does and how AQE sizes them for youData Platform · 2 Nov 2026
- Spark Kafka stream fails with failOnDataLoss: offsets out of range, aged-out data and recreated topicsData Platform · 2 Nov 2026
- Sev1: Databricks job fails with 'driver is up but is not responsive' — driver OOM and GC stormsDatabricks on Azure · 31 Oct 2026
- Sev1: Spark job stuck at 199/200 tasks for hours — finding and fixing data skewData Platform · 31 Oct 2026
- Azure Databricks standard access mode errors: RDD, SparkContext, UDF and Spark config failuresDatabricks on Azure · 30 Oct 2026
- Apache Iceberg hidden partitioning and partition evolution: change the layout without rewriting the tableData Platform · 29 Oct 2026
- Delta Lake basics: create a table, append, MERGE, and use time travel to undo mistakesData Platform · 29 Oct 2026
- Spark data skew in depth: diagnose skewed joins and aggregations, then fix with AQE, broadcast or saltingData Platform · 29 Oct 2026
- Azure Databricks \"No space left on device\": fixing full driver and worker disksDatabricks on Azure · 28 Oct 2026
- FetchFailedException and ExecutorLostFailure in Azure Databricks: lost shuffle files from OOM, spot evictions and decommissioningDatabricks on Azure · 28 Oct 2026
- Spark JDBC read is slow or runs in one task: partitionColumn, bounds, predicates and fetchsizeData Platform · 28 Oct 2026
- Spark Structured Streaming state keeps growing: watermarks that don't work, unbounded dropDuplicates and stream-stream joinsData Platform · 28 Oct 2026
- Long-running Databricks jobs reading Avro hit \"GC overhead limit exceeded\" - the DBR 18 Avro fast reader known issue and workaroundDatabricks on Azure · 27 Oct 2026
- Apache Iceberg table maintenance - expiring snapshots, compacting files and removing orphans with SparkData Platform · 26 Oct 2026
- Azure Data Factory mapping data flow failures - cluster start errors, out of memory, broadcast timeouts and sink errorsData Platform · 26 Oct 2026
- Databricks \"driver is temporarily unavailable\" or \"not responding\" - fixing driver overload, GC pauses and collect()Databricks on Azure · 26 Oct 2026
- Optimization: disk cache vs Spark cache on Azure Databricks - which to use, and when caching hurtsDatabricks on Azure · 25 Oct 2026
- Optimization: when Photon pays off on Azure Databricks - test it per job, not per workspaceDatabricks on Azure · 25 Oct 2026
- Sev1: critical Spark job keeps failing — ExecutorLostFailure, OOM and FetchFailedExceptionData Platform · 25 Oct 2026
- Transformation: Synapse Spark pools and notebooks to Azure DatabricksDatabricks on Azure · 25 Oct 2026
- Transformation: upgrading jobs to a new Databricks Runtime LTS without breaking productionDatabricks on Azure · 25 Oct 2026
- Databricks job performance tuning: AQE, shuffle, skew, joins, Photon and file layoutData Platform · 23 Oct 2026
- Delta Lake ConcurrentAppendException and other write conflicts: find the clash and stop itData Platform · 23 Oct 2026
- Spark Structured Streaming checkpoint recovery runbook: restart, change or reset a stream safelyData Platform · 23 Oct 2026
- Reading the Spark UI to explain a slow job to a customerData Platform · 22 Oct 2026
- Right-sizing standalone Databricks compute: single-node clusters, job clusters and serverlessData Platform · 22 Oct 2026
- The small-files problem in data lakes: detect it and compact itData Platform · 22 Oct 2026
- Debugging failed Databricks jobs: OOM, skew and slow stagesData Platform · 15 Oct 2026