All pull requests

Pull requests

• [SPARK-60278][SDP] SCD1 Ignore-null support; Merge to target table before auxiliary table

  #59537·AnishMahto opened Oct 16, 2026Contributor·

  ·

• [MINOR][SQL] Fix the @since version of ORC Types Framework ops that ship in Spark 4.3.0

  #59536·cloud-fan opened Oct 16, 2026Contributor·

  ·
  1

• [SPARK-60277][SQL] Merge a union's keyed partitionings when the unknown-keyed leg declares the other legs' keys

  #59535·ulysses-you opened Oct 16, 2026Contributor·

  ·

• [SPARK-60275][PYTHON] Migrate SQL_BATCHED_UDF to the EvalTypeHandler pipeline and remove read_udfs

  #59534·Yicong-Huang opened Oct 16, 2026Contributor·

  ·
  1

• [SPARK-60276][CORE] Preserve ownership of deferred pipelined task completions

  #59533·jerrypeng opened Oct 16, 2026Contributor·

  ·

• [SPARK-60246][FOLLOWUP][CORE] Remove logging from FileDownloadCallback and test the close-during-write path

  #59532·cravani opened Oct 15, 2026Contributor·

  ·

• [SPARK-60274][SDP] SCD1 Ignore-null support; Wire ignore-null microbatch reconciliation

  #59531·AnishMahto opened Oct 15, 2026Contributor·

  ·

• [SPARK-60273][CONNECT][TEST] Avoid binding the default Connect port in SparkConnectClientSuite URI check

  #59530·Yicong-Huang opened Oct 15, 2026Contributor·

  ·
  1

• [SPARK-59438][SQL] Do not push projection with subquery expressions through Limit/Offset

  #59529·txwyy123 opened Oct 15, 2026·

  ·

• [SPARK-60266][SDP] SCD1 Ignore-null support; Apply persisted tombstones per field

  #59528·AnishMahto opened Oct 15, 2026Contributor·

  ·

• [SPARK-60267][SQL] Fix Int overflow in the segment-tree cache size estimate for ROWS frames with offsets near Int.MaxValue

  #59527·markj-db opened Oct 15, 2026Contributor·

  ·

• [SPARK-60270][CONNECT] Preserve streaming source names for table reads

  #59526·ericm-db opened Oct 15, 2026Contributor·

  ·
  1

• [WIP][POC][GRAPHFRAMES] Add GraphFrames documentation to the Spark docs

  #59525·SemyonSinchenko opened Oct 15, 2026Member·

  ·
  1

• [SPARK-60272][CORE] Reject repeated consumption of pipelined shuffle partitions

  #59524·jerrypeng opened Oct 15, 2026Contributor·

  ·
  3

• [SPARK-60271][CORE] Reject persisted native pipelined shuffle consumers

  #59523·jerrypeng opened Oct 15, 2026Contributor·

  ·
  4

• [SPARK-60265][SQL] Allow optional grouping of V2 scan splits below shuffles

  #59522·rekbun opened Oct 15, 2026·

  ·

• [SPARK-XXXXX][SS] Fix state data source change feed dropping list state values after the first

  #59521·kavpreetgrewal opened Oct 15, 2026Contributor·

  ·

• [WIP][SQL] Add a Rust SDK for native data sources over the C ABI

  #59520·gengliangwang opened Oct 15, 2026Member·

  ·

• [SPARK-60252][SDP] SCD1 Ignore-null support; Field Reconciliation Data Classes

  #59519·AnishMahto opened Oct 15, 2026Contributor·

  ·

• [SPARK-60264][SS] Propagate close() failures in AbortableStreamBasedCheckpointFileManager

  #59518·snmvaughan opened Oct 15, 2026·

  ·
  3

• [SPARK-54733][SQL] Desc As Json GeographyType

  #59517·ashutosh-jindal opened Oct 15, 2026Contributor·

  ·

• [SPARK-60244][SQL] Align XML CHAR/VARCHAR map key error message with JSON

  #59516·ykisana opened Oct 15, 2026Contributor·

  ·

• [SPARK-60249] [SS] Allow reuse of named streaming sources

  #59511·SMHodges opened Oct 15, 2026·

  ·

• [SPARK-60262][SQL] Fail Parquet reads where two requested fields select the same column

  #59510·andygrove opened Oct 15, 2026Member·

  ·
  3

• [SPARK-60044][SQL][4.2] Freeze the k-way merge ordering of GroupPartitionsExec when the merge is planned

  #59509·peter-toth opened Oct 15, 2026Contributor·

  ·