Question
What is partition pruning in Spark SQL?
Select an option. Your answer will be checked instantly.
Correct Answer: C. Skipping data partitions whose partition values cannot satisfy a query
Explanation:
Filters on partition columns allow Spark to avoid opening unrelated directories.
Good partition design can greatly reduce scanned data.
Leave a Reply