In order for the single loop fusion from the previous slide to work you need to have narrow dependencies where each partition of the parent is referenced by at most one child RDD.
Please log in to leave a comment.
In order for the single loop fusion from the previous slide to work you need to have narrow dependencies where each partition of the parent is referenced by at most one child RDD.