Instead of waiting for all the other nodes to update the parameter values v0, once a node finishes it will update the parameter values and start another gradient computation step.
Please log in to leave a comment.
Instead of waiting for all the other nodes to update the parameter values v0, once a node finishes it will update the parameter values and start another gradient computation step.