jax.experimental.multihost_utils.sync_global_devices

jax.experimental.multihost_utils.sync_global_devices#

jax.experimental.multihost_utils.sync_global_devices(name)[source]#

Creates a barrier across all hosts/devices.

Parameters:

name (str) –