Set default number of nodes to 1
We put default number of nodes to 1 in particular so that the linear evaluation with 8 GPUs has a global batch size of 1024, to reproduce the results.
Please register or sign in to comment
We put default number of nodes to 1 in particular so that the linear evaluation with 8 GPUs has a global batch size of 1024, to reproduce the results.