The 60-man field for the Olympics was set on Tuesday based on world golf rankings, and there were a half-dozen late withdrawals, including U.S. Open runner-up Louis Oosthuizen.