Former U.S. Open champion Matt Fitzpatrick of Team GB withdrew from the Olympic men's golf competition after he shot an 81 on Saturday because of a thumb injury.