Outside of the deep south and southwest, most of the climates found in North America are also found in Europe. It wasn’t a big problem. There were difficulties with agriculture in colonial New England, and Natives introduced the colonists to new crops and agricultural techniques, but the colonists adapted quickly.
A small number of Brits settled in Africa. Way more went to America. None left because of racism.
A very small setback compared to the enormous amount of freedom they enjoy. American women are the most spoiled group in world history.