Find 2 houses for rent with a yard in Columbia Heights, MN. Private outdoor space is a coveted rental feature, especially in busy cities. Finding a house with a yard gives you your very own spot to relax, grill out, or do some gardening. Plus, being outside gives you the opportunity to socialize with neighbors and meet more people in the community.