Find 2 apartments for rent with a yard in Port Jefferson, NY. Private outdoor space can be hard to come by when you rent in an apartment community. Finding an apartment with a yard gives you your very own spot to relax, grill out, or do some gardening. Many apartment communities share a greenspace, providing an opportunity to meet neighbors and socialize outdoors.