Anne was the daughter of Benjamin Harrison of Berkeley Plantation (died July 12, 1745) and Ann Carter (Daughter of Robert “King” Carter). Anne married William Randolph III son of William Randolph II & Elizabeth Peyton (Beverly) Randolph of Turkey Island, & had children William Beverly Randolph, Peyton Randolph, Anne (Randolph) Harrison, Elizabeth (Randolph) Grymes, Lucy (Randolph) Burwell and Peter Randolph. Their home Wilton was constructed for William Randolph III and Anne Randolph c. 1753. Wilton was originally the manor house on a 2,000-acre tobacco plantation located on the north bank of the James River several miles east of the city of Richmond. Between 1747 and 1759, William III acquired more than a dozen contiguous tracts of land. About 1753, Randolph completed construction of large Georgian manor house overlooking the river, which he named "Wilton."
