The 27-year-old actress turned fashion designer told Net-A-Porter she keeps so busy photographers don't even take the time to follow her around.
“There is a threshold in New York, and once you pass that and are considered a New Yorker, they leave you alone,” she explained to Net-a-Porter.
“But we’re at the office every day, then home or out for dinner, so there aren’t the opportunities for them to take pictures. For the most part you try and avoid it… [I do], at least.”
Ashley and her sister Mary-Kate rose to fame after the twins landed a shared role on the hit sitcom "Full House" at the early age of 9 months. She credits this as the reason why they've never been intimidated by their celebrity status.
“We were nine months old when we started, so fame has always been part of our lives,” she said. “There wasn’t any weirdness where we decided that we wanted to be famous."
“Then as we got older, we were very fortunate that we could hire and work with amazing people who want to protect us,” she added.
In their rare interview with Net-A-Porter the Olsen sisters also discussed the origins of their interest in fashion and how Michelle Tanner, their character on "Full House," influenced their style.