The source said West feels the photographers have asked him inappropriate questions about his personal life ever since he began dating reality star Kim Kardashian in 2012.
A few months later, when Kardashian became pregnant, another photographer asked if they would invite Ray J -- with whom Kardashian stars in a sex tape -- to the baby shower.
The source said that since these instances, West has instituted a "don't ever talk" policy for anyone with a camera.
2014: The Year in Fashion [PHOTOS]
Tracy Morgan hits back at Walmart