Sources have revealed to TMZ.com that the department contacted Denise Richards, who has temporary guardianship over Sheen’s kids and told her that she was not allowed to take them over to the ‘Anger Management’ star’s house for a visit.