No, never met Charlie or family members. I had two different buddies I explored the area with back then. We were young, careful, and kind of timid so did not approach buildings if it looked like people may be around; many did. We were surprised as hell when the news broke about the arrests. And, pretty scared.
Plan to start in Eureka Valley - something we spotted at a distance last trip, want to check out - and work south.
Yes, Three Pin, there are indeed some scary places in those Panamints, even today. I guess over the hill from Butte Valley at Barker Ranch is the scariest, though!
The last time I drove the long dirt road from Eureka Valley to DV, bits of my truck started falling off and I almost shook my teeth out.
If you do get near The Striped Butte, it makes an interesting short hike. There is a "road" that approaches the Butte from the south and from its end in the sagebrush you can make your way to a ridge and then to the top. The route is easy to see from the Stone Cabin.