That was practically my back yard growing up. I lived north of there off Ludlow (the road that comes down the winding hill next to the east "castle.") That hill is a blast on a bike or sporty car, but a real PITA on a bicycle! My cousins owned Ohio Caverns, if you went there, so I rode my bicycle down that way a lot growing up.
One of the high school teachers my wife had lived in the west house, and the daughter had parties there. One of my great-great grandparents had a tavern/inn on the road that runs by the two castles (but further east) in the early 1800s, but it is long gone.
That's all a beautiful area to drive/ride through!
Steve