As admirers of Arthur Elrod, Tony Duquette, and other 1960s design icons, Ed Cole and Christopher Wigand were always fascinated by Palm Springs. When the Tokyo-based couple began looking for a second home, they headed straight to the Southern California desert in search of a midcentury property that retained its original character. The endeavor was not so easy. Some sellers turned out to be reticent; others had renovated their residences beyond recognition. But eventually a promising new listing appeared: the storied house dreamed up by Hollywood set designer James McNaughton in the early ’60s, which became known as San Simeonita (a reference to its resemblance to San Simeon’s Hearst Castle). The sprawling Palladian-style villa had been famously owned by media heir George Randolph Hearst, who hosted lavish parties for dignitaries and celebrities there and reportedly sheltered his niece Patty Hearst after her much-publicized 1974 kidnapping.

“We had driven by the house many times without really knowing its history and were always intrigued by it,” says Wigand of the Palm Springs abode. “From the front it looked imposing, mysterious, and a little scary, although there were not many hints about what was behind the doors.” Here’s what they found behind the towering doorway, set with brass medallions: 8,000 square feet of glass-walled rooms surrounded by Romanesque statues and colonnaded belvederes and reflecting pools, all backed by panoramic views of the Coachella Valley. The house was bigger and required more work than Wigand and Cole would have liked (some of James McNaughton’s architectural details had been removed, and there were a few unsightly additions), but it had character in spades.

With the help of interior designer Anthony Cochran and contractor Stoker Inc., the couple was able to restore the property’s luster, creating a 21st-century interpretation of McNaughton’s vision. “I’m not sure any of us really knew what we were getting into,” says Cochran, half jokingly. “It was a fantastic challenge to make the property feel modern while completely embracing the past.” The designer and his clients were lucky to have archival magazine spreads—including a story published in Architectural Digest in 1963, showing the home’s early decor and layout. These images guided the renovation of the outdoor pool, for example, which kept its statues and belvederes but lost a bulky bar and wraparound railings.