While in London, she became a favorite with Britain's royalty, and in 1932, after starring with her brother in the Broadway play "The Band Wagon" she retired from the stage to marry British Lord Charles Arthur Cavendish, the second son of the 9th Duke of Devonshire.
The couple lived in Lismore Castle in Ireland, where she gave birth to three children, a daughter and twin sons. Following Lord Cavendish's death in 1944, three years later she married Colonel Kingman Douglass, an American Air Force officer and Investment Banker, who later became Assistant Director of the Central Intelligence Agency. While her brother achieved fame and success in Hollywood during the 1930s, in 1936, she gave serious consideration to making a musical film there with her brother, but changed her mind after visiting him and feeling intimidated by his overwhelming reputation.
So, in 1937, she began filming in England with Maurice Chevalier, but after just two days, she withdrew from the film project, feeling that the film would not work for her. An outgoing person, she made numerous friends and was often in Hollywood society. In 1971, she and her brother Fred were both inducted into the Theater Hall of Fame. Adele Douglass died in Tucson, Arizona from a stroke at the age of 84. Just prior to her death, she had donated her papers and memorabilia to the Howard Gotlieb Archival Research Center.