In 1704, Jean-Joseph Gosselin, Seigneur de Tourville, became Seigneur de Garcelles and had the present château built in 1721. Around 1780, the Doynel de Saint Quentin family acquired the estate, which was subsequently inherited.
The château grounds and avenues were listed in September 1942 to prevent the trees from being requisitioned for the "war effort". In 1944, during the Battle of Normandy, bombing raids caused severe damage to the château and its tree lines.