This pub stands on the corner of Russell Street and Dolphin Lane, Russell Street was built in the 1830's and a pub called the White Hart stood here long before this. The premises were completely burnt to the ground in 1891 when the mother of the then licensee George Ford knocked over a lamp and set the pub alight.

This area of Dover took many hits from both shells and bombs during world war 2, the Fremlins brewery in Dolphin Passage to many hit though out the war, next door to the Castle pub the East Kent Bus Garage was hit by a bomb in 1942 this same year the Castle was closed due to being hit.

Brinley Critchley reopened the pub in 1950, it was then taken over in 1961 by the very well known Charles Bollands who retired in 1975.