The Castle Keep was part of the stone castle, constructed between 1172 and 1177 on the orders of Henry II. This replaced the earlier, Norman motte-and-bailey castle that gave the city of Newcastle its name.
Image: Dan Pope 2006 (CC BY-NC-SA)
http://www.flickr.com/photos/gusset/299422172