The substantial remains of the castle are grouped around a small, open courtyard, with few indications of serious fortification. There is no firm evidence to suggest the site was fortified before 1304, though the substantial foundations of the southwest tower have been compared with earlier defensive stone keeps. Much of what is visible at Weobley today can be attributed to two, probably contiguous, phases of building activity, with work beginning in the early years of the 14th century.

The earliest buildings to be constructed were the hall block, the two southern towers and sections of the east curtain. The latter was intended to form the outer walls of the east range. Surprisingly, this scheme made no immediate provision for the defence of the west side of the castle, or the area between the two southern towers. Although this might suggest peaceful conditions during the time of construction, there can be no doubting the defensibility of certain aspects of the work begun during this first phase. This is evidenced, for example, by the crenellated wall-tops, the watchtower and the completion of the southwest tower to battlement level.