The village sign was given to the village by the members of Swanton Morley Women's Institute to commemorate the 50th anniversary of the Federation of Women's Institute in England. Each member was given a small sum of money and was asked to use it to make a larger amount. Some members brought seeds and grew vegetables - others opened their home to visitors.

The sign stands on the village green and depicts Sir William de Morley receiving rent from his tenants - seemingly cap in hand. Even the dog appears to be bowing! Mounted on top of the sign is a carving of the water mill that stood on the River Wensum just north of the village. The mill was formerly a fulling mill and converted to a paper mill in the 18th Century.