History not working in bash

When I type at the bash prompt

!5

... I simply get

!5: command not found

... as the response. Any ideas about what I am doing wrong? Anything I should check?