There are some specialized contexts for the situations where you don't want to allow expressions. These are the "Limited" contexts, like "LimitedNumeric", "LimitedComplex", "LimitedVector", "LimitedPolynomial", and so on. These handle disabling the operators, or in some cases just limiting them, and producing error messages for them.
In your case, you could use
loadMacros("contextLimitedNumeric.pl");
Context("LimitedNumeric");
to enable the limited context in which only numbers (not formulas) can be entered. Use
Context("LimitedNumeric-List")
if you want to allow commas so that lists of numbers can be entered.
There is also
Context("LimitedNumeric-Fraction");
that allows division of integers, and
Context("LimitedNumeric-StrictFraction");
that allows fractions but not decimal numbers (though the contextFraction.pl file is probably better for doing that sort of thing -- LimitedNumeric-StrictFraction was a predecessor to the more fully featured Fraction context).
If you are using complex numbers, there are several limited complex contexts. You can require the complex number to be in polar form for example, or force it to be entered in cartesian form. See the POD documentation for contextLimitedComplex.pl for more details.
If you want to change the error message, you can do
Context("LimitedNumeric");
Context()->{error}{msg}{"Can't use '%s' in this context"} =
"You must enter a number, not an expression or list";
to replace all the "Can't use ..." messages at once. Alter the message to your tastes.