Flight attendants absolutely can deny based on their observation. So can gate agents….
However, that is not their performance metric, and SADLY, unlike @Kritchlow, they usually do not get backed up by the captain.
Can’t count how many times FAs came up saying some jackass pax wouldn’t listen...