sudo is required to view manpages when using most as the pager

I've installed most to be used as the default pager to view the man pages. most is exported as the PAGER in .bashrc. When I run a command like man grep I get the following error:

man: can't execute “most”: No such file or directory

man: command exited with status 255: sed -e '/^[[:space:]]*$/{ N; /^[[:space:]]*\n[[:space:]]*$/D; }' | LESS=-ix8RmPm Manual page grep(1) ?ltline %lt?L/%L.:byte %bB?s/%s..?e (END):?pB %pB\%.. (press h for help or q to quit)$PM Manual page grep(1) ?ltline %lt?L/%L.:byte %bB?s/%s..?e (END):?pB %pB\%.. (press h for help or q to quit)$ MAN_PN=grep(1) “most”

However, the following commands work without any issues.

• man -P most grep
• man -P pager grep <<< loads with most
• sudo man grep <<< works when command is run as root user

Ubuntu version: Ubuntu 20.04.1 LTS

PS: I upgraded to 20.04 from 18.04