I have the same issue on my system. Any time I install a perl package from CPAN it is not readable by all users. I assume that it's because of the default umask on my server, which was probably set by our IT folks.
I've just got in the habit of changing the permissions every time I install a package.