The only drawback is to be looked at on sight and ...

The only drawback is to be looked at on sight and without any discretion while wandering among the books. It is annoying to be treated like potential thieves.