open man (or info) pages from the same position where you left off last time

I treat man pages is the primary source of documentation about installed software. I would like to use them not only as a reference, but actually read them from beginning to end. And here comes the question. When I close the man page, next time I want it to be opened at the place I left off. Is it possible? Ideally it would work with less, which is the default system pager. But I am OK to change it to any pager that will do the trick. Standalone vim for example remembers position the file was read at last time. There might be some way to use it as a pager remembering position. Please try your idea before posting comments/answer.