Yes you can, using session access you can do the following:
1) Both Users A & B will be able to see a_view.qvw & b_view.qvw on Access point, but User A or B will be able to go into only the report they have access to.
2) User A will be able to see only a_view.qvw and User B only b_view.qvw on access point.
This can be achieved by enabling "Filter Access point based on session access" option in Document Properties -> Server tab.