If you're using a different route and the map piece doesn't end up near the cursor, you can select it with the keyboard. Open the inventory, press the down arrow key twice and the press Enter to select the map piece. Pressing the down arrow key twice is a bit slow, but since there are a few frames where you can't select the map piece, you don't lose time by doing so.