This should be the wiring diagram from the owners manual on your boat.
The red/black wire on the load side of fuse 12 provides 12 volts to a terminal board in the bow panel. You will note that it goes through a 15 pin connector. This power is jumped from the terminal board to the line side of the up and down switches. These are normally open switches.
You will notice there are no ground wires anywhere near these switches. The only way this circuit can go to ground is by closing one of the switches and allowing current to flow to the trim relays under the motor cowling and go to ground there.
You say that the fuse is blowing even though the switches are not made. Only way this could be is if one of the switch contacts are stuck closed.
Let’s do this : Disconnect the blue and green wires from their switch and then replace the fuse. The fuse should hold.
Assuming the fuse holds, check for presence of voltage at each of the contacts where you removed the green and blue wire. If voltage appears on one, that switch contact is welded shut.
If the fuse blows, you are somehow getting to a ground polarity in the wiring harness or at the 15 pin connector.
Our next move will depend on the results of this test.
EDIT; sorry, I just noticed that there are ground terminals on the terminal strip where the red/black wire from the fuse terminates. It that terminal strip is faulty in some way, this is where the short could occur. Before doing any of the above tests, disconnect the black wires from that terminal board and replace the fuse.