i had this issue with my aux port (dont have the usb)
i read some suggested to remove the rear vents (it just clips off) but when i did i couldnt access it.
but i was able to pull the console from the side where it meets teh carpet and was able to access the port that way. honestly i wasnt able to get the port to be as secure as it was b4 it fell but since i just keep my aux cable plugged in. it causes no problems. hopefully u have better luck