The bell at the top of the wharf. You always have to ring it to make the ship appear. It's part of the normal progression through the wharf.
Well crap I went through the whole place and didn't even see it. I guess I have to go all the way back to the top.