Pass the What?

Things said while eating dinner:

Me: Pass the salt and pepper.

Co-worker: Here's the salt.

Me: Can I have the pepper also?

Co-worker: I can't find the pepper. (said while moving the pepper mill on the table out of the way to look for pepper.

Me: Never mind, just hand me the brown thing in your hand, I'll use that.