Beachgoers pulled the body of a man from the water at Chelsea about 10pm Thursday night.
A Victoria Police spokeswoman said it was unclear whether the man's death was as a result of an accident or foul play.
He is described as African in appearance and aged in his 20s. His identity is yet to be established.
