Two men have drowned after they braved the sea in wild weather off the Mornington Peninsula coast on Wednesday afternoon.