~3 nm West-Southwest of Point Sur is the relatively shallow Schmieder Bank, with the top at about 20 fathoms. https://en.wikipedia.org/wiki/Schmieder_Bank
My Sue was one of the Cordell Expedition divers who originally explored Schmieder Bank resulting it it being included in the Monterey Bay National Marine Sanctuary. And as Alan suggested, depending on the conditions, you might want to stay offshore of Schmieder Bank.