At high tide it must be OK. You don't wanna deal with rip currents during ebb. There were some TV news about Atlantic city rip currents, something to do about sand slide. It probably doesn't apply to cape May but still as you probably already know, high tide is better for viz and safer.
http://tides.mobilegeographics.com/locations/1002.html