Albany used to be a whaling town. At one time, it was producing 70% of the world's whale oil. Now of course, whaling has stopped and it's all seems the Japanese's fault that some whale species are endangered.
The last of their whaling ship is now part of Whale World. You can actually tour the ship but the entrance ticket is a bit steep.
The beach next to it is pretty nice. Some people swim there but I wouldn't recommend it unless you have enough body fat like an elephant seal or a baby whale..