CAD: Memory Efficient Convolutional Adapter for Segment Anything