Pure Silver is not attracted to a magnet. However, if the percentage of the silver alloy used to make jewellery has more concentration of cheaper variants that make it stick to the magnet.
Silver in its natural form is not noticeably magnetic and has only weak magnetic properties. However, using iron, nickel, cobalt, etc. that are quite magnetic, and this implies that either your silver is not pure or is a silver-plated cheap product. You need to shell out additional cost to get the silver of the best quality and this makes it quite a good idea for achieving a long term and durable investment source.