Key wallet with zipper