Foldable shopping bag with belt clip