Start planning your trip!
Don't be guiri!
If you are from Montmartre on rue Lepic, where tourists often return walk to see the Sacre-Couer, you have the Fromagerie Lepic, where oddly enough the neighborhood, you will hear more French than other languages.
If you are on the other side of the Seine, one of the most famous stores but no more expensive than others is Chez Barthélémy in the Rue de Grenelle 51.
For other districts, here you can find a good list of recognized small cheese shops in Paris.