Get a Zero water filter. It's the best of the small commercial ones.
Deionized water, also known as demineralized water / DM water[2] (DI water, DIW or de-ionized water), is water that has had its mineral ions removed, such as cations like sodium, calcium, iron, and copper, and anions such as chloride and sulfate. Deionization is a chemical process that uses specially manufactured ion-exchange resins which exchange hydrogen ion and hydroxide ion for dissolved minerals, which then recombine to form water. Because the majority of water impurities are dissolved salts, deionization produces a high purity water that is generally similar to distilled water, and this process is quick and without scale buildup. However, deionization does not significantly remove uncharged organic molecules, viruses or bacteria, except by incidental trapping in the resin.