Does it matter if I purchase a dehumidifier that's too small?

Yes, the unit may be overworked by running continuously. To reduce humidity to an acceptable level or to dry a room sufficiently a dehumidifier must be powerful enough to reduce the rooms’ moisture level to approximately 50%.