Take out the batteries when storing for a long time because batteries can leak and destroy the recorder with the acid leaking into the device. You have to replace a damaged recorder and the most common damage is battery leakage - so avoid the headache and REMOVE THE BATTERIES!
Other things to avoid
Don't leave the recorder where your pet and chew on it. It's happened before.
Don't leave the recorder and case in a hot location like the dashboard of your car. It CAN melt with enough heat.
Don't get the recorder wet - duh!
Common thing to lose - the SD card. Know where your SD Card is at all times.
Can't change a rubric once you've started using it.