The plates are in a basic capacitive configuration, seems to me that your basically shorting out a capacitor when you jump leads in a new configuration (electrical). You may also have a little battery action going on.
Just my humble opinion