Women didn't have purse, they had pocket sewn in to their skirt.
Glove, Hats/pins, hair combs. Depends on how much money they had and where they lived. City or farm. If you have any more ?? email me I have ton of info about this time floating around in my head ambi_222@yahoo
References :

Undergarments:
Bustle-they're the things that you see under the back of a woman's dress, that make it stick out for a mile They extended almost straight out from the back waist to support a lot of drapery and ribbons and other stuff.
Camisole-It's a kind of combination, with attached knee-length drawers under the corset and bustle.

Outer garments:
Riding Habits-a matching skirt and jacket with a veiled tophat and a chemissette, but without a bustle.
Long Jacket and Skirt-worn for walking or traveling with a bustle and bonnet.
Aesthetic Dresses-instead of the sorset, the aesthetic dress was made of simple fabrics and worn loose or with a belt. They were worn in the home and sometimes to receive guests.

Headgear and Hair:
Hair would be worn pulled back and in ringlets or a low knot. Bangs were usually curled at the top of the forehead. They also wore bonnets.

Hope I helped! You can find more information and pictures at the link below.

Love and peace out!
References :
http://en.wikipedia.org/wiki/1880s_in_fashion#Women.27s_fashion