It would be more historically accurate to wear the corset under your clothes but who cares? This is inspiration! Personally I would recommend a good quality steel boned corset because the plastic boned ones are foul, they bend and become unwearable.
They're also known as Granny Boots but I would refer to my favourite pair of boots more nicely, they're usually mid- calf to under the knee length and are laced up. They're not particularly common in high street shops but I got my pair from Schuh, if you see any then snap them up!
It wouldn't be a post without mentioning the Victorians and their mourning etiquette. I'm not suggesting you follow the "rules" of mourning because a black veil might be a touch too far. An embroidered handkerchief folded inside pocket with only the initials visible is a nice touch. I love jet jewellery which is commonly associated with mourning culture but black glass is also a good alternative.
Bustles and ruffles!
You can even add some Victorian details to items you already own, you can pin up your skirt to create a bustle and add ruffles to a skirt with a few simple techniques.
You can find victorian inspired jewellery anywhere and everywhere but if you're picky then try looking in vintage and antique shops, you probably won't find a genuine item in your first shop and be prepared to spend a lot of money. Esty is the best online place to find unique jewellery so go ahead and browse, even if it's just for fun.
Lolita has lots of Victorian inspiration so check out Daily Lolita or create a discussion on EGL, even a basic outfit has wonderful details such as petticoats and puff sleeves. There's also tons of brands that release Victorian inspired clothes including Mary Magdalene, Victorian Maiden and (my favourite) Excentrique.
Gloves are always available during Winter but why don't you try and create a mini wardrobe of gloves? I always wear them when my nails are stained from my classes or whenever I want to add a touch of elegance to my outfits. Real leather is easily found but I suggest looking online for materials such as velvet, mainstream shops nearly always use bad quality. I advise wearing velvet during the Winter or using silk underneath fingerless gloves, lace and crochet gloves are fantastic during Summer. Vintage gloves are very small, I rarely fit any pairs which is surprising because I have tiny hands. They're also mostly white or ivory but I have found blue before, I believe it relates to weddings and other special occasions.