One idea is the 39 hanger rule. I have the basic wardrobe written down. You limit the number of clothes in your wardrobe in the closet to how many you can hang on 39 hangers.
Emily Cho wrote a book in the 1980’s. You may still be able to find it in your local library. She uses the idea of choosing a core color for your wardrobe. For me, that color would be navy. Develop a professional wardrobe around that color.
I’ve seen it where you start with 3 pair of slacks in black, brown, and navy. Then add a sweater in a flattering color. I don’t remember the next steps.
The latest idea in fashion is the capsule wardrobe. This too is a way of minimizing how many clothes you have in your closet and drawers.
Living overseas, I had to travel by plane. The latest regulation limit passengers to one check on piece of luggage plus one carry one. That’s motivation for minimization.
Yes, you still need athletic wear to include a swimsuit. I wear loose yoga pants plus a t-shirt for working out plus good athletic shoes and socks. Most wardrobe plans don’t go into what’s needed to wear underneath. You do want excellent undergarments.
I may come back with later posting from personal notes with “minimal wardrobes.” based on capsules and/or the 39 hanger rule.
Where you are starting is an overabundance. You need to break it down to the 39 hangers, keeping only those items that work together. What do you like? What is your daily life like? Working in a factory, for instance, my wardrobe was blue jeans, t-shirts, 3 flannels shirts, something to wear on Sunday,. My teaching wardrobe, of course was different. When I worked in the factory, I kept my jeans in a laundry basket on my closet floor. I needed work boots for the factory, athletic shoes for running, and dress shoes for Mass. I taught swimming so I needed swimming suits plus sweat pants and sweat shirt to cover up.