Looking for advice for sagging new latex mattress

I really didn’t mean to write a book but I almost did:)
My background story: I’ve been a fan of latex mattresses for many years. Back in the early 90’s I bought a used Englander latex mattress for my guest bedroom from a client who was moving. During the first year my guests all raved about how comfortable the mattress was. Unhappy with my nearly new Beautyrest I moved the latex guest mattress on to my box springs and I was hooked! After a couple of years I decided to buy a new latex mattress as the old mattress was thinner and I couldn’t find sheets to fit:(
I bought a “racetrack” latex mattress and had that for about 10 years. Replaced it in 2005 with a custom made latex mattress from a local mattress factory. 6" medium firm core, 3" 21 ILD layer and a 19" ILD topper in a traditional stitched cover.
The last couple of years the mattress started to bother me, I have a bad back and fibromyalgia and although I need support I am very sensitive to pressure points. I’ve been shopping for a new mattress at a few local stores here in Portland. Very few have latex and the ones that do don’t have many options for ILD levels, most are just firm. The one local small latex mattress factory does not even carry a 3’ 19" ILD anymore.
So I found a local mattress factory/wholesale company. I knew they carried latex in the past, unfortunately they stopped carrying latex last year. But they had a Queen latex floor model left at the warehouse. It was never in a retail store, just in their wholesale showroom. I went out to look at it and liked it very much. They made me a great deal and I brought it home a couple of weeks ago.
The mattress is made up of three 3" layers of latex, the top layer is 14-17 ILD, the middle layer is 23-27 and the bottom layer is 34-39. It is quite a bit firmer than my old mattress but I adjusted pretty quickly. I did use an old 3" 21 ILD topper I had on top of the mattress, under my mattress protector and that has made it perfect for me.
The problem I am having is primarily cosmetic, it appears to be sagging in the middle looking at it. It is very comfortable, it doesn’t feel like there is a sag in the mattress. I haven’t slept this well in years. But I am concerned that there is something going on with the way it sits inside the cover that could cause a problem as time goes by.
Each of the latex layers is covered with a thin stretchy translucent material, almost like a nylon stocking. When we lifted it out of the truck and brought it in the house it was like a big bulging sack of latex, no structure to hold it together. The cover is a heavy cotton with a layer of wool. Seems to be made very well. We put it on the bed and kind of stretched it around until all the layers were flat. I’ve played with it a bit to spread it out and added my old latex topper.
I have very bad arthritis in my hands and although it will be difficult I think I need to remove the nylon cover from the latex layers so it sticks together and doesn’t move as much. I’m also considering replacing the bottom layers with a 6" core to give it more structure. I’ve never felt the process of layering toppers without a thicker core was a good idea, it’s one of the reasons I never bought a DIY mattress online. I hard mattress will never work for me, the new mattress is as firm as I could possibly tolerate. So I’m not sure if I added a 6" core what ILD it should be. I think the firm bottom that I have now would be way too firm if it was 6" with a 3" 14 ILD on top as I had to add the 19 ILD topper for it to work.
I would appreciate ideas from the mattress experts here. Especially about removing the nylon covers on the layers, and the best way to solve the sagging problem.
It might seem silly to be thinking of rebuilding a new mattress but I got such a deal on the mattress ($450) that I may consider it.
Thank you for your help!

https://uploads.mattressunderground.com/outside/43479/Organic.Latex.POP.Flyer1(3).pdf
https://uploads.mattressunderground.com/outside/43479/Organic.Latex.POP.Flyer1(3).pdf

I know you didn’t ask this in the Sleep EZ section of the forum, but just figured I’d chime in real quick. I do recommend taking the layers out of their individual covers because they will change the way you contour into the mattress and will likely make the mattress feel firmer than normal. However, if you’re fine with the feel, then you can leave them as they are, it’s really a matter of preference, I suppose.

For the sagging issue, I’d recommend you do the same thing I advise our customers do when they contact us with sagging problems. What you need to do is isolate the problem so you can find out what is causing the issues your experiencing. The first step is to lay the top layer on the ground by itself then place something flat and straight across the layer (like a broomstick) from left to right. This will let you know how much of an impression (if any) that layer has. If the broomstick is perfectly flat across the top layer, then you want to check the next layer, and so on. If all of the layers are perfectly flat, then it’s probably your foundation that’s the problem. We’ve been in business for 45 years, and we still only get 30 or so warranty checks / requests per year, so it really is quite rare. Most of the time when a latex mattress has an impression, the problem lies with the foundation or mattress cover, or the way the layers are assembled in the cover.

Thanks for your reply!
I wish what you suggested was an option but I don’t have anyone to help me and I couldn’t physically move the mattress:) I don’t think the problem is the foundation, it is a 2 year old Leggett and Platt adjustable base. It was difficult but yesterday I did manage to remove the individual covers off the latex pieces, kind of wish I hadn’t as now has a firmer feel. I didn’t see your post before I did it unfortunately:( Didn’t sleep well last night. The mattress does sit better in the cover after reassembly. It’s weird but it actually hangs over the edge of the foundation a bit. It’s a standard queen size, my old latex mattress didn’t do that.