Hi chs4000,
What you are describing would be very typical of lower density memory foam (little memory) which would also be less durable than higher quality/density memory foam toppers. If you were to buy a similar topper in a 4 or 5 lb density then it would have a much greater chance of lasting you for a few years or longer. Some of the better sources for memory foam layers or toppers I’m aware of are also included in the component post here as well just in case you decide at some point to try a memory foam topper once again.
Phoenix