AzerothCore is based on SunwellCore (a fork from TC). SunwellCore was a public server with 4000 players online and they made sure their core could handle that amount of players easily. Reading data from the ram is much faster than reading from the hard disk (there are entire systems based on this principle). That's one of the reason there is a bigger ram usage.
|Number of players||Minimum RAM requirement (approx.)|
We recommend at least 16 GB as the server will gradually cache the world maps as the players explore them which finally takes up to at least 11 GB of RAM usage.
It means that even though you have few players online, when they explore any map, it will never be unloaded from the RAM until reboot. So after enough time, all the maps will be loaded, taking up more RAM. It's an architectural choice granting "high performance" on heavy usage.