How are you checking the size? Some tools will split file size based on the number of hard links. So a 10GB file may show as 5GB in folder A and the other 5GB in folder B.
Also, if you're using Docker. Its crucial that your downloads and media directories are listed as a single volume. If it's two volumes, it'll copy rather than hard link.