Hello andrekje,
During orthomosaic export each tile is generated in the memory before saving to the disk, so if you are saving single BigTIFF file in 100 k x 200 k pixels resolution (20 GPix), it will require about 100 GB RAM, so at the moment I can suggest to use split in blocks option and save the orthomosaic in four tiles of about 5-6 GPix resolution.