The unprecedented growth of Artificial Intelligence (AI) models, particularly transformer-based language models like GPT-3 and BERT, has ushered in the era of large-scale AI development. Training AI models using conventional 2D graphical processing unit (GPU) chips contribute significantly to carbon emissions.