Nanochat vs Llama for training from scratch? [P]

The user is training an AI model from scratch and seeks advice on the best architecture, considering switching from Nanochat (which lacks Transformers compatibility) to the Llama architecture. The goal is an open-source project with a new, larger dataset, despite Nanochat's advantages.