It never says the ELs towered over the Agori. I always thought they are Glatorian sized-don't you remember from RoTGB 6 that they used to be Glatorian, but then given elemental powers and becoming their element?
Depending on how a titan is built it might be only slightly taller than a Glatorian, but a lot bulkier. Personally, I think of the EL as powerful people, and putting them in a canister makes them seem equal in power to other sets (exception being MN, who is more powerful). Tuma is not that much taller than a canister set, but he's harder to build, and has more armour. Think of how much better a set would be if it were a titan than a canister(they don't have to be MNT or Takanuva sized titans, but Tuma sized titans).
And yeah, MNT isn't cannon. That shield is rediculously sized, and his sword looks like a toothpick compared to the size of the set.