We did follow the sounds of the letters - once upon a time. English actually did sound something like it's spelled now. As I recall from a linguistics class, once spelling was forcibly standardized...