In this scene "Ginger" is a thinly veiled anagram for "Nigger." The redheads in this scene are upset because the role of Annie is being played by a non-redhead. This is similar to people getting mad about non-blacks playing black characters. The name for doing so is called "blacking up" or "blackface."