A dizzying look at the backrooms of literature, with petty squabbles, long-nurtured grudges, envied or undeserved prizes, failing publishers, and self-important critics, "The No Variations" is a serious game, or perhaps a frivolous tragedy.