Nitrile gloves are made of nitrile rubber, or poly(butadiene/acrylonitrile). This polymer is highly soluble in chloroform, with some papers I found indicating that one can dissolve up to 18% in mass of nitrile butadiene rubber in chloroform. Moreover, it permeates easily through NBR, meaning we can expect the dissolution to be fast in addition to thermodynamically
favourable.
Finally, I would not expect the mechanism here to be any different from that of any polymer dissolution by a good solvent. The solvent will permeate through the polymer, intercalate between polymer chains, and solvate them (inducing swelling). Once solvated, the network of polymer chains looses its mechanical properties and they can fully separate. (I wish I could find a good existing illustration for that part, but I can't right now… If anyone can, feel free to edit!)