I don't think anyone really disputes what should be done when an LLM violates copyright in a way that would be a violation if a human did it.

Questions about LLMs are primarily about whether it's legal for them to do something that would be legal for a human to do and secondarily about the technical feasibility of policing them at all.