GPL gives users complete freedom over how they run the program and what plugins they use. By saying that plugins that are being distributed can be only GPL (being a derivative work), you’re implying that plugins distributed under other licences are not allowed to be run, which contradicts the Freedom Zero.