“ Furthermore, when Milbank writes that “according to Jacques Lacan, as with most of the postmodernists, there exists,‘besides’ the material realm, only the operation of signs which gives rise to subjectivity as an effect of signification,” he imputes to Lacan the basic premise of what Badiou calls “democratic materialism,” against which Badiou argues and in which he sees the predominant form of today’s ideology (“there are only bodies and languages”). But Lacan does not fit this frame either—if for no other reason than because within it, there is no place for the Real. Milbank himself admits this: “Lacan deems that semiotics must be supplemented by mathematical set theory. And it is this conclusion which already opens up the curious link between nihilism and subjectivity that will later be exploited by Alain Badiou and to a degree by Žižek himself.” So yes, I fully endorse the “nihilistic mathematization of the semiotic” as the only logical materialism.
The Monstrosity of Christ - S. Zizek