Freedom of speech, who benefits from that?

Spinoza was one of the first philosophers, in the 17th Century, to consider society as one would consider nature: as a network of causes and effects.

Also with matters we regard as ‘good’, the question arises: who benefits from them and who is hindered by them?

For example: can minorities suffer from absolute freedom of speech? Think about racism, antisemitism, hate against homosexuality, the suppressing of religious minorities.