You seem to have got the Acosta stuff wrong. The judge didn’t rule on First, he (from your link) “sided with CNN on the basis of the suit’s Fifth Amendment claims, saying the White House did not provide Acosta with the due process required to legally revoke his press pass”.That gets an odd answer from another commentator, to which I reply:
"due process" is much wider than life, liberty or property. As you surely know. The odd thing here is that this article focusses on the First, even though the judgement was made explicitly on the basis of the Fifth.
And when you think about it, what seems "wrong" about the press pass being revoked is indeed not a freedom of speech matter, as this article notes; the wrongness lies in the White House's treatment of an individual. The WH's action was arbitrary, and motivated by pique; this is why it falls foul of the Fifth. And correctly so: the WH (aka the Govt) should not be able to play favourites, and try to intimidate journalists by withdrawl of access.