Wouter,

I don't think its a question of english language, it's a question of age. When I learned sailing we would say "port has right of way" meaning sailing over port (with the boom at port side) as you say. But nowadays you say "wind from starboard" has right of way, and starboard tack means exactly that. Of course "wind from starboard" is defined by "boom on port". Thus, language has changed over the years.

Backbord is port by the way.