Fetishisation exists towards Black men too. There is the “Black men have bigger penises” stereotype which is just that. Also the porn “industry” overtly fetishises Black men having sex with or raping white women.
In relation to sexual advances, we suffer in a similar way to Black women. The main difference is that there is more pressure on Black men to satisfy the desires of predatory white women. If we reject their advances we are abused and accused (by both women and men) of being less masculine. I have personal experience of this form of abuse.