You are supposed to have spacers there.
The instructions from Bumot says that if you do not have the original Yamaha luggage brackets attached to the passenger foot-peg brackets, then you need the spacer kit. (I believe I had to order it separately)
You could probably just get some spacers at a local hardware store.
Spacers received very quickly from bumot, they sent me 3 different sizes, I did not used the same size for left and right .. anyway it is finally done.