I gave up on trying to squeeze my sunglasses in there and so now I just leave them on the sliding door of the center console. I keep the cleaning cloth that I use for my sunglasses in the glasses compartment now.
I had a 2012 Pilot with the sunglass holder and now one in my Elite PP. In neither vehicle did my sunglasses fit in there, so I ignored it. The little blue cloth that came with the PP used to clean the dust off the head unit and shiny plastic I keep in the little sliding tray in the console.
Yeah mine don’t fit in there very well. There was one time when I was sure I put them in there but when it dropped down it was empty. I searched everywhere in my car and couldn’t find them. They had fallen behind the drop-down holder. I couldn’t believe it haha