Good point.
Maybe it would be a good idea to just have a sacrificial section of wood inserted into an aluminum tube sleeve (or aluminum pole end. With the insert turned so it has a press fit with a shoulder to keep it in place, and maybe a set screw in the side, it could probably stay in place...