I feel your pain as I had the same problem. I drilled a small hole in the metal door handle pull and ran a loop of paracord through it. I just grasp the loop now when needing to close the door. Maybe not the perfect solution, but simple and effective.
Ode to the Forum Moderators
May the Mods grant me the serenity to accept the opinions of those I cannot change,
the courage to offer valid input to those who are open to another way of thinking,
and the wisdom to shut myself down whenever I get too in love with my own misconceived brilliance.