No you don't need to worry about the converter. Both the converter and solar can be charging the batteries at the same time. Nothing bad will happen.
Besides if you are out boondocking your converter is not going to be plugged in anyway. My solar panels are on 24/7/365 whether I am plugged into shore power or the truck. No issues.
2014 Jayco Swift 281BHS, 300W Solar!
2015 F250 XLT 4x4 Crew Cab, Short box, 6.2 gas